2024-01-15T11:15:01.631 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-15T11:15:01.632 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-01-15_11:07:32-fs:volumes-rishabh-clone-stats-testing-default-smithi/7517066 --name rishabh-2024-01-15_11:07:32-fs:volumes-rishabh-clone-stats-testing-default-smithi --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone-progress}} -- /home/teuthworker/archive/rishabh-2024-01-15_11:07:32-fs:volumes-rishabh-clone-stats-testing-default-smithi/7517066/orig.config.yaml 2024-01-15T11:15:01.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T11:15:01.745 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-01-15_11:07:32-fs:volumes-rishabh-clone-stats-testing-default-smithi/7517066 branch: rishabh-clone-stats description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone-progress}} email: null first_in_suite: false job_id: '7517066' kernel: client: branch: testing flavor: default kdb: true sha1: c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2024-01-15_11:07:32-fs:volumes-rishabh-clone-stats-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: rishabh-clone-stats ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 95c90f413c4bb65e3e56909855f2308fd9bda05b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 95c90f413c4bb65e3e56909855f2308fd9bda05b kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: mgr-vol-clone-stats-temp sha1: 73a4532fc4d97adee0b985d4d42874ea351a1c86 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9877 sha1: 95c90f413c4bb65e3e56909855f2308fd9bda05b sleep_before_teardown: 0 suite: fs:volumes suite_branch: mgr-vol-clone-stats-temp suite_path: /home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa suite_relpath: qa suite_repo: https://github.com/rishabh-d-dave/ceph suite_sha1: 73a4532fc4d97adee0b985d4d42874ea351a1c86 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi027.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPBnOYlMQZHvWwfRYzDYI90m0b2Ib+moa15Lpnog/0M4WWyxTtEegBqhQQxuZnqNOBdau4US96SblQ9RadXUjdM= smithi093.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMzxXsvE+yYOk/I5Pd5RHOAYL4opbzOhvVRVsnTWbJZUQYmMi3dUgNFEJYyITebwHf0tYQgIOC62SsEqOtZLbJI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestCloneProgress teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: cd45576300487d997e5a85abed65500b9f5d143b timestamp: 2024-01-15_11:07:32 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-15T11:15:01.745 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa; will attempt to use it 2024-01-15T11:15:01.746 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks 2024-01-15T11:15:01.746 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-15T11:15:01.747 INFO:teuthology.task.internal:Checking packages... 2024-01-15T11:15:01.770 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '95c90f413c4bb65e3e56909855f2308fd9bda05b' 2024-01-15T11:15:01.770 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-15T11:15:01.770 INFO:teuthology.packaging:ref: None 2024-01-15T11:15:01.770 INFO:teuthology.packaging:tag: None 2024-01-15T11:15:01.770 INFO:teuthology.packaging:branch: rishabh-clone-stats 2024-01-15T11:15:01.770 INFO:teuthology.packaging:sha1: 95c90f413c4bb65e3e56909855f2308fd9bda05b 2024-01-15T11:15:01.770 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=rishabh-clone-stats 2024-01-15T11:15:01.989 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7629-g95c90f41-1jammy 2024-01-15T11:15:01.990 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-15T11:15:01.998 INFO:teuthology.task.internal:no buildpackages task found 2024-01-15T11:15:01.998 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-15T11:15:02.020 INFO:teuthology.task.internal:Saving configuration 2024-01-15T11:15:02.035 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-15T11:15:02.041 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-15T11:15:02.066 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-01-15_11:07:32-fs:volumes-rishabh-clone-stats-testing-default-smithi/7517066', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-15 11:08:31.124657', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINTkYJtLLEz0KNx5pecGlkElQF96i+CHJFmhqvb/cwe1'} 2024-01-15T11:15:02.089 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-01-15_11:07:32-fs:volumes-rishabh-clone-stats-testing-default-smithi/7517066', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-15 11:08:31.126282', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIVcWwVlU6QBgi4g53OJgLkgMOCaYOMf9zk5dl4BXtE1'} 2024-01-15T11:15:02.089 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-15T11:15:02.096 INFO:teuthology.task.internal:roles: ubuntu@smithi027.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-01-15T11:15:02.096 INFO:teuthology.task.internal:roles: ubuntu@smithi093.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-01-15T11:15:02.096 INFO:teuthology.run_tasks:Running task console_log... 2024-01-15T11:15:02.164 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8d455d8430>, signals=[15]) 2024-01-15T11:15:02.164 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-15T11:15:02.171 INFO:teuthology.task.internal:Opening connections... 2024-01-15T11:15:02.171 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi027.front.sepia.ceph.com 2024-01-15T11:15:02.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T11:15:02.259 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi093.front.sepia.ceph.com 2024-01-15T11:15:02.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T11:15:02.335 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-15T11:15:02.341 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2024-01-15T11:15:02.346 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2024-01-15T11:15:02.347 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2024-01-15T11:15:02.393 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-15T11:15:02.393 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Ubuntu" 2024-01-15T11:15:02.393 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="22.04" 2024-01-15T11:15:02.394 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-15T11:15:02.394 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_CODENAME=jammy 2024-01-15T11:15:02.394 INFO:teuthology.orchestra.run.smithi027.stdout:ID=ubuntu 2024-01-15T11:15:02.394 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE=debian 2024-01-15T11:15:02.394 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-15T11:15:02.394 INFO:teuthology.orchestra.run.smithi027.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-15T11:15:02.394 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-15T11:15:02.394 INFO:teuthology.orchestra.run.smithi027.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-15T11:15:02.394 INFO:teuthology.orchestra.run.smithi027.stdout:UBUNTU_CODENAME=jammy 2024-01-15T11:15:02.395 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2024-01-15T11:15:02.420 DEBUG:teuthology.orchestra.run.smithi093:> uname -m 2024-01-15T11:15:02.425 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2024-01-15T11:15:02.425 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2024-01-15T11:15:02.470 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-15T11:15:02.471 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Ubuntu" 2024-01-15T11:15:02.471 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="22.04" 2024-01-15T11:15:02.471 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-15T11:15:02.471 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_CODENAME=jammy 2024-01-15T11:15:02.471 INFO:teuthology.orchestra.run.smithi093.stdout:ID=ubuntu 2024-01-15T11:15:02.471 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE=debian 2024-01-15T11:15:02.471 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-15T11:15:02.471 INFO:teuthology.orchestra.run.smithi093.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-15T11:15:02.471 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-15T11:15:02.471 INFO:teuthology.orchestra.run.smithi093.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-15T11:15:02.471 INFO:teuthology.orchestra.run.smithi093.stdout:UBUNTU_CODENAME=jammy 2024-01-15T11:15:02.471 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2024-01-15T11:15:02.495 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-15T11:15:02.504 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-15T11:15:02.510 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-15T11:15:02.510 DEBUG:teuthology.orchestra.run.smithi027:> test '!' -e /home/ubuntu/cephtest 2024-01-15T11:15:02.512 DEBUG:teuthology.orchestra.run.smithi093:> test '!' -e /home/ubuntu/cephtest 2024-01-15T11:15:02.518 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-15T11:15:02.524 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-15T11:15:02.524 DEBUG:teuthology.orchestra.run.smithi027:> test -z $(ls -A /var/lib/ceph) 2024-01-15T11:15:02.559 DEBUG:teuthology.orchestra.run.smithi093:> test -z $(ls -A /var/lib/ceph) 2024-01-15T11:15:02.577 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-15T11:15:02.631 INFO:teuthology.run_tasks:Running task kernel... 2024-01-15T11:15:02.646 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b'} 2024-01-15T11:15:02.646 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-01-15T11:15:02.646 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-01-15T11:15:02.647 DEBUG:teuthology.orchestra.run.smithi027:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-15T11:15:02.647 DEBUG:teuthology.orchestra.run.smithi093:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-15T11:15:02.651 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T11:15:02.652 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-01-15T11:15:02.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T11:15:02.655 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-01-15T11:15:02.814 DEBUG:teuthology.task.kernel:sha1 for client.1 is c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b 2024-01-15T11:15:02.814 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b"... 2024-01-15T11:15:02.815 DEBUG:teuthology.orchestra.run.smithi093:> uname -r 2024-01-15T11:15:02.820 INFO:teuthology.orchestra.run.smithi093.stdout:5.15.0-56-generic 2024-01-15T11:15:02.820 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b 2024-01-15T11:15:02.820 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-15T11:15:02.821 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-01-15T11:15:02.821 DEBUG:teuthology.orchestra.run.smithi093:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-01-15T11:15:02.833 DEBUG:teuthology.task.kernel:sha1 for client.0 is c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b 2024-01-15T11:15:02.833 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b"... 2024-01-15T11:15:02.833 DEBUG:teuthology.orchestra.run.smithi027:> uname -r 2024-01-15T11:15:02.838 INFO:teuthology.orchestra.run.smithi027.stdout:5.15.0-56-generic 2024-01-15T11:15:02.838 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b 2024-01-15T11:15:02.838 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-15T11:15:02.839 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-01-15T11:15:02.839 DEBUG:teuthology.orchestra.run.smithi027:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-01-15T11:15:02.871 INFO:teuthology.orchestra.run.smithi093.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-01-15T11:15:02.897 INFO:teuthology.orchestra.run.smithi027.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-01-15T11:15:03.018 INFO:teuthology.orchestra.run.smithi093.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-01-15T11:15:03.018 INFO:teuthology.orchestra.run.smithi093.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-01-15T11:15:03.018 INFO:teuthology.orchestra.run.smithi093.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-01-15T11:15:03.018 INFO:teuthology.orchestra.run.smithi093.stderr:hint: 2024-01-15T11:15:03.019 INFO:teuthology.orchestra.run.smithi093.stderr:hint: git config --global init.defaultBranch 2024-01-15T11:15:03.019 INFO:teuthology.orchestra.run.smithi093.stderr:hint: 2024-01-15T11:15:03.019 INFO:teuthology.orchestra.run.smithi093.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-01-15T11:15:03.019 INFO:teuthology.orchestra.run.smithi093.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-01-15T11:15:03.019 INFO:teuthology.orchestra.run.smithi093.stderr:hint: 2024-01-15T11:15:03.019 INFO:teuthology.orchestra.run.smithi093.stderr:hint: git branch -m 2024-01-15T11:15:03.020 INFO:teuthology.orchestra.run.smithi093.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-01-15T11:15:03.022 DEBUG:teuthology.orchestra.run.smithi093:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-01-15T11:15:03.049 INFO:teuthology.orchestra.run.smithi027.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-01-15T11:15:03.049 INFO:teuthology.orchestra.run.smithi027.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-01-15T11:15:03.049 INFO:teuthology.orchestra.run.smithi027.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-01-15T11:15:03.049 INFO:teuthology.orchestra.run.smithi027.stderr:hint: 2024-01-15T11:15:03.050 INFO:teuthology.orchestra.run.smithi027.stderr:hint: git config --global init.defaultBranch 2024-01-15T11:15:03.050 INFO:teuthology.orchestra.run.smithi027.stderr:hint: 2024-01-15T11:15:03.050 INFO:teuthology.orchestra.run.smithi027.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-01-15T11:15:03.050 INFO:teuthology.orchestra.run.smithi027.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-01-15T11:15:03.050 INFO:teuthology.orchestra.run.smithi027.stderr:hint: 2024-01-15T11:15:03.050 INFO:teuthology.orchestra.run.smithi027.stderr:hint: git branch -m 2024-01-15T11:15:03.051 INFO:teuthology.orchestra.run.smithi027.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-01-15T11:15:03.054 DEBUG:teuthology.orchestra.run.smithi027:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-01-15T11:15:03.087 DEBUG:teuthology.orchestra.run.smithi093:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-01-15T11:15:03.121 DEBUG:teuthology.orchestra.run.smithi027:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-01-15T11:15:03.143 DEBUG:teuthology.orchestra.run.smithi093:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-01-15T11:15:03.175 DEBUG:teuthology.orchestra.run.smithi027:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-01-15T11:18:34.591 INFO:teuthology.orchestra.run.smithi027.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-01-15T11:18:34.591 INFO:teuthology.orchestra.run.smithi027.stderr: * [new branch] main -> origin/main 2024-01-15T11:18:34.623 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20190312 -> 20190312 2024-01-15T11:18:34.624 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20190416 -> 20190416 2024-01-15T11:18:34.624 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20190514 -> 20190514 2024-01-15T11:18:34.624 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20190618 -> 20190618 2024-01-15T11:18:34.624 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20190717 -> 20190717 2024-01-15T11:18:34.624 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20190815 -> 20190815 2024-01-15T11:18:34.624 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20190923 -> 20190923 2024-01-15T11:18:34.624 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20191022 -> 20191022 2024-01-15T11:18:34.624 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20191215 -> 20191215 2024-01-15T11:18:34.624 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20200122 -> 20200122 2024-01-15T11:18:34.625 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20200316 -> 20200316 2024-01-15T11:18:34.625 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20200421 -> 20200421 2024-01-15T11:18:34.626 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20200519 -> 20200519 2024-01-15T11:18:34.626 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20200619 -> 20200619 2024-01-15T11:18:34.626 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20200721 -> 20200721 2024-01-15T11:18:34.626 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20200817 -> 20200817 2024-01-15T11:18:34.626 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20200918 -> 20200918 2024-01-15T11:18:34.626 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20201022 -> 20201022 2024-01-15T11:18:34.626 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20201118 -> 20201118 2024-01-15T11:18:34.629 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20201218 -> 20201218 2024-01-15T11:18:34.630 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20210208 -> 20210208 2024-01-15T11:18:34.630 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20210315 -> 20210315 2024-01-15T11:18:34.630 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20210511 -> 20210511 2024-01-15T11:18:34.630 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20210716 -> 20210716 2024-01-15T11:18:34.630 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20210818 -> 20210818 2024-01-15T11:18:34.630 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20210919 -> 20210919 2024-01-15T11:18:34.630 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20211027 -> 20211027 2024-01-15T11:18:34.630 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20211216 -> 20211216 2024-01-15T11:18:34.630 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20220209 -> 20220209 2024-01-15T11:18:34.630 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20220310 -> 20220310 2024-01-15T11:18:34.630 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20220411 -> 20220411 2024-01-15T11:18:34.630 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20220509 -> 20220509 2024-01-15T11:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20220610 -> 20220610 2024-01-15T11:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20220708 -> 20220708 2024-01-15T11:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20220815 -> 20220815 2024-01-15T11:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20220913 -> 20220913 2024-01-15T11:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20221012 -> 20221012 2024-01-15T11:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20221109 -> 20221109 2024-01-15T11:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20221214 -> 20221214 2024-01-15T11:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20230117 -> 20230117 2024-01-15T11:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20230210 -> 20230210 2024-01-15T11:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20230310 -> 20230310 2024-01-15T11:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20230404 -> 20230404 2024-01-15T11:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20230515 -> 20230515 2024-01-15T11:18:34.631 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20230625 -> 20230625 2024-01-15T11:18:34.632 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20230804 -> 20230804 2024-01-15T11:18:34.632 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20230919 -> 20230919 2024-01-15T11:18:34.632 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20231030 -> 20231030 2024-01-15T11:18:34.632 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20231111 -> 20231111 2024-01-15T11:18:34.632 INFO:teuthology.orchestra.run.smithi027.stderr: * [new tag] 20231211 -> 20231211 2024-01-15T11:18:38.920 INFO:teuthology.orchestra.run.smithi027.stderr:Updating files: 47% (1634/3423) Updating files: 48% (1644/3423) Updating files: 49% (1678/3423) Updating files: 50% (1712/3423) Updating files: 51% (1746/3423) Updating files: 52% (1780/3423) Updating files: 53% (1815/3423) Updating files: 54% (1849/3423) Updating files: 55% (1883/3423) Updating files: 56% (1917/3423) Updating files: 57% (1952/3423) Updating files: 58% (1986/3423) Updating files: 59% (2020/3423) Updating files: 60% (2054/3423) Updating files: 61% (2089/3423) Updating files: 62% (2123/3423) Updating files: 63% (2157/3423) Updating files: 63% (2162/3423) Updating files: 64% (2191/3423) Updating files: 65% (2225/3423) Updating files: 66% (2260/3423) Updating files: 67% (2294/3423) Updating files: 68% (2328/3423) Updating files: 69% (2362/3423) Updating files: 70% (2397/3423) Updating files: 71% (2431/3423) Updating files: 72% (2465/3423) Updating files: 73% (2499/3423) Updating files: 74% (2534/3423) Updating files: 75% (2568/3423) Updating files: 76% (2602/3423) Updating files: 76% (2615/3423) Updating files: 77% (2636/3423) Updating files: 78% (2670/3423) Updating files: 79% (2705/3423) Updating files: 80% (2739/3423) Updating files: 81% (2773/3423) Updating files: 82% (2807/3423) Updating files: 83% (2842/3423) Updating files: 83% (2857/3423) Updating files: 84% (2876/3423) Updating files: 85% (2910/3423) Updating files: 86% (2944/3423) Updating files: 87% (2979/3423) Updating files: 88% (3013/3423) Updating files: 89% (3047/3423) Updating files: 90% (3081/3423) Updating files: 91% (3115/3423) Updating files: 92% (3150/3423) Updating files: 93% (3184/3423) Updating files: 94% (3218/3423) Updating files: 95% (3252/3423) Updating files: 96% (3287/3423) Updating files: 97% (3321/3423) Updating files: 98% (3355/3423) Updating files: 99% (3389/3423) Updating files: 100% (3423/3423) Updating files: 100% (3423/3423), done. 2024-01-15T11:18:38.925 INFO:teuthology.orchestra.run.smithi027.stdout:HEAD is now at b3132c18 Merge branch 'robot/patch-0-1704975046' into 'main' 2024-01-15T11:18:38.947 INFO:teuthology.task.kernel:Downloading kernel c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b on client.0... 2024-01-15T11:18:38.948 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b 2024-01-15T11:18:39.190 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gc719ee96ba78/ 2024-01-15T11:18:39.191 DEBUG:teuthology.orchestra.run.smithi027:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-gc719ee96ba78_6.6.0-gc719ee96ba78-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gc719ee96ba78/ --input-file=- 2024-01-15T11:18:39.194 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi027.front.sepia.ceph.com to complete... 2024-01-15T11:18:41.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15 11:18:41 URL:https://4.chacra.ceph.com/r/kernel/testing/c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gc719ee96ba78/linux-image-6.6.0-gc719ee96ba78_6.6.0-gc719ee96ba78-1_amd64.deb [38953196/38953196] -> "/tmp/linux-image.deb" [1] 2024-01-15T11:18:41.207 INFO:teuthology.orchestra.run.smithi027.stderr:FINISHED --2024-01-15 11:18:41-- 2024-01-15T11:18:41.207 INFO:teuthology.orchestra.run.smithi027.stderr:Total wall clock time: 2.0s 2024-01-15T11:18:41.207 INFO:teuthology.orchestra.run.smithi027.stderr:Downloaded: 1 files, 37M in 1.8s (20.3 MB/s) 2024-01-15T11:18:41.212 INFO:teuthology.task.kernel:Installing kernel c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b on client.0... 2024-01-15T11:18:41.212 DEBUG:teuthology.orchestra.run.smithi027:> sudo dpkg -i /tmp/linux-image.deb 2024-01-15T11:18:41.429 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package linux-image-6.6.0-gc719ee96ba78. 2024-01-15T11:18:42.281 INFO:teuthology.orchestra.run.smithi093.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-01-15T11:18:42.282 INFO:teuthology.orchestra.run.smithi093.stderr: * [new branch] main -> origin/main 2024-01-15T11:18:42.314 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20190312 -> 20190312 2024-01-15T11:18:42.314 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20190416 -> 20190416 2024-01-15T11:18:42.314 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20190514 -> 20190514 2024-01-15T11:18:42.314 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20190618 -> 20190618 2024-01-15T11:18:42.314 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20190717 -> 20190717 2024-01-15T11:18:42.314 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20190815 -> 20190815 2024-01-15T11:18:42.314 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20190923 -> 20190923 2024-01-15T11:18:42.315 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20191022 -> 20191022 2024-01-15T11:18:42.315 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20191215 -> 20191215 2024-01-15T11:18:42.315 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20200122 -> 20200122 2024-01-15T11:18:42.315 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20200316 -> 20200316 2024-01-15T11:18:42.320 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20200421 -> 20200421 2024-01-15T11:18:42.320 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20200519 -> 20200519 2024-01-15T11:18:42.320 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20200619 -> 20200619 2024-01-15T11:18:42.321 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20200721 -> 20200721 2024-01-15T11:18:42.321 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20200817 -> 20200817 2024-01-15T11:18:42.321 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20200918 -> 20200918 2024-01-15T11:18:42.321 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20201022 -> 20201022 2024-01-15T11:18:42.321 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20201118 -> 20201118 2024-01-15T11:18:42.321 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20201218 -> 20201218 2024-01-15T11:18:42.321 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20210208 -> 20210208 2024-01-15T11:18:42.321 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20210315 -> 20210315 2024-01-15T11:18:42.321 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20210511 -> 20210511 2024-01-15T11:18:42.321 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20210716 -> 20210716 2024-01-15T11:18:42.322 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20210818 -> 20210818 2024-01-15T11:18:42.322 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20210919 -> 20210919 2024-01-15T11:18:42.322 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20211027 -> 20211027 2024-01-15T11:18:42.322 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20211216 -> 20211216 2024-01-15T11:18:42.322 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20220209 -> 20220209 2024-01-15T11:18:42.322 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20220310 -> 20220310 2024-01-15T11:18:42.322 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20220411 -> 20220411 2024-01-15T11:18:42.322 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20220509 -> 20220509 2024-01-15T11:18:42.322 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20220610 -> 20220610 2024-01-15T11:18:42.322 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20220708 -> 20220708 2024-01-15T11:18:42.322 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20220815 -> 20220815 2024-01-15T11:18:42.322 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20220913 -> 20220913 2024-01-15T11:18:42.323 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20221012 -> 20221012 2024-01-15T11:18:42.323 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20221109 -> 20221109 2024-01-15T11:18:42.323 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20221214 -> 20221214 2024-01-15T11:18:42.323 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20230117 -> 20230117 2024-01-15T11:18:42.323 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20230210 -> 20230210 2024-01-15T11:18:42.323 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20230310 -> 20230310 2024-01-15T11:18:42.323 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20230404 -> 20230404 2024-01-15T11:18:42.323 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20230515 -> 20230515 2024-01-15T11:18:42.323 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20230625 -> 20230625 2024-01-15T11:18:42.323 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20230804 -> 20230804 2024-01-15T11:18:42.323 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20230919 -> 20230919 2024-01-15T11:18:42.324 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20231030 -> 20231030 2024-01-15T11:18:42.324 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20231111 -> 20231111 2024-01-15T11:18:42.324 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20231211 -> 20231211 2024-01-15T11:18:43.466 INFO:teuthology.orchestra.run.smithi027.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-01-15T11:18:43.471 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-01-15T11:18:43.565 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-image-6.6.0-gc719ee96ba78 (6.6.0-gc719ee96ba78-1) ... 2024-01-15T11:18:46.384 INFO:teuthology.orchestra.run.smithi093.stderr:Updating files: 49% (1706/3423) Updating files: 50% (1712/3423) Updating files: 51% (1746/3423) Updating files: 52% (1780/3423) Updating files: 53% (1815/3423) Updating files: 54% (1849/3423) Updating files: 55% (1883/3423) Updating files: 56% (1917/3423) Updating files: 57% (1952/3423) Updating files: 58% (1986/3423) Updating files: 59% (2020/3423) Updating files: 60% (2054/3423) Updating files: 61% (2089/3423) Updating files: 62% (2123/3423) Updating files: 63% (2157/3423) Updating files: 64% (2191/3423) Updating files: 64% (2218/3423) Updating files: 65% (2225/3423) Updating files: 66% (2260/3423) Updating files: 67% (2294/3423) Updating files: 68% (2328/3423) Updating files: 69% (2362/3423) Updating files: 70% (2397/3423) Updating files: 71% (2431/3423) Updating files: 72% (2465/3423) Updating files: 73% (2499/3423) Updating files: 74% (2534/3423) Updating files: 75% (2568/3423) Updating files: 76% (2602/3423) Updating files: 77% (2636/3423) Updating files: 78% (2670/3423) Updating files: 79% (2705/3423) Updating files: 80% (2739/3423) Updating files: 81% (2773/3423) Updating files: 81% (2782/3423) Updating files: 82% (2807/3423) Updating files: 83% (2842/3423) Updating files: 84% (2876/3423) Updating files: 85% (2910/3423) Updating files: 86% (2944/3423) Updating files: 87% (2979/3423) Updating files: 88% (3013/3423) Updating files: 89% (3047/3423) Updating files: 90% (3081/3423) Updating files: 91% (3115/3423) Updating files: 92% (3150/3423) Updating files: 93% (3184/3423) Updating files: 94% (3218/3423) Updating files: 95% (3252/3423) Updating files: 96% (3287/3423) Updating files: 96% (3308/3423) Updating files: 97% (3321/3423) Updating files: 98% (3355/3423) Updating files: 99% (3389/3423) Updating files: 100% (3423/3423) Updating files: 100% (3423/3423), done. 2024-01-15T11:18:46.389 INFO:teuthology.orchestra.run.smithi093.stdout:HEAD is now at b3132c18 Merge branch 'robot/patch-0-1704975046' into 'main' 2024-01-15T11:18:46.410 INFO:teuthology.task.kernel:Downloading kernel c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b on client.1... 2024-01-15T11:18:46.410 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b 2024-01-15T11:18:46.550 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gc719ee96ba78/ 2024-01-15T11:18:46.550 DEBUG:teuthology.orchestra.run.smithi093:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-gc719ee96ba78_6.6.0-gc719ee96ba78-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gc719ee96ba78/ --input-file=- 2024-01-15T11:18:46.553 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi093.front.sepia.ceph.com to complete... 2024-01-15T11:18:46.929 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-image-6.6.0-gc719ee96ba78 (6.6.0-gc719ee96ba78-1) ... 2024-01-15T11:18:47.018 INFO:teuthology.orchestra.run.smithi027.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-gc719ee96ba78 2024-01-15T11:18:48.073 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15 11:18:48 URL:https://4.chacra.ceph.com/r/kernel/testing/c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gc719ee96ba78/linux-image-6.6.0-gc719ee96ba78_6.6.0-gc719ee96ba78-1_amd64.deb [38953196/38953196] -> "/tmp/linux-image.deb" [1] 2024-01-15T11:18:48.073 INFO:teuthology.orchestra.run.smithi093.stderr:FINISHED --2024-01-15 11:18:48-- 2024-01-15T11:18:48.073 INFO:teuthology.orchestra.run.smithi093.stderr:Total wall clock time: 1.5s 2024-01-15T11:18:48.073 INFO:teuthology.orchestra.run.smithi093.stderr:Downloaded: 1 files, 37M in 1.4s (27.1 MB/s) 2024-01-15T11:18:48.078 INFO:teuthology.task.kernel:Installing kernel c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b on client.1... 2024-01-15T11:18:48.079 DEBUG:teuthology.orchestra.run.smithi093:> sudo dpkg -i /tmp/linux-image.deb 2024-01-15T11:18:48.319 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package linux-image-6.6.0-gc719ee96ba78. 2024-01-15T11:18:50.275 INFO:teuthology.orchestra.run.smithi093.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-01-15T11:18:50.280 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-01-15T11:18:50.391 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking linux-image-6.6.0-gc719ee96ba78 (6.6.0-gc719ee96ba78-1) ... 2024-01-15T11:18:53.201 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up linux-image-6.6.0-gc719ee96ba78 (6.6.0-gc719ee96ba78-1) ... 2024-01-15T11:18:53.324 INFO:teuthology.orchestra.run.smithi093.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-gc719ee96ba78 2024-01-15T11:19:07.504 INFO:teuthology.orchestra.run.smithi027.stderr:Sourcing file `/etc/default/grub' 2024-01-15T11:19:07.518 INFO:teuthology.orchestra.run.smithi027.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-15T11:19:07.552 INFO:teuthology.orchestra.run.smithi027.stderr:Generating grub configuration file ... 2024-01-15T11:19:07.836 INFO:teuthology.orchestra.run.smithi027.stderr:Found linux image: /boot/vmlinuz-6.6.0-gc719ee96ba78 2024-01-15T11:19:07.856 INFO:teuthology.orchestra.run.smithi027.stderr:Found initrd image: /boot/initrd.img-6.6.0-gc719ee96ba78 2024-01-15T11:19:08.138 INFO:teuthology.orchestra.run.smithi027.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-15T11:19:08.152 INFO:teuthology.orchestra.run.smithi027.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-15T11:19:08.213 INFO:teuthology.orchestra.run.smithi027.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-15T11:19:08.219 INFO:teuthology.orchestra.run.smithi027.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-15T11:19:08.498 INFO:teuthology.orchestra.run.smithi027.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-15T11:19:08.498 INFO:teuthology.orchestra.run.smithi027.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-15T11:19:08.499 INFO:teuthology.orchestra.run.smithi027.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-15T11:19:08.540 INFO:teuthology.orchestra.run.smithi027.stderr:done 2024-01-15T11:19:08.728 DEBUG:teuthology.orchestra.run.smithi027:> dpkg-deb -c /tmp/linux-image.deb 2024-01-15T11:19:08.735 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./ 2024-01-15T11:19:08.735 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./boot/ 2024-01-15T11:19:08.735 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 4415617 2024-01-08 03:37 ./boot/System.map-6.6.0-gc719ee96ba78 2024-01-15T11:19:08.748 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 169214 2024-01-08 03:37 ./boot/config-6.6.0-gc719ee96ba78 2024-01-15T11:19:08.748 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11352864 2024-01-08 03:37 ./boot/vmlinuz-6.6.0-gc719ee96ba78 2024-01-15T11:19:08.768 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./etc/ 2024-01-15T11:19:08.768 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./etc/kernel/ 2024-01-15T11:19:08.769 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./etc/kernel/postinst.d/ 2024-01-15T11:19:08.769 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./etc/kernel/postrm.d/ 2024-01-15T11:19:08.769 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./etc/kernel/preinst.d/ 2024-01-15T11:19:08.769 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./etc/kernel/prerm.d/ 2024-01-15T11:19:08.769 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/ 2024-01-15T11:19:08.769 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/ 2024-01-15T11:19:08.769 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/ 2024-01-15T11:19:08.769 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/ 2024-01-15T11:19:08.769 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/ 2024-01-15T11:19:08.769 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/ 2024-01-15T11:19:08.769 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/ 2024-01-15T11:19:08.769 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 490233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/aesni-intel.ko 2024-01-15T11:19:08.772 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 25329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-15T11:19:08.772 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 29529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-15T11:19:08.772 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 30313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-15T11:19:08.772 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 93113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-15T11:19:08.772 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 106729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-15T11:19:08.772 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 152241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-15T11:19:08.773 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-15T11:19:08.773 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-15T11:19:08.773 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 83889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-15T11:19:08.773 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-15T11:19:08.773 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 47225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-15T11:19:08.773 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 47209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-15T11:19:08.773 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 51801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-15T11:19:08.773 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 38937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-15T11:19:08.773 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 40529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-15T11:19:08.773 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 58585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-15T11:19:08.773 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 50497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-15T11:19:08.773 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 32065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-15T11:19:08.773 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-15T11:19:08.773 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kernel/ 2024-01-15T11:19:08.773 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kernel/cpu/ 2024-01-15T11:19:08.773 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kernel/cpu/mce/ 2024-01-15T11:19:08.774 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 40113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-15T11:19:08.774 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kernel/cpuid.ko 2024-01-15T11:19:08.774 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kernel/msr.ko 2024-01-15T11:19:08.774 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kvm/ 2024-01-15T11:19:08.774 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 354433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-15T11:19:08.774 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 881625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-15T11:19:08.774 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 2275865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kvm/kvm.ko 2024-01-15T11:19:08.790 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/ 2024-01-15T11:19:08.790 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 53697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/af_alg.ko 2024-01-15T11:19:08.790 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/algif_hash.ko 2024-01-15T11:19:08.790 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/algif_skcipher.ko 2024-01-15T11:19:08.790 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/ansi_cprng.ko 2024-01-15T11:19:08.790 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/anubis.ko 2024-01-15T11:19:08.790 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/arc4.ko 2024-01-15T11:19:08.790 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/asymmetric_keys/ 2024-01-15T11:19:08.790 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-01-15T11:19:08.790 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/ 2024-01-15T11:19:08.790 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/async_memcpy.ko 2024-01-15T11:19:08.791 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/async_pq.ko 2024-01-15T11:19:08.791 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-15T11:19:08.791 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/async_tx.ko 2024-01-15T11:19:08.791 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/async_xor.ko 2024-01-15T11:19:08.791 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/raid6test.ko 2024-01-15T11:19:08.791 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/authenc.ko 2024-01-15T11:19:08.791 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/authencesn.ko 2024-01-15T11:19:08.791 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/blake2b_generic.ko 2024-01-15T11:19:08.791 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/blowfish_common.ko 2024-01-15T11:19:08.791 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/blowfish_generic.ko 2024-01-15T11:19:08.791 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 38809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/camellia_generic.ko 2024-01-15T11:19:08.791 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 27321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/cast5_generic.ko 2024-01-15T11:19:08.791 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/cast6_generic.ko 2024-01-15T11:19:08.791 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/cast_common.ko 2024-01-15T11:19:08.792 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 35097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/ccm.ko 2024-01-15T11:19:08.792 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/cmac.ko 2024-01-15T11:19:08.792 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/crc32_generic.ko 2024-01-15T11:19:08.792 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 47505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/cryptd.ko 2024-01-15T11:19:08.792 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 39505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/crypto_engine.ko 2024-01-15T11:19:08.792 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/crypto_simd.ko 2024-01-15T11:19:08.792 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/crypto_user.ko 2024-01-15T11:19:08.792 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/cts.ko 2024-01-15T11:19:08.792 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/des_generic.ko 2024-01-15T11:19:08.792 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/dh_generic.ko 2024-01-15T11:19:08.792 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/echainiv.ko 2024-01-15T11:19:08.792 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 25321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/essiv.ko 2024-01-15T11:19:08.792 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/fcrypt.ko 2024-01-15T11:19:08.792 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/khazad.ko 2024-01-15T11:19:08.792 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/lrw.ko 2024-01-15T11:19:08.793 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/lz4.ko 2024-01-15T11:19:08.793 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/lz4hc.ko 2024-01-15T11:19:08.793 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/md4.ko 2024-01-15T11:19:08.793 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/michael_mic.ko 2024-01-15T11:19:08.793 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/pcbc.ko 2024-01-15T11:19:08.793 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/pcrypt.ko 2024-01-15T11:19:08.793 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/rmd160.ko 2024-01-15T11:19:08.793 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 29393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/seed.ko 2024-01-15T11:19:08.793 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 27081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/serpent_generic.ko 2024-01-15T11:19:08.793 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 149193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/tcrypt.ko 2024-01-15T11:19:08.793 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/tea.ko 2024-01-15T11:19:08.793 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/twofish_common.ko 2024-01-15T11:19:08.793 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/twofish_generic.ko 2024-01-15T11:19:08.793 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/vmac.ko 2024-01-15T11:19:08.793 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 36185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/wp512.ko 2024-01-15T11:19:08.793 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/xcbc.ko 2024-01-15T11:19:08.794 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/xor.ko 2024-01-15T11:19:08.794 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/xts.ko 2024-01-15T11:19:08.794 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/xxhash_generic.ko 2024-01-15T11:19:08.794 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ 2024-01-15T11:19:08.794 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/ 2024-01-15T11:19:08.794 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/acpi_extlog.ko 2024-01-15T11:19:08.794 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-15T11:19:08.794 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/acpi_pad.ko 2024-01-15T11:19:08.794 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/apei/ 2024-01-15T11:19:08.794 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 31241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/apei/einj.ko 2024-01-15T11:19:08.794 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/ec_sys.ko 2024-01-15T11:19:08.794 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/platform_profile.ko 2024-01-15T11:19:08.794 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/sbs.ko 2024-01-15T11:19:08.794 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/sbshc.ko 2024-01-15T11:19:08.794 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 103025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/video.ko 2024-01-15T11:19:08.794 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/ 2024-01-15T11:19:08.795 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/acard-ahci.ko 2024-01-15T11:19:08.795 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 88865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/ahci.ko 2024-01-15T11:19:08.795 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/ahci_platform.ko 2024-01-15T11:19:08.795 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 88289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/libahci.ko 2024-01-15T11:19:08.795 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 34985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/libahci_platform.ko 2024-01-15T11:19:08.795 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_acpi.ko 2024-01-15T11:19:08.795 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 30433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_ali.ko 2024-01-15T11:19:08.795 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 33505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_amd.ko 2024-01-15T11:19:08.795 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_artop.ko 2024-01-15T11:19:08.795 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_atiixp.ko 2024-01-15T11:19:08.795 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_atp867x.ko 2024-01-15T11:19:08.795 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_cmd640.ko 2024-01-15T11:19:08.795 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 25185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_cmd64x.ko 2024-01-15T11:19:08.795 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_cypress.ko 2024-01-15T11:19:08.795 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_efar.ko 2024-01-15T11:19:08.795 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_hpt366.ko 2024-01-15T11:19:08.796 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 33977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_hpt37x.ko 2024-01-15T11:19:08.796 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-15T11:19:08.796 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-15T11:19:08.796 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_it8213.ko 2024-01-15T11:19:08.796 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 35273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_it821x.ko 2024-01-15T11:19:08.796 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_jmicron.ko 2024-01-15T11:19:08.796 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 51481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_legacy.ko 2024-01-15T11:19:08.796 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_marvell.ko 2024-01-15T11:19:08.796 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_mpiix.ko 2024-01-15T11:19:08.796 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_netcell.ko 2024-01-15T11:19:08.796 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_ninja32.ko 2024-01-15T11:19:08.796 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_ns87410.ko 2024-01-15T11:19:08.796 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_ns87415.ko 2024-01-15T11:19:08.796 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_oldpiix.ko 2024-01-15T11:19:08.796 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_opti.ko 2024-01-15T11:19:08.797 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_optidma.ko 2024-01-15T11:19:08.797 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 32585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_pcmcia.ko 2024-01-15T11:19:08.797 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 37793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-15T11:19:08.797 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-15T11:19:08.797 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_piccolo.ko 2024-01-15T11:19:08.797 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_radisys.ko 2024-01-15T11:19:08.797 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_rdc.ko 2024-01-15T11:19:08.797 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_rz1000.ko 2024-01-15T11:19:08.797 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_sch.ko 2024-01-15T11:19:08.797 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_serverworks.ko 2024-01-15T11:19:08.797 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_sil680.ko 2024-01-15T11:19:08.797 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_sl82c105.ko 2024-01-15T11:19:08.797 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_triflex.ko 2024-01-15T11:19:08.797 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 30433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_via.ko 2024-01-15T11:19:08.797 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pdc_adma.ko 2024-01-15T11:19:08.797 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 29121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_inic162x.ko 2024-01-15T11:19:08.798 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 83345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_mv.ko 2024-01-15T11:19:08.798 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 70393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_nv.ko 2024-01-15T11:19:08.798 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 37377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_promise.ko 2024-01-15T11:19:08.798 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_qstor.ko 2024-01-15T11:19:08.798 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 29273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_sil.ko 2024-01-15T11:19:08.798 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 38337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_sil24.ko 2024-01-15T11:19:08.798 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_sis.ko 2024-01-15T11:19:08.798 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_svw.ko 2024-01-15T11:19:08.798 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 44793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_sx4.ko 2024-01-15T11:19:08.798 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_uli.ko 2024-01-15T11:19:08.798 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 35065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_via.ko 2024-01-15T11:19:08.798 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_vsc.ko 2024-01-15T11:19:08.798 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/auxdisplay/ 2024-01-15T11:19:08.798 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/auxdisplay/ks0108.ko 2024-01-15T11:19:08.798 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/bcma/ 2024-01-15T11:19:08.798 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 124473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/bcma/bcma.ko 2024-01-15T11:19:08.799 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/ 2024-01-15T11:19:08.799 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/aoe/ 2024-01-15T11:19:08.799 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 113665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/aoe/aoe.ko 2024-01-15T11:19:08.799 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/drbd/ 2024-01-15T11:19:08.799 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 965585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/drbd/drbd.ko 2024-01-15T11:19:08.799 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 173225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/floppy.ko 2024-01-15T11:19:08.799 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/mtip32xx/ 2024-01-15T11:19:08.799 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 94297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-15T11:19:08.799 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 115793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/nbd.ko 2024-01-15T11:19:08.799 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/null_blk/ 2024-01-15T11:19:08.799 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 110385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/null_blk/null_blk.ko 2024-01-15T11:19:08.799 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 98193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/pktcdvd.ko 2024-01-15T11:19:08.799 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 263769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/rbd.ko 2024-01-15T11:19:08.870 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/xen-blkback/ 2024-01-15T11:19:08.870 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 98145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-15T11:19:08.870 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/zram/ 2024-01-15T11:19:08.870 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 60217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/zram/zram.ko 2024-01-15T11:19:08.870 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ 2024-01-15T11:19:08.870 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 30705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/applicom.ko 2024-01-15T11:19:08.870 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hangcheck-timer.ko 2024-01-15T11:19:08.870 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hw_random/ 2024-01-15T11:19:08.870 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-15T11:19:08.870 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-15T11:19:08.871 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-15T11:19:08.871 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hw_random/via-rng.ko 2024-01-15T11:19:08.871 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-15T11:19:08.871 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ 2024-01-15T11:19:08.871 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 30713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-15T11:19:08.871 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 148601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-15T11:19:08.871 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-15T11:19:08.871 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 139313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-15T11:19:08.871 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 70921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-15T11:19:08.871 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 53513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-15T11:19:08.871 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 36321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/lp.ko 2024-01-15T11:19:08.871 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/mwave/ 2024-01-15T11:19:08.871 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 84097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/mwave/mwave.ko 2024-01-15T11:19:08.872 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 25873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/nvram.ko 2024-01-15T11:19:08.872 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 32169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ppdev.ko 2024-01-15T11:19:08.872 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 51113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tlclk.ko 2024-01-15T11:19:08.872 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/ 2024-01-15T11:19:08.872 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-15T11:19:08.872 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-01-15T11:19:08.872 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-01-15T11:19:08.872 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 32985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-01-15T11:19:08.872 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 30121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-15T11:19:08.872 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-15T11:19:08.872 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-01-15T11:19:08.872 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/xillybus/ 2024-01-15T11:19:08.872 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/xillybus/xillybus_class.ko 2024-01-15T11:19:08.873 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 50945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/xillybus/xillybus_core.ko 2024-01-15T11:19:08.873 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-01-15T11:19:08.873 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/clk/ 2024-01-15T11:19:08.873 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/clk/clk-palmas.ko 2024-01-15T11:19:08.873 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 47849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/clk/clk-si5351.ko 2024-01-15T11:19:08.873 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/clk/clk-twl6040.ko 2024-01-15T11:19:08.873 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/clk/clk-wm831x.ko 2024-01-15T11:19:08.873 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/cpufreq/ 2024-01-15T11:19:08.873 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-15T11:19:08.873 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-15T11:19:08.873 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 25297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-15T11:19:08.873 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/ 2024-01-15T11:19:08.873 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/ccp/ 2024-01-15T11:19:08.873 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 70801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-15T11:19:08.874 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 243025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/ccp/ccp.ko 2024-01-15T11:19:08.874 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/intel/ 2024-01-15T11:19:08.874 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/intel/qat/ 2024-01-15T11:19:08.874 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/intel/qat/qat_common/ 2024-01-15T11:19:08.874 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 438761 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-15T11:19:08.874 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-01-15T11:19:08.874 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-15T11:19:08.874 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/padlock-aes.ko 2024-01-15T11:19:08.874 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/padlock-sha.ko 2024-01-15T11:19:08.874 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/virtio/ 2024-01-15T11:19:08.874 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 70273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-15T11:19:08.874 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dca/ 2024-01-15T11:19:08.874 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 29785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dca/dca.ko 2024-01-15T11:19:08.875 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dma/ 2024-01-15T11:19:08.875 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dma/dw/ 2024-01-15T11:19:08.875 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-15T11:19:08.875 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dma/ioat/ 2024-01-15T11:19:08.875 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 122569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-15T11:19:08.875 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/ 2024-01-15T11:19:08.875 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 79953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/amd64_edac.ko 2024-01-15T11:19:08.875 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 35769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/e752x_edac.ko 2024-01-15T11:19:08.875 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 63617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/edac_mce_amd.ko 2024-01-15T11:19:08.875 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i3000_edac.ko 2024-01-15T11:19:08.875 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i3200_edac.ko 2024-01-15T11:19:08.875 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i5100_edac.ko 2024-01-15T11:19:08.875 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 25657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i5400_edac.ko 2024-01-15T11:19:08.876 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i7300_edac.ko 2024-01-15T11:19:08.876 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 52041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i7core_edac.ko 2024-01-15T11:19:08.876 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i82975x_edac.ko 2024-01-15T11:19:08.876 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/ie31200_edac.ko 2024-01-15T11:19:08.876 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 56825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/sb_edac.ko 2024-01-15T11:19:08.876 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/x38_edac.ko 2024-01-15T11:19:08.876 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/ 2024-01-15T11:19:08.876 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-gpio.ko 2024-01-15T11:19:08.876 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 27185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-max14577.ko 2024-01-15T11:19:08.876 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 29569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-max77693.ko 2024-01-15T11:19:08.876 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-max8997.ko 2024-01-15T11:19:08.876 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-palmas.ko 2024-01-15T11:19:08.876 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-rt8973a.ko 2024-01-15T11:19:08.876 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 27785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-sm5502.ko 2024-01-15T11:19:08.877 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/firmware/ 2024-01-15T11:19:08.877 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 34977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/firmware/dmi-sysfs.ko 2024-01-15T11:19:08.877 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/firmware/efi/ 2024-01-15T11:19:08.877 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/firmware/efi/efi-pstore.ko 2024-01-15T11:19:08.877 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-15T11:19:08.877 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/ 2024-01-15T11:19:08.877 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-adp5520.ko 2024-01-15T11:19:08.877 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-amd8111.ko 2024-01-15T11:19:08.877 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-arizona.ko 2024-01-15T11:19:08.877 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-da9052.ko 2024-01-15T11:19:08.877 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-da9055.ko 2024-01-15T11:19:08.878 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-dln2.ko 2024-01-15T11:19:08.878 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 77849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-f7188x.ko 2024-01-15T11:19:08.878 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-generic.ko 2024-01-15T11:19:08.878 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-ich.ko 2024-01-15T11:19:08.878 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-01-15T11:19:08.878 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-kempld.ko 2024-01-15T11:19:08.878 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-lp3943.ko 2024-01-15T11:19:08.878 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-max7300.ko 2024-01-15T11:19:08.878 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-max730x.ko 2024-01-15T11:19:08.878 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-max732x.ko 2024-01-15T11:19:08.878 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 25145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-01-15T11:19:08.878 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 47073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-pca953x.ko 2024-01-15T11:19:08.879 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-pcf857x.ko 2024-01-15T11:19:08.879 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-rdc321x.ko 2024-01-15T11:19:08.879 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-sch.ko 2024-01-15T11:19:08.879 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-sch311x.ko 2024-01-15T11:19:08.879 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-tps65912.ko 2024-01-15T11:19:08.879 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-twl4030.ko 2024-01-15T11:19:08.879 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-twl6040.ko 2024-01-15T11:19:08.879 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-15T11:19:08.879 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-vx855.ko 2024-01-15T11:19:08.879 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-wm831x.ko 2024-01-15T11:19:08.879 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-wm8350.ko 2024-01-15T11:19:08.879 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-wm8994.ko 2024-01-15T11:19:08.879 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/ 2024-01-15T11:19:08.880 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-a4tech.ko 2024-01-15T11:19:08.880 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 39169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-apple.ko 2024-01-15T11:19:08.880 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-appleir.ko 2024-01-15T11:19:08.880 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-aureal.ko 2024-01-15T11:19:08.880 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-axff.ko 2024-01-15T11:19:08.880 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-belkin.ko 2024-01-15T11:19:08.880 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-cherry.ko 2024-01-15T11:19:08.880 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-chicony.ko 2024-01-15T11:19:08.880 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 60649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-cp2112.ko 2024-01-15T11:19:08.880 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-cypress.ko 2024-01-15T11:19:08.880 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-dr.ko 2024-01-15T11:19:08.880 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-elecom.ko 2024-01-15T11:19:08.880 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-elo.ko 2024-01-15T11:19:08.880 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-emsff.ko 2024-01-15T11:19:08.881 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-ezkey.ko 2024-01-15T11:19:08.881 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-gaff.ko 2024-01-15T11:19:08.881 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-generic.ko 2024-01-15T11:19:08.881 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-gt683r.ko 2024-01-15T11:19:08.881 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-gyration.ko 2024-01-15T11:19:08.881 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-15T11:19:08.881 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-15T11:19:08.881 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-holtekff.ko 2024-01-15T11:19:08.881 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-hyperv.ko 2024-01-15T11:19:08.881 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-icade.ko 2024-01-15T11:19:08.881 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-kensington.ko 2024-01-15T11:19:08.881 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-keytouch.ko 2024-01-15T11:19:08.881 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-kye.ko 2024-01-15T11:19:08.882 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-lcpower.ko 2024-01-15T11:19:08.882 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-led.ko 2024-01-15T11:19:08.882 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 42297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-lenovo.ko 2024-01-15T11:19:08.882 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 30697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-lg-g15.ko 2024-01-15T11:19:08.882 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 58185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-15T11:19:08.882 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 101481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-15T11:19:08.882 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 80993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-logitech.ko 2024-01-15T11:19:08.882 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 30801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-magicmouse.ko 2024-01-15T11:19:08.882 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-microsoft.ko 2024-01-15T11:19:08.882 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-monterey.ko 2024-01-15T11:19:08.882 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 50161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-multitouch.ko 2024-01-15T11:19:08.882 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 32593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-ntrig.ko 2024-01-15T11:19:08.882 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-ortek.ko 2024-01-15T11:19:08.882 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-penmount.ko 2024-01-15T11:19:08.883 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-petalynx.ko 2024-01-15T11:19:08.883 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 72937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-picolcd.ko 2024-01-15T11:19:08.883 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-pl.ko 2024-01-15T11:19:08.883 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-plantronics.ko 2024-01-15T11:19:08.883 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-primax.ko 2024-01-15T11:19:08.883 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 35393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-rmi.ko 2024-01-15T11:19:08.883 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-15T11:19:08.883 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-common.ko 2024-01-15T11:19:08.883 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 31425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-15T11:19:08.883 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 29729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-15T11:19:08.883 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 31129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-15T11:19:08.883 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-15T11:19:08.883 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 29489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-15T11:19:08.884 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-15T11:19:08.884 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 29313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-15T11:19:08.884 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 27937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-15T11:19:08.884 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-15T11:19:08.884 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat.ko 2024-01-15T11:19:08.884 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-saitek.ko 2024-01-15T11:19:08.884 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-samsung.ko 2024-01-15T11:19:08.884 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 36817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-15T11:19:08.884 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-sjoy.ko 2024-01-15T11:19:08.884 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 51249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-sony.ko 2024-01-15T11:19:08.884 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-speedlink.ko 2024-01-15T11:19:08.885 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 25297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-steelseries.ko 2024-01-15T11:19:08.885 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-sunplus.ko 2024-01-15T11:19:08.885 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-15T11:19:08.885 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-tivo.ko 2024-01-15T11:19:08.885 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-tmff.ko 2024-01-15T11:19:08.885 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-topseed.ko 2024-01-15T11:19:08.885 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-twinhan.ko 2024-01-15T11:19:08.885 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 71073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-uclogic.ko 2024-01-15T11:19:08.885 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-waltop.ko 2024-01-15T11:19:08.885 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 143473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-wiimote.ko 2024-01-15T11:19:08.885 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-xinmo.ko 2024-01-15T11:19:08.885 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-zpff.ko 2024-01-15T11:19:08.886 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-zydacron.ko 2024-01-15T11:19:08.886 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 267825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid.ko 2024-01-15T11:19:08.886 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 32321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/uhid.ko 2024-01-15T11:19:08.886 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/usbhid/ 2024-01-15T11:19:08.886 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 125721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/usbhid/usbhid.ko 2024-01-15T11:19:08.886 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/usbhid/usbkbd.ko 2024-01-15T11:19:08.886 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/usbhid/usbmouse.ko 2024-01-15T11:19:08.886 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 217873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/wacom.ko 2024-01-15T11:19:08.886 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hv/ 2024-01-15T11:19:08.886 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 64201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hv/hv_balloon.ko 2024-01-15T11:19:08.886 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 89625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hv/hv_utils.ko 2024-01-15T11:19:08.886 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 305465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hv/hv_vmbus.ko 2024-01-15T11:19:08.887 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ 2024-01-15T11:19:08.887 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 66521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/abituguru.ko 2024-01-15T11:19:08.887 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 61393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/abituguru3.ko 2024-01-15T11:19:08.887 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 34745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-15T11:19:08.887 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ad7414.ko 2024-01-15T11:19:08.887 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ad7418.ko 2024-01-15T11:19:08.887 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 25257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adc128d818.ko 2024-01-15T11:19:08.887 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 31729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adm1025.ko 2024-01-15T11:19:08.887 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 97977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adm1026.ko 2024-01-15T11:19:08.887 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adm1029.ko 2024-01-15T11:19:08.887 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 45553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adm1031.ko 2024-01-15T11:19:08.887 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adm9240.ko 2024-01-15T11:19:08.887 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ads7828.ko 2024-01-15T11:19:08.888 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adt7410.ko 2024-01-15T11:19:08.888 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adt7411.ko 2024-01-15T11:19:08.888 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 74433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adt7462.ko 2024-01-15T11:19:08.888 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 39585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adt7470.ko 2024-01-15T11:19:08.888 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 67929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adt7475.ko 2024-01-15T11:19:08.888 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adt7x10.ko 2024-01-15T11:19:08.888 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 39073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/amc6821.ko 2024-01-15T11:19:08.888 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 55201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/applesmc.ko 2024-01-15T11:19:08.888 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 49913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/asb100.ko 2024-01-15T11:19:08.888 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 58617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/asc7621.ko 2024-01-15T11:19:08.888 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 40825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-15T11:19:08.889 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/atxp1.ko 2024-01-15T11:19:08.889 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/coretemp.ko 2024-01-15T11:19:08.889 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/da9052-hwmon.ko 2024-01-15T11:19:08.889 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/da9055-hwmon.ko 2024-01-15T11:19:08.889 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 44465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-15T11:19:08.889 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 99601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/dme1737.ko 2024-01-15T11:19:08.889 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ds1621.ko 2024-01-15T11:19:08.889 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ds620.ko 2024-01-15T11:19:08.889 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 29777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/emc1403.ko 2024-01-15T11:19:08.889 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 33185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/emc2103.ko 2024-01-15T11:19:08.889 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 30321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/emc6w201.ko 2024-01-15T11:19:08.889 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 66985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/f71805f.ko 2024-01-15T11:19:08.889 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 94457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/f71882fg.ko 2024-01-15T11:19:08.890 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 41401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/f75375s.ko 2024-01-15T11:19:08.890 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/fam15h_power.ko 2024-01-15T11:19:08.890 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 55449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/fschmd.ko 2024-01-15T11:19:08.890 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/g760a.ko 2024-01-15T11:19:08.890 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/g762.ko 2024-01-15T11:19:08.890 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 46801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/gl518sm.ko 2024-01-15T11:19:08.890 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 45529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/gl520sm.ko 2024-01-15T11:19:08.890 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/hih6130.ko 2024-01-15T11:19:08.890 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-15T11:19:08.890 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/i5500_temp.ko 2024-01-15T11:19:08.890 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/i5k_amb.ko 2024-01-15T11:19:08.890 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 34529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ibmaem.ko 2024-01-15T11:19:08.890 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ibmpex.ko 2024-01-15T11:19:08.890 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ina209.ko 2024-01-15T11:19:08.891 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ina2xx.ko 2024-01-15T11:19:08.891 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 130449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/it87.ko 2024-01-15T11:19:08.891 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/jc42.ko 2024-01-15T11:19:08.891 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/k10temp.ko 2024-01-15T11:19:08.891 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/k8temp.ko 2024-01-15T11:19:08.891 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lineage-pem.ko 2024-01-15T11:19:08.891 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 48601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm63.ko 2024-01-15T11:19:08.891 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm73.ko 2024-01-15T11:19:08.891 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 36777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm75.ko 2024-01-15T11:19:08.891 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm77.ko 2024-01-15T11:19:08.891 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 34593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm78.ko 2024-01-15T11:19:08.891 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 31745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm80.ko 2024-01-15T11:19:08.891 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm83.ko 2024-01-15T11:19:08.892 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 72833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm85.ko 2024-01-15T11:19:08.892 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 46153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm87.ko 2024-01-15T11:19:08.892 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 37913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm90.ko 2024-01-15T11:19:08.892 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm92.ko 2024-01-15T11:19:08.892 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 108841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm93.ko 2024-01-15T11:19:08.892 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 33393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm95234.ko 2024-01-15T11:19:08.892 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm95241.ko 2024-01-15T11:19:08.892 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm95245.ko 2024-01-15T11:19:08.892 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc2945.ko 2024-01-15T11:19:08.892 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc4151.ko 2024-01-15T11:19:08.892 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc4215.ko 2024-01-15T11:19:08.892 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc4222.ko 2024-01-15T11:19:08.893 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc4245.ko 2024-01-15T11:19:08.893 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc4260.ko 2024-01-15T11:19:08.893 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc4261.ko 2024-01-15T11:19:08.893 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 33489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max16065.ko 2024-01-15T11:19:08.893 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max1619.ko 2024-01-15T11:19:08.893 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max1668.ko 2024-01-15T11:19:08.893 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max197.ko 2024-01-15T11:19:08.893 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 27129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max6639.ko 2024-01-15T11:19:08.893 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max6650.ko 2024-01-15T11:19:08.893 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 35777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max6697.ko 2024-01-15T11:19:08.893 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/mc13783-adc.ko 2024-01-15T11:19:08.893 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/mcp3021.ko 2024-01-15T11:19:08.893 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-01-15T11:19:08.894 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 44129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/nct6683.ko 2024-01-15T11:19:08.894 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 119817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/nct6775-core.ko 2024-01-15T11:19:08.894 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 60705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/nct6775.ko 2024-01-15T11:19:08.894 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 59737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/nct7802.ko 2024-01-15T11:19:08.894 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 82337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pc87360.ko 2024-01-15T11:19:08.894 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 54433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pc87427.ko 2024-01-15T11:19:08.894 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pcf8591.ko 2024-01-15T11:19:08.894 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/ 2024-01-15T11:19:08.894 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-15T11:19:08.894 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-15T11:19:08.894 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-15T11:19:08.894 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-15T11:19:08.895 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-15T11:19:08.895 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-15T11:19:08.895 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-15T11:19:08.895 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 82577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-15T11:19:08.895 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-15T11:19:08.895 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 30729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-15T11:19:08.895 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-15T11:19:08.895 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-15T11:19:08.895 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/powr1220.ko 2024-01-15T11:19:08.895 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/sch5627.ko 2024-01-15T11:19:08.895 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/sch5636.ko 2024-01-15T11:19:08.896 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 27145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-15T11:19:08.896 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 32137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/sht15.ko 2024-01-15T11:19:08.896 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/sht21.ko 2024-01-15T11:19:08.896 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/shtc1.ko 2024-01-15T11:19:08.896 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 40105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/sis5595.ko 2024-01-15T11:19:08.896 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/smsc47b397.ko 2024-01-15T11:19:08.896 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 39193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/smsc47m1.ko 2024-01-15T11:19:08.896 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 37385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/smsc47m192.ko 2024-01-15T11:19:08.896 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/thmc50.ko 2024-01-15T11:19:08.896 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/tmp102.ko 2024-01-15T11:19:08.896 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/tmp103.ko 2024-01-15T11:19:08.897 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/tmp401.ko 2024-01-15T11:19:08.897 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/tmp421.ko 2024-01-15T11:19:08.897 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/via-cputemp.ko 2024-01-15T11:19:08.897 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 41945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/via686a.ko 2024-01-15T11:19:08.897 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 52457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/vt1211.ko 2024-01-15T11:19:08.897 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 51545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/vt8231.ko 2024-01-15T11:19:08.897 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 57449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83627ehf.ko 2024-01-15T11:19:08.897 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 78873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83627hf.ko 2024-01-15T11:19:08.897 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 71345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83781d.ko 2024-01-15T11:19:08.897 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 63225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83791d.ko 2024-01-15T11:19:08.898 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 71321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83792d.ko 2024-01-15T11:19:08.898 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 101473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83793.ko 2024-01-15T11:19:08.898 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 119505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83795.ko 2024-01-15T11:19:08.898 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83l785ts.ko 2024-01-15T11:19:08.898 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 35625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83l786ng.ko 2024-01-15T11:19:08.898 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-01-15T11:19:08.898 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-01-15T11:19:08.898 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/ 2024-01-15T11:19:08.898 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/algos/ 2024-01-15T11:19:08.898 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-15T11:19:08.899 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-15T11:19:08.899 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/ 2024-01-15T11:19:08.899 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 27969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-01-15T11:19:08.899 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-01-15T11:19:08.899 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 27777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-01-15T11:19:08.899 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-15T11:19:08.899 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-15T11:19:08.899 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-15T11:19:08.899 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-01-15T11:19:08.899 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 6929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-15T11:19:08.899 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-01-15T11:19:08.900 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 50201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-15T11:19:08.900 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-15T11:19:08.900 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-15T11:19:08.900 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-15T11:19:08.900 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-01-15T11:19:08.900 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-01-15T11:19:08.900 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 62817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-15T11:19:08.900 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-15T11:19:08.900 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 47889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-15T11:19:08.900 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-01-15T11:19:08.900 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-15T11:19:08.901 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-15T11:19:08.901 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-01-15T11:19:08.901 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 25145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-15T11:19:08.901 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-15T11:19:08.901 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 47241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-15T11:19:08.901 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-01-15T11:19:08.901 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-15T11:19:08.901 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-15T11:19:08.901 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-01-15T11:19:08.901 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 29361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-01-15T11:19:08.902 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-15T11:19:08.902 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-01-15T11:19:08.902 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-15T11:19:08.902 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-15T11:19:08.902 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-15T11:19:08.902 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-15T11:19:08.902 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 47657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-01-15T11:19:08.902 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/i2c-mux.ko 2024-01-15T11:19:08.902 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/i2c-smbus.ko 2024-01-15T11:19:08.902 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 27073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/i2c-stub.ko 2024-01-15T11:19:08.902 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/muxes/ 2024-01-15T11:19:08.902 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-01-15T11:19:08.903 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-01-15T11:19:08.903 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 29737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-01-15T11:19:08.903 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ 2024-01-15T11:19:08.903 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/ 2024-01-15T11:19:08.903 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 273609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-15T11:19:08.903 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 879969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/ib_core.ko 2024-01-15T11:19:08.903 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 69273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-15T11:19:08.903 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 324217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-15T11:19:08.903 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 97985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-15T11:19:08.903 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 282273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-15T11:19:08.903 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 66201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-15T11:19:08.904 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/ 2024-01-15T11:19:08.904 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/cxgb4/ 2024-01-15T11:19:08.904 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 493073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-15T11:19:08.904 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/mlx4/ 2024-01-15T11:19:08.904 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 419737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-15T11:19:08.904 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/mlx5/ 2024-01-15T11:19:08.904 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 739025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-15T11:19:08.904 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/mthca/ 2024-01-15T11:19:08.904 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 296625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-15T11:19:08.904 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/ocrdma/ 2024-01-15T11:19:08.905 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 153697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-01-15T11:19:08.905 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/usnic/ 2024-01-15T11:19:08.905 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 168969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-01-15T11:19:08.905 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/ 2024-01-15T11:19:08.905 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/ipoib/ 2024-01-15T11:19:08.905 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 263081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-15T11:19:08.905 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/iser/ 2024-01-15T11:19:08.905 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 100241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-15T11:19:08.905 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/isert/ 2024-01-15T11:19:08.905 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 111425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-15T11:19:08.906 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/srp/ 2024-01-15T11:19:08.906 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 128753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-15T11:19:08.906 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/srpt/ 2024-01-15T11:19:08.906 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 129529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-15T11:19:08.906 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/ 2024-01-15T11:19:08.906 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/evbug.ko 2024-01-15T11:19:08.906 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/ff-memless.ko 2024-01-15T11:19:08.906 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/gameport/ 2024-01-15T11:19:08.906 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-15T11:19:08.906 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-15T11:19:08.906 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 41241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/gameport/gameport.ko 2024-01-15T11:19:08.907 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 41801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/joydev.ko 2024-01-15T11:19:08.907 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/ 2024-01-15T11:19:08.907 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-01-15T11:19:08.907 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-01-15T11:19:08.907 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-01-15T11:19:08.907 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24761 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-01-15T11:19:08.907 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 36665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-15T11:19:08.907 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-01-15T11:19:08.907 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/lkkbd.ko 2024-01-15T11:19:08.907 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/lm8323.ko 2024-01-15T11:19:08.907 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/lm8333.ko 2024-01-15T11:19:08.908 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-01-15T11:19:08.908 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-01-15T11:19:08.908 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-01-15T11:19:08.908 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-01-15T11:19:08.908 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/newtonkbd.ko 2024-01-15T11:19:08.908 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-01-15T11:19:08.908 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/qt1070.ko 2024-01-15T11:19:08.908 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/qt2160.ko 2024-01-15T11:19:08.908 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-01-15T11:19:08.908 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/stowaway.ko 2024-01-15T11:19:08.908 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/sunkbd.ko 2024-01-15T11:19:08.908 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-01-15T11:19:08.908 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-01-15T11:19:08.909 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-01-15T11:19:08.909 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/xtkbd.ko 2024-01-15T11:19:08.909 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/matrix-keymap.ko 2024-01-15T11:19:08.909 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/ 2024-01-15T11:19:08.909 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 34329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/appletouch.ko 2024-01-15T11:19:08.909 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 34177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/bcm5974.ko 2024-01-15T11:19:08.909 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 123681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/cyapatp.ko 2024-01-15T11:19:08.909 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 89449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-15T11:19:08.909 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/gpio_mouse.ko 2024-01-15T11:19:08.909 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 335929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/psmouse.ko 2024-01-15T11:19:08.909 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/sermouse.ko 2024-01-15T11:19:08.909 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-15T11:19:08.909 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-15T11:19:08.910 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-15T11:19:08.910 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/rmi4/ 2024-01-15T11:19:08.910 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 109873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-15T11:19:08.910 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/ 2024-01-15T11:19:08.910 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/altera_ps2.ko 2024-01-15T11:19:08.910 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/arc_ps2.ko 2024-01-15T11:19:08.910 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/ct82c710.ko 2024-01-15T11:19:08.910 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-15T11:19:08.910 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/parkbd.ko 2024-01-15T11:19:08.910 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/pcips2.ko 2024-01-15T11:19:08.910 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/ps2mult.ko 2024-01-15T11:19:08.910 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/serio_raw.ko 2024-01-15T11:19:08.910 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/serport.ko 2024-01-15T11:19:08.910 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/sparse-keymap.ko 2024-01-15T11:19:08.911 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/iommu/ 2024-01-15T11:19:08.911 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/iommu/amd/ 2024-01-15T11:19:08.911 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 39289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/iommu/amd/iommu_v2.ko 2024-01-15T11:19:08.911 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/ 2024-01-15T11:19:08.911 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-88pm860x.ko 2024-01-15T11:19:08.911 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-adp5520.ko 2024-01-15T11:19:08.911 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 59753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-bd2802.ko 2024-01-15T11:19:08.911 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-blinkm.ko 2024-01-15T11:19:08.911 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-da903x.ko 2024-01-15T11:19:08.911 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-da9052.ko 2024-01-15T11:19:08.911 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-gpio.ko 2024-01-15T11:19:08.911 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-lm3530.ko 2024-01-15T11:19:08.911 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 30505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-lm3533.ko 2024-01-15T11:19:08.911 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-lm355x.ko 2024-01-15T11:19:08.912 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-lm3642.ko 2024-01-15T11:19:08.912 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-lp3944.ko 2024-01-15T11:19:08.912 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-lp8788.ko 2024-01-15T11:19:08.912 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-max8997.ko 2024-01-15T11:19:08.912 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-mc13783.ko 2024-01-15T11:19:08.912 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-menf21bmc.ko 2024-01-15T11:19:08.912 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-pca9532.ko 2024-01-15T11:19:08.912 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-pca955x.ko 2024-01-15T11:19:08.912 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-pca963x.ko 2024-01-15T11:19:08.912 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 34433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-ss4200.ko 2024-01-15T11:19:08.912 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-tca6507.ko 2024-01-15T11:19:08.912 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-wm831x-status.ko 2024-01-15T11:19:08.912 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-wm8350.ko 2024-01-15T11:19:08.912 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ 2024-01-15T11:19:08.913 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-15T11:19:08.913 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-15T11:19:08.913 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-15T11:19:08.913 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-15T11:19:08.913 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-15T11:19:08.913 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-15T11:19:08.913 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-15T11:19:08.913 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-15T11:19:08.913 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/ 2024-01-15T11:19:08.913 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/bcache/ 2024-01-15T11:19:08.913 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 654969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/bcache/bcache.ko 2024-01-15T11:19:08.913 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 40577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-bio-prison.ko 2024-01-15T11:19:08.914 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 89601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-bufio.ko 2024-01-15T11:19:08.914 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 47529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-cache-smq.ko 2024-01-15T11:19:08.914 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 156009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-cache.ko 2024-01-15T11:19:08.914 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 106897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-crypt.ko 2024-01-15T11:19:08.914 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-delay.ko 2024-01-15T11:19:08.914 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 53857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-era.ko 2024-01-15T11:19:08.914 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-flakey.ko 2024-01-15T11:19:08.914 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 41529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-log-userspace.ko 2024-01-15T11:19:08.914 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 32737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-log.ko 2024-01-15T11:19:08.914 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 49545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-mirror.ko 2024-01-15T11:19:08.914 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 78033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-multipath.ko 2024-01-15T11:19:08.914 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-queue-length.ko 2024-01-15T11:19:08.914 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 70825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-raid.ko 2024-01-15T11:19:08.914 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 36297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-region-hash.ko 2024-01-15T11:19:08.915 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-round-robin.ko 2024-01-15T11:19:08.915 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-service-time.ko 2024-01-15T11:19:08.915 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 109529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-snapshot.ko 2024-01-15T11:19:08.915 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-switch.ko 2024-01-15T11:19:08.915 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 181865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-thin-pool.ko 2024-01-15T11:19:08.915 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 51737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-verity.ko 2024-01-15T11:19:08.915 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-zero.ko 2024-01-15T11:19:08.915 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/faulty.ko 2024-01-15T11:19:08.915 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/linear.ko 2024-01-15T11:19:08.915 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 32417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/multipath.ko 2024-01-15T11:19:08.915 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/persistent-data/ 2024-01-15T11:19:08.915 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 199937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-15T11:19:08.915 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 37337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/raid0.ko 2024-01-15T11:19:08.915 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 113073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/raid1.ko 2024-01-15T11:19:08.916 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 158681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/raid10.ko 2024-01-15T11:19:08.916 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 395721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/raid456.ko 2024-01-15T11:19:08.916 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/ 2024-01-15T11:19:08.916 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/ 2024-01-15T11:19:08.916 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 178137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptbase.ko 2024-01-15T11:19:08.916 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 63385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptctl.ko 2024-01-15T11:19:08.916 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 44665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptfc.ko 2024-01-15T11:19:08.916 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 37225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptlan.ko 2024-01-15T11:19:08.916 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 123321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptsas.ko 2024-01-15T11:19:08.916 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 79041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptscsih.ko 2024-01-15T11:19:08.916 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 53017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptspi.ko 2024-01-15T11:19:08.916 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/ 2024-01-15T11:19:08.917 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/88pm800.ko 2024-01-15T11:19:08.917 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12761 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/88pm805.ko 2024-01-15T11:19:08.917 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/88pm80x.ko 2024-01-15T11:19:08.917 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/arizona-i2c.ko 2024-01-15T11:19:08.917 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 123721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/arizona.ko 2024-01-15T11:19:08.917 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/bcm590xx.ko 2024-01-15T11:19:08.917 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/cros_ec_dev.ko 2024-01-15T11:19:08.917 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 34961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/dln2.ko 2024-01-15T11:19:08.917 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/janz-cmodio.ko 2024-01-15T11:19:08.917 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 53585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/kempld-core.ko 2024-01-15T11:19:08.917 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 27529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/lm3533-core.ko 2024-01-15T11:19:08.917 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-01-15T11:19:08.917 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/lp3943.ko 2024-01-15T11:19:08.918 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 54569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/lpc_ich.ko 2024-01-15T11:19:08.918 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/lpc_sch.ko 2024-01-15T11:19:08.918 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/max8907.ko 2024-01-15T11:19:08.918 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 29857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/mc13xxx-core.ko 2024-01-15T11:19:08.918 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-01-15T11:19:08.918 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/menf21bmc.ko 2024-01-15T11:19:08.918 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/pcf50633-adc.ko 2024-01-15T11:19:08.918 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/pcf50633-gpio.ko 2024-01-15T11:19:08.918 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 34873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/pcf50633.ko 2024-01-15T11:19:08.918 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-01-15T11:19:08.918 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/retu-mfd.ko 2024-01-15T11:19:08.918 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 80425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/si476x-core.ko 2024-01-15T11:19:08.919 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 48457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/sm501.ko 2024-01-15T11:19:08.919 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/ti_am335x_tscadc.ko 2024-01-15T11:19:08.919 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 51137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/tps65010.ko 2024-01-15T11:19:08.919 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/tps6507x.ko 2024-01-15T11:19:08.919 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/viperboard.ko 2024-01-15T11:19:08.919 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/vx855.ko 2024-01-15T11:19:08.919 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/wl1273-core.ko 2024-01-15T11:19:08.919 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 44345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/wm8994.ko 2024-01-15T11:19:08.919 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ 2024-01-15T11:19:08.919 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-01-15T11:19:08.919 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 48489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ad525x_dpot.ko 2024-01-15T11:19:08.919 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/altera-stapl/ 2024-01-15T11:19:08.919 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 46585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-15T11:19:08.920 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/apds9802als.ko 2024-01-15T11:19:08.920 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 36729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/apds990x.ko 2024-01-15T11:19:08.920 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 45593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/bh1770glc.ko 2024-01-15T11:19:08.920 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/c2port/ 2024-01-15T11:19:08.920 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-01-15T11:19:08.920 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 35281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/c2port/core.ko 2024-01-15T11:19:08.920 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/cb710/ 2024-01-15T11:19:08.920 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 25161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/cb710/cb710.ko 2024-01-15T11:19:08.920 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ds1682.ko 2024-01-15T11:19:08.920 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/dummy-irq.ko 2024-01-15T11:19:08.920 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/echo/ 2024-01-15T11:19:08.920 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/echo/echo.ko 2024-01-15T11:19:08.920 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/eeprom/ 2024-01-15T11:19:08.920 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 37849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/eeprom/at24.ko 2024-01-15T11:19:08.921 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/eeprom/eeprom.ko 2024-01-15T11:19:08.921 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-15T11:19:08.921 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/eeprom/max6875.ko 2024-01-15T11:19:08.921 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 33009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/enclosure.ko 2024-01-15T11:19:08.921 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/genwqe/ 2024-01-15T11:19:08.921 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 152201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-01-15T11:19:08.921 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/hmc6352.ko 2024-01-15T11:19:08.921 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 31257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/hpilo.ko 2024-01-15T11:19:08.921 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ibmasm/ 2024-01-15T11:19:08.921 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 72129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-01-15T11:19:08.921 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ics932s401.ko 2024-01-15T11:19:08.921 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/isl29003.ko 2024-01-15T11:19:08.921 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/isl29020.ko 2024-01-15T11:19:08.922 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/lis3lv02d/ 2024-01-15T11:19:08.922 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 42513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-15T11:19:08.922 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-15T11:19:08.922 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/mei/ 2024-01-15T11:19:08.922 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 125209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/mei/mei-me.ko 2024-01-15T11:19:08.922 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 56521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/mei/mei-txe.ko 2024-01-15T11:19:08.922 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 310113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/mei/mei.ko 2024-01-15T11:19:08.922 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 31329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/phantom.ko 2024-01-15T11:19:08.922 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ti-st/ 2024-01-15T11:19:08.922 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 74265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ti-st/st_drv.ko 2024-01-15T11:19:08.922 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/tifm_7xx1.ko 2024-01-15T11:19:08.922 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/tifm_core.ko 2024-01-15T11:19:08.922 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/tsl2550.ko 2024-01-15T11:19:08.922 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 48697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/vmw_balloon.ko 2024-01-15T11:19:08.923 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/vmw_vmci/ 2024-01-15T11:19:08.923 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 183609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-15T11:19:08.923 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ 2024-01-15T11:19:08.923 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/bonding/ 2024-01-15T11:19:08.923 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 490129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/bonding/bonding.ko 2024-01-15T11:19:08.923 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/ 2024-01-15T11:19:08.923 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/b53/ 2024-01-15T11:19:08.923 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 106033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-15T11:19:08.923 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 40417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-15T11:19:08.923 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-15T11:19:08.923 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/mv88e6xxx/ 2024-01-15T11:19:08.923 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 453737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-15T11:19:08.923 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dummy.ko 2024-01-15T11:19:08.924 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/eql.ko 2024-01-15T11:19:08.924 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/ 2024-01-15T11:19:08.924 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/3com/ 2024-01-15T11:19:08.924 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 45785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-15T11:19:08.924 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 42105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-15T11:19:08.924 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 130553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-15T11:19:08.924 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 68849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-15T11:19:08.924 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/8390/ 2024-01-15T11:19:08.924 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 37649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-15T11:19:08.924 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 59689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-15T11:19:08.924 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 27201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-15T11:19:08.924 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 99049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-15T11:19:08.924 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/adaptec/ 2024-01-15T11:19:08.924 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 54521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-15T11:19:08.924 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/agere/ 2024-01-15T11:19:08.925 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 69137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-15T11:19:08.925 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/alteon/ 2024-01-15T11:19:08.925 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 59585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-15T11:19:08.925 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/altera/ 2024-01-15T11:19:08.925 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 41409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-15T11:19:08.925 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/amd/ 2024-01-15T11:19:08.925 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 54609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-15T11:19:08.925 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 49289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-15T11:19:08.925 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 87297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-15T11:19:08.925 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/ 2024-01-15T11:19:08.925 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/alx/ 2024-01-15T11:19:08.925 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 97337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-15T11:19:08.926 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-01-15T11:19:08.926 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 104673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-15T11:19:08.926 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-01-15T11:19:08.926 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 90257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-15T11:19:08.926 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atlx/ 2024-01-15T11:19:08.926 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 81569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-15T11:19:08.926 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 69729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-15T11:19:08.926 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/ 2024-01-15T11:19:08.926 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 78401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-15T11:19:08.926 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 176761 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-15T11:19:08.926 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-01-15T11:19:08.926 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 1421497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-15T11:19:08.926 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 128569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-15T11:19:08.926 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/genet/ 2024-01-15T11:19:08.927 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 132089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-15T11:19:08.927 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 312081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-15T11:19:08.927 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/brocade/ 2024-01-15T11:19:08.927 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/brocade/bna/ 2024-01-15T11:19:08.927 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 323513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-15T11:19:08.927 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/ 2024-01-15T11:19:08.927 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-01-15T11:19:08.927 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 193497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-15T11:19:08.927 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-01-15T11:19:08.927 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 347417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-15T11:19:08.927 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-01-15T11:19:08.927 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 1044497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-15T11:19:08.927 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-01-15T11:19:08.927 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 166193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-15T11:19:08.928 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-01-15T11:19:08.928 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 34881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-15T11:19:08.928 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/cisco/ 2024-01-15T11:19:08.928 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/cisco/enic/ 2024-01-15T11:19:08.928 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 204345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-15T11:19:08.928 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/ 2024-01-15T11:19:08.928 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/ 2024-01-15T11:19:08.928 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 69449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-15T11:19:08.928 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 61489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-15T11:19:08.928 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 141225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-15T11:19:08.928 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 51497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-15T11:19:08.928 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 62817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-15T11:19:08.928 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 31369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-15T11:19:08.929 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dlink/ 2024-01-15T11:19:08.929 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 60873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-15T11:19:08.929 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 62833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-15T11:19:08.929 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 45721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dnet.ko 2024-01-15T11:19:08.929 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 25185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/ec_bhf.ko 2024-01-15T11:19:08.929 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/emulex/ 2024-01-15T11:19:08.929 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/emulex/benet/ 2024-01-15T11:19:08.929 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 281137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-15T11:19:08.929 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 49457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/ethoc.ko 2024-01-15T11:19:08.929 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 51737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/fealnx.ko 2024-01-15T11:19:08.929 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/fujitsu/ 2024-01-15T11:19:08.929 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 45345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-01-15T11:19:08.929 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/ 2024-01-15T11:19:08.929 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 90465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-15T11:19:08.929 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/e1000/ 2024-01-15T11:19:08.930 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 295577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-15T11:19:08.930 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/e1000e/ 2024-01-15T11:19:08.930 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 584497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-15T11:19:08.999 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/fm10k/ 2024-01-15T11:19:08.999 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 246209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-15T11:19:08.999 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/i40e/ 2024-01-15T11:19:08.999 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 925825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-15T11:19:09.000 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/iavf/ 2024-01-15T11:19:09.000 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 302937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-15T11:19:09.000 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/igb/ 2024-01-15T11:19:09.000 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 514641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-15T11:19:09.000 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/igbvf/ 2024-01-15T11:19:09.000 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 93593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-15T11:19:09.000 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-01-15T11:19:09.000 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 734305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-15T11:19:09.000 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-01-15T11:19:09.000 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 151769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-15T11:19:09.000 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 86921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/jme.ko 2024-01-15T11:19:09.000 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/marvell/ 2024-01-15T11:19:09.001 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-15T11:19:09.001 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 102289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-15T11:19:09.001 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 122649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-15T11:19:09.001 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/ 2024-01-15T11:19:09.001 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-01-15T11:19:09.001 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 727601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-15T11:19:09.001 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 278937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-15T11:19:09.001 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-01-15T11:19:09.001 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-01-15T11:19:09.001 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 1113681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-15T11:19:09.001 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/micrel/ 2024-01-15T11:19:09.001 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 53041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-01-15T11:19:09.001 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 40993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-01-15T11:19:09.001 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-01-15T11:19:09.002 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 95665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-15T11:19:09.002 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/myricom/ 2024-01-15T11:19:09.002 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-01-15T11:19:09.002 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 108649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-15T11:19:09.002 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/natsemi/ 2024-01-15T11:19:09.002 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 73441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-15T11:19:09.002 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 47777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-15T11:19:09.002 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/neterion/ 2024-01-15T11:19:09.002 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 150905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-15T11:19:09.002 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/nvidia/ 2024-01-15T11:19:09.002 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 136721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-15T11:19:09.002 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/packetengines/ 2024-01-15T11:19:09.002 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 50481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-15T11:19:09.002 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 43145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-15T11:19:09.003 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/qlogic/ 2024-01-15T11:19:09.003 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-01-15T11:19:09.003 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 227897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-15T11:19:09.003 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 87081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-15T11:19:09.003 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-01-15T11:19:09.003 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 672049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-15T11:19:09.003 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/rdc/ 2024-01-15T11:19:09.003 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 43017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-15T11:19:09.003 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/realtek/ 2024-01-15T11:19:09.003 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 67385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-15T11:19:09.003 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 83985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-15T11:19:09.003 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 29321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-15T11:19:09.004 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 189801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-15T11:19:09.004 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/samsung/ 2024-01-15T11:19:09.004 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-01-15T11:19:09.004 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 104241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-01-15T11:19:09.004 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sfc/ 2024-01-15T11:19:09.004 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 1052497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-15T11:19:09.004 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/silan/ 2024-01-15T11:19:09.004 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 47097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-15T11:19:09.004 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sis/ 2024-01-15T11:19:09.004 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 54817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-15T11:19:09.004 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 63337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-15T11:19:09.004 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/smsc/ 2024-01-15T11:19:09.004 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 61537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-15T11:19:09.005 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 67193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-15T11:19:09.005 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 73409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-15T11:19:09.005 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 68177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-15T11:19:09.005 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/stmicro/ 2024-01-15T11:19:09.005 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-01-15T11:19:09.005 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-01-15T11:19:09.005 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 39905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-15T11:19:09.005 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-01-15T11:19:09.005 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 487025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-15T11:19:09.005 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sun/ 2024-01-15T11:19:09.005 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 103337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-15T11:19:09.005 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 166097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-15T11:19:09.005 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 66329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-15T11:19:09.006 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 78801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-15T11:19:09.006 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/tehuti/ 2024-01-15T11:19:09.006 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 50057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-15T11:19:09.006 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/ti/ 2024-01-15T11:19:09.006 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 86529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-15T11:19:09.006 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/via/ 2024-01-15T11:19:09.006 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 80273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-15T11:19:09.006 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 83633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-15T11:19:09.006 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/wiznet/ 2024-01-15T11:19:09.006 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 46241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-15T11:19:09.006 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 30849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-15T11:19:09.006 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/xircom/ 2024-01-15T11:19:09.007 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 59993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-15T11:19:09.007 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/fddi/ 2024-01-15T11:19:09.007 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 41001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/fddi/defxx.ko 2024-01-15T11:19:09.007 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/fddi/skfp/ 2024-01-15T11:19:09.007 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 216985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/fddi/skfp/skfp.ko 2024-01-15T11:19:09.007 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 77345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/geneve.ko 2024-01-15T11:19:09.007 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/hyperv/ 2024-01-15T11:19:09.007 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 235521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-15T11:19:09.007 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ieee802154/ 2024-01-15T11:19:09.007 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-15T11:19:09.007 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 25065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ifb.ko 2024-01-15T11:19:09.007 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ipvlan/ 2024-01-15T11:19:09.008 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 83769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-15T11:19:09.008 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 62145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/macvlan.ko 2024-01-15T11:19:09.008 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/macvtap.ko 2024-01-15T11:19:09.008 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mdio/ 2024-01-15T11:19:09.008 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-15T11:19:09.008 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-15T11:19:09.008 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mdio/mdio-gpio.ko 2024-01-15T11:19:09.008 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-15T11:19:09.008 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mdio.ko 2024-01-15T11:19:09.008 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mii.ko 2024-01-15T11:19:09.008 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 43953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/netconsole.ko 2024-01-15T11:19:09.008 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/nlmon.ko 2024-01-15T11:19:09.008 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/pcs/ 2024-01-15T11:19:09.009 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-15T11:19:09.009 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 38977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-15T11:19:09.009 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/ 2024-01-15T11:19:09.009 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/amd.ko 2024-01-15T11:19:09.009 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 50033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-15T11:19:09.009 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 44721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-15T11:19:09.009 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/bcm87xx.ko 2024-01-15T11:19:09.009 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 42241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/broadcom.ko 2024-01-15T11:19:09.009 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/cicada.ko 2024-01-15T11:19:09.009 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/davicom.ko 2024-01-15T11:19:09.009 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/et1011c.ko 2024-01-15T11:19:09.009 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/icplus.ko 2024-01-15T11:19:09.009 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/lxt.ko 2024-01-15T11:19:09.010 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 82049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/marvell.ko 2024-01-15T11:19:09.010 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 76113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/micrel.ko 2024-01-15T11:19:09.010 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/national.ko 2024-01-15T11:19:09.010 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 97857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/phylink.ko 2024-01-15T11:19:09.010 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/qsemi.ko 2024-01-15T11:19:09.010 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 50065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/realtek.ko 2024-01-15T11:19:09.010 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 29985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/smsc.ko 2024-01-15T11:19:09.010 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/ste10Xp.ko 2024-01-15T11:19:09.010 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/vitesse.ko 2024-01-15T11:19:09.010 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/plip/ 2024-01-15T11:19:09.010 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 43505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/plip/plip.ko 2024-01-15T11:19:09.010 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/ 2024-01-15T11:19:09.010 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-15T11:19:09.011 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 29713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/ppp_async.ko 2024-01-15T11:19:09.011 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-15T11:19:09.011 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-15T11:19:09.011 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-15T11:19:09.011 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 42545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/pppoe.ko 2024-01-15T11:19:09.011 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/pppox.ko 2024-01-15T11:19:09.011 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 32689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/pptp.ko 2024-01-15T11:19:09.011 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/sb1000.ko 2024-01-15T11:19:09.011 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/slip/ 2024-01-15T11:19:09.011 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 42465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/slip/slip.ko 2024-01-15T11:19:09.011 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/sungem_phy.ko 2024-01-15T11:19:09.011 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 64449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/tap.ko 2024-01-15T11:19:09.011 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/ 2024-01-15T11:19:09.012 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 106169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/team.ko 2024-01-15T11:19:09.012 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-15T11:19:09.012 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-15T11:19:09.012 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-15T11:19:09.012 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/team_mode_random.ko 2024-01-15T11:19:09.012 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-15T11:19:09.012 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 87017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/veth.ko 2024-01-15T11:19:09.012 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/vmxnet3/ 2024-01-15T11:19:09.012 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 144297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-15T11:19:09.012 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/vxlan/ 2024-01-15T11:19:09.012 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 297329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/vxlan/vxlan.ko 2024-01-15T11:19:09.013 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/xen-netback/ 2024-01-15T11:19:09.013 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 144585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-15T11:19:09.013 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ntb/ 2024-01-15T11:19:09.013 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ntb/ntb.ko 2024-01-15T11:19:09.013 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/nvme/ 2024-01-15T11:19:09.013 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/nvme/host/ 2024-01-15T11:19:09.013 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 265121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/nvme/host/nvme-core.ko 2024-01-15T11:19:09.013 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 102209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/nvme/host/nvme.ko 2024-01-15T11:19:09.013 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/parport/ 2024-01-15T11:19:09.013 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 133841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/parport/parport.ko 2024-01-15T11:19:09.013 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/parport/parport_cs.ko 2024-01-15T11:19:09.013 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 84465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/parport/parport_pc.ko 2024-01-15T11:19:09.013 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/parport/parport_serial.ko 2024-01-15T11:19:09.013 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/ 2024-01-15T11:19:09.014 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/hotplug/ 2024-01-15T11:19:09.014 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 25009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-15T11:19:09.014 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-01-15T11:19:09.014 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-01-15T11:19:09.014 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/pci-stub.ko 2024-01-15T11:19:09.014 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 46465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/xen-pcifront.ko 2024-01-15T11:19:09.014 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/ 2024-01-15T11:19:09.014 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/i82092.ko 2024-01-15T11:19:09.014 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 145809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/pcmcia.ko 2024-01-15T11:19:09.014 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 62137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/pcmcia_core.ko 2024-01-15T11:19:09.014 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 34345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-01-15T11:19:09.014 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 34265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/pd6729.ko 2024-01-15T11:19:09.014 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 112889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-15T11:19:09.015 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/phy/ 2024-01-15T11:19:09.015 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/phy/broadcom/ 2024-01-15T11:19:09.015 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-01-15T11:19:09.015 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/phy/samsung/ 2024-01-15T11:19:09.015 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-01-15T11:19:09.015 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pinctrl/ 2024-01-15T11:19:09.015 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pinctrl/intel/ 2024-01-15T11:19:09.015 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 70153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-15T11:19:09.015 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/ 2024-01-15T11:19:09.015 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/ 2024-01-15T11:19:09.015 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 50889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-01-15T11:19:09.015 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros_ec.ko 2024-01-15T11:19:09.015 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-01-15T11:19:09.016 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 25417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-01-15T11:19:09.016 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-01-15T11:19:09.016 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-01-15T11:19:09.016 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-01-15T11:19:09.016 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/ 2024-01-15T11:19:09.016 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 67097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-15T11:19:09.016 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 39145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/acerhdf.ko 2024-01-15T11:19:09.016 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 37025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-15T11:19:09.016 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 59665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-15T11:19:09.016 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 31161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-15T11:19:09.016 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 127441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-15T11:19:09.016 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 36849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-15T11:19:09.016 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 49121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-15T11:19:09.017 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-15T11:19:09.017 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 40265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-15T11:19:09.017 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-15T11:19:09.017 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 36593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/hdaps.ko 2024-01-15T11:19:09.017 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/ibm_rtl.ko 2024-01-15T11:19:09.017 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/intel/ 2024-01-15T11:19:09.017 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-15T11:19:09.017 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-01-15T11:19:09.017 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 43497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/intel_ips.ko 2024-01-15T11:19:09.018 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-15T11:19:09.018 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-15T11:19:09.018 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 34801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-15T11:19:09.018 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 42329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-15T11:19:09.018 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-15T11:19:09.018 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-15T11:19:09.018 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-15T11:19:09.018 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-15T11:19:09.018 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-15T11:19:09.019 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 57569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/wmi.ko 2024-01-15T11:19:09.019 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/ 2024-01-15T11:19:09.019 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/ 2024-01-15T11:19:09.019 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 30281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/88pm860x_battery.ko 2024-01-15T11:19:09.019 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 33985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/88pm860x_charger.ko 2024-01-15T11:19:09.019 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 55057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/bq2415x_charger.ko 2024-01-15T11:19:09.019 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 54081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/bq24190_charger.ko 2024-01-15T11:19:09.019 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/bq24735-charger.ko 2024-01-15T11:19:09.019 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-01-15T11:19:09.019 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/da9030_battery.ko 2024-01-15T11:19:09.019 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/da9052-battery.ko 2024-01-15T11:19:09.019 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 29281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/ds2760_battery.ko 2024-01-15T11:19:09.020 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/ds2780_battery.ko 2024-01-15T11:19:09.020 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/ds2781_battery.ko 2024-01-15T11:19:09.020 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/ds2782_battery.ko 2024-01-15T11:19:09.020 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/gpio-charger.ko 2024-01-15T11:19:09.020 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/isp1704_charger.ko 2024-01-15T11:19:09.020 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/lp8727_charger.ko 2024-01-15T11:19:09.020 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/max14577_charger.ko 2024-01-15T11:19:09.020 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 25897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/max17040_battery.ko 2024-01-15T11:19:09.020 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 30289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/max17042_battery.ko 2024-01-15T11:19:09.020 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/max8903_charger.ko 2024-01-15T11:19:09.020 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/max8925_power.ko 2024-01-15T11:19:09.020 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/pcf50633-charger.ko 2024-01-15T11:19:09.020 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 38009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/sbs-battery.ko 2024-01-15T11:19:09.021 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/test_power.ko 2024-01-15T11:19:09.021 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/tps65090-charger.ko 2024-01-15T11:19:09.021 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/wm831x_backup.ko 2024-01-15T11:19:09.021 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/wm831x_power.ko 2024-01-15T11:19:09.021 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/wm8350_power.ko 2024-01-15T11:19:09.021 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/powercap/ 2024-01-15T11:19:09.021 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 57729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-15T11:19:09.021 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-15T11:19:09.021 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pps/ 2024-01-15T11:19:09.021 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pps/clients/ 2024-01-15T11:19:09.021 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-15T11:19:09.021 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-15T11:19:09.022 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pps/clients/pps_parport.ko 2024-01-15T11:19:09.022 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 41873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pps/pps_core.ko 2024-01-15T11:19:09.022 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ptp/ 2024-01-15T11:19:09.022 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 66385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ptp/ptp.ko 2024-01-15T11:19:09.022 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ptp/ptp_kvm.ko 2024-01-15T11:19:09.022 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/ 2024-01-15T11:19:09.022 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-88pm80x.ko 2024-01-15T11:19:09.022 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-88pm860x.ko 2024-01-15T11:19:09.022 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-15T11:19:09.022 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-da9052.ko 2024-01-15T11:19:09.022 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-da9055.ko 2024-01-15T11:19:09.022 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-da9063.ko 2024-01-15T11:19:09.022 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-15T11:19:09.022 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 68577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-15T11:19:09.023 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-15T11:19:09.023 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-15T11:19:09.023 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-15T11:19:09.023 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-15T11:19:09.023 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-15T11:19:09.023 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-15T11:19:09.023 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-15T11:19:09.023 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-em3027.ko 2024-01-15T11:19:09.023 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-15T11:19:09.023 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-15T11:19:09.023 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 35969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-15T11:19:09.023 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-lp8788.ko 2024-01-15T11:19:09.023 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 38097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-15T11:19:09.024 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-15T11:19:09.024 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 25945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-15T11:19:09.024 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-m48t86.ko 2024-01-15T11:19:09.024 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-max6900.ko 2024-01-15T11:19:09.024 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-max8907.ko 2024-01-15T11:19:09.024 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-max8925.ko 2024-01-15T11:19:09.024 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 25809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-max8997.ko 2024-01-15T11:19:09.024 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-max8998.ko 2024-01-15T11:19:09.024 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-01-15T11:19:09.024 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-15T11:19:09.024 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-palmas.ko 2024-01-15T11:19:09.024 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 46633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-15T11:19:09.024 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-pcf50633.ko 2024-01-15T11:19:09.024 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-15T11:19:09.025 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-15T11:19:09.025 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 29817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-15T11:19:09.025 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-15T11:19:09.025 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-rc5t583.ko 2024-01-15T11:19:09.025 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-15T11:19:09.025 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 33753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-15T11:19:09.025 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 27833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-15T11:19:09.025 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 25257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-15T11:19:09.025 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-15T11:19:09.025 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-s35390a.ko 2024-01-15T11:19:09.025 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-15T11:19:09.025 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-tps6586x.ko 2024-01-15T11:19:09.025 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-tps65910.ko 2024-01-15T11:19:09.025 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-wm831x.ko 2024-01-15T11:19:09.026 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-wm8350.ko 2024-01-15T11:19:09.026 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 27873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-x1205.ko 2024-01-15T11:19:09.026 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/ 2024-01-15T11:19:09.026 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 77617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/3w-9xxx.ko 2024-01-15T11:19:09.026 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 57665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/3w-sas.ko 2024-01-15T11:19:09.026 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 55105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/3w-xxxx.ko 2024-01-15T11:19:09.026 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 135185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/BusLogic.ko 2024-01-15T11:19:09.026 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/a100u2w.ko 2024-01-15T11:19:09.026 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aacraid/ 2024-01-15T11:19:09.026 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 272305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-15T11:19:09.026 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 100617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/advansys.ko 2024-01-15T11:19:09.026 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aic7xxx/ 2024-01-15T11:19:09.026 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 356201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-15T11:19:09.027 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 295801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-15T11:19:09.027 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aic94xx/ 2024-01-15T11:19:09.027 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 189185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-01-15T11:19:09.027 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/am53c974.ko 2024-01-15T11:19:09.027 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/arcmsr/ 2024-01-15T11:19:09.027 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 106881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-15T11:19:09.027 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 38185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/atp870u.ko 2024-01-15T11:19:09.027 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/be2iscsi/ 2024-01-15T11:19:09.027 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 246985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-15T11:19:09.027 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/bfa/ 2024-01-15T11:19:09.027 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 1171945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/bfa/bfa.ko 2024-01-15T11:19:09.028 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/bnx2fc/ 2024-01-15T11:19:09.028 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 237273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-15T11:19:09.028 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/bnx2i/ 2024-01-15T11:19:09.028 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 115369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-15T11:19:09.028 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 40585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/ch.ko 2024-01-15T11:19:09.028 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/csiostor/ 2024-01-15T11:19:09.028 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 308921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-15T11:19:09.028 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/cxgbi/ 2024-01-15T11:19:09.028 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-01-15T11:19:09.028 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 76145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-15T11:19:09.028 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-01-15T11:19:09.028 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 101449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-15T11:19:09.029 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 146689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-15T11:19:09.029 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 75553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/dc395x.ko 2024-01-15T11:19:09.029 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 38073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/dmx3191d.ko 2024-01-15T11:19:09.029 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/esas2r/ 2024-01-15T11:19:09.029 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 212425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-15T11:19:09.029 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 60505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/esp_scsi.ko 2024-01-15T11:19:09.029 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/fcoe/ 2024-01-15T11:19:09.029 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 78209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-15T11:19:09.029 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 158505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-15T11:19:09.029 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/fdomain.ko 2024-01-15T11:19:09.029 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/fnic/ 2024-01-15T11:19:09.029 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 263489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/fnic/fnic.ko 2024-01-15T11:19:09.029 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 201817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/hpsa.ko 2024-01-15T11:19:09.030 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 51209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/hptiop.ko 2024-01-15T11:19:09.030 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 49041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/hv_storvsc.ko 2024-01-15T11:19:09.030 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 35337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/imm.ko 2024-01-15T11:19:09.030 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 44057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/initio.ko 2024-01-15T11:19:09.030 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 266537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/ipr.ko 2024-01-15T11:19:09.030 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 101881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/ips.ko 2024-01-15T11:19:09.030 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/isci/ 2024-01-15T11:19:09.030 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 317153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/isci/isci.ko 2024-01-15T11:19:09.030 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-15T11:19:09.030 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 52961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-15T11:19:09.030 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/libfc/ 2024-01-15T11:19:09.030 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 314865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/libfc/libfc.ko 2024-01-15T11:19:09.030 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 145585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/libiscsi.ko 2024-01-15T11:19:09.030 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 53521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-15T11:19:09.031 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/libsas/ 2024-01-15T11:19:09.031 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 216665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/libsas/libsas.ko 2024-01-15T11:19:09.031 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/lpfc/ 2024-01-15T11:19:09.031 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 2197249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-15T11:19:09.031 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/megaraid/ 2024-01-15T11:19:09.031 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 73569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-15T11:19:09.031 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 33529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-15T11:19:09.031 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 310617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-15T11:19:09.031 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 84721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/megaraid.ko 2024-01-15T11:19:09.031 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/mpt3sas/ 2024-01-15T11:19:09.031 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 659825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-15T11:19:09.031 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/mvsas/ 2024-01-15T11:19:09.031 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 119561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-15T11:19:09.031 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 78129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/mvumi.ko 2024-01-15T11:19:09.032 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pcmcia/ 2024-01-15T11:19:09.032 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 81625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-01-15T11:19:09.032 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-01-15T11:19:09.032 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-01-15T11:19:09.032 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-01-15T11:19:09.032 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pm8001/ 2024-01-15T11:19:09.032 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 364105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-15T11:19:09.032 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 123617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pmcraid.ko 2024-01-15T11:19:09.032 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 34513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/ppa.ko 2024-01-15T11:19:09.032 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 55361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qla1280.ko 2024-01-15T11:19:09.032 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qla2xxx/ 2024-01-15T11:19:09.032 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 1876689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-15T11:19:09.032 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 85289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-15T11:19:09.032 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qla4xxx/ 2024-01-15T11:19:09.033 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 559033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-15T11:19:09.033 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qlogicfas408.ko 2024-01-15T11:19:09.033 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/raid_class.ko 2024-01-15T11:19:09.033 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 238761 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/scsi_debug.ko 2024-01-15T11:19:09.033 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 173937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-15T11:19:09.033 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 279313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-15T11:19:09.033 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 97729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-15T11:19:09.033 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 73881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-15T11:19:09.033 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 44993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-15T11:19:09.033 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/ses.ko 2024-01-15T11:19:09.033 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 115889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/st.ko 2024-01-15T11:19:09.033 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 46825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/stex.ko 2024-01-15T11:19:09.033 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/sym53c8xx_2/ 2024-01-15T11:19:09.033 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 162121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-15T11:19:09.034 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 42297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/virtio_scsi.ko 2024-01-15T11:19:09.034 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 50321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-15T11:19:09.034 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 39961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/wd719x.ko 2024-01-15T11:19:09.034 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 50025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/xen-scsifront.ko 2024-01-15T11:19:09.034 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ssb/ 2024-01-15T11:19:09.034 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 129441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ssb/ssb.ko 2024-01-15T11:19:09.034 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/ 2024-01-15T11:19:09.034 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/iscsi/ 2024-01-15T11:19:09.034 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 736601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-15T11:19:09.034 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/loopback/ 2024-01-15T11:19:09.034 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 49985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-15T11:19:09.034 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 39713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/target_core_file.ko 2024-01-15T11:19:09.034 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 43025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/target_core_iblock.ko 2024-01-15T11:19:09.035 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 930257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/target_core_mod.ko 2024-01-15T11:19:09.035 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 44305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/target_core_pscsi.ko 2024-01-15T11:19:09.035 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 122521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/target_core_user.ko 2024-01-15T11:19:09.035 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/tcm_fc/ 2024-01-15T11:19:09.035 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 75593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-15T11:19:09.035 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/ 2024-01-15T11:19:09.035 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/ 2024-01-15T11:19:09.035 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/ 2024-01-15T11:19:09.035 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-15T11:19:09.035 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 29321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-15T11:19:09.035 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-15T11:19:09.035 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-15T11:19:09.035 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-15T11:19:09.036 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-15T11:19:09.036 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-15T11:19:09.036 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-15T11:19:09.036 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-15T11:19:09.036 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-15T11:19:09.036 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-15T11:19:09.036 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 37065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-15T11:19:09.036 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 30729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-01-15T11:19:09.036 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-15T11:19:09.036 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-15T11:19:09.036 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-15T11:19:09.036 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/ 2024-01-15T11:19:09.036 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/ipwireless/ 2024-01-15T11:19:09.036 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 78425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-15T11:19:09.037 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 57865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/moxa.ko 2024-01-15T11:19:09.037 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 50953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/mxser.ko 2024-01-15T11:19:09.037 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 108601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/n_gsm.ko 2024-01-15T11:19:09.037 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 31961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/n_hdlc.ko 2024-01-15T11:19:09.037 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 67929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/nozomi.ko 2024-01-15T11:19:09.037 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/ 2024-01-15T11:19:09.037 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/8250/ 2024-01-15T11:19:09.037 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 35753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-01-15T11:19:09.037 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 59497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-15T11:19:09.037 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-01-15T11:19:09.037 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/altera_uart.ko 2024-01-15T11:19:09.037 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/arc_uart.ko 2024-01-15T11:19:09.037 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 72425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-01-15T11:19:09.038 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/jsm/ 2024-01-15T11:19:09.038 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 103073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-15T11:19:09.038 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/rp2.ko 2024-01-15T11:19:09.038 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 52817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/sc16is7xx.ko 2024-01-15T11:19:09.038 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ufs/ 2024-01-15T11:19:09.038 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ufs/core/ 2024-01-15T11:19:09.038 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 531265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-15T11:19:09.038 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ufs/host/ 2024-01-15T11:19:09.038 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-15T11:19:09.038 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-01-15T11:19:09.038 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/ 2024-01-15T11:19:09.038 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 44513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio.ko 2024-01-15T11:19:09.038 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_aec.ko 2024-01-15T11:19:09.038 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_cif.ko 2024-01-15T11:19:09.039 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_dmem_genirq.ko 2024-01-15T11:19:09.039 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_mf624.ko 2024-01-15T11:19:09.039 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_netx.ko 2024-01-15T11:19:09.039 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_pci_generic.ko 2024-01-15T11:19:09.039 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-01-15T11:19:09.039 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_sercos3.ko 2024-01-15T11:19:09.039 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/ 2024-01-15T11:19:09.039 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/c67x00/ 2024-01-15T11:19:09.039 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 73297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/c67x00/c67x00.ko 2024-01-15T11:19:09.039 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/chipidea/ 2024-01-15T11:19:09.039 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 144377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-01-15T11:19:09.039 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-01-15T11:19:09.039 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-01-15T11:19:09.039 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-01-15T11:19:09.040 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/class/ 2024-01-15T11:19:09.040 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 87089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/class/cdc-acm.ko 2024-01-15T11:19:09.040 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 51345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-15T11:19:09.040 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 47305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/class/usblp.ko 2024-01-15T11:19:09.040 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 89857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/class/usbtmc.ko 2024-01-15T11:19:09.040 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/common/ 2024-01-15T11:19:09.040 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/common/ulpi.ko 2024-01-15T11:19:09.040 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/dwc2/ 2024-01-15T11:19:09.040 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-01-15T11:19:09.040 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/dwc3/ 2024-01-15T11:19:09.040 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-01-15T11:19:09.040 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 30041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-01-15T11:19:09.040 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 448505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/dwc3/dwc3.ko 2024-01-15T11:19:09.041 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/ 2024-01-15T11:19:09.041 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/ 2024-01-15T11:19:09.041 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 60177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/u_ether.ko 2024-01-15T11:19:09.041 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 51881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/u_serial.ko 2024-01-15T11:19:09.041 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-01-15T11:19:09.041 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 42449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-01-15T11:19:09.041 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 27953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-01-15T11:19:09.041 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 36513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-01-15T11:19:09.041 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 92489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-01-15T11:19:09.041 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 51049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-01-15T11:19:09.041 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 122081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-01-15T11:19:09.041 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 57681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-01-15T11:19:09.041 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-01-15T11:19:09.041 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 31265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-01-15T11:19:09.041 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 57729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-01-15T11:19:09.042 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 85609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-01-15T11:19:09.042 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-01-15T11:19:09.042 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 58113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-01-15T11:19:09.042 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 67337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-01-15T11:19:09.042 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/ 2024-01-15T11:19:09.042 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-01-15T11:19:09.042 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-01-15T11:19:09.042 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-01-15T11:19:09.042 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-01-15T11:19:09.042 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-01-15T11:19:09.042 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-01-15T11:19:09.042 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-01-15T11:19:09.043 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-01-15T11:19:09.043 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 32073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-01-15T11:19:09.043 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-01-15T11:19:09.043 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-01-15T11:19:09.043 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 27201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-01-15T11:19:09.043 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 62185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-01-15T11:19:09.043 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-01-15T11:19:09.043 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 161225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/libcomposite.ko 2024-01-15T11:19:09.043 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/ 2024-01-15T11:19:09.043 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-01-15T11:19:09.044 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/bdc/ 2024-01-15T11:19:09.044 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 157681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-01-15T11:19:09.044 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 36089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-01-15T11:19:09.044 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 52721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-01-15T11:19:09.044 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 69705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-01-15T11:19:09.044 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 56033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-01-15T11:19:09.044 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 76057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/net2272.ko 2024-01-15T11:19:09.044 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 75073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/net2280.ko 2024-01-15T11:19:09.044 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 73169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-01-15T11:19:09.044 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 65809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-01-15T11:19:09.044 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 66097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-01-15T11:19:09.044 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 81505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-01-15T11:19:09.045 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 156073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-01-15T11:19:09.045 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/ 2024-01-15T11:19:09.045 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/bcma-hcd.ko 2024-01-15T11:19:09.045 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 80113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/isp116x-hcd.ko 2024-01-15T11:19:09.045 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 87353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-01-15T11:19:09.045 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 78873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-01-15T11:19:09.045 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 51329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-15T11:19:09.045 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/sl811_cs.ko 2024-01-15T11:19:09.045 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/ssb-hcd.ko 2024-01-15T11:19:09.045 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 25945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-01-15T11:19:09.045 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/image/ 2024-01-15T11:19:09.045 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 34585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/image/mdc800.ko 2024-01-15T11:19:09.045 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/image/microtek.ko 2024-01-15T11:19:09.045 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/ 2024-01-15T11:19:09.046 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 41721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/adutux.ko 2024-01-15T11:19:09.046 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/appledisplay.ko 2024-01-15T11:19:09.046 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-01-15T11:19:09.046 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/cytherm.ko 2024-01-15T11:19:09.046 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/ehset.ko 2024-01-15T11:19:09.046 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/emi26.ko 2024-01-15T11:19:09.046 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/emi62.ko 2024-01-15T11:19:09.046 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/ezusb.ko 2024-01-15T11:19:09.046 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/idmouse.ko 2024-01-15T11:19:09.046 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 36553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/iowarrior.ko 2024-01-15T11:19:09.046 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-15T11:19:09.046 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 36529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/ldusb.ko 2024-01-15T11:19:09.046 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 36265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/legousbtower.ko 2024-01-15T11:19:09.046 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 27793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/lvstest.ko 2024-01-15T11:19:09.046 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/sisusbvga/ 2024-01-15T11:19:09.047 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 64841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-15T11:19:09.047 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-15T11:19:09.047 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/usb3503.ko 2024-01-15T11:19:09.047 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 25145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/usblcd.ko 2024-01-15T11:19:09.047 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-15T11:19:09.047 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 70809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/usbtest.ko 2024-01-15T11:19:09.047 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 41905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/uss720.ko 2024-01-15T11:19:09.047 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 27617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/yurex.ko 2024-01-15T11:19:09.047 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/mon/ 2024-01-15T11:19:09.047 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 72953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/mon/usbmon.ko 2024-01-15T11:19:09.047 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/musb/ 2024-01-15T11:19:09.047 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 301697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/musb/musb_hdrc.ko 2024-01-15T11:19:09.048 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/phy/ 2024-01-15T11:19:09.048 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/phy/phy-generic.ko 2024-01-15T11:19:09.048 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-01-15T11:19:09.048 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/phy/phy-isp1301.ko 2024-01-15T11:19:09.048 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/phy/phy-tahvo.ko 2024-01-15T11:19:09.048 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ 2024-01-15T11:19:09.048 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/aircable.ko 2024-01-15T11:19:09.048 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 33329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ark3116.ko 2024-01-15T11:19:09.048 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-15T11:19:09.048 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 38105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ch341.ko 2024-01-15T11:19:09.048 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 70257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/cp210x.ko 2024-01-15T11:19:09.049 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 31057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/cyberjack.ko 2024-01-15T11:19:09.049 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 58217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-15T11:19:09.049 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 49817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-15T11:19:09.049 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/empeg.ko 2024-01-15T11:19:09.049 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 44273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/f81232.ko 2024-01-15T11:19:09.049 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 175137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-15T11:19:09.049 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 53113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-15T11:19:09.049 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 137081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-15T11:19:09.049 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 124833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/io_ti.ko 2024-01-15T11:19:09.049 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 67769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ipaq.ko 2024-01-15T11:19:09.049 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ipw.ko 2024-01-15T11:19:09.050 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ir-usb.ko 2024-01-15T11:19:09.050 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 58233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-15T11:19:09.050 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 107521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/keyspan.ko 2024-01-15T11:19:09.050 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 35617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-15T11:19:09.050 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 25665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-15T11:19:09.050 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 33689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-15T11:19:09.050 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 32953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/mct_u232.ko 2024-01-15T11:19:09.050 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/metro-usb.ko 2024-01-15T11:19:09.050 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 66449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/mos7720.ko 2024-01-15T11:19:09.050 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 78217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/mos7840.ko 2024-01-15T11:19:09.050 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 56337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/mxuport.ko 2024-01-15T11:19:09.050 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/navman.ko 2024-01-15T11:19:09.051 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/omninet.ko 2024-01-15T11:19:09.051 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/opticon.ko 2024-01-15T11:19:09.051 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 191137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/option.ko 2024-01-15T11:19:09.051 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 39073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/oti6858.ko 2024-01-15T11:19:09.051 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 54353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/pl2303.ko 2024-01-15T11:19:09.051 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/qcaux.ko 2024-01-15T11:19:09.051 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 37825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/qcserial.ko 2024-01-15T11:19:09.051 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 34321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/quatech2.ko 2024-01-15T11:19:09.051 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/safe_serial.ko 2024-01-15T11:19:09.051 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 51625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/sierra.ko 2024-01-15T11:19:09.051 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-15T11:19:09.051 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 29993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ssu100.ko 2024-01-15T11:19:09.051 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/symbolserial.ko 2024-01-15T11:19:09.051 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 61489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-15T11:19:09.052 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-15T11:19:09.052 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/usb_debug.ko 2024-01-15T11:19:09.052 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 33201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-15T11:19:09.052 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 125609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/usbserial.ko 2024-01-15T11:19:09.052 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/visor.ko 2024-01-15T11:19:09.052 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 37409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/whiteheat.ko 2024-01-15T11:19:09.052 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/wishbone-serial.ko 2024-01-15T11:19:09.052 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-15T11:19:09.052 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ 2024-01-15T11:19:09.052 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 52913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/uas.ko 2024-01-15T11:19:09.052 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-15T11:19:09.053 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-15T11:19:09.053 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-15T11:19:09.053 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 33497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-15T11:19:09.053 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-15T11:19:09.053 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-15T11:19:09.053 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-15T11:19:09.053 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-karma.ko 2024-01-15T11:19:09.053 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-15T11:19:09.053 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-15T11:19:09.053 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-15T11:19:09.053 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-15T11:19:09.054 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 35337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-15T11:19:09.054 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 179969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/usb-storage.ko 2024-01-15T11:19:09.054 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/usbip/ 2024-01-15T11:19:09.054 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 67481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-15T11:19:09.054 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 72177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-15T11:19:09.054 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 107001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-15T11:19:09.054 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vfio/ 2024-01-15T11:19:09.054 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vfio/pci/ 2024-01-15T11:19:09.054 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 154297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-15T11:19:09.054 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 29537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-15T11:19:09.054 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 108737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vfio/vfio.ko 2024-01-15T11:19:09.054 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 77609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-15T11:19:09.054 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vhost/ 2024-01-15T11:19:09.054 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 113785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vhost/vhost.ko 2024-01-15T11:19:09.055 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-15T11:19:09.055 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 58089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vhost/vhost_net.ko 2024-01-15T11:19:09.055 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 89249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vhost/vhost_scsi.ko 2024-01-15T11:19:09.055 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/ 2024-01-15T11:19:09.055 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/ 2024-01-15T11:19:09.055 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-01-15T11:19:09.055 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/aat2870_bl.ko 2024-01-15T11:19:09.055 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/adp5520_bl.ko 2024-01-15T11:19:09.055 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 32609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/adp8860_bl.ko 2024-01-15T11:19:09.055 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 39993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/adp8870_bl.ko 2024-01-15T11:19:09.055 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/apple_bl.ko 2024-01-15T11:19:09.055 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/as3711_bl.ko 2024-01-15T11:19:09.056 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/bd6107.ko 2024-01-15T11:19:09.056 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/da903x_bl.ko 2024-01-15T11:19:09.056 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/da9052_bl.ko 2024-01-15T11:19:09.056 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/gpio_backlight.ko 2024-01-15T11:19:09.056 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/kb3886_bl.ko 2024-01-15T11:19:09.056 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/lcd.ko 2024-01-15T11:19:09.056 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/lm3533_bl.ko 2024-01-15T11:19:09.056 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/lm3639_bl.ko 2024-01-15T11:19:09.056 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/lv5207lp.ko 2024-01-15T11:19:09.056 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/max8925_bl.ko 2024-01-15T11:19:09.056 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/pandora_bl.ko 2024-01-15T11:19:09.057 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-01-15T11:19:09.057 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-15T11:19:09.057 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/wm831x_bl.ko 2024-01-15T11:19:09.057 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/ 2024-01-15T11:19:09.057 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/masters/ 2024-01-15T11:19:09.057 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/masters/ds2482.ko 2024-01-15T11:19:09.057 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 38985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/masters/ds2490.ko 2024-01-15T11:19:09.057 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/masters/matrox_w1.ko 2024-01-15T11:19:09.057 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/masters/w1-gpio.ko 2024-01-15T11:19:09.057 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/ 2024-01-15T11:19:09.057 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-15T11:19:09.058 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-15T11:19:09.058 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-15T11:19:09.058 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-15T11:19:09.058 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-15T11:19:09.058 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-15T11:19:09.058 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-15T11:19:09.058 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-15T11:19:09.058 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-15T11:19:09.058 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-15T11:19:09.059 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 56425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-15T11:19:09.059 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 102673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/wire.ko 2024-01-15T11:19:09.059 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/ 2024-01-15T11:19:09.059 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/acquirewdt.ko 2024-01-15T11:19:09.059 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/advantechwdt.ko 2024-01-15T11:19:09.059 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-15T11:19:09.059 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-15T11:19:09.059 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/cpu5wdt.ko 2024-01-15T11:19:09.059 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/da9052_wdt.ko 2024-01-15T11:19:09.060 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/da9055_wdt.ko 2024-01-15T11:19:09.060 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/da9063_wdt.ko 2024-01-15T11:19:09.060 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/dw_wdt.ko 2024-01-15T11:19:09.060 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/eurotechwdt.ko 2024-01-15T11:19:09.060 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-15T11:19:09.060 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 27401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/hpwdt.ko 2024-01-15T11:19:09.060 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/i6300esb.ko 2024-01-15T11:19:09.060 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-15T11:19:09.061 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-15T11:19:09.061 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/ib700wdt.ko 2024-01-15T11:19:09.061 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/ibmasr.ko 2024-01-15T11:19:09.061 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-15T11:19:09.061 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-15T11:19:09.061 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/it87_wdt.ko 2024-01-15T11:19:09.061 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/kempld_wdt.ko 2024-01-15T11:19:09.061 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/machzwd.ko 2024-01-15T11:19:09.061 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/mena21_wdt.ko 2024-01-15T11:19:09.061 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-01-15T11:19:09.061 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/nv_tco.ko 2024-01-15T11:19:09.061 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-01-15T11:19:09.062 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/pc87413_wdt.ko 2024-01-15T11:19:09.062 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 38657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-15T11:19:09.062 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 31825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-15T11:19:09.062 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/retu_wdt.ko 2024-01-15T11:19:09.062 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-01-15T11:19:09.062 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-01-15T11:19:09.062 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-15T11:19:09.062 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/sc1200wdt.ko 2024-01-15T11:19:09.062 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-15T11:19:09.062 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-01-15T11:19:09.062 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/softdog.ko 2024-01-15T11:19:09.062 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-15T11:19:09.062 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/twl4030_wdt.ko 2024-01-15T11:19:09.062 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/via_wdt.ko 2024-01-15T11:19:09.063 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-15T11:19:09.063 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-15T11:19:09.063 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 25409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-15T11:19:09.063 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/wafer5823wdt.ko 2024-01-15T11:19:09.063 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/wdt_pci.ko 2024-01-15T11:19:09.063 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/wm831x_wdt.ko 2024-01-15T11:19:09.063 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/wm8350_wdt.ko 2024-01-15T11:19:09.063 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/xen_wdt.ko 2024-01-15T11:19:09.063 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/ 2024-01-15T11:19:09.063 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-evtchn.ko 2024-01-15T11:19:09.063 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-gntalloc.ko 2024-01-15T11:19:09.063 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 47865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-gntdev.ko 2024-01-15T11:19:09.063 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-pciback/ 2024-01-15T11:19:09.064 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 176377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-15T11:19:09.064 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 40121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-privcmd.ko 2024-01-15T11:19:09.064 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 71249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-scsiback.ko 2024-01-15T11:19:09.064 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xenfs/ 2024-01-15T11:19:09.064 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-15T11:19:09.064 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ 2024-01-15T11:19:09.064 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/9p/ 2024-01-15T11:19:09.064 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 166425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/9p/9p.ko 2024-01-15T11:19:09.064 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/adfs/ 2024-01-15T11:19:09.064 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 61073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/adfs/adfs.ko 2024-01-15T11:19:09.064 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/affs/ 2024-01-15T11:19:09.064 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 163593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/affs/affs.ko 2024-01-15T11:19:09.064 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/afs/ 2024-01-15T11:19:09.065 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 932817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/afs/kafs.ko 2024-01-15T11:19:09.065 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/autofs/ 2024-01-15T11:19:09.065 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 101057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/autofs/autofs4.ko 2024-01-15T11:19:09.065 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/befs/ 2024-01-15T11:19:09.065 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 64545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/befs/befs.ko 2024-01-15T11:19:09.065 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/bfs/ 2024-01-15T11:19:09.065 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 41257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/bfs/bfs.ko 2024-01-15T11:19:09.065 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 34585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/binfmt_misc.ko 2024-01-15T11:19:09.065 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/btrfs/ 2024-01-15T11:19:09.065 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 3402729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/btrfs/btrfs.ko 2024-01-15T11:19:09.065 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/cachefiles/ 2024-01-15T11:19:09.065 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 306009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/cachefiles/cachefiles.ko 2024-01-15T11:19:09.066 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ceph/ 2024-01-15T11:19:09.066 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 1331609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ceph/ceph.ko 2024-01-15T11:19:09.066 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/coda/ 2024-01-15T11:19:09.066 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 100801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/coda/coda.ko 2024-01-15T11:19:09.066 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/configfs/ 2024-01-15T11:19:09.066 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 108393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/configfs/configfs.ko 2024-01-15T11:19:09.066 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/cramfs/ 2024-01-15T11:19:09.066 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 29625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/cramfs/cramfs.ko 2024-01-15T11:19:09.066 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/dlm/ 2024-01-15T11:19:09.066 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 642513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/dlm/dlm.ko 2024-01-15T11:19:09.066 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/efs/ 2024-01-15T11:19:09.066 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 36649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/efs/efs.ko 2024-01-15T11:19:09.066 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/f2fs/ 2024-01-15T11:19:09.067 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 1505025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/f2fs/f2fs.ko 2024-01-15T11:19:09.113 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/fat/ 2024-01-15T11:19:09.113 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 27929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/fat/msdos.ko 2024-01-15T11:19:09.113 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/freevxfs/ 2024-01-15T11:19:09.113 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 42545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/freevxfs/freevxfs.ko 2024-01-15T11:19:09.113 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/fscache/ 2024-01-15T11:19:09.113 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 226481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/fscache/fscache.ko 2024-01-15T11:19:09.113 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/fuse/ 2024-01-15T11:19:09.113 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/fuse/cuse.ko 2024-01-15T11:19:09.113 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/gfs2/ 2024-01-15T11:19:09.114 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 1231529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/gfs2/gfs2.ko 2024-01-15T11:19:09.114 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/hfs/ 2024-01-15T11:19:09.114 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 141209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/hfs/hfs.ko 2024-01-15T11:19:09.114 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/hfsplus/ 2024-01-15T11:19:09.114 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 222817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/hfsplus/hfsplus.ko 2024-01-15T11:19:09.114 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/hpfs/ 2024-01-15T11:19:09.114 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 192329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/hpfs/hpfs.ko 2024-01-15T11:19:09.114 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/isofs/ 2024-01-15T11:19:09.114 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 74065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/isofs/isofs.ko 2024-01-15T11:19:09.114 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/jfs/ 2024-01-15T11:19:09.114 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 419497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/jfs/jfs.ko 2024-01-15T11:19:09.114 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/lockd/ 2024-01-15T11:19:09.114 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 280313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/lockd/lockd.ko 2024-01-15T11:19:09.115 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/minix/ 2024-01-15T11:19:09.115 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 89193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/minix/minix.ko 2024-01-15T11:19:09.115 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/netfs/ 2024-01-15T11:19:09.115 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 124649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/netfs/netfs.ko 2024-01-15T11:19:09.115 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/ 2024-01-15T11:19:09.115 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/blocklayout/ 2024-01-15T11:19:09.115 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 81449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-15T11:19:09.115 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/filelayout/ 2024-01-15T11:19:09.115 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 59449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-15T11:19:09.115 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/flexfilelayout/ 2024-01-15T11:19:09.115 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 117465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-15T11:19:09.115 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 1055721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/nfs.ko 2024-01-15T11:19:09.115 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 66441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/nfsv2.ko 2024-01-15T11:19:09.116 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 120177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/nfsv3.ko 2024-01-15T11:19:09.116 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 2042137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/nfsv4.ko 2024-01-15T11:19:09.116 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs_common/ 2024-01-15T11:19:09.116 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs_common/grace.ko 2024-01-15T11:19:09.116 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs_common/nfs_acl.ko 2024-01-15T11:19:09.116 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfsd/ 2024-01-15T11:19:09.116 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 1516873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfsd/nfsd.ko 2024-01-15T11:19:09.116 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nilfs2/ 2024-01-15T11:19:09.116 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 592833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nilfs2/nilfs2.ko 2024-01-15T11:19:09.116 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/ 2024-01-15T11:19:09.116 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-celtic.ko 2024-01-15T11:19:09.116 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-centeuro.ko 2024-01-15T11:19:09.116 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-croatian.ko 2024-01-15T11:19:09.117 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-cyrillic.ko 2024-01-15T11:19:09.117 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-gaelic.ko 2024-01-15T11:19:09.117 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-greek.ko 2024-01-15T11:19:09.117 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-iceland.ko 2024-01-15T11:19:09.117 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-inuit.ko 2024-01-15T11:19:09.117 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-roman.ko 2024-01-15T11:19:09.117 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-romanian.ko 2024-01-15T11:19:09.117 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-turkish.ko 2024-01-15T11:19:09.117 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_ascii.ko 2024-01-15T11:19:09.117 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp1250.ko 2024-01-15T11:19:09.117 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp1251.ko 2024-01-15T11:19:09.117 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp1255.ko 2024-01-15T11:19:09.117 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp737.ko 2024-01-15T11:19:09.118 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp775.ko 2024-01-15T11:19:09.118 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp850.ko 2024-01-15T11:19:09.118 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp852.ko 2024-01-15T11:19:09.118 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp855.ko 2024-01-15T11:19:09.118 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp857.ko 2024-01-15T11:19:09.118 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp860.ko 2024-01-15T11:19:09.118 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp861.ko 2024-01-15T11:19:09.118 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp862.ko 2024-01-15T11:19:09.118 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp863.ko 2024-01-15T11:19:09.118 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp864.ko 2024-01-15T11:19:09.118 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp865.ko 2024-01-15T11:19:09.118 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp866.ko 2024-01-15T11:19:09.118 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp869.ko 2024-01-15T11:19:09.119 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp874.ko 2024-01-15T11:19:09.119 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 94137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp932.ko 2024-01-15T11:19:09.119 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 142673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp936.ko 2024-01-15T11:19:09.119 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 165745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp949.ko 2024-01-15T11:19:09.119 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 118121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp950.ko 2024-01-15T11:19:09.119 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_euc-jp.ko 2024-01-15T11:19:09.119 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-1.ko 2024-01-15T11:19:09.119 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-13.ko 2024-01-15T11:19:09.119 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-14.ko 2024-01-15T11:19:09.119 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-15.ko 2024-01-15T11:19:09.119 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-2.ko 2024-01-15T11:19:09.119 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-3.ko 2024-01-15T11:19:09.120 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-4.ko 2024-01-15T11:19:09.120 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-5.ko 2024-01-15T11:19:09.120 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-6.ko 2024-01-15T11:19:09.120 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-7.ko 2024-01-15T11:19:09.120 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-9.ko 2024-01-15T11:19:09.120 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_koi8-r.ko 2024-01-15T11:19:09.120 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_koi8-ru.ko 2024-01-15T11:19:09.120 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_koi8-u.ko 2024-01-15T11:19:09.120 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-15T11:19:09.120 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_utf8.ko 2024-01-15T11:19:09.120 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ntfs/ 2024-01-15T11:19:09.120 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 219417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ntfs/ntfs.ko 2024-01-15T11:19:09.120 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/ 2024-01-15T11:19:09.121 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/cluster/ 2024-01-15T11:19:09.121 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 244409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-15T11:19:09.121 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/dlm/ 2024-01-15T11:19:09.121 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 440737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-15T11:19:09.121 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/dlmfs/ 2024-01-15T11:19:09.121 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 54049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-15T11:19:09.121 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 2592433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/ocfs2.ko 2024-01-15T11:19:09.121 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-15T11:19:09.121 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 31729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-15T11:19:09.121 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 35897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-15T11:19:09.121 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/omfs/ 2024-01-15T11:19:09.121 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 53433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/omfs/omfs.ko 2024-01-15T11:19:09.121 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/overlayfs/ 2024-01-15T11:19:09.121 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 352161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/overlayfs/overlay.ko 2024-01-15T11:19:09.122 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/pstore/ 2024-01-15T11:19:09.122 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 54809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/pstore/ramoops.ko 2024-01-15T11:19:09.122 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/qnx4/ 2024-01-15T11:19:09.122 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/qnx4/qnx4.ko 2024-01-15T11:19:09.122 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/qnx6/ 2024-01-15T11:19:09.122 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 46689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/qnx6/qnx6.ko 2024-01-15T11:19:09.122 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/quota/ 2024-01-15T11:19:09.122 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 30881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/quota/quota_tree.ko 2024-01-15T11:19:09.122 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/quota/quota_v1.ko 2024-01-15T11:19:09.122 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/quota/quota_v2.ko 2024-01-15T11:19:09.122 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/reiserfs/ 2024-01-15T11:19:09.122 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 532673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/reiserfs/reiserfs.ko 2024-01-15T11:19:09.122 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/romfs/ 2024-01-15T11:19:09.122 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/romfs/romfs.ko 2024-01-15T11:19:09.123 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/smb/ 2024-01-15T11:19:09.123 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/smb/client/ 2024-01-15T11:19:09.123 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 2668401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/smb/client/cifs.ko 2024-01-15T11:19:09.123 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/smb/common/ 2024-01-15T11:19:09.123 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/smb/common/cifs_arc4.ko 2024-01-15T11:19:09.123 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/smb/common/cifs_md4.ko 2024-01-15T11:19:09.123 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/squashfs/ 2024-01-15T11:19:09.123 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 134641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/squashfs/squashfs.ko 2024-01-15T11:19:09.123 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/sysv/ 2024-01-15T11:19:09.123 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 90721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/sysv/sysv.ko 2024-01-15T11:19:09.123 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/udf/ 2024-01-15T11:19:09.123 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 247737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/udf/udf.ko 2024-01-15T11:19:09.123 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ufs/ 2024-01-15T11:19:09.124 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 162497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ufs/ufs.ko 2024-01-15T11:19:09.124 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/xfs/ 2024-01-15T11:19:09.124 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 4011017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/xfs/xfs.ko 2024-01-15T11:19:09.124 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/kernel/ 2024-01-15T11:19:09.124 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/kernel/locking/ 2024-01-15T11:19:09.124 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 75489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/kernel/locking/locktorture.ko 2024-01-15T11:19:09.124 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/kernel/time/ 2024-01-15T11:19:09.124 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/kernel/time/test_udelay.ko 2024-01-15T11:19:09.124 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 60553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/kernel/torture.ko 2024-01-15T11:19:09.124 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/ 2024-01-15T11:19:09.124 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 6833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/crc-itu-t.ko 2024-01-15T11:19:09.124 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 6529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/crc7.ko 2024-01-15T11:19:09.124 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/crc8.ko 2024-01-15T11:19:09.125 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/crypto/ 2024-01-15T11:19:09.125 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/crypto/libarc4.ko 2024-01-15T11:19:09.125 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 37081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/crypto/libdes.ko 2024-01-15T11:19:09.125 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/interval_tree_test.ko 2024-01-15T11:19:09.125 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/libcrc32c.ko 2024-01-15T11:19:09.125 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/lru_cache.ko 2024-01-15T11:19:09.125 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/lz4/ 2024-01-15T11:19:09.125 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 33801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/lz4/lz4_compress.ko 2024-01-15T11:19:09.125 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/lz4/lz4hc_compress.ko 2024-01-15T11:19:09.125 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/math/ 2024-01-15T11:19:09.125 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 6617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/math/cordic.ko 2024-01-15T11:19:09.125 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/memory-notifier-error-inject.ko 2024-01-15T11:19:09.125 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/notifier-error-inject.ko 2024-01-15T11:19:09.125 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/percpu_test.ko 2024-01-15T11:19:09.126 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/pm-notifier-error-inject.ko 2024-01-15T11:19:09.126 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/raid6/ 2024-01-15T11:19:09.126 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 143433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/raid6/raid6_pq.ko 2024-01-15T11:19:09.126 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/rbtree_test.ko 2024-01-15T11:19:09.126 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/reed_solomon/ 2024-01-15T11:19:09.126 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-15T11:19:09.126 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 38841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/test-kstrtox.ko 2024-01-15T11:19:09.126 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/test-string_helpers.ko 2024-01-15T11:19:09.126 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 4760425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/test_bpf.ko 2024-01-15T11:19:09.126 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 49089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/test_firmware.ko 2024-01-15T11:19:09.126 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 6369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/test_module.ko 2024-01-15T11:19:09.126 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/test_user_copy.ko 2024-01-15T11:19:09.126 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/ts_bm.ko 2024-01-15T11:19:09.126 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/ts_fsm.ko 2024-01-15T11:19:09.126 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/ts_kmp.ko 2024-01-15T11:19:09.127 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/xz/ 2024-01-15T11:19:09.127 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/xz/xz_dec_test.ko 2024-01-15T11:19:09.127 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/mm/ 2024-01-15T11:19:09.127 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/mm/hwpoison-inject.ko 2024-01-15T11:19:09.127 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ 2024-01-15T11:19:09.127 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/ 2024-01-15T11:19:09.127 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 55737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/6lowpan.ko 2024-01-15T11:19:09.127 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_dest.ko 2024-01-15T11:19:09.127 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_fragment.ko 2024-01-15T11:19:09.127 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_hop.ko 2024-01-15T11:19:09.127 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 6985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-15T11:19:09.127 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_mobility.ko 2024-01-15T11:19:09.127 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_routing.ko 2024-01-15T11:19:09.127 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_udp.ko 2024-01-15T11:19:09.128 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/802/ 2024-01-15T11:19:09.128 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 30385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/802/garp.ko 2024-01-15T11:19:09.128 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 34809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/802/mrp.ko 2024-01-15T11:19:09.128 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/802/p8022.ko 2024-01-15T11:19:09.128 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/802/psnap.ko 2024-01-15T11:19:09.128 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/802/stp.ko 2024-01-15T11:19:09.128 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/8021q/ 2024-01-15T11:19:09.128 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 81737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/8021q/8021q.ko 2024-01-15T11:19:09.128 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/9p/ 2024-01-15T11:19:09.128 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 198337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/9p/9pnet.ko 2024-01-15T11:19:09.128 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 35977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/9p/9pnet_fd.ko 2024-01-15T11:19:09.128 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/9p/9pnet_rdma.ko 2024-01-15T11:19:09.128 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 32337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/9p/9pnet_virtio.ko 2024-01-15T11:19:09.129 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/batman-adv/ 2024-01-15T11:19:09.129 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 649297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/batman-adv/batman-adv.ko 2024-01-15T11:19:09.129 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/ 2024-01-15T11:19:09.129 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 63809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/br_netfilter.ko 2024-01-15T11:19:09.129 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 777689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/bridge.ko 2024-01-15T11:19:09.129 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ 2024-01-15T11:19:09.129 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-15T11:19:09.129 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-15T11:19:09.129 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-15T11:19:09.129 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-15T11:19:09.129 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-15T11:19:09.129 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-15T11:19:09.129 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-15T11:19:09.129 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-15T11:19:09.130 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-15T11:19:09.130 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-15T11:19:09.130 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-15T11:19:09.130 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-15T11:19:09.130 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-15T11:19:09.130 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-15T11:19:09.130 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-15T11:19:09.130 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-15T11:19:09.130 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-15T11:19:09.130 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-15T11:19:09.130 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-15T11:19:09.130 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-15T11:19:09.130 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 55929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebtables.ko 2024-01-15T11:19:09.130 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-15T11:19:09.131 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-15T11:19:09.131 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ceph/ 2024-01-15T11:19:09.131 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 1046897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ceph/libceph.ko 2024-01-15T11:19:09.131 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/core/ 2024-01-15T11:19:09.131 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 125993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/core/pktgen.ko 2024-01-15T11:19:09.131 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dccp/ 2024-01-15T11:19:09.131 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 194209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dccp/dccp.ko 2024-01-15T11:19:09.131 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dccp/dccp_diag.ko 2024-01-15T11:19:09.131 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 57881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dccp/dccp_ipv4.ko 2024-01-15T11:19:09.131 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 60337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dccp/dccp_ipv6.ko 2024-01-15T11:19:09.131 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dsa/ 2024-01-15T11:19:09.131 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 390473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dsa/dsa_core.ko 2024-01-15T11:19:09.131 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dsa/tag_brcm.ko 2024-01-15T11:19:09.131 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dsa/tag_dsa.ko 2024-01-15T11:19:09.132 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dsa/tag_none.ko 2024-01-15T11:19:09.132 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dsa/tag_trailer.ko 2024-01-15T11:19:09.132 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/hsr/ 2024-01-15T11:19:09.132 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 99729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/hsr/hsr.ko 2024-01-15T11:19:09.132 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ieee802154/ 2024-01-15T11:19:09.132 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ieee802154/6lowpan/ 2024-01-15T11:19:09.132 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 45233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-15T11:19:09.132 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 254625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ieee802154/ieee802154.ko 2024-01-15T11:19:09.132 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 47289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-15T11:19:09.132 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ 2024-01-15T11:19:09.132 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ah4.ko 2024-01-15T11:19:09.132 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 38905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/esp4.ko 2024-01-15T11:19:09.132 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 48337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/fou.ko 2024-01-15T11:19:09.132 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/gre.ko 2024-01-15T11:19:09.133 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 48657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/inet_diag.ko 2024-01-15T11:19:09.133 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 60633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ip_gre.ko 2024-01-15T11:19:09.133 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 61225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ip_tunnel.ko 2024-01-15T11:19:09.133 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 34505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ip_vti.ko 2024-01-15T11:19:09.133 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ipcomp.ko 2024-01-15T11:19:09.133 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ipip.ko 2024-01-15T11:19:09.133 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ 2024-01-15T11:19:09.133 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 37641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-15T11:19:09.133 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-15T11:19:09.133 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-15T11:19:09.133 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 41609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ip_tables.ko 2024-01-15T11:19:09.133 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-15T11:19:09.133 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-01-15T11:19:09.133 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-15T11:19:09.133 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-15T11:19:09.134 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-15T11:19:09.134 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-01-15T11:19:09.134 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-15T11:19:09.134 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-15T11:19:09.134 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-15T11:19:09.134 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-15T11:19:09.134 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-15T11:19:09.134 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-15T11:19:09.134 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 27625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-15T11:19:09.134 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-15T11:19:09.134 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-15T11:19:09.134 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-01-15T11:19:09.134 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-15T11:19:09.134 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-15T11:19:09.135 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-15T11:19:09.135 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-15T11:19:09.135 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-15T11:19:09.135 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_bic.ko 2024-01-15T11:19:09.135 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_dctcp.ko 2024-01-15T11:19:09.135 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_diag.ko 2024-01-15T11:19:09.135 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_highspeed.ko 2024-01-15T11:19:09.135 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_htcp.ko 2024-01-15T11:19:09.135 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_hybla.ko 2024-01-15T11:19:09.135 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_illinois.ko 2024-01-15T11:19:09.135 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_lp.ko 2024-01-15T11:19:09.135 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_scalable.ko 2024-01-15T11:19:09.135 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_vegas.ko 2024-01-15T11:19:09.135 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_veno.ko 2024-01-15T11:19:09.136 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_westwood.ko 2024-01-15T11:19:09.136 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_yeah.ko 2024-01-15T11:19:09.136 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tunnel4.ko 2024-01-15T11:19:09.136 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/udp_diag.ko 2024-01-15T11:19:09.136 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 41665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/udp_tunnel.ko 2024-01-15T11:19:09.136 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-15T11:19:09.136 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ 2024-01-15T11:19:09.136 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ah6.ko 2024-01-15T11:19:09.136 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 39537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/esp6.ko 2024-01-15T11:19:09.136 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/fou6.ko 2024-01-15T11:19:09.136 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 80897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ip6_gre.ko 2024-01-15T11:19:09.136 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 93577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ip6_tunnel.ko 2024-01-15T11:19:09.136 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-15T11:19:09.136 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 53273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ip6_vti.ko 2024-01-15T11:19:09.137 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ipcomp6.ko 2024-01-15T11:19:09.137 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/mip6.ko 2024-01-15T11:19:09.137 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ 2024-01-15T11:19:09.137 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 42169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-15T11:19:09.137 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-01-15T11:19:09.137 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-15T11:19:09.137 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-15T11:19:09.137 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-15T11:19:09.137 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-15T11:19:09.137 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-15T11:19:09.137 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-15T11:19:09.137 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-15T11:19:09.137 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-15T11:19:09.138 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-15T11:19:09.138 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-15T11:19:09.138 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-15T11:19:09.138 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-15T11:19:09.138 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-15T11:19:09.138 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-15T11:19:09.138 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-15T11:19:09.138 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 39113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-15T11:19:09.138 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-15T11:19:09.138 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 25945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-15T11:19:09.138 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-15T11:19:09.138 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-15T11:19:09.138 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-15T11:19:09.139 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-15T11:19:09.139 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-15T11:19:09.139 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 74073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/sit.ko 2024-01-15T11:19:09.139 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/tunnel6.ko 2024-01-15T11:19:09.139 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-15T11:19:09.139 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/key/ 2024-01-15T11:19:09.139 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 82833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/key/af_key.ko 2024-01-15T11:19:09.139 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/ 2024-01-15T11:19:09.139 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 125281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_core.ko 2024-01-15T11:19:09.139 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-15T11:19:09.139 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 25953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_eth.ko 2024-01-15T11:19:09.139 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 35569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_ip.ko 2024-01-15T11:19:09.139 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 36713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_ip6.ko 2024-01-15T11:19:09.139 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 33001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_netlink.ko 2024-01-15T11:19:09.139 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 53241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_ppp.ko 2024-01-15T11:19:09.140 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/lapb/ 2024-01-15T11:19:09.140 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 47977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/lapb/lapb.ko 2024-01-15T11:19:09.140 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/llc/ 2024-01-15T11:19:09.140 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/llc/llc.ko 2024-01-15T11:19:09.140 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 267913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/llc/llc2.ko 2024-01-15T11:19:09.140 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/mac802154/ 2024-01-15T11:19:09.140 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 290417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/mac802154/mac802154.ko 2024-01-15T11:19:09.140 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/mpls/ 2024-01-15T11:19:09.140 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/mpls/mpls_gso.ko 2024-01-15T11:19:09.140 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ 2024-01-15T11:19:09.140 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ 2024-01-15T11:19:09.140 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 119585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set.ko 2024-01-15T11:19:09.140 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-15T11:19:09.141 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-15T11:19:09.141 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-15T11:19:09.141 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 100297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-15T11:19:09.141 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 101441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-15T11:19:09.141 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 102817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-15T11:19:09.141 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 103417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-15T11:19:09.141 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 112849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-15T11:19:09.141 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 60329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-15T11:19:09.141 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 109593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-15T11:19:09.141 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 113129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-15T11:19:09.141 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 112585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-15T11:19:09.141 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 111585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-15T11:19:09.141 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 114465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-15T11:19:09.141 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 30025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-15T11:19:09.142 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ 2024-01-15T11:19:09.142 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 411729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-15T11:19:09.142 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-15T11:19:09.142 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-15T11:19:09.142 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-15T11:19:09.142 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-15T11:19:09.142 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-15T11:19:09.142 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-15T11:19:09.142 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-15T11:19:09.142 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-15T11:19:09.142 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-15T11:19:09.142 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-15T11:19:09.142 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-15T11:19:09.142 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-15T11:19:09.143 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-15T11:19:09.143 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 49257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conncount.ko 2024-01-15T11:19:09.143 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 408257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack.ko 2024-01-15T11:19:09.143 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-15T11:19:09.143 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-15T11:19:09.143 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 33761 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-15T11:19:09.143 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 118145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-15T11:19:09.143 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-15T11:19:09.143 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-15T11:19:09.143 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 107233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-15T11:19:09.143 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 33633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-15T11:19:09.143 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-15T11:19:09.143 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 66641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-15T11:19:09.143 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-15T11:19:09.144 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-15T11:19:09.144 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-15T11:19:09.144 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 89425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_flow_table.ko 2024-01-15T11:19:09.144 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-15T11:19:09.144 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 37129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_log_syslog.ko 2024-01-15T11:19:09.144 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 95353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_nat.ko 2024-01-15T11:19:09.144 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-15T11:19:09.144 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-15T11:19:09.144 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_nat_irc.ko 2024-01-15T11:19:09.144 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_nat_sip.ko 2024-01-15T11:19:09.144 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-15T11:19:09.144 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 44065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-15T11:19:09.144 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 615649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_tables.ko 2024-01-15T11:19:09.144 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 42561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nfnetlink.ko 2024-01-15T11:19:09.145 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 30233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-15T11:19:09.145 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 30569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-01-15T11:19:09.145 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 39785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nfnetlink_log.ko 2024-01-15T11:19:09.145 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-15T11:19:09.145 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 49377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-15T11:19:09.145 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_chain_nat.ko 2024-01-15T11:19:09.145 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 33209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_compat.ko 2024-01-15T11:19:09.145 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 40721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_ct.ko 2024-01-15T11:19:09.145 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-15T11:19:09.145 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_fib.ko 2024-01-15T11:19:09.145 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-15T11:19:09.145 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_hash.ko 2024-01-15T11:19:09.145 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_limit.ko 2024-01-15T11:19:09.145 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_log.ko 2024-01-15T11:19:09.145 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_masq.ko 2024-01-15T11:19:09.146 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_nat.ko 2024-01-15T11:19:09.146 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_numgen.ko 2024-01-15T11:19:09.146 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_osf.ko 2024-01-15T11:19:09.146 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_queue.ko 2024-01-15T11:19:09.146 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_redir.ko 2024-01-15T11:19:09.146 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_reject.ko 2024-01-15T11:19:09.146 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_reject_inet.ko 2024-01-15T11:19:09.146 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_socket.ko 2024-01-15T11:19:09.146 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_synproxy.ko 2024-01-15T11:19:09.146 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_tproxy.ko 2024-01-15T11:19:09.146 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 89313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/x_tables.ko 2024-01-15T11:19:09.146 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_AUDIT.ko 2024-01-15T11:19:09.146 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-15T11:19:09.146 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-15T11:19:09.147 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-15T11:19:09.147 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 18169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_CT.ko 2024-01-15T11:19:09.147 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_DSCP.ko 2024-01-15T11:19:09.147 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_HL.ko 2024-01-15T11:19:09.147 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_HMARK.ko 2024-01-15T11:19:09.147 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 38873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-15T11:19:09.147 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_LED.ko 2024-01-15T11:19:09.147 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_LOG.ko 2024-01-15T11:19:09.147 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-15T11:19:09.147 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_NETMAP.ko 2024-01-15T11:19:09.147 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_NFLOG.ko 2024-01-15T11:19:09.147 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-15T11:19:09.147 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_RATEEST.ko 2024-01-15T11:19:09.148 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-15T11:19:09.148 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 14337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_SECMARK.ko 2024-01-15T11:19:09.148 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-15T11:19:09.148 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-15T11:19:09.148 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_TEE.ko 2024-01-15T11:19:09.148 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_TPROXY.ko 2024-01-15T11:19:09.148 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_TRACE.ko 2024-01-15T11:19:09.148 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_addrtype.ko 2024-01-15T11:19:09.148 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_bpf.ko 2024-01-15T11:19:09.148 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_cgroup.ko 2024-01-15T11:19:09.148 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_cluster.ko 2024-01-15T11:19:09.148 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_comment.ko 2024-01-15T11:19:09.148 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_connbytes.ko 2024-01-15T11:19:09.149 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_connlabel.ko 2024-01-15T11:19:09.149 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_connlimit.ko 2024-01-15T11:19:09.149 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_connmark.ko 2024-01-15T11:19:09.149 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_conntrack.ko 2024-01-15T11:19:09.149 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_cpu.ko 2024-01-15T11:19:09.149 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_dccp.ko 2024-01-15T11:19:09.149 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_devgroup.ko 2024-01-15T11:19:09.149 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_dscp.ko 2024-01-15T11:19:09.149 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_ecn.ko 2024-01-15T11:19:09.149 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_esp.ko 2024-01-15T11:19:09.149 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 43289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_hashlimit.ko 2024-01-15T11:19:09.149 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_helper.ko 2024-01-15T11:19:09.149 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_hl.ko 2024-01-15T11:19:09.149 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_ipcomp.ko 2024-01-15T11:19:09.149 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_iprange.ko 2024-01-15T11:19:09.150 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_ipvs.ko 2024-01-15T11:19:09.150 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_l2tp.ko 2024-01-15T11:19:09.150 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_length.ko 2024-01-15T11:19:09.150 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_limit.ko 2024-01-15T11:19:09.150 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_mac.ko 2024-01-15T11:19:09.150 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_mark.ko 2024-01-15T11:19:09.150 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_multiport.ko 2024-01-15T11:19:09.150 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_nat.ko 2024-01-15T11:19:09.150 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_nfacct.ko 2024-01-15T11:19:09.150 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_osf.ko 2024-01-15T11:19:09.150 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_owner.ko 2024-01-15T11:19:09.150 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_physdev.ko 2024-01-15T11:19:09.150 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_pkttype.ko 2024-01-15T11:19:09.151 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_policy.ko 2024-01-15T11:19:09.151 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_quota.ko 2024-01-15T11:19:09.151 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_rateest.ko 2024-01-15T11:19:09.151 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_realm.ko 2024-01-15T11:19:09.151 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 36433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_recent.ko 2024-01-15T11:19:09.151 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_sctp.ko 2024-01-15T11:19:09.151 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 30089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_set.ko 2024-01-15T11:19:09.151 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 16089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_socket.ko 2024-01-15T11:19:09.151 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_state.ko 2024-01-15T11:19:09.151 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_statistic.ko 2024-01-15T11:19:09.151 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_string.ko 2024-01-15T11:19:09.151 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 8553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_tcpmss.ko 2024-01-15T11:19:09.151 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_tcpudp.ko 2024-01-15T11:19:09.151 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_time.ko 2024-01-15T11:19:09.152 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_u32.ko 2024-01-15T11:19:09.152 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netlink/ 2024-01-15T11:19:09.152 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netlink/netlink_diag.ko 2024-01-15T11:19:09.152 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/nsh/ 2024-01-15T11:19:09.152 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 12425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/nsh/nsh.ko 2024-01-15T11:19:09.152 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/openvswitch/ 2024-01-15T11:19:09.152 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 380033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/openvswitch/openvswitch.ko 2024-01-15T11:19:09.152 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/openvswitch/vport-geneve.ko 2024-01-15T11:19:09.152 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/openvswitch/vport-gre.ko 2024-01-15T11:19:09.152 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 11793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/openvswitch/vport-vxlan.ko 2024-01-15T11:19:09.152 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/packet/ 2024-01-15T11:19:09.152 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/packet/af_packet_diag.ko 2024-01-15T11:19:09.152 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/phonet/ 2024-01-15T11:19:09.152 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 110201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/phonet/phonet.ko 2024-01-15T11:19:09.153 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 54721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/phonet/pn_pep.ko 2024-01-15T11:19:09.153 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/rds/ 2024-01-15T11:19:09.153 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 251481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/rds/rds.ko 2024-01-15T11:19:09.153 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 164937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/rds/rds_rdma.ko 2024-01-15T11:19:09.153 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 67377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/rds/rds_tcp.ko 2024-01-15T11:19:09.153 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/rxrpc/ 2024-01-15T11:19:09.153 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 819657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/rxrpc/rxrpc.ko 2024-01-15T11:19:09.153 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/ 2024-01-15T11:19:09.153 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 32241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_csum.ko 2024-01-15T11:19:09.153 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_gact.ko 2024-01-15T11:19:09.153 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_ipt.ko 2024-01-15T11:19:09.153 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 34097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_mirred.ko 2024-01-15T11:19:09.153 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_nat.ko 2024-01-15T11:19:09.153 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 43449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_pedit.ko 2024-01-15T11:19:09.154 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 31961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_police.ko 2024-01-15T11:19:09.154 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_simple.ko 2024-01-15T11:19:09.154 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 35297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_skbedit.ko 2024-01-15T11:19:09.154 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 36665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_vlan.ko 2024-01-15T11:19:09.154 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_basic.ko 2024-01-15T11:19:09.154 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 33961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_bpf.ko 2024-01-15T11:19:09.154 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_cgroup.ko 2024-01-15T11:19:09.154 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 31401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_flow.ko 2024-01-15T11:19:09.154 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 31769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_fw.ko 2024-01-15T11:19:09.154 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 38425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_route.ko 2024-01-15T11:19:09.154 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 61409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_u32.ko 2024-01-15T11:19:09.154 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/em_cmp.ko 2024-01-15T11:19:09.154 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 13409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/em_ipset.ko 2024-01-15T11:19:09.154 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 33289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/em_meta.ko 2024-01-15T11:19:09.155 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/em_nbyte.ko 2024-01-15T11:19:09.155 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/em_text.ko 2024-01-15T11:19:09.155 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/em_u32.ko 2024-01-15T11:19:09.155 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 21649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_choke.ko 2024-01-15T11:19:09.155 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_codel.ko 2024-01-15T11:19:09.155 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 34633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_drr.ko 2024-01-15T11:19:09.155 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 33609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_fq.ko 2024-01-15T11:19:09.155 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 31617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_fq_codel.ko 2024-01-15T11:19:09.155 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 35433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_gred.ko 2024-01-15T11:19:09.155 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 49817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_hfsc.ko 2024-01-15T11:19:09.155 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_hhf.ko 2024-01-15T11:19:09.155 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 66393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_htb.ko 2024-01-15T11:19:09.155 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_ingress.ko 2024-01-15T11:19:09.155 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 30273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_mqprio.ko 2024-01-15T11:19:09.156 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_mqprio_lib.ko 2024-01-15T11:19:09.156 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_multiq.ko 2024-01-15T11:19:09.156 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 36137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_netem.ko 2024-01-15T11:19:09.156 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 27497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_pie.ko 2024-01-15T11:19:09.156 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_plug.ko 2024-01-15T11:19:09.156 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 24729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_prio.ko 2024-01-15T11:19:09.156 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 48729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_qfq.ko 2024-01-15T11:19:09.156 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 32905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_red.ko 2024-01-15T11:19:09.156 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 26881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_sfb.ko 2024-01-15T11:19:09.156 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 31353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_sfq.ko 2024-01-15T11:19:09.156 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_tbf.ko 2024-01-15T11:19:09.156 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 28105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_teql.ko 2024-01-15T11:19:09.156 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sctp/ 2024-01-15T11:19:09.157 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 929745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sctp/sctp.ko 2024-01-15T11:19:09.157 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 19033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sctp/sctp_diag.ko 2024-01-15T11:19:09.157 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/ 2024-01-15T11:19:09.157 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/auth_gss/ 2024-01-15T11:19:09.157 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 336529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-15T11:19:09.157 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 54737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-15T11:19:09.157 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 1520097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/sunrpc.ko 2024-01-15T11:19:09.157 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/xprtrdma/ 2024-01-15T11:19:09.157 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 707657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-15T11:19:09.157 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/tipc/ 2024-01-15T11:19:09.157 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/tipc/diag.ko 2024-01-15T11:19:09.157 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 862665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/tipc/tipc.ko 2024-01-15T11:19:09.157 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/unix/ 2024-01-15T11:19:09.157 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/unix/unix_diag.ko 2024-01-15T11:19:09.158 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/vmw_vsock/ 2024-01-15T11:19:09.158 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 85409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-15T11:19:09.158 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 68049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-15T11:19:09.158 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 96193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/vmw_vsock/vsock.ko 2024-01-15T11:19:09.158 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 10705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-15T11:19:09.158 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 17521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-15T11:19:09.158 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/x25/ 2024-01-15T11:19:09.158 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 125177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/x25/x25.ko 2024-01-15T11:19:09.158 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/xfrm/ 2024-01-15T11:19:09.158 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 22657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/xfrm/xfrm_algo.ko 2024-01-15T11:19:09.158 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 20649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-15T11:19:09.158 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 102257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/xfrm/xfrm_user.ko 2024-01-15T11:19:09.158 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/virt/ 2024-01-15T11:19:09.159 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/virt/lib/ 2024-01-15T11:19:09.159 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 15537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/virt/lib/irqbypass.ko 2024-01-15T11:19:09.159 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 640081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.alias 2024-01-15T11:19:09.159 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 624107 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.alias.bin 2024-01-15T11:19:09.159 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 7663 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.builtin 2024-01-15T11:19:09.159 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 23428 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.builtin.alias.bin 2024-01-15T11:19:09.159 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 9821 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.builtin.bin 2024-01-15T11:19:09.159 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 70004 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.builtin.modinfo 2024-01-15T11:19:09.159 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 146313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.dep 2024-01-15T11:19:09.159 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 232548 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.dep.bin 2024-01-15T11:19:09.159 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 210 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.devname 2024-01-15T11:19:09.159 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 72606 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.order 2024-01-15T11:19:09.159 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 879 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.softdep 2024-01-15T11:19:09.159 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 254438 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.symbols 2024-01-15T11:19:09.160 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 309363 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.symbols.bin 2024-01-15T11:19:09.160 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./usr/ 2024-01-15T11:19:09.160 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./usr/share/ 2024-01-15T11:19:09.160 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./usr/share/doc/ 2024-01-15T11:19:09.160 INFO:teuthology.orchestra.run.smithi027.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./usr/share/doc/linux-image-6.6.0-gc719ee96ba78/ 2024-01-15T11:19:09.160 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 170 2024-01-08 03:37 ./usr/share/doc/linux-image-6.6.0-gc719ee96ba78/changelog.Debian.gz 2024-01-15T11:19:09.160 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r-- root/root 691 2024-01-08 03:37 ./usr/share/doc/linux-image-6.6.0-gc719ee96ba78/copyright 2024-01-15T11:19:09.161 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gc719ee96ba78 2024-01-15T11:19:09.161 INFO:teuthology.task.kernel:searching for kernel 6.6.0-gc719ee96ba78 2024-01-15T11:19:09.161 DEBUG:teuthology.orchestra.run.smithi027:> egrep '(submenu|menuentry.*6.6.0-gc719ee96ba78).*{' /boot/grub/grub.cfg 2024-01-15T11:19:09.168 INFO:teuthology.orchestra.run.smithi027.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-15T11:19:09.168 INFO:teuthology.orchestra.run.smithi027.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gc719ee96ba78' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gc719ee96ba78-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-15T11:19:09.168 INFO:teuthology.orchestra.run.smithi027.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gc719ee96ba78 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gc719ee96ba78-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-15T11:19:09.169 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-01-15T11:19:09.169 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-gc719ee96ba78 2024-01-15T11:19:09.169 DEBUG:teuthology.orchestra.run.smithi027:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-01-15T11:19:09.211 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi027.front.sepia.ceph.com to complete... 2024-01-15T11:19:09.604 INFO:teuthology.orchestra.run.smithi027.stderr:Sourcing file `/etc/default/grub' 2024-01-15T11:19:09.606 INFO:teuthology.orchestra.run.smithi027.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-15T11:19:09.615 INFO:teuthology.orchestra.run.smithi027.stderr:Generating grub configuration file ... 2024-01-15T11:19:09.816 INFO:teuthology.orchestra.run.smithi027.stderr:Found linux image: /boot/vmlinuz-6.6.0-gc719ee96ba78 2024-01-15T11:19:09.822 INFO:teuthology.orchestra.run.smithi027.stderr:Found initrd image: /boot/initrd.img-6.6.0-gc719ee96ba78 2024-01-15T11:19:10.049 INFO:teuthology.orchestra.run.smithi027.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-15T11:19:10.054 INFO:teuthology.orchestra.run.smithi027.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-15T11:19:10.096 INFO:teuthology.orchestra.run.smithi027.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-15T11:19:10.102 INFO:teuthology.orchestra.run.smithi027.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-15T11:19:10.223 INFO:teuthology.orchestra.run.smithi027.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-15T11:19:10.223 INFO:teuthology.orchestra.run.smithi027.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-15T11:19:10.223 INFO:teuthology.orchestra.run.smithi027.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-15T11:19:10.234 INFO:teuthology.orchestra.run.smithi027.stderr:done 2024-01-15T11:19:13.219 INFO:teuthology.orchestra.run.smithi093.stderr:Sourcing file `/etc/default/grub' 2024-01-15T11:19:13.271 INFO:teuthology.orchestra.run.smithi093.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-15T11:19:13.297 INFO:teuthology.orchestra.run.smithi093.stderr:Generating grub configuration file ... 2024-01-15T11:19:13.626 INFO:teuthology.orchestra.run.smithi093.stderr:Found linux image: /boot/vmlinuz-6.6.0-gc719ee96ba78 2024-01-15T11:19:13.643 INFO:teuthology.orchestra.run.smithi093.stderr:Found initrd image: /boot/initrd.img-6.6.0-gc719ee96ba78 2024-01-15T11:19:13.921 INFO:teuthology.orchestra.run.smithi093.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-15T11:19:13.929 INFO:teuthology.orchestra.run.smithi093.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-15T11:19:13.987 INFO:teuthology.orchestra.run.smithi093.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-15T11:19:13.993 INFO:teuthology.orchestra.run.smithi093.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-15T11:19:14.141 INFO:teuthology.orchestra.run.smithi093.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-15T11:19:14.141 INFO:teuthology.orchestra.run.smithi093.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-15T11:19:14.141 INFO:teuthology.orchestra.run.smithi093.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-15T11:19:14.188 INFO:teuthology.orchestra.run.smithi093.stderr:done 2024-01-15T11:19:14.356 DEBUG:teuthology.orchestra.run.smithi093:> dpkg-deb -c /tmp/linux-image.deb 2024-01-15T11:19:14.364 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./ 2024-01-15T11:19:14.364 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./boot/ 2024-01-15T11:19:14.364 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 4415617 2024-01-08 03:37 ./boot/System.map-6.6.0-gc719ee96ba78 2024-01-15T11:19:14.376 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 169214 2024-01-08 03:37 ./boot/config-6.6.0-gc719ee96ba78 2024-01-15T11:19:14.377 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11352864 2024-01-08 03:37 ./boot/vmlinuz-6.6.0-gc719ee96ba78 2024-01-15T11:19:14.395 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./etc/ 2024-01-15T11:19:14.395 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./etc/kernel/ 2024-01-15T11:19:14.395 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./etc/kernel/postinst.d/ 2024-01-15T11:19:14.395 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./etc/kernel/postrm.d/ 2024-01-15T11:19:14.395 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./etc/kernel/preinst.d/ 2024-01-15T11:19:14.396 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./etc/kernel/prerm.d/ 2024-01-15T11:19:14.396 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/ 2024-01-15T11:19:14.396 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/ 2024-01-15T11:19:14.396 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/ 2024-01-15T11:19:14.396 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/ 2024-01-15T11:19:14.396 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/ 2024-01-15T11:19:14.396 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/ 2024-01-15T11:19:14.396 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/ 2024-01-15T11:19:14.396 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 490233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/aesni-intel.ko 2024-01-15T11:19:14.399 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-15T11:19:14.399 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-15T11:19:14.400 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-15T11:19:14.400 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 93113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-15T11:19:14.400 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 106729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-15T11:19:14.400 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 152241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-15T11:19:14.400 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-15T11:19:14.400 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-15T11:19:14.400 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 83889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-15T11:19:14.400 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-15T11:19:14.400 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-15T11:19:14.400 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-15T11:19:14.400 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-15T11:19:14.400 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-15T11:19:14.401 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 40529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-15T11:19:14.401 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 58585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-15T11:19:14.401 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 50497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-15T11:19:14.401 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-15T11:19:14.401 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-15T11:19:14.401 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kernel/ 2024-01-15T11:19:14.401 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kernel/cpu/ 2024-01-15T11:19:14.401 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kernel/cpu/mce/ 2024-01-15T11:19:14.401 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 40113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-15T11:19:14.401 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kernel/cpuid.ko 2024-01-15T11:19:14.401 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kernel/msr.ko 2024-01-15T11:19:14.401 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kvm/ 2024-01-15T11:19:14.401 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 354433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-15T11:19:14.401 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 881625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-15T11:19:14.402 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 2275865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/arch/x86/kvm/kvm.ko 2024-01-15T11:19:14.483 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/ 2024-01-15T11:19:14.483 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 53697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/af_alg.ko 2024-01-15T11:19:14.483 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/algif_hash.ko 2024-01-15T11:19:14.483 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/algif_skcipher.ko 2024-01-15T11:19:14.483 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/ansi_cprng.ko 2024-01-15T11:19:14.483 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/anubis.ko 2024-01-15T11:19:14.483 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/arc4.ko 2024-01-15T11:19:14.483 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/asymmetric_keys/ 2024-01-15T11:19:14.483 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-01-15T11:19:14.484 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/ 2024-01-15T11:19:14.484 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/async_memcpy.ko 2024-01-15T11:19:14.484 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/async_pq.ko 2024-01-15T11:19:14.484 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-15T11:19:14.484 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/async_tx.ko 2024-01-15T11:19:14.484 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/async_xor.ko 2024-01-15T11:19:14.484 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/async_tx/raid6test.ko 2024-01-15T11:19:14.484 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/authenc.ko 2024-01-15T11:19:14.484 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/authencesn.ko 2024-01-15T11:19:14.484 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/blake2b_generic.ko 2024-01-15T11:19:14.484 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/blowfish_common.ko 2024-01-15T11:19:14.484 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/blowfish_generic.ko 2024-01-15T11:19:14.484 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/camellia_generic.ko 2024-01-15T11:19:14.484 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/cast5_generic.ko 2024-01-15T11:19:14.484 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/cast6_generic.ko 2024-01-15T11:19:14.485 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/cast_common.ko 2024-01-15T11:19:14.485 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/ccm.ko 2024-01-15T11:19:14.485 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/cmac.ko 2024-01-15T11:19:14.485 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/crc32_generic.ko 2024-01-15T11:19:14.485 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/cryptd.ko 2024-01-15T11:19:14.485 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/crypto_engine.ko 2024-01-15T11:19:14.485 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/crypto_simd.ko 2024-01-15T11:19:14.485 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/crypto_user.ko 2024-01-15T11:19:14.485 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/cts.ko 2024-01-15T11:19:14.485 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/des_generic.ko 2024-01-15T11:19:14.485 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/dh_generic.ko 2024-01-15T11:19:14.485 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/echainiv.ko 2024-01-15T11:19:14.485 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/essiv.ko 2024-01-15T11:19:14.485 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/fcrypt.ko 2024-01-15T11:19:14.486 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/khazad.ko 2024-01-15T11:19:14.486 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/lrw.ko 2024-01-15T11:19:14.486 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/lz4.ko 2024-01-15T11:19:14.486 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/lz4hc.ko 2024-01-15T11:19:14.486 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/md4.ko 2024-01-15T11:19:14.486 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/michael_mic.ko 2024-01-15T11:19:14.486 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/pcbc.ko 2024-01-15T11:19:14.486 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/pcrypt.ko 2024-01-15T11:19:14.486 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/rmd160.ko 2024-01-15T11:19:14.486 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/seed.ko 2024-01-15T11:19:14.486 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/serpent_generic.ko 2024-01-15T11:19:14.486 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 149193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/tcrypt.ko 2024-01-15T11:19:14.486 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/tea.ko 2024-01-15T11:19:14.487 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/twofish_common.ko 2024-01-15T11:19:14.487 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/twofish_generic.ko 2024-01-15T11:19:14.487 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/vmac.ko 2024-01-15T11:19:14.487 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/wp512.ko 2024-01-15T11:19:14.487 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/xcbc.ko 2024-01-15T11:19:14.487 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/xor.ko 2024-01-15T11:19:14.487 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/xts.ko 2024-01-15T11:19:14.487 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/crypto/xxhash_generic.ko 2024-01-15T11:19:14.487 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ 2024-01-15T11:19:14.487 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/ 2024-01-15T11:19:14.487 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/acpi_extlog.ko 2024-01-15T11:19:14.487 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-15T11:19:14.488 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/acpi_pad.ko 2024-01-15T11:19:14.488 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/apei/ 2024-01-15T11:19:14.488 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/apei/einj.ko 2024-01-15T11:19:14.488 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/ec_sys.ko 2024-01-15T11:19:14.488 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/platform_profile.ko 2024-01-15T11:19:14.488 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/sbs.ko 2024-01-15T11:19:14.488 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/sbshc.ko 2024-01-15T11:19:14.488 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 103025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/acpi/video.ko 2024-01-15T11:19:14.488 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/ 2024-01-15T11:19:14.488 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/acard-ahci.ko 2024-01-15T11:19:14.488 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 88865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/ahci.ko 2024-01-15T11:19:14.488 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/ahci_platform.ko 2024-01-15T11:19:14.488 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 88289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/libahci.ko 2024-01-15T11:19:14.489 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/libahci_platform.ko 2024-01-15T11:19:14.489 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_acpi.ko 2024-01-15T11:19:14.489 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_ali.ko 2024-01-15T11:19:14.489 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_amd.ko 2024-01-15T11:19:14.489 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_artop.ko 2024-01-15T11:19:14.489 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_atiixp.ko 2024-01-15T11:19:14.489 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_atp867x.ko 2024-01-15T11:19:14.489 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_cmd640.ko 2024-01-15T11:19:14.489 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_cmd64x.ko 2024-01-15T11:19:14.489 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_cypress.ko 2024-01-15T11:19:14.489 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_efar.ko 2024-01-15T11:19:14.489 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_hpt366.ko 2024-01-15T11:19:14.489 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_hpt37x.ko 2024-01-15T11:19:14.489 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-15T11:19:14.489 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-15T11:19:14.490 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_it8213.ko 2024-01-15T11:19:14.490 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_it821x.ko 2024-01-15T11:19:14.490 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_jmicron.ko 2024-01-15T11:19:14.490 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_legacy.ko 2024-01-15T11:19:14.490 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_marvell.ko 2024-01-15T11:19:14.490 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_mpiix.ko 2024-01-15T11:19:14.490 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_netcell.ko 2024-01-15T11:19:14.490 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_ninja32.ko 2024-01-15T11:19:14.490 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_ns87410.ko 2024-01-15T11:19:14.490 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_ns87415.ko 2024-01-15T11:19:14.490 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_oldpiix.ko 2024-01-15T11:19:14.490 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_opti.ko 2024-01-15T11:19:14.490 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_optidma.ko 2024-01-15T11:19:14.490 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_pcmcia.ko 2024-01-15T11:19:14.490 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-15T11:19:14.491 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-15T11:19:14.491 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_piccolo.ko 2024-01-15T11:19:14.491 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_radisys.ko 2024-01-15T11:19:14.491 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_rdc.ko 2024-01-15T11:19:14.491 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_rz1000.ko 2024-01-15T11:19:14.491 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_sch.ko 2024-01-15T11:19:14.491 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_serverworks.ko 2024-01-15T11:19:14.491 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_sil680.ko 2024-01-15T11:19:14.491 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_sl82c105.ko 2024-01-15T11:19:14.491 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_triflex.ko 2024-01-15T11:19:14.491 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pata_via.ko 2024-01-15T11:19:14.491 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/pdc_adma.ko 2024-01-15T11:19:14.491 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_inic162x.ko 2024-01-15T11:19:14.491 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 83345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_mv.ko 2024-01-15T11:19:14.491 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 70393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_nv.ko 2024-01-15T11:19:14.491 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_promise.ko 2024-01-15T11:19:14.492 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_qstor.ko 2024-01-15T11:19:14.492 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_sil.ko 2024-01-15T11:19:14.492 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_sil24.ko 2024-01-15T11:19:14.492 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_sis.ko 2024-01-15T11:19:14.492 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_svw.ko 2024-01-15T11:19:14.492 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 44793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_sx4.ko 2024-01-15T11:19:14.492 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_uli.ko 2024-01-15T11:19:14.492 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_via.ko 2024-01-15T11:19:14.492 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ata/sata_vsc.ko 2024-01-15T11:19:14.492 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/auxdisplay/ 2024-01-15T11:19:14.492 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/auxdisplay/ks0108.ko 2024-01-15T11:19:14.492 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/bcma/ 2024-01-15T11:19:14.492 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 124473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/bcma/bcma.ko 2024-01-15T11:19:14.492 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/ 2024-01-15T11:19:14.492 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/aoe/ 2024-01-15T11:19:14.493 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 113665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/aoe/aoe.ko 2024-01-15T11:19:14.493 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/drbd/ 2024-01-15T11:19:14.493 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 965585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/drbd/drbd.ko 2024-01-15T11:19:14.493 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 173225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/floppy.ko 2024-01-15T11:19:14.493 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/mtip32xx/ 2024-01-15T11:19:14.493 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 94297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-15T11:19:14.493 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 115793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/nbd.ko 2024-01-15T11:19:14.493 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/null_blk/ 2024-01-15T11:19:14.493 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 110385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/null_blk/null_blk.ko 2024-01-15T11:19:14.493 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 98193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/pktcdvd.ko 2024-01-15T11:19:14.493 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 263769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/rbd.ko 2024-01-15T11:19:14.493 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/xen-blkback/ 2024-01-15T11:19:14.493 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 98145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-15T11:19:14.493 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/zram/ 2024-01-15T11:19:14.494 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 60217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/block/zram/zram.ko 2024-01-15T11:19:14.494 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ 2024-01-15T11:19:14.494 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/applicom.ko 2024-01-15T11:19:14.494 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hangcheck-timer.ko 2024-01-15T11:19:14.494 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hw_random/ 2024-01-15T11:19:14.494 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-15T11:19:14.494 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-15T11:19:14.494 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-15T11:19:14.494 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hw_random/via-rng.ko 2024-01-15T11:19:14.494 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-15T11:19:14.494 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ 2024-01-15T11:19:14.494 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-15T11:19:14.494 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 148601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-15T11:19:14.494 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-15T11:19:14.494 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 139313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-15T11:19:14.495 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 70921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-15T11:19:14.495 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 53513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-15T11:19:14.495 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/lp.ko 2024-01-15T11:19:14.495 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/mwave/ 2024-01-15T11:19:14.495 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 84097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/mwave/mwave.ko 2024-01-15T11:19:14.495 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/nvram.ko 2024-01-15T11:19:14.495 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/ppdev.ko 2024-01-15T11:19:14.495 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tlclk.ko 2024-01-15T11:19:14.495 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/ 2024-01-15T11:19:14.495 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-15T11:19:14.495 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-01-15T11:19:14.495 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-01-15T11:19:14.495 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-01-15T11:19:14.495 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-15T11:19:14.495 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-15T11:19:14.495 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-01-15T11:19:14.495 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/xillybus/ 2024-01-15T11:19:14.496 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/xillybus/xillybus_class.ko 2024-01-15T11:19:14.496 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 50945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/xillybus/xillybus_core.ko 2024-01-15T11:19:14.496 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-01-15T11:19:14.496 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/clk/ 2024-01-15T11:19:14.496 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/clk/clk-palmas.ko 2024-01-15T11:19:14.496 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/clk/clk-si5351.ko 2024-01-15T11:19:14.496 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/clk/clk-twl6040.ko 2024-01-15T11:19:14.496 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/clk/clk-wm831x.ko 2024-01-15T11:19:14.496 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/cpufreq/ 2024-01-15T11:19:14.496 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-15T11:19:14.496 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-15T11:19:14.496 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-15T11:19:14.496 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/ 2024-01-15T11:19:14.497 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/ccp/ 2024-01-15T11:19:14.497 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 70801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-15T11:19:14.497 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 243025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/ccp/ccp.ko 2024-01-15T11:19:14.497 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/intel/ 2024-01-15T11:19:14.497 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/intel/qat/ 2024-01-15T11:19:14.497 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/intel/qat/qat_common/ 2024-01-15T11:19:14.497 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 438761 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-15T11:19:14.497 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-01-15T11:19:14.497 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-15T11:19:14.497 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/padlock-aes.ko 2024-01-15T11:19:14.497 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/padlock-sha.ko 2024-01-15T11:19:14.497 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/virtio/ 2024-01-15T11:19:14.497 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 70273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-15T11:19:14.498 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dca/ 2024-01-15T11:19:14.498 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dca/dca.ko 2024-01-15T11:19:14.498 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dma/ 2024-01-15T11:19:14.498 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dma/dw/ 2024-01-15T11:19:14.498 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-15T11:19:14.498 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dma/ioat/ 2024-01-15T11:19:14.498 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 122569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-15T11:19:14.498 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/ 2024-01-15T11:19:14.498 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 79953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/amd64_edac.ko 2024-01-15T11:19:14.498 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/e752x_edac.ko 2024-01-15T11:19:14.498 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 63617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/edac_mce_amd.ko 2024-01-15T11:19:14.498 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i3000_edac.ko 2024-01-15T11:19:14.498 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i3200_edac.ko 2024-01-15T11:19:14.498 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i5100_edac.ko 2024-01-15T11:19:14.498 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i5400_edac.ko 2024-01-15T11:19:14.499 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i7300_edac.ko 2024-01-15T11:19:14.499 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 52041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i7core_edac.ko 2024-01-15T11:19:14.499 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/i82975x_edac.ko 2024-01-15T11:19:14.499 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/ie31200_edac.ko 2024-01-15T11:19:14.499 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 56825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/sb_edac.ko 2024-01-15T11:19:14.499 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/edac/x38_edac.ko 2024-01-15T11:19:14.499 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/ 2024-01-15T11:19:14.499 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-gpio.ko 2024-01-15T11:19:14.499 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-max14577.ko 2024-01-15T11:19:14.499 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-max77693.ko 2024-01-15T11:19:14.499 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-max8997.ko 2024-01-15T11:19:14.499 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-palmas.ko 2024-01-15T11:19:14.499 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-rt8973a.ko 2024-01-15T11:19:14.499 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/extcon/extcon-sm5502.ko 2024-01-15T11:19:14.499 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/firmware/ 2024-01-15T11:19:14.499 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/firmware/dmi-sysfs.ko 2024-01-15T11:19:14.500 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/firmware/efi/ 2024-01-15T11:19:14.500 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/firmware/efi/efi-pstore.ko 2024-01-15T11:19:14.500 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-15T11:19:14.500 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/ 2024-01-15T11:19:14.500 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-adp5520.ko 2024-01-15T11:19:14.500 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-amd8111.ko 2024-01-15T11:19:14.500 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-arizona.ko 2024-01-15T11:19:14.500 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-da9052.ko 2024-01-15T11:19:14.500 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-da9055.ko 2024-01-15T11:19:14.500 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-dln2.ko 2024-01-15T11:19:14.500 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 77849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-f7188x.ko 2024-01-15T11:19:14.500 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-generic.ko 2024-01-15T11:19:14.500 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-ich.ko 2024-01-15T11:19:14.500 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-01-15T11:19:14.500 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-kempld.ko 2024-01-15T11:19:14.501 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-lp3943.ko 2024-01-15T11:19:14.501 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-max7300.ko 2024-01-15T11:19:14.501 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-max730x.ko 2024-01-15T11:19:14.501 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-max732x.ko 2024-01-15T11:19:14.501 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-01-15T11:19:14.501 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-pca953x.ko 2024-01-15T11:19:14.501 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-pcf857x.ko 2024-01-15T11:19:14.501 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-rdc321x.ko 2024-01-15T11:19:14.501 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-sch.ko 2024-01-15T11:19:14.501 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-sch311x.ko 2024-01-15T11:19:14.501 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-tps65912.ko 2024-01-15T11:19:14.501 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-twl4030.ko 2024-01-15T11:19:14.501 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-twl6040.ko 2024-01-15T11:19:14.501 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-15T11:19:14.502 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-vx855.ko 2024-01-15T11:19:14.502 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-wm831x.ko 2024-01-15T11:19:14.502 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-wm8350.ko 2024-01-15T11:19:14.502 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/gpio/gpio-wm8994.ko 2024-01-15T11:19:14.502 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/ 2024-01-15T11:19:14.502 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-a4tech.ko 2024-01-15T11:19:14.502 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-apple.ko 2024-01-15T11:19:14.502 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-appleir.ko 2024-01-15T11:19:14.502 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-aureal.ko 2024-01-15T11:19:14.502 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-axff.ko 2024-01-15T11:19:14.502 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-belkin.ko 2024-01-15T11:19:14.502 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-cherry.ko 2024-01-15T11:19:14.502 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-chicony.ko 2024-01-15T11:19:14.503 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 60649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-cp2112.ko 2024-01-15T11:19:14.503 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-cypress.ko 2024-01-15T11:19:14.503 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-dr.ko 2024-01-15T11:19:14.503 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-elecom.ko 2024-01-15T11:19:14.503 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-elo.ko 2024-01-15T11:19:14.503 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-emsff.ko 2024-01-15T11:19:14.503 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-ezkey.ko 2024-01-15T11:19:14.503 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-gaff.ko 2024-01-15T11:19:14.503 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-generic.ko 2024-01-15T11:19:14.503 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-gt683r.ko 2024-01-15T11:19:14.503 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-gyration.ko 2024-01-15T11:19:14.503 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-15T11:19:14.503 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-15T11:19:14.503 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-holtekff.ko 2024-01-15T11:19:14.504 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-hyperv.ko 2024-01-15T11:19:14.504 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-icade.ko 2024-01-15T11:19:14.504 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-kensington.ko 2024-01-15T11:19:14.504 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-keytouch.ko 2024-01-15T11:19:14.504 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-kye.ko 2024-01-15T11:19:14.504 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-lcpower.ko 2024-01-15T11:19:14.504 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-led.ko 2024-01-15T11:19:14.504 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 42297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-lenovo.ko 2024-01-15T11:19:14.504 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-lg-g15.ko 2024-01-15T11:19:14.504 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 58185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-15T11:19:14.504 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 101481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-15T11:19:14.504 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 80993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-logitech.ko 2024-01-15T11:19:14.504 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-magicmouse.ko 2024-01-15T11:19:14.504 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-microsoft.ko 2024-01-15T11:19:14.505 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-monterey.ko 2024-01-15T11:19:14.505 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 50161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-multitouch.ko 2024-01-15T11:19:14.505 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-ntrig.ko 2024-01-15T11:19:14.505 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-ortek.ko 2024-01-15T11:19:14.505 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-penmount.ko 2024-01-15T11:19:14.505 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-petalynx.ko 2024-01-15T11:19:14.505 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 72937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-picolcd.ko 2024-01-15T11:19:14.505 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-pl.ko 2024-01-15T11:19:14.505 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-plantronics.ko 2024-01-15T11:19:14.505 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-primax.ko 2024-01-15T11:19:14.505 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-rmi.ko 2024-01-15T11:19:14.505 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-15T11:19:14.505 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-common.ko 2024-01-15T11:19:14.505 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-15T11:19:14.506 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-15T11:19:14.506 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-15T11:19:14.506 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-15T11:19:14.506 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-15T11:19:14.506 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-15T11:19:14.506 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-15T11:19:14.506 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-15T11:19:14.506 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-15T11:19:14.506 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-roccat.ko 2024-01-15T11:19:14.506 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-saitek.ko 2024-01-15T11:19:14.506 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-samsung.ko 2024-01-15T11:19:14.506 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-15T11:19:14.506 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-sjoy.ko 2024-01-15T11:19:14.506 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-sony.ko 2024-01-15T11:19:14.506 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-speedlink.ko 2024-01-15T11:19:14.506 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-steelseries.ko 2024-01-15T11:19:14.507 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-sunplus.ko 2024-01-15T11:19:14.507 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-15T11:19:14.507 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-tivo.ko 2024-01-15T11:19:14.507 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-tmff.ko 2024-01-15T11:19:14.507 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-topseed.ko 2024-01-15T11:19:14.507 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-twinhan.ko 2024-01-15T11:19:14.507 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 71073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-uclogic.ko 2024-01-15T11:19:14.507 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-waltop.ko 2024-01-15T11:19:14.507 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 143473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-wiimote.ko 2024-01-15T11:19:14.507 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-xinmo.ko 2024-01-15T11:19:14.507 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-zpff.ko 2024-01-15T11:19:14.507 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid-zydacron.ko 2024-01-15T11:19:14.507 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 267825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/hid.ko 2024-01-15T11:19:14.507 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/uhid.ko 2024-01-15T11:19:14.507 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/usbhid/ 2024-01-15T11:19:14.507 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 125721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/usbhid/usbhid.ko 2024-01-15T11:19:14.507 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/usbhid/usbkbd.ko 2024-01-15T11:19:14.508 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/usbhid/usbmouse.ko 2024-01-15T11:19:14.508 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 217873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hid/wacom.ko 2024-01-15T11:19:14.508 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hv/ 2024-01-15T11:19:14.508 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 64201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hv/hv_balloon.ko 2024-01-15T11:19:14.508 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 89625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hv/hv_utils.ko 2024-01-15T11:19:14.508 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 305465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hv/hv_vmbus.ko 2024-01-15T11:19:14.508 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ 2024-01-15T11:19:14.508 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 66521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/abituguru.ko 2024-01-15T11:19:14.508 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 61393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/abituguru3.ko 2024-01-15T11:19:14.508 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-15T11:19:14.508 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ad7414.ko 2024-01-15T11:19:14.508 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ad7418.ko 2024-01-15T11:19:14.509 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adc128d818.ko 2024-01-15T11:19:14.509 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adm1025.ko 2024-01-15T11:19:14.509 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 97977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adm1026.ko 2024-01-15T11:19:14.509 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adm1029.ko 2024-01-15T11:19:14.509 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 45553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adm1031.ko 2024-01-15T11:19:14.509 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adm9240.ko 2024-01-15T11:19:14.509 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ads7828.ko 2024-01-15T11:19:14.509 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adt7410.ko 2024-01-15T11:19:14.509 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adt7411.ko 2024-01-15T11:19:14.509 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 74433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adt7462.ko 2024-01-15T11:19:14.509 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adt7470.ko 2024-01-15T11:19:14.509 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 67929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adt7475.ko 2024-01-15T11:19:14.509 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/adt7x10.ko 2024-01-15T11:19:14.509 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/amc6821.ko 2024-01-15T11:19:14.509 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 55201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/applesmc.ko 2024-01-15T11:19:14.510 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 49913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/asb100.ko 2024-01-15T11:19:14.510 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 58617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/asc7621.ko 2024-01-15T11:19:14.510 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 40825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-15T11:19:14.510 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/atxp1.ko 2024-01-15T11:19:14.510 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/coretemp.ko 2024-01-15T11:19:14.510 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/da9052-hwmon.ko 2024-01-15T11:19:14.510 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/da9055-hwmon.ko 2024-01-15T11:19:14.510 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 44465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-15T11:19:14.510 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 99601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/dme1737.ko 2024-01-15T11:19:14.510 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ds1621.ko 2024-01-15T11:19:14.510 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ds620.ko 2024-01-15T11:19:14.510 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/emc1403.ko 2024-01-15T11:19:14.510 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/emc2103.ko 2024-01-15T11:19:14.510 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/emc6w201.ko 2024-01-15T11:19:14.510 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 66985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/f71805f.ko 2024-01-15T11:19:14.511 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 94457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/f71882fg.ko 2024-01-15T11:19:14.511 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/f75375s.ko 2024-01-15T11:19:14.511 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/fam15h_power.ko 2024-01-15T11:19:14.511 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 55449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/fschmd.ko 2024-01-15T11:19:14.511 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/g760a.ko 2024-01-15T11:19:14.511 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/g762.ko 2024-01-15T11:19:14.511 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 46801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/gl518sm.ko 2024-01-15T11:19:14.511 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 45529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/gl520sm.ko 2024-01-15T11:19:14.511 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/hih6130.ko 2024-01-15T11:19:14.511 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-15T11:19:14.511 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/i5500_temp.ko 2024-01-15T11:19:14.511 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/i5k_amb.ko 2024-01-15T11:19:14.512 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ibmaem.ko 2024-01-15T11:19:14.512 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ibmpex.ko 2024-01-15T11:19:14.512 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ina209.ko 2024-01-15T11:19:14.512 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ina2xx.ko 2024-01-15T11:19:14.512 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 130449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/it87.ko 2024-01-15T11:19:14.512 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/jc42.ko 2024-01-15T11:19:14.512 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/k10temp.ko 2024-01-15T11:19:14.512 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/k8temp.ko 2024-01-15T11:19:14.512 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lineage-pem.ko 2024-01-15T11:19:14.512 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 48601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm63.ko 2024-01-15T11:19:14.512 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm73.ko 2024-01-15T11:19:14.512 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm75.ko 2024-01-15T11:19:14.512 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm77.ko 2024-01-15T11:19:14.513 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm78.ko 2024-01-15T11:19:14.513 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm80.ko 2024-01-15T11:19:14.513 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm83.ko 2024-01-15T11:19:14.513 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 72833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm85.ko 2024-01-15T11:19:14.513 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 46153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm87.ko 2024-01-15T11:19:14.513 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm90.ko 2024-01-15T11:19:14.513 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm92.ko 2024-01-15T11:19:14.513 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 108841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm93.ko 2024-01-15T11:19:14.513 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm95234.ko 2024-01-15T11:19:14.513 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm95241.ko 2024-01-15T11:19:14.514 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/lm95245.ko 2024-01-15T11:19:14.514 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc2945.ko 2024-01-15T11:19:14.514 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc4151.ko 2024-01-15T11:19:14.514 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc4215.ko 2024-01-15T11:19:14.514 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc4222.ko 2024-01-15T11:19:14.514 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc4245.ko 2024-01-15T11:19:14.514 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc4260.ko 2024-01-15T11:19:14.514 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/ltc4261.ko 2024-01-15T11:19:14.514 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max16065.ko 2024-01-15T11:19:14.514 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max1619.ko 2024-01-15T11:19:14.514 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max1668.ko 2024-01-15T11:19:14.514 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max197.ko 2024-01-15T11:19:14.514 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max6639.ko 2024-01-15T11:19:14.514 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max6650.ko 2024-01-15T11:19:14.514 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/max6697.ko 2024-01-15T11:19:14.515 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/mc13783-adc.ko 2024-01-15T11:19:14.515 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/mcp3021.ko 2024-01-15T11:19:14.515 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-01-15T11:19:14.515 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 44129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/nct6683.ko 2024-01-15T11:19:14.515 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 119817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/nct6775-core.ko 2024-01-15T11:19:14.515 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 60705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/nct6775.ko 2024-01-15T11:19:14.515 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 59737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/nct7802.ko 2024-01-15T11:19:14.515 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 82337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pc87360.ko 2024-01-15T11:19:14.515 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 54433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pc87427.ko 2024-01-15T11:19:14.515 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pcf8591.ko 2024-01-15T11:19:14.515 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/ 2024-01-15T11:19:14.515 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-15T11:19:14.515 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-15T11:19:14.515 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-15T11:19:14.515 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-15T11:19:14.515 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-15T11:19:14.516 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-15T11:19:14.516 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-15T11:19:14.516 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 82577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-15T11:19:14.516 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-15T11:19:14.516 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-15T11:19:14.516 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-15T11:19:14.516 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-15T11:19:14.516 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/powr1220.ko 2024-01-15T11:19:14.516 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/sch5627.ko 2024-01-15T11:19:14.516 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/sch5636.ko 2024-01-15T11:19:14.516 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-15T11:19:14.516 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/sht15.ko 2024-01-15T11:19:14.516 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/sht21.ko 2024-01-15T11:19:14.516 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/shtc1.ko 2024-01-15T11:19:14.516 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 40105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/sis5595.ko 2024-01-15T11:19:14.517 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/smsc47b397.ko 2024-01-15T11:19:14.517 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/smsc47m1.ko 2024-01-15T11:19:14.517 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/smsc47m192.ko 2024-01-15T11:19:14.517 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/thmc50.ko 2024-01-15T11:19:14.517 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/tmp102.ko 2024-01-15T11:19:14.517 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/tmp103.ko 2024-01-15T11:19:14.517 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/tmp401.ko 2024-01-15T11:19:14.517 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/tmp421.ko 2024-01-15T11:19:14.517 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/via-cputemp.ko 2024-01-15T11:19:14.517 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/via686a.ko 2024-01-15T11:19:14.517 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 52457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/vt1211.ko 2024-01-15T11:19:14.517 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/vt8231.ko 2024-01-15T11:19:14.517 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 57449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83627ehf.ko 2024-01-15T11:19:14.517 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 78873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83627hf.ko 2024-01-15T11:19:14.517 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 71345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83781d.ko 2024-01-15T11:19:14.517 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 63225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83791d.ko 2024-01-15T11:19:14.517 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 71321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83792d.ko 2024-01-15T11:19:14.518 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 101473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83793.ko 2024-01-15T11:19:14.518 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 119505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83795.ko 2024-01-15T11:19:14.518 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83l785ts.ko 2024-01-15T11:19:14.518 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/w83l786ng.ko 2024-01-15T11:19:14.518 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-01-15T11:19:14.518 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-01-15T11:19:14.518 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/ 2024-01-15T11:19:14.518 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/algos/ 2024-01-15T11:19:14.518 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-15T11:19:14.518 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-15T11:19:14.518 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/ 2024-01-15T11:19:14.518 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-01-15T11:19:14.518 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-01-15T11:19:14.518 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-01-15T11:19:14.519 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-15T11:19:14.519 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-15T11:19:14.519 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-15T11:19:14.519 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-01-15T11:19:14.519 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 6929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-15T11:19:14.519 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-01-15T11:19:14.519 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 50201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-15T11:19:14.519 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-15T11:19:14.519 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-15T11:19:14.519 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-15T11:19:14.519 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-01-15T11:19:14.519 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-01-15T11:19:14.519 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 62817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-15T11:19:14.519 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-15T11:19:14.519 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-15T11:19:14.519 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-01-15T11:19:14.520 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-15T11:19:14.520 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-15T11:19:14.520 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-01-15T11:19:14.520 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-15T11:19:14.520 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-15T11:19:14.520 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-15T11:19:14.520 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-01-15T11:19:14.520 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-15T11:19:14.520 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-15T11:19:14.520 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-01-15T11:19:14.520 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-01-15T11:19:14.520 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-15T11:19:14.520 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-01-15T11:19:14.521 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-15T11:19:14.521 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-15T11:19:14.521 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-15T11:19:14.521 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-15T11:19:14.521 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-01-15T11:19:14.521 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/i2c-mux.ko 2024-01-15T11:19:14.521 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/i2c-smbus.ko 2024-01-15T11:19:14.521 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/i2c-stub.ko 2024-01-15T11:19:14.521 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/muxes/ 2024-01-15T11:19:14.521 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-01-15T11:19:14.521 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-01-15T11:19:14.521 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-01-15T11:19:14.521 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ 2024-01-15T11:19:14.521 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/ 2024-01-15T11:19:14.521 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 273609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-15T11:19:14.522 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 879969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/ib_core.ko 2024-01-15T11:19:14.522 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 69273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-15T11:19:14.522 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 324217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-15T11:19:14.522 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 97985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-15T11:19:14.522 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 282273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-15T11:19:14.522 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 66201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-15T11:19:14.522 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/ 2024-01-15T11:19:14.522 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/cxgb4/ 2024-01-15T11:19:14.522 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 493073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-15T11:19:14.522 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/mlx4/ 2024-01-15T11:19:14.522 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 419737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-15T11:19:14.522 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/mlx5/ 2024-01-15T11:19:14.522 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 739025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-15T11:19:14.522 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/mthca/ 2024-01-15T11:19:14.522 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 296625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-15T11:19:14.522 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/ocrdma/ 2024-01-15T11:19:14.523 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 153697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-01-15T11:19:14.523 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/usnic/ 2024-01-15T11:19:14.523 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 168969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-01-15T11:19:14.523 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/ 2024-01-15T11:19:14.523 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/ipoib/ 2024-01-15T11:19:14.523 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 263081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-15T11:19:14.523 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/iser/ 2024-01-15T11:19:14.523 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 100241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-15T11:19:14.523 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/isert/ 2024-01-15T11:19:14.523 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 111425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-15T11:19:14.523 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/srp/ 2024-01-15T11:19:14.523 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 128753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-15T11:19:14.523 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/srpt/ 2024-01-15T11:19:14.523 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 129529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-15T11:19:14.523 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/ 2024-01-15T11:19:14.524 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/evbug.ko 2024-01-15T11:19:14.524 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/ff-memless.ko 2024-01-15T11:19:14.524 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/gameport/ 2024-01-15T11:19:14.524 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-15T11:19:14.524 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-15T11:19:14.524 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/gameport/gameport.ko 2024-01-15T11:19:14.524 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/joydev.ko 2024-01-15T11:19:14.524 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/ 2024-01-15T11:19:14.524 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-01-15T11:19:14.524 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-01-15T11:19:14.524 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-01-15T11:19:14.524 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24761 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-01-15T11:19:14.524 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-15T11:19:14.524 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-01-15T11:19:14.525 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/lkkbd.ko 2024-01-15T11:19:14.525 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/lm8323.ko 2024-01-15T11:19:14.525 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/lm8333.ko 2024-01-15T11:19:14.525 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-01-15T11:19:14.525 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-01-15T11:19:14.525 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-01-15T11:19:14.525 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-01-15T11:19:14.525 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/newtonkbd.ko 2024-01-15T11:19:14.525 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-01-15T11:19:14.525 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/qt1070.ko 2024-01-15T11:19:14.525 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/qt2160.ko 2024-01-15T11:19:14.525 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-01-15T11:19:14.525 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/stowaway.ko 2024-01-15T11:19:14.525 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/sunkbd.ko 2024-01-15T11:19:14.525 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-01-15T11:19:14.525 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-01-15T11:19:14.526 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-01-15T11:19:14.526 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/keyboard/xtkbd.ko 2024-01-15T11:19:14.526 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/matrix-keymap.ko 2024-01-15T11:19:14.526 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/ 2024-01-15T11:19:14.526 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/appletouch.ko 2024-01-15T11:19:14.526 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/bcm5974.ko 2024-01-15T11:19:14.526 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 123681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/cyapatp.ko 2024-01-15T11:19:14.526 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 89449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-15T11:19:14.526 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/gpio_mouse.ko 2024-01-15T11:19:14.526 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 335929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/psmouse.ko 2024-01-15T11:19:14.526 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/sermouse.ko 2024-01-15T11:19:14.526 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-15T11:19:14.526 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-15T11:19:14.526 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-15T11:19:14.526 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/rmi4/ 2024-01-15T11:19:14.526 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 109873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-15T11:19:14.527 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/ 2024-01-15T11:19:14.527 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/altera_ps2.ko 2024-01-15T11:19:14.527 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/arc_ps2.ko 2024-01-15T11:19:14.527 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/ct82c710.ko 2024-01-15T11:19:14.527 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-15T11:19:14.527 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/parkbd.ko 2024-01-15T11:19:14.527 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/pcips2.ko 2024-01-15T11:19:14.527 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/ps2mult.ko 2024-01-15T11:19:14.527 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/serio_raw.ko 2024-01-15T11:19:14.527 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/serio/serport.ko 2024-01-15T11:19:14.527 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/input/sparse-keymap.ko 2024-01-15T11:19:14.527 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/iommu/ 2024-01-15T11:19:14.527 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/iommu/amd/ 2024-01-15T11:19:14.527 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/iommu/amd/iommu_v2.ko 2024-01-15T11:19:14.527 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/ 2024-01-15T11:19:14.528 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-88pm860x.ko 2024-01-15T11:19:14.528 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-adp5520.ko 2024-01-15T11:19:14.528 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 59753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-bd2802.ko 2024-01-15T11:19:14.528 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-blinkm.ko 2024-01-15T11:19:14.528 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-da903x.ko 2024-01-15T11:19:14.528 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-da9052.ko 2024-01-15T11:19:14.528 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-gpio.ko 2024-01-15T11:19:14.528 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-lm3530.ko 2024-01-15T11:19:14.528 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-lm3533.ko 2024-01-15T11:19:14.528 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-lm355x.ko 2024-01-15T11:19:14.528 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-lm3642.ko 2024-01-15T11:19:14.528 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-lp3944.ko 2024-01-15T11:19:14.528 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-lp8788.ko 2024-01-15T11:19:14.528 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-max8997.ko 2024-01-15T11:19:14.529 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-mc13783.ko 2024-01-15T11:19:14.529 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-menf21bmc.ko 2024-01-15T11:19:14.529 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-pca9532.ko 2024-01-15T11:19:14.529 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-pca955x.ko 2024-01-15T11:19:14.529 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-pca963x.ko 2024-01-15T11:19:14.529 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-ss4200.ko 2024-01-15T11:19:14.529 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-tca6507.ko 2024-01-15T11:19:14.529 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-wm831x-status.ko 2024-01-15T11:19:14.529 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/leds-wm8350.ko 2024-01-15T11:19:14.529 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ 2024-01-15T11:19:14.529 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-15T11:19:14.529 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-15T11:19:14.529 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-15T11:19:14.529 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-15T11:19:14.529 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-15T11:19:14.529 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-15T11:19:14.530 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-15T11:19:14.530 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-15T11:19:14.530 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/ 2024-01-15T11:19:14.530 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/bcache/ 2024-01-15T11:19:14.530 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 654969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/bcache/bcache.ko 2024-01-15T11:19:14.530 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 40577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-bio-prison.ko 2024-01-15T11:19:14.530 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 89601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-bufio.ko 2024-01-15T11:19:14.530 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-cache-smq.ko 2024-01-15T11:19:14.530 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 156009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-cache.ko 2024-01-15T11:19:14.530 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 106897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-crypt.ko 2024-01-15T11:19:14.530 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-delay.ko 2024-01-15T11:19:14.530 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 53857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-era.ko 2024-01-15T11:19:14.530 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-flakey.ko 2024-01-15T11:19:14.530 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-log-userspace.ko 2024-01-15T11:19:14.530 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-log.ko 2024-01-15T11:19:14.530 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 49545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-mirror.ko 2024-01-15T11:19:14.530 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 78033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-multipath.ko 2024-01-15T11:19:14.531 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-queue-length.ko 2024-01-15T11:19:14.531 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 70825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-raid.ko 2024-01-15T11:19:14.531 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-region-hash.ko 2024-01-15T11:19:14.531 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-round-robin.ko 2024-01-15T11:19:14.531 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-service-time.ko 2024-01-15T11:19:14.531 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 109529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-snapshot.ko 2024-01-15T11:19:14.531 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-switch.ko 2024-01-15T11:19:14.531 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 181865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-thin-pool.ko 2024-01-15T11:19:14.531 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-verity.ko 2024-01-15T11:19:14.531 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/dm-zero.ko 2024-01-15T11:19:14.531 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/faulty.ko 2024-01-15T11:19:14.531 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/linear.ko 2024-01-15T11:19:14.531 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/multipath.ko 2024-01-15T11:19:14.531 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/persistent-data/ 2024-01-15T11:19:14.531 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 199937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-15T11:19:14.531 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/raid0.ko 2024-01-15T11:19:14.532 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 113073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/raid1.ko 2024-01-15T11:19:14.532 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 158681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/raid10.ko 2024-01-15T11:19:14.532 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 395721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/md/raid456.ko 2024-01-15T11:19:14.532 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/ 2024-01-15T11:19:14.532 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/ 2024-01-15T11:19:14.532 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 178137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptbase.ko 2024-01-15T11:19:14.532 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 63385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptctl.ko 2024-01-15T11:19:14.532 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 44665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptfc.ko 2024-01-15T11:19:14.532 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptlan.ko 2024-01-15T11:19:14.532 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 123321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptsas.ko 2024-01-15T11:19:14.532 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 79041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptscsih.ko 2024-01-15T11:19:14.532 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 53017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/message/fusion/mptspi.ko 2024-01-15T11:19:14.532 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/ 2024-01-15T11:19:14.532 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/88pm800.ko 2024-01-15T11:19:14.532 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12761 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/88pm805.ko 2024-01-15T11:19:14.533 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/88pm80x.ko 2024-01-15T11:19:14.533 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/arizona-i2c.ko 2024-01-15T11:19:14.533 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 123721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/arizona.ko 2024-01-15T11:19:14.533 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/bcm590xx.ko 2024-01-15T11:19:14.533 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/cros_ec_dev.ko 2024-01-15T11:19:14.533 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/dln2.ko 2024-01-15T11:19:14.533 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/janz-cmodio.ko 2024-01-15T11:19:14.533 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 53585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/kempld-core.ko 2024-01-15T11:19:14.533 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/lm3533-core.ko 2024-01-15T11:19:14.533 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-01-15T11:19:14.533 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/lp3943.ko 2024-01-15T11:19:14.533 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 54569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/lpc_ich.ko 2024-01-15T11:19:14.533 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/lpc_sch.ko 2024-01-15T11:19:14.533 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/max8907.ko 2024-01-15T11:19:14.533 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/mc13xxx-core.ko 2024-01-15T11:19:14.533 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-01-15T11:19:14.533 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/menf21bmc.ko 2024-01-15T11:19:14.534 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/pcf50633-adc.ko 2024-01-15T11:19:14.534 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/pcf50633-gpio.ko 2024-01-15T11:19:14.534 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/pcf50633.ko 2024-01-15T11:19:14.534 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-01-15T11:19:14.534 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/retu-mfd.ko 2024-01-15T11:19:14.534 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 80425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/si476x-core.ko 2024-01-15T11:19:14.534 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 48457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/sm501.ko 2024-01-15T11:19:14.534 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/ti_am335x_tscadc.ko 2024-01-15T11:19:14.534 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/tps65010.ko 2024-01-15T11:19:14.534 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/tps6507x.ko 2024-01-15T11:19:14.534 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/viperboard.ko 2024-01-15T11:19:14.534 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/vx855.ko 2024-01-15T11:19:14.534 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/wl1273-core.ko 2024-01-15T11:19:14.534 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 44345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/mfd/wm8994.ko 2024-01-15T11:19:14.534 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ 2024-01-15T11:19:14.534 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-01-15T11:19:14.535 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 48489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ad525x_dpot.ko 2024-01-15T11:19:14.535 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/altera-stapl/ 2024-01-15T11:19:14.535 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 46585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-15T11:19:14.535 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/apds9802als.ko 2024-01-15T11:19:14.535 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/apds990x.ko 2024-01-15T11:19:14.535 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 45593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/bh1770glc.ko 2024-01-15T11:19:14.535 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/c2port/ 2024-01-15T11:19:14.535 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-01-15T11:19:14.535 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/c2port/core.ko 2024-01-15T11:19:14.535 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/cb710/ 2024-01-15T11:19:14.535 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/cb710/cb710.ko 2024-01-15T11:19:14.535 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ds1682.ko 2024-01-15T11:19:14.535 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/dummy-irq.ko 2024-01-15T11:19:14.535 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/echo/ 2024-01-15T11:19:14.535 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/echo/echo.ko 2024-01-15T11:19:14.535 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/eeprom/ 2024-01-15T11:19:14.535 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/eeprom/at24.ko 2024-01-15T11:19:14.536 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/eeprom/eeprom.ko 2024-01-15T11:19:14.536 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-15T11:19:14.536 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/eeprom/max6875.ko 2024-01-15T11:19:14.536 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/enclosure.ko 2024-01-15T11:19:14.536 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/genwqe/ 2024-01-15T11:19:14.536 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 152201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-01-15T11:19:14.536 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/hmc6352.ko 2024-01-15T11:19:14.536 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/hpilo.ko 2024-01-15T11:19:14.536 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ibmasm/ 2024-01-15T11:19:14.536 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 72129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-01-15T11:19:14.536 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ics932s401.ko 2024-01-15T11:19:14.536 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/isl29003.ko 2024-01-15T11:19:14.536 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/isl29020.ko 2024-01-15T11:19:14.536 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/lis3lv02d/ 2024-01-15T11:19:14.537 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 42513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-15T11:19:14.537 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-15T11:19:14.537 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/mei/ 2024-01-15T11:19:14.537 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 125209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/mei/mei-me.ko 2024-01-15T11:19:14.537 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 56521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/mei/mei-txe.ko 2024-01-15T11:19:14.537 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 310113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/mei/mei.ko 2024-01-15T11:19:14.537 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/phantom.ko 2024-01-15T11:19:14.537 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ti-st/ 2024-01-15T11:19:14.537 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 74265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/ti-st/st_drv.ko 2024-01-15T11:19:14.537 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/tifm_7xx1.ko 2024-01-15T11:19:14.537 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/tifm_core.ko 2024-01-15T11:19:14.537 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/tsl2550.ko 2024-01-15T11:19:14.537 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 48697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/vmw_balloon.ko 2024-01-15T11:19:14.537 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/vmw_vmci/ 2024-01-15T11:19:14.537 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 183609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-15T11:19:14.537 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ 2024-01-15T11:19:14.538 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/bonding/ 2024-01-15T11:19:14.538 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 490129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/bonding/bonding.ko 2024-01-15T11:19:14.538 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/ 2024-01-15T11:19:14.538 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/b53/ 2024-01-15T11:19:14.538 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 106033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-15T11:19:14.538 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 40417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-15T11:19:14.538 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-15T11:19:14.538 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/mv88e6xxx/ 2024-01-15T11:19:14.538 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 453737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-15T11:19:14.538 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/dummy.ko 2024-01-15T11:19:14.538 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/eql.ko 2024-01-15T11:19:14.538 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/ 2024-01-15T11:19:14.538 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/3com/ 2024-01-15T11:19:14.538 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 45785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-15T11:19:14.538 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 42105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-15T11:19:14.538 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 130553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-15T11:19:14.539 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 68849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-15T11:19:14.539 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/8390/ 2024-01-15T11:19:14.539 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-15T11:19:14.539 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 59689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-15T11:19:14.539 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-15T11:19:14.539 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 99049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-15T11:19:14.539 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/adaptec/ 2024-01-15T11:19:14.539 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 54521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-15T11:19:14.539 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/agere/ 2024-01-15T11:19:14.539 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 69137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-15T11:19:14.539 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/alteon/ 2024-01-15T11:19:14.539 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 59585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-15T11:19:14.539 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/altera/ 2024-01-15T11:19:14.539 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-15T11:19:14.539 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/amd/ 2024-01-15T11:19:14.539 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 54609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-15T11:19:14.539 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 49289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-15T11:19:14.540 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 87297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-15T11:19:14.540 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/ 2024-01-15T11:19:14.540 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/alx/ 2024-01-15T11:19:14.540 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 97337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-15T11:19:14.540 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-01-15T11:19:14.540 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 104673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-15T11:19:14.540 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-01-15T11:19:14.540 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 90257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-15T11:19:14.540 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atlx/ 2024-01-15T11:19:14.540 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 81569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-15T11:19:14.540 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 69729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-15T11:19:14.540 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/ 2024-01-15T11:19:14.540 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 78401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-15T11:19:14.540 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 176761 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-15T11:19:14.541 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-01-15T11:19:14.541 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1421497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-15T11:19:14.541 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 128569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-15T11:19:14.541 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/genet/ 2024-01-15T11:19:14.541 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 132089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-15T11:19:14.541 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 312081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-15T11:19:14.541 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/brocade/ 2024-01-15T11:19:14.541 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/brocade/bna/ 2024-01-15T11:19:14.541 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 323513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-15T11:19:14.541 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/ 2024-01-15T11:19:14.541 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-01-15T11:19:14.541 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 193497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-15T11:19:14.541 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-01-15T11:19:14.541 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 347417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-15T11:19:14.611 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-01-15T11:19:14.611 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1044497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-15T11:19:14.611 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-01-15T11:19:14.612 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 166193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-15T11:19:14.612 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-01-15T11:19:14.612 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-15T11:19:14.612 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/cisco/ 2024-01-15T11:19:14.612 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/cisco/enic/ 2024-01-15T11:19:14.612 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 204345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-15T11:19:14.612 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/ 2024-01-15T11:19:14.612 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/ 2024-01-15T11:19:14.612 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 69449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-15T11:19:14.612 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 61489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-15T11:19:14.612 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 141225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-15T11:19:14.613 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-15T11:19:14.613 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 62817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-15T11:19:14.613 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-15T11:19:14.613 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dlink/ 2024-01-15T11:19:14.613 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 60873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-15T11:19:14.613 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 62833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-15T11:19:14.613 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 45721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/dnet.ko 2024-01-15T11:19:14.613 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/ec_bhf.ko 2024-01-15T11:19:14.613 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/emulex/ 2024-01-15T11:19:14.613 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/emulex/benet/ 2024-01-15T11:19:14.613 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 281137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-15T11:19:14.613 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 49457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/ethoc.ko 2024-01-15T11:19:14.614 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/fealnx.ko 2024-01-15T11:19:14.614 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/fujitsu/ 2024-01-15T11:19:14.614 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 45345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-01-15T11:19:14.614 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/ 2024-01-15T11:19:14.614 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 90465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-15T11:19:14.614 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/e1000/ 2024-01-15T11:19:14.614 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 295577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-15T11:19:14.614 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/e1000e/ 2024-01-15T11:19:14.614 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 584497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-15T11:19:14.614 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/fm10k/ 2024-01-15T11:19:14.614 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 246209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-15T11:19:14.614 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/i40e/ 2024-01-15T11:19:14.614 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 925825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-15T11:19:14.615 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/iavf/ 2024-01-15T11:19:14.615 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 302937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-15T11:19:14.615 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/igb/ 2024-01-15T11:19:14.615 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 514641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-15T11:19:14.615 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/igbvf/ 2024-01-15T11:19:14.615 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 93593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-15T11:19:14.615 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-01-15T11:19:14.615 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 734305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-15T11:19:14.615 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-01-15T11:19:14.615 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 151769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-15T11:19:14.615 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 86921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/jme.ko 2024-01-15T11:19:14.615 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/marvell/ 2024-01-15T11:19:14.615 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-15T11:19:14.615 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 102289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-15T11:19:14.616 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 122649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-15T11:19:14.616 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/ 2024-01-15T11:19:14.616 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-01-15T11:19:14.616 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 727601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-15T11:19:14.616 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 278937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-15T11:19:14.616 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-01-15T11:19:14.616 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-01-15T11:19:14.616 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1113681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-15T11:19:14.616 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/micrel/ 2024-01-15T11:19:14.616 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 53041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-01-15T11:19:14.616 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 40993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-01-15T11:19:14.616 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-01-15T11:19:14.616 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 95665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-15T11:19:14.617 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/myricom/ 2024-01-15T11:19:14.617 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-01-15T11:19:14.617 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 108649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-15T11:19:14.617 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/natsemi/ 2024-01-15T11:19:14.617 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 73441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-15T11:19:14.617 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-15T11:19:14.617 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/neterion/ 2024-01-15T11:19:14.617 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 150905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-15T11:19:14.617 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/nvidia/ 2024-01-15T11:19:14.617 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 136721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-15T11:19:14.617 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/packetengines/ 2024-01-15T11:19:14.618 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 50481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-15T11:19:14.618 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 43145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-15T11:19:14.618 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/qlogic/ 2024-01-15T11:19:14.618 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-01-15T11:19:14.618 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 227897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-15T11:19:14.618 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 87081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-15T11:19:14.618 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-01-15T11:19:14.618 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 672049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-15T11:19:14.618 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/rdc/ 2024-01-15T11:19:14.618 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 43017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-15T11:19:14.618 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/realtek/ 2024-01-15T11:19:14.618 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 67385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-15T11:19:14.618 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 83985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-15T11:19:14.618 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-15T11:19:14.618 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 189801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-15T11:19:14.618 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/samsung/ 2024-01-15T11:19:14.619 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-01-15T11:19:14.619 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 104241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-01-15T11:19:14.619 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sfc/ 2024-01-15T11:19:14.619 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1052497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-15T11:19:14.619 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/silan/ 2024-01-15T11:19:14.619 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-15T11:19:14.619 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sis/ 2024-01-15T11:19:14.619 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 54817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-15T11:19:14.619 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 63337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-15T11:19:14.619 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/smsc/ 2024-01-15T11:19:14.619 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 61537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-15T11:19:14.619 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 67193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-15T11:19:14.619 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 73409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-15T11:19:14.619 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 68177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-15T11:19:14.619 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/stmicro/ 2024-01-15T11:19:14.619 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-01-15T11:19:14.620 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-01-15T11:19:14.620 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-15T11:19:14.620 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-01-15T11:19:14.620 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 487025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-15T11:19:14.620 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sun/ 2024-01-15T11:19:14.620 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 103337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-15T11:19:14.620 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 166097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-15T11:19:14.620 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 66329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-15T11:19:14.620 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 78801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-15T11:19:14.620 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/tehuti/ 2024-01-15T11:19:14.620 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 50057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-15T11:19:14.620 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/ti/ 2024-01-15T11:19:14.620 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 86529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-15T11:19:14.620 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/via/ 2024-01-15T11:19:14.620 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 80273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-15T11:19:14.621 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 83633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-15T11:19:14.621 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/wiznet/ 2024-01-15T11:19:14.621 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 46241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-15T11:19:14.621 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-15T11:19:14.621 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/xircom/ 2024-01-15T11:19:14.621 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 59993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-15T11:19:14.621 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/fddi/ 2024-01-15T11:19:14.621 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/fddi/defxx.ko 2024-01-15T11:19:14.621 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/fddi/skfp/ 2024-01-15T11:19:14.621 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 216985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/fddi/skfp/skfp.ko 2024-01-15T11:19:14.621 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 77345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/geneve.ko 2024-01-15T11:19:14.621 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/hyperv/ 2024-01-15T11:19:14.621 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 235521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-15T11:19:14.622 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ieee802154/ 2024-01-15T11:19:14.622 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-15T11:19:14.622 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ifb.ko 2024-01-15T11:19:14.622 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ipvlan/ 2024-01-15T11:19:14.622 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 83769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-15T11:19:14.622 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 62145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/macvlan.ko 2024-01-15T11:19:14.622 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/macvtap.ko 2024-01-15T11:19:14.622 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mdio/ 2024-01-15T11:19:14.622 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-15T11:19:14.622 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-15T11:19:14.622 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mdio/mdio-gpio.ko 2024-01-15T11:19:14.622 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-15T11:19:14.622 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mdio.ko 2024-01-15T11:19:14.622 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/mii.ko 2024-01-15T11:19:14.623 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 43953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/netconsole.ko 2024-01-15T11:19:14.623 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/nlmon.ko 2024-01-15T11:19:14.623 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/pcs/ 2024-01-15T11:19:14.623 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-15T11:19:14.623 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-15T11:19:14.623 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/ 2024-01-15T11:19:14.623 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/amd.ko 2024-01-15T11:19:14.623 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 50033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-15T11:19:14.623 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 44721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-15T11:19:14.623 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/bcm87xx.ko 2024-01-15T11:19:14.623 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 42241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/broadcom.ko 2024-01-15T11:19:14.623 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/cicada.ko 2024-01-15T11:19:14.623 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/davicom.ko 2024-01-15T11:19:14.623 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/et1011c.ko 2024-01-15T11:19:14.623 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/icplus.ko 2024-01-15T11:19:14.623 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/lxt.ko 2024-01-15T11:19:14.624 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 82049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/marvell.ko 2024-01-15T11:19:14.624 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 76113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/micrel.ko 2024-01-15T11:19:14.624 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/national.ko 2024-01-15T11:19:14.624 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 97857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/phylink.ko 2024-01-15T11:19:14.624 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/qsemi.ko 2024-01-15T11:19:14.624 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 50065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/realtek.ko 2024-01-15T11:19:14.624 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/smsc.ko 2024-01-15T11:19:14.624 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/ste10Xp.ko 2024-01-15T11:19:14.624 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/phy/vitesse.ko 2024-01-15T11:19:14.624 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/plip/ 2024-01-15T11:19:14.624 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 43505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/plip/plip.ko 2024-01-15T11:19:14.624 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/ 2024-01-15T11:19:14.624 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-15T11:19:14.624 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/ppp_async.ko 2024-01-15T11:19:14.624 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-15T11:19:14.624 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-15T11:19:14.625 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-15T11:19:14.625 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 42545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/pppoe.ko 2024-01-15T11:19:14.625 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/pppox.ko 2024-01-15T11:19:14.625 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/ppp/pptp.ko 2024-01-15T11:19:14.625 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/sb1000.ko 2024-01-15T11:19:14.625 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/slip/ 2024-01-15T11:19:14.625 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 42465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/slip/slip.ko 2024-01-15T11:19:14.625 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/sungem_phy.ko 2024-01-15T11:19:14.625 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 64449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/tap.ko 2024-01-15T11:19:14.625 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/ 2024-01-15T11:19:14.625 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 106169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/team.ko 2024-01-15T11:19:14.625 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-15T11:19:14.625 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-15T11:19:14.625 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-15T11:19:14.625 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/team_mode_random.ko 2024-01-15T11:19:14.625 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-15T11:19:14.625 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 87017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/veth.ko 2024-01-15T11:19:14.626 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/vmxnet3/ 2024-01-15T11:19:14.626 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 144297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-15T11:19:14.626 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/vxlan/ 2024-01-15T11:19:14.626 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 297329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/vxlan/vxlan.ko 2024-01-15T11:19:14.626 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/xen-netback/ 2024-01-15T11:19:14.626 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 144585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-15T11:19:14.626 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ntb/ 2024-01-15T11:19:14.626 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ntb/ntb.ko 2024-01-15T11:19:14.626 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/nvme/ 2024-01-15T11:19:14.626 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/nvme/host/ 2024-01-15T11:19:14.626 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 265121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/nvme/host/nvme-core.ko 2024-01-15T11:19:14.626 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 102209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/nvme/host/nvme.ko 2024-01-15T11:19:14.626 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/parport/ 2024-01-15T11:19:14.626 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 133841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/parport/parport.ko 2024-01-15T11:19:14.626 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/parport/parport_cs.ko 2024-01-15T11:19:14.626 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 84465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/parport/parport_pc.ko 2024-01-15T11:19:14.627 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/parport/parport_serial.ko 2024-01-15T11:19:14.627 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/ 2024-01-15T11:19:14.627 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/hotplug/ 2024-01-15T11:19:14.627 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-15T11:19:14.627 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-01-15T11:19:14.627 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-01-15T11:19:14.627 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/pci-stub.ko 2024-01-15T11:19:14.627 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 46465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pci/xen-pcifront.ko 2024-01-15T11:19:14.627 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/ 2024-01-15T11:19:14.627 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/i82092.ko 2024-01-15T11:19:14.627 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 145809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/pcmcia.ko 2024-01-15T11:19:14.627 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 62137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/pcmcia_core.ko 2024-01-15T11:19:14.627 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-01-15T11:19:14.627 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/pd6729.ko 2024-01-15T11:19:14.628 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 112889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-15T11:19:14.628 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/phy/ 2024-01-15T11:19:14.628 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/phy/broadcom/ 2024-01-15T11:19:14.628 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-01-15T11:19:14.628 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/phy/samsung/ 2024-01-15T11:19:14.628 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-01-15T11:19:14.628 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pinctrl/ 2024-01-15T11:19:14.628 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pinctrl/intel/ 2024-01-15T11:19:14.628 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 70153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-15T11:19:14.628 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/ 2024-01-15T11:19:14.628 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/ 2024-01-15T11:19:14.628 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 50889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-01-15T11:19:14.629 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros_ec.ko 2024-01-15T11:19:14.629 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-01-15T11:19:14.629 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-01-15T11:19:14.629 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-01-15T11:19:14.629 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-01-15T11:19:14.629 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-01-15T11:19:14.629 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/ 2024-01-15T11:19:14.629 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 67097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-15T11:19:14.629 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/acerhdf.ko 2024-01-15T11:19:14.629 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-15T11:19:14.629 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 59665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-15T11:19:14.629 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-15T11:19:14.629 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 127441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-15T11:19:14.629 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-15T11:19:14.629 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 49121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-15T11:19:14.629 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-15T11:19:14.629 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 40265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-15T11:19:14.630 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-15T11:19:14.630 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/hdaps.ko 2024-01-15T11:19:14.630 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/ibm_rtl.ko 2024-01-15T11:19:14.630 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/intel/ 2024-01-15T11:19:14.630 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-15T11:19:14.630 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-01-15T11:19:14.630 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 43497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/intel_ips.ko 2024-01-15T11:19:14.630 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-15T11:19:14.630 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-15T11:19:14.630 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-15T11:19:14.630 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 42329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-15T11:19:14.630 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-15T11:19:14.630 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-15T11:19:14.630 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-15T11:19:14.630 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-15T11:19:14.630 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-15T11:19:14.631 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 57569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/platform/x86/wmi.ko 2024-01-15T11:19:14.631 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/ 2024-01-15T11:19:14.631 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/ 2024-01-15T11:19:14.631 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/88pm860x_battery.ko 2024-01-15T11:19:14.631 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/88pm860x_charger.ko 2024-01-15T11:19:14.631 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 55057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/bq2415x_charger.ko 2024-01-15T11:19:14.631 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 54081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/bq24190_charger.ko 2024-01-15T11:19:14.631 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/bq24735-charger.ko 2024-01-15T11:19:14.631 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-01-15T11:19:14.631 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/da9030_battery.ko 2024-01-15T11:19:14.631 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/da9052-battery.ko 2024-01-15T11:19:14.631 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/ds2760_battery.ko 2024-01-15T11:19:14.631 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/ds2780_battery.ko 2024-01-15T11:19:14.631 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/ds2781_battery.ko 2024-01-15T11:19:14.632 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/ds2782_battery.ko 2024-01-15T11:19:14.632 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/gpio-charger.ko 2024-01-15T11:19:14.632 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/isp1704_charger.ko 2024-01-15T11:19:14.632 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/lp8727_charger.ko 2024-01-15T11:19:14.632 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/max14577_charger.ko 2024-01-15T11:19:14.632 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/max17040_battery.ko 2024-01-15T11:19:14.632 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/max17042_battery.ko 2024-01-15T11:19:14.632 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/max8903_charger.ko 2024-01-15T11:19:14.632 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/max8925_power.ko 2024-01-15T11:19:14.632 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/pcf50633-charger.ko 2024-01-15T11:19:14.632 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/sbs-battery.ko 2024-01-15T11:19:14.632 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/test_power.ko 2024-01-15T11:19:14.632 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/tps65090-charger.ko 2024-01-15T11:19:14.632 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/wm831x_backup.ko 2024-01-15T11:19:14.633 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/wm831x_power.ko 2024-01-15T11:19:14.633 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/power/supply/wm8350_power.ko 2024-01-15T11:19:14.633 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/powercap/ 2024-01-15T11:19:14.633 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 57729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-15T11:19:14.633 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-15T11:19:14.633 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pps/ 2024-01-15T11:19:14.633 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pps/clients/ 2024-01-15T11:19:14.633 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-15T11:19:14.633 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-15T11:19:14.633 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pps/clients/pps_parport.ko 2024-01-15T11:19:14.633 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/pps/pps_core.ko 2024-01-15T11:19:14.633 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ptp/ 2024-01-15T11:19:14.633 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 66385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ptp/ptp.ko 2024-01-15T11:19:14.633 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ptp/ptp_kvm.ko 2024-01-15T11:19:14.634 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/ 2024-01-15T11:19:14.634 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-88pm80x.ko 2024-01-15T11:19:14.634 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-88pm860x.ko 2024-01-15T11:19:14.634 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-15T11:19:14.634 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-da9052.ko 2024-01-15T11:19:14.634 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-da9055.ko 2024-01-15T11:19:14.634 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-da9063.ko 2024-01-15T11:19:14.634 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-15T11:19:14.634 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 68577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-15T11:19:14.634 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-15T11:19:14.634 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-15T11:19:14.634 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-15T11:19:14.634 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-15T11:19:14.634 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-15T11:19:14.634 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-15T11:19:14.634 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-15T11:19:14.635 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-em3027.ko 2024-01-15T11:19:14.635 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-15T11:19:14.635 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-15T11:19:14.635 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-15T11:19:14.635 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-lp8788.ko 2024-01-15T11:19:14.635 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-15T11:19:14.635 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-15T11:19:14.635 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-15T11:19:14.635 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-m48t86.ko 2024-01-15T11:19:14.635 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-max6900.ko 2024-01-15T11:19:14.635 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-max8907.ko 2024-01-15T11:19:14.636 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-max8925.ko 2024-01-15T11:19:14.636 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-max8997.ko 2024-01-15T11:19:14.636 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-max8998.ko 2024-01-15T11:19:14.636 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-01-15T11:19:14.636 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-15T11:19:14.636 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-palmas.ko 2024-01-15T11:19:14.636 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 46633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-15T11:19:14.636 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-pcf50633.ko 2024-01-15T11:19:14.636 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-15T11:19:14.636 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-15T11:19:14.636 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-15T11:19:14.636 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-15T11:19:14.636 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-rc5t583.ko 2024-01-15T11:19:14.637 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-15T11:19:14.637 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-15T11:19:14.637 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-15T11:19:14.637 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-15T11:19:14.637 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-15T11:19:14.637 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-s35390a.ko 2024-01-15T11:19:14.637 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-15T11:19:14.637 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-tps6586x.ko 2024-01-15T11:19:14.637 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-tps65910.ko 2024-01-15T11:19:14.637 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-wm831x.ko 2024-01-15T11:19:14.637 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-wm8350.ko 2024-01-15T11:19:14.637 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/rtc/rtc-x1205.ko 2024-01-15T11:19:14.637 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/ 2024-01-15T11:19:14.637 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 77617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/3w-9xxx.ko 2024-01-15T11:19:14.638 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 57665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/3w-sas.ko 2024-01-15T11:19:14.638 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 55105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/3w-xxxx.ko 2024-01-15T11:19:14.638 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 135185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/BusLogic.ko 2024-01-15T11:19:14.638 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/a100u2w.ko 2024-01-15T11:19:14.638 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aacraid/ 2024-01-15T11:19:14.638 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 272305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-15T11:19:14.638 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 100617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/advansys.ko 2024-01-15T11:19:14.638 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aic7xxx/ 2024-01-15T11:19:14.638 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 356201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-15T11:19:14.638 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 295801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-15T11:19:14.638 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aic94xx/ 2024-01-15T11:19:14.638 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 189185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-01-15T11:19:14.638 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/am53c974.ko 2024-01-15T11:19:14.638 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/arcmsr/ 2024-01-15T11:19:14.638 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 106881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-15T11:19:14.639 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/atp870u.ko 2024-01-15T11:19:14.639 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/be2iscsi/ 2024-01-15T11:19:14.639 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 246985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-15T11:19:14.639 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/bfa/ 2024-01-15T11:19:14.639 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1171945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/bfa/bfa.ko 2024-01-15T11:19:14.639 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/bnx2fc/ 2024-01-15T11:19:14.639 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 237273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-15T11:19:14.639 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/bnx2i/ 2024-01-15T11:19:14.639 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 115369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-15T11:19:14.639 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 40585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/ch.ko 2024-01-15T11:19:14.639 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/csiostor/ 2024-01-15T11:19:14.639 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 308921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-15T11:19:14.639 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/cxgbi/ 2024-01-15T11:19:14.639 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-01-15T11:19:14.640 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 76145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-15T11:19:14.640 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-01-15T11:19:14.640 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 101449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-15T11:19:14.640 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 146689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-15T11:19:14.640 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 75553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/dc395x.ko 2024-01-15T11:19:14.640 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/dmx3191d.ko 2024-01-15T11:19:14.640 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/esas2r/ 2024-01-15T11:19:14.640 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 212425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-15T11:19:14.640 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 60505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/esp_scsi.ko 2024-01-15T11:19:14.640 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/fcoe/ 2024-01-15T11:19:14.640 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 78209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-15T11:19:14.640 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 158505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-15T11:19:14.641 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/fdomain.ko 2024-01-15T11:19:14.641 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/fnic/ 2024-01-15T11:19:14.641 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 263489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/fnic/fnic.ko 2024-01-15T11:19:14.641 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 201817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/hpsa.ko 2024-01-15T11:19:14.641 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/hptiop.ko 2024-01-15T11:19:14.641 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 49041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/hv_storvsc.ko 2024-01-15T11:19:14.641 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/imm.ko 2024-01-15T11:19:14.641 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 44057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/initio.ko 2024-01-15T11:19:14.641 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 266537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/ipr.ko 2024-01-15T11:19:14.641 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 101881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/ips.ko 2024-01-15T11:19:14.641 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/isci/ 2024-01-15T11:19:14.641 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 317153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/isci/isci.ko 2024-01-15T11:19:14.641 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-15T11:19:14.642 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 52961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-15T11:19:14.642 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/libfc/ 2024-01-15T11:19:14.642 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 314865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/libfc/libfc.ko 2024-01-15T11:19:14.642 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 145585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/libiscsi.ko 2024-01-15T11:19:14.642 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 53521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-15T11:19:14.642 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/libsas/ 2024-01-15T11:19:14.642 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 216665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/libsas/libsas.ko 2024-01-15T11:19:14.642 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/lpfc/ 2024-01-15T11:19:14.642 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 2197249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-15T11:19:14.642 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/megaraid/ 2024-01-15T11:19:14.642 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 73569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-15T11:19:14.642 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-15T11:19:14.642 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 310617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-15T11:19:14.642 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 84721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/megaraid.ko 2024-01-15T11:19:14.642 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/mpt3sas/ 2024-01-15T11:19:14.643 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 659825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-15T11:19:14.643 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/mvsas/ 2024-01-15T11:19:14.643 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 119561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-15T11:19:14.643 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 78129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/mvumi.ko 2024-01-15T11:19:14.643 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pcmcia/ 2024-01-15T11:19:14.643 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 81625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-01-15T11:19:14.643 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-01-15T11:19:14.643 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-01-15T11:19:14.643 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-01-15T11:19:14.643 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pm8001/ 2024-01-15T11:19:14.643 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 364105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-15T11:19:14.643 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 123617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/pmcraid.ko 2024-01-15T11:19:14.643 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/ppa.ko 2024-01-15T11:19:14.643 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 55361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qla1280.ko 2024-01-15T11:19:14.643 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qla2xxx/ 2024-01-15T11:19:14.643 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1876689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-15T11:19:14.644 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 85289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-15T11:19:14.644 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qla4xxx/ 2024-01-15T11:19:14.644 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 559033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-15T11:19:14.644 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/qlogicfas408.ko 2024-01-15T11:19:14.644 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/raid_class.ko 2024-01-15T11:19:14.644 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 238761 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/scsi_debug.ko 2024-01-15T11:19:14.644 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 173937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-15T11:19:14.644 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 279313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-15T11:19:14.644 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 97729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-15T11:19:14.644 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 73881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-15T11:19:14.644 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 44993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-15T11:19:14.644 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/ses.ko 2024-01-15T11:19:14.645 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 115889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/st.ko 2024-01-15T11:19:14.645 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 46825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/stex.ko 2024-01-15T11:19:14.645 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/sym53c8xx_2/ 2024-01-15T11:19:14.645 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 162121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-15T11:19:14.645 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 42297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/virtio_scsi.ko 2024-01-15T11:19:14.645 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 50321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-15T11:19:14.645 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/wd719x.ko 2024-01-15T11:19:14.645 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 50025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/scsi/xen-scsifront.ko 2024-01-15T11:19:14.645 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ssb/ 2024-01-15T11:19:14.645 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 129441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ssb/ssb.ko 2024-01-15T11:19:14.645 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/ 2024-01-15T11:19:14.645 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/iscsi/ 2024-01-15T11:19:14.645 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 736601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-15T11:19:14.645 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/loopback/ 2024-01-15T11:19:14.645 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 49985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-15T11:19:14.646 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/target_core_file.ko 2024-01-15T11:19:14.646 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 43025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/target_core_iblock.ko 2024-01-15T11:19:14.646 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 930257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/target_core_mod.ko 2024-01-15T11:19:14.646 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 44305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/target_core_pscsi.ko 2024-01-15T11:19:14.646 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 122521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/target_core_user.ko 2024-01-15T11:19:14.646 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/tcm_fc/ 2024-01-15T11:19:14.646 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 75593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-15T11:19:14.646 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/ 2024-01-15T11:19:14.646 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/ 2024-01-15T11:19:14.646 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/ 2024-01-15T11:19:14.646 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-15T11:19:14.646 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-15T11:19:14.646 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-15T11:19:14.647 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-15T11:19:14.647 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-15T11:19:14.647 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-15T11:19:14.647 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-15T11:19:14.647 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-15T11:19:14.647 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-15T11:19:14.647 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-15T11:19:14.647 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-15T11:19:14.647 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-15T11:19:14.647 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-01-15T11:19:14.647 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-15T11:19:14.647 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-15T11:19:14.647 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-15T11:19:14.647 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/ 2024-01-15T11:19:14.648 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/ipwireless/ 2024-01-15T11:19:14.648 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 78425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-15T11:19:14.648 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 57865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/moxa.ko 2024-01-15T11:19:14.648 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 50953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/mxser.ko 2024-01-15T11:19:14.648 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 108601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/n_gsm.ko 2024-01-15T11:19:14.648 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/n_hdlc.ko 2024-01-15T11:19:14.648 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 67929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/nozomi.ko 2024-01-15T11:19:14.648 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/ 2024-01-15T11:19:14.648 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/8250/ 2024-01-15T11:19:14.648 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-01-15T11:19:14.648 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 59497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-15T11:19:14.648 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-01-15T11:19:14.649 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/altera_uart.ko 2024-01-15T11:19:14.649 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/arc_uart.ko 2024-01-15T11:19:14.649 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 72425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-01-15T11:19:14.649 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/jsm/ 2024-01-15T11:19:14.649 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 103073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-15T11:19:14.649 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/rp2.ko 2024-01-15T11:19:14.649 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 52817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/tty/serial/sc16is7xx.ko 2024-01-15T11:19:14.649 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ufs/ 2024-01-15T11:19:14.649 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ufs/core/ 2024-01-15T11:19:14.649 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 531265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-15T11:19:14.649 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ufs/host/ 2024-01-15T11:19:14.650 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-15T11:19:14.650 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-01-15T11:19:14.650 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/ 2024-01-15T11:19:14.650 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 44513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio.ko 2024-01-15T11:19:14.650 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_aec.ko 2024-01-15T11:19:14.650 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_cif.ko 2024-01-15T11:19:14.650 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_dmem_genirq.ko 2024-01-15T11:19:14.650 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_mf624.ko 2024-01-15T11:19:14.650 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_netx.ko 2024-01-15T11:19:14.650 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_pci_generic.ko 2024-01-15T11:19:14.650 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-01-15T11:19:14.651 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/uio/uio_sercos3.ko 2024-01-15T11:19:14.651 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/ 2024-01-15T11:19:14.651 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/c67x00/ 2024-01-15T11:19:14.651 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 73297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/c67x00/c67x00.ko 2024-01-15T11:19:14.651 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/chipidea/ 2024-01-15T11:19:14.651 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 144377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-01-15T11:19:14.651 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-01-15T11:19:14.651 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-01-15T11:19:14.651 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-01-15T11:19:14.651 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/class/ 2024-01-15T11:19:14.652 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 87089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/class/cdc-acm.ko 2024-01-15T11:19:14.652 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-15T11:19:14.652 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/class/usblp.ko 2024-01-15T11:19:14.652 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 89857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/class/usbtmc.ko 2024-01-15T11:19:14.652 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/common/ 2024-01-15T11:19:14.652 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/common/ulpi.ko 2024-01-15T11:19:14.652 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/dwc2/ 2024-01-15T11:19:14.652 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-01-15T11:19:14.652 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/dwc3/ 2024-01-15T11:19:14.652 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-01-15T11:19:14.652 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-01-15T11:19:14.652 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 448505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/dwc3/dwc3.ko 2024-01-15T11:19:14.653 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/ 2024-01-15T11:19:14.653 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/ 2024-01-15T11:19:14.653 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 60177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/u_ether.ko 2024-01-15T11:19:14.653 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/u_serial.ko 2024-01-15T11:19:14.653 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-01-15T11:19:14.653 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 42449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-01-15T11:19:14.653 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-01-15T11:19:14.653 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-01-15T11:19:14.653 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 92489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-01-15T11:19:14.653 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-01-15T11:19:14.653 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 122081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-01-15T11:19:14.653 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 57681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-01-15T11:19:14.653 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-01-15T11:19:14.654 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-01-15T11:19:14.654 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 57729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-01-15T11:19:14.654 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 85609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-01-15T11:19:14.654 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-01-15T11:19:14.654 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 58113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-01-15T11:19:14.654 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 67337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-01-15T11:19:14.654 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/ 2024-01-15T11:19:14.654 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-01-15T11:19:14.654 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-01-15T11:19:14.654 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-01-15T11:19:14.654 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-01-15T11:19:14.654 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-01-15T11:19:14.655 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-01-15T11:19:14.655 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-01-15T11:19:14.655 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-01-15T11:19:14.655 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-01-15T11:19:14.655 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-01-15T11:19:14.655 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-01-15T11:19:14.655 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-01-15T11:19:14.655 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 62185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-01-15T11:19:14.655 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-01-15T11:19:14.655 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 161225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/libcomposite.ko 2024-01-15T11:19:14.655 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/ 2024-01-15T11:19:14.655 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-01-15T11:19:14.655 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/bdc/ 2024-01-15T11:19:14.656 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 157681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-01-15T11:19:14.656 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-01-15T11:19:14.656 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 52721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-01-15T11:19:14.656 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 69705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-01-15T11:19:14.656 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 56033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-01-15T11:19:14.656 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 76057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/net2272.ko 2024-01-15T11:19:14.656 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 75073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/net2280.ko 2024-01-15T11:19:14.656 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 73169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-01-15T11:19:14.656 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 65809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-01-15T11:19:14.656 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 66097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-01-15T11:19:14.656 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 81505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-01-15T11:19:14.656 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 156073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-01-15T11:19:14.657 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/ 2024-01-15T11:19:14.657 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/bcma-hcd.ko 2024-01-15T11:19:14.657 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 80113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/isp116x-hcd.ko 2024-01-15T11:19:14.657 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 87353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-01-15T11:19:14.657 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 78873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-01-15T11:19:14.657 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-15T11:19:14.657 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/sl811_cs.ko 2024-01-15T11:19:14.657 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/ssb-hcd.ko 2024-01-15T11:19:14.657 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-01-15T11:19:14.657 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/image/ 2024-01-15T11:19:14.657 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/image/mdc800.ko 2024-01-15T11:19:14.657 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/image/microtek.ko 2024-01-15T11:19:14.657 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/ 2024-01-15T11:19:14.657 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/adutux.ko 2024-01-15T11:19:14.658 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/appledisplay.ko 2024-01-15T11:19:14.658 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-01-15T11:19:14.658 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/cytherm.ko 2024-01-15T11:19:14.658 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/ehset.ko 2024-01-15T11:19:14.658 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/emi26.ko 2024-01-15T11:19:14.658 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/emi62.ko 2024-01-15T11:19:14.658 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/ezusb.ko 2024-01-15T11:19:14.658 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/idmouse.ko 2024-01-15T11:19:14.658 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/iowarrior.ko 2024-01-15T11:19:14.658 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-15T11:19:14.658 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/ldusb.ko 2024-01-15T11:19:14.659 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/legousbtower.ko 2024-01-15T11:19:14.659 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/lvstest.ko 2024-01-15T11:19:14.659 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/sisusbvga/ 2024-01-15T11:19:14.659 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 64841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-15T11:19:14.659 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-15T11:19:14.659 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/usb3503.ko 2024-01-15T11:19:14.659 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/usblcd.ko 2024-01-15T11:19:14.659 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-15T11:19:14.659 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 70809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/usbtest.ko 2024-01-15T11:19:14.659 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/uss720.ko 2024-01-15T11:19:14.659 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/misc/yurex.ko 2024-01-15T11:19:14.659 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/mon/ 2024-01-15T11:19:14.659 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 72953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/mon/usbmon.ko 2024-01-15T11:19:14.659 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/musb/ 2024-01-15T11:19:14.659 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 301697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/musb/musb_hdrc.ko 2024-01-15T11:19:14.660 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/phy/ 2024-01-15T11:19:14.660 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/phy/phy-generic.ko 2024-01-15T11:19:14.660 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-01-15T11:19:14.660 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/phy/phy-isp1301.ko 2024-01-15T11:19:14.660 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/phy/phy-tahvo.ko 2024-01-15T11:19:14.660 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ 2024-01-15T11:19:14.660 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/aircable.ko 2024-01-15T11:19:14.660 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ark3116.ko 2024-01-15T11:19:14.660 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-15T11:19:14.660 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ch341.ko 2024-01-15T11:19:14.660 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 70257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/cp210x.ko 2024-01-15T11:19:14.660 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/cyberjack.ko 2024-01-15T11:19:14.661 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 58217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-15T11:19:14.661 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 49817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-15T11:19:14.661 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/empeg.ko 2024-01-15T11:19:14.661 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 44273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/f81232.ko 2024-01-15T11:19:14.661 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 175137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-15T11:19:14.661 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 53113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-15T11:19:14.661 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 137081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-15T11:19:14.661 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 124833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/io_ti.ko 2024-01-15T11:19:14.661 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 67769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ipaq.ko 2024-01-15T11:19:14.661 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ipw.ko 2024-01-15T11:19:14.661 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ir-usb.ko 2024-01-15T11:19:14.661 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 58233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-15T11:19:14.662 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 107521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/keyspan.ko 2024-01-15T11:19:14.662 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-15T11:19:14.662 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-15T11:19:14.662 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-15T11:19:14.662 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/mct_u232.ko 2024-01-15T11:19:14.662 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/metro-usb.ko 2024-01-15T11:19:14.662 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 66449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/mos7720.ko 2024-01-15T11:19:14.662 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 78217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/mos7840.ko 2024-01-15T11:19:14.662 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 56337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/mxuport.ko 2024-01-15T11:19:14.662 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/navman.ko 2024-01-15T11:19:14.662 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/omninet.ko 2024-01-15T11:19:14.662 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/opticon.ko 2024-01-15T11:19:14.662 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 191137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/option.ko 2024-01-15T11:19:14.662 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/oti6858.ko 2024-01-15T11:19:14.663 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 54353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/pl2303.ko 2024-01-15T11:19:14.663 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/qcaux.ko 2024-01-15T11:19:14.663 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/qcserial.ko 2024-01-15T11:19:14.663 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/quatech2.ko 2024-01-15T11:19:14.663 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/safe_serial.ko 2024-01-15T11:19:14.663 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/sierra.ko 2024-01-15T11:19:14.663 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-15T11:19:14.663 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ssu100.ko 2024-01-15T11:19:14.663 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/symbolserial.ko 2024-01-15T11:19:14.663 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 61489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-15T11:19:14.663 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-15T11:19:14.663 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/usb_debug.ko 2024-01-15T11:19:14.663 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-15T11:19:14.663 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 125609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/usbserial.ko 2024-01-15T11:19:14.663 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/visor.ko 2024-01-15T11:19:14.663 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/whiteheat.ko 2024-01-15T11:19:14.664 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/wishbone-serial.ko 2024-01-15T11:19:14.664 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-15T11:19:14.664 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ 2024-01-15T11:19:14.664 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 52913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/uas.ko 2024-01-15T11:19:14.664 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-15T11:19:14.664 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-15T11:19:14.664 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-15T11:19:14.664 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-15T11:19:14.664 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-15T11:19:14.664 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-15T11:19:14.664 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-15T11:19:14.664 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-karma.ko 2024-01-15T11:19:14.664 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-15T11:19:14.664 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-15T11:19:14.664 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-15T11:19:14.665 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-15T11:19:14.665 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-15T11:19:14.665 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 179969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/storage/usb-storage.ko 2024-01-15T11:19:14.665 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/usbip/ 2024-01-15T11:19:14.665 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 67481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-15T11:19:14.665 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 72177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-15T11:19:14.665 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 107001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-15T11:19:14.665 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vfio/ 2024-01-15T11:19:14.665 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vfio/pci/ 2024-01-15T11:19:14.665 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 154297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-15T11:19:14.665 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-15T11:19:14.665 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 108737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vfio/vfio.ko 2024-01-15T11:19:14.665 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 77609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-15T11:19:14.665 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vhost/ 2024-01-15T11:19:14.665 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 113785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vhost/vhost.ko 2024-01-15T11:19:14.665 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-15T11:19:14.666 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 58089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vhost/vhost_net.ko 2024-01-15T11:19:14.666 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 89249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/vhost/vhost_scsi.ko 2024-01-15T11:19:14.666 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/ 2024-01-15T11:19:14.666 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/ 2024-01-15T11:19:14.666 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-01-15T11:19:14.666 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/aat2870_bl.ko 2024-01-15T11:19:14.666 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/adp5520_bl.ko 2024-01-15T11:19:14.666 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/adp8860_bl.ko 2024-01-15T11:19:14.666 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/adp8870_bl.ko 2024-01-15T11:19:14.666 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/apple_bl.ko 2024-01-15T11:19:14.666 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/as3711_bl.ko 2024-01-15T11:19:14.666 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/bd6107.ko 2024-01-15T11:19:14.666 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/da903x_bl.ko 2024-01-15T11:19:14.666 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/da9052_bl.ko 2024-01-15T11:19:14.666 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/gpio_backlight.ko 2024-01-15T11:19:14.667 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/kb3886_bl.ko 2024-01-15T11:19:14.667 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/lcd.ko 2024-01-15T11:19:14.667 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/lm3533_bl.ko 2024-01-15T11:19:14.667 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/lm3639_bl.ko 2024-01-15T11:19:14.667 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/lv5207lp.ko 2024-01-15T11:19:14.667 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/max8925_bl.ko 2024-01-15T11:19:14.667 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/pandora_bl.ko 2024-01-15T11:19:14.667 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-01-15T11:19:14.667 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-15T11:19:14.667 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/video/backlight/wm831x_bl.ko 2024-01-15T11:19:14.667 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/ 2024-01-15T11:19:14.667 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/masters/ 2024-01-15T11:19:14.667 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/masters/ds2482.ko 2024-01-15T11:19:14.667 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/masters/ds2490.ko 2024-01-15T11:19:14.668 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/masters/matrox_w1.ko 2024-01-15T11:19:14.668 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/masters/w1-gpio.ko 2024-01-15T11:19:14.668 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/ 2024-01-15T11:19:14.668 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-15T11:19:14.668 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-15T11:19:14.668 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-15T11:19:14.668 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-15T11:19:14.668 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14153 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-15T11:19:14.668 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-15T11:19:14.668 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-15T11:19:14.668 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-15T11:19:14.668 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-15T11:19:14.668 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-15T11:19:14.668 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 56425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-15T11:19:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 102673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/w1/wire.ko 2024-01-15T11:19:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/ 2024-01-15T11:19:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/acquirewdt.ko 2024-01-15T11:19:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/advantechwdt.ko 2024-01-15T11:19:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-15T11:19:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-15T11:19:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/cpu5wdt.ko 2024-01-15T11:19:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/da9052_wdt.ko 2024-01-15T11:19:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/da9055_wdt.ko 2024-01-15T11:19:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/da9063_wdt.ko 2024-01-15T11:19:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/dw_wdt.ko 2024-01-15T11:19:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/eurotechwdt.ko 2024-01-15T11:19:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-15T11:19:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/hpwdt.ko 2024-01-15T11:19:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/i6300esb.ko 2024-01-15T11:19:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-15T11:19:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-15T11:19:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/ib700wdt.ko 2024-01-15T11:19:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/ibmasr.ko 2024-01-15T11:19:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-15T11:19:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-15T11:19:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/it87_wdt.ko 2024-01-15T11:19:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/kempld_wdt.ko 2024-01-15T11:19:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/machzwd.ko 2024-01-15T11:19:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/mena21_wdt.ko 2024-01-15T11:19:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-01-15T11:19:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/nv_tco.ko 2024-01-15T11:19:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-01-15T11:19:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22265 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/pc87413_wdt.ko 2024-01-15T11:19:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-15T11:19:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-15T11:19:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/retu_wdt.ko 2024-01-15T11:19:14.671 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-01-15T11:19:14.671 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-01-15T11:19:14.671 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-15T11:19:14.671 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/sc1200wdt.ko 2024-01-15T11:19:14.671 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-15T11:19:14.671 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-01-15T11:19:14.671 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/softdog.ko 2024-01-15T11:19:14.671 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-15T11:19:14.671 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/twl4030_wdt.ko 2024-01-15T11:19:14.671 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/via_wdt.ko 2024-01-15T11:19:14.671 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-15T11:19:14.671 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-15T11:19:14.672 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-15T11:19:14.672 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/wafer5823wdt.ko 2024-01-15T11:19:14.672 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/wdt_pci.ko 2024-01-15T11:19:14.672 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/wm831x_wdt.ko 2024-01-15T11:19:14.672 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/wm8350_wdt.ko 2024-01-15T11:19:14.672 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/watchdog/xen_wdt.ko 2024-01-15T11:19:14.672 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/ 2024-01-15T11:19:14.672 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-evtchn.ko 2024-01-15T11:19:14.672 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-gntalloc.ko 2024-01-15T11:19:14.672 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-gntdev.ko 2024-01-15T11:19:14.672 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-pciback/ 2024-01-15T11:19:14.672 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 176377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-15T11:19:14.672 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 40121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-privcmd.ko 2024-01-15T11:19:14.672 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 71249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xen-scsiback.ko 2024-01-15T11:19:14.672 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xenfs/ 2024-01-15T11:19:14.672 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-15T11:19:14.673 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ 2024-01-15T11:19:14.673 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/9p/ 2024-01-15T11:19:14.673 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 166425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/9p/9p.ko 2024-01-15T11:19:14.673 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/adfs/ 2024-01-15T11:19:14.673 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 61073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/adfs/adfs.ko 2024-01-15T11:19:14.673 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/affs/ 2024-01-15T11:19:14.673 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 163593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/affs/affs.ko 2024-01-15T11:19:14.673 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/afs/ 2024-01-15T11:19:14.673 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 932817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/afs/kafs.ko 2024-01-15T11:19:14.673 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/autofs/ 2024-01-15T11:19:14.673 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 101057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/autofs/autofs4.ko 2024-01-15T11:19:14.673 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/befs/ 2024-01-15T11:19:14.673 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 64545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/befs/befs.ko 2024-01-15T11:19:14.673 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/bfs/ 2024-01-15T11:19:14.673 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/bfs/bfs.ko 2024-01-15T11:19:14.674 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/binfmt_misc.ko 2024-01-15T11:19:14.674 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/btrfs/ 2024-01-15T11:19:14.674 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 3402729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/btrfs/btrfs.ko 2024-01-15T11:19:14.674 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/cachefiles/ 2024-01-15T11:19:14.674 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 306009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/cachefiles/cachefiles.ko 2024-01-15T11:19:14.674 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ceph/ 2024-01-15T11:19:14.674 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1331609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ceph/ceph.ko 2024-01-15T11:19:14.674 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/coda/ 2024-01-15T11:19:14.674 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 100801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/coda/coda.ko 2024-01-15T11:19:14.674 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/configfs/ 2024-01-15T11:19:14.674 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 108393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/configfs/configfs.ko 2024-01-15T11:19:14.674 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/cramfs/ 2024-01-15T11:19:14.674 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/cramfs/cramfs.ko 2024-01-15T11:19:14.674 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/dlm/ 2024-01-15T11:19:14.674 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 642513 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/dlm/dlm.ko 2024-01-15T11:19:14.675 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/efs/ 2024-01-15T11:19:14.675 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/efs/efs.ko 2024-01-15T11:19:14.675 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/f2fs/ 2024-01-15T11:19:14.675 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1505025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/f2fs/f2fs.ko 2024-01-15T11:19:14.675 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/fat/ 2024-01-15T11:19:14.675 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/fat/msdos.ko 2024-01-15T11:19:14.675 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/freevxfs/ 2024-01-15T11:19:14.675 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 42545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/freevxfs/freevxfs.ko 2024-01-15T11:19:14.675 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/fscache/ 2024-01-15T11:19:14.675 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 226481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/fscache/fscache.ko 2024-01-15T11:19:14.675 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/fuse/ 2024-01-15T11:19:14.675 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/fuse/cuse.ko 2024-01-15T11:19:14.675 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/gfs2/ 2024-01-15T11:19:14.676 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1231529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/gfs2/gfs2.ko 2024-01-15T11:19:14.676 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/hfs/ 2024-01-15T11:19:14.676 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 141209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/hfs/hfs.ko 2024-01-15T11:19:14.676 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/hfsplus/ 2024-01-15T11:19:14.676 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 222817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/hfsplus/hfsplus.ko 2024-01-15T11:19:14.676 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/hpfs/ 2024-01-15T11:19:14.676 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 192329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/hpfs/hpfs.ko 2024-01-15T11:19:14.676 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/isofs/ 2024-01-15T11:19:14.676 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 74065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/isofs/isofs.ko 2024-01-15T11:19:14.676 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/jfs/ 2024-01-15T11:19:14.676 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 419497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/jfs/jfs.ko 2024-01-15T11:19:14.676 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/lockd/ 2024-01-15T11:19:14.677 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 280313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/lockd/lockd.ko 2024-01-15T11:19:14.677 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/minix/ 2024-01-15T11:19:14.677 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 89193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/minix/minix.ko 2024-01-15T11:19:14.677 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/netfs/ 2024-01-15T11:19:14.677 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 124649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/netfs/netfs.ko 2024-01-15T11:19:14.677 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/ 2024-01-15T11:19:14.677 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/blocklayout/ 2024-01-15T11:19:14.677 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 81449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-15T11:19:14.677 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/filelayout/ 2024-01-15T11:19:14.677 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 59449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-15T11:19:14.677 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/flexfilelayout/ 2024-01-15T11:19:14.677 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 117465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-15T11:19:14.677 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1055721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/nfs.ko 2024-01-15T11:19:14.677 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 66441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/nfsv2.ko 2024-01-15T11:19:14.677 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 120177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/nfsv3.ko 2024-01-15T11:19:14.678 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 2042137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs/nfsv4.ko 2024-01-15T11:19:14.678 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs_common/ 2024-01-15T11:19:14.678 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs_common/grace.ko 2024-01-15T11:19:14.678 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfs_common/nfs_acl.ko 2024-01-15T11:19:14.678 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfsd/ 2024-01-15T11:19:14.678 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1516873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nfsd/nfsd.ko 2024-01-15T11:19:14.678 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nilfs2/ 2024-01-15T11:19:14.678 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 592833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nilfs2/nilfs2.ko 2024-01-15T11:19:14.720 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/ 2024-01-15T11:19:14.720 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-celtic.ko 2024-01-15T11:19:14.720 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-centeuro.ko 2024-01-15T11:19:14.720 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-croatian.ko 2024-01-15T11:19:14.720 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-cyrillic.ko 2024-01-15T11:19:14.720 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-gaelic.ko 2024-01-15T11:19:14.720 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-greek.ko 2024-01-15T11:19:14.720 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-iceland.ko 2024-01-15T11:19:14.720 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-inuit.ko 2024-01-15T11:19:14.720 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-roman.ko 2024-01-15T11:19:14.720 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-romanian.ko 2024-01-15T11:19:14.720 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/mac-turkish.ko 2024-01-15T11:19:14.721 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_ascii.ko 2024-01-15T11:19:14.721 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp1250.ko 2024-01-15T11:19:14.721 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp1251.ko 2024-01-15T11:19:14.721 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp1255.ko 2024-01-15T11:19:14.721 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp737.ko 2024-01-15T11:19:14.721 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp775.ko 2024-01-15T11:19:14.721 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp850.ko 2024-01-15T11:19:14.721 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp852.ko 2024-01-15T11:19:14.721 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp855.ko 2024-01-15T11:19:14.721 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp857.ko 2024-01-15T11:19:14.721 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp860.ko 2024-01-15T11:19:14.721 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp861.ko 2024-01-15T11:19:14.721 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp862.ko 2024-01-15T11:19:14.721 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp863.ko 2024-01-15T11:19:14.721 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp864.ko 2024-01-15T11:19:14.721 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp865.ko 2024-01-15T11:19:14.722 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp866.ko 2024-01-15T11:19:14.722 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp869.ko 2024-01-15T11:19:14.722 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp874.ko 2024-01-15T11:19:14.722 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 94137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp932.ko 2024-01-15T11:19:14.722 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 142673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp936.ko 2024-01-15T11:19:14.722 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 165745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp949.ko 2024-01-15T11:19:14.722 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 118121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_cp950.ko 2024-01-15T11:19:14.722 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_euc-jp.ko 2024-01-15T11:19:14.722 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-1.ko 2024-01-15T11:19:14.722 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-13.ko 2024-01-15T11:19:14.722 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-14.ko 2024-01-15T11:19:14.722 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-15.ko 2024-01-15T11:19:14.722 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-2.ko 2024-01-15T11:19:14.722 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-3.ko 2024-01-15T11:19:14.722 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-4.ko 2024-01-15T11:19:14.722 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-5.ko 2024-01-15T11:19:14.723 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-6.ko 2024-01-15T11:19:14.723 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-7.ko 2024-01-15T11:19:14.723 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_iso8859-9.ko 2024-01-15T11:19:14.723 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_koi8-r.ko 2024-01-15T11:19:14.723 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_koi8-ru.ko 2024-01-15T11:19:14.723 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_koi8-u.ko 2024-01-15T11:19:14.723 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-15T11:19:14.723 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/nls/nls_utf8.ko 2024-01-15T11:19:14.723 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ntfs/ 2024-01-15T11:19:14.723 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 219417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ntfs/ntfs.ko 2024-01-15T11:19:14.723 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/ 2024-01-15T11:19:14.723 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/cluster/ 2024-01-15T11:19:14.723 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 244409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-15T11:19:14.723 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/dlm/ 2024-01-15T11:19:14.723 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 440737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-15T11:19:14.723 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/dlmfs/ 2024-01-15T11:19:14.724 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 54049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-15T11:19:14.724 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 2592433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/ocfs2.ko 2024-01-15T11:19:14.724 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-15T11:19:14.724 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-15T11:19:14.724 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-15T11:19:14.724 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/omfs/ 2024-01-15T11:19:14.724 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 53433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/omfs/omfs.ko 2024-01-15T11:19:14.724 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/overlayfs/ 2024-01-15T11:19:14.724 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 352161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/overlayfs/overlay.ko 2024-01-15T11:19:14.724 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/pstore/ 2024-01-15T11:19:14.724 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 54809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/pstore/ramoops.ko 2024-01-15T11:19:14.724 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/qnx4/ 2024-01-15T11:19:14.724 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/qnx4/qnx4.ko 2024-01-15T11:19:14.724 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/qnx6/ 2024-01-15T11:19:14.724 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 46689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/qnx6/qnx6.ko 2024-01-15T11:19:14.724 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/quota/ 2024-01-15T11:19:14.725 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/quota/quota_tree.ko 2024-01-15T11:19:14.725 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/quota/quota_v1.ko 2024-01-15T11:19:14.725 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/quota/quota_v2.ko 2024-01-15T11:19:14.725 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/reiserfs/ 2024-01-15T11:19:14.725 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 532673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/reiserfs/reiserfs.ko 2024-01-15T11:19:14.725 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/romfs/ 2024-01-15T11:19:14.725 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/romfs/romfs.ko 2024-01-15T11:19:14.725 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/smb/ 2024-01-15T11:19:14.725 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/smb/client/ 2024-01-15T11:19:14.725 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 2668401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/smb/client/cifs.ko 2024-01-15T11:19:14.725 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/smb/common/ 2024-01-15T11:19:14.725 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/smb/common/cifs_arc4.ko 2024-01-15T11:19:14.725 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/smb/common/cifs_md4.ko 2024-01-15T11:19:14.725 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/squashfs/ 2024-01-15T11:19:14.725 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 134641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/squashfs/squashfs.ko 2024-01-15T11:19:14.725 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/sysv/ 2024-01-15T11:19:14.725 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 90721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/sysv/sysv.ko 2024-01-15T11:19:14.726 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/udf/ 2024-01-15T11:19:14.726 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 247737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/udf/udf.ko 2024-01-15T11:19:14.726 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ufs/ 2024-01-15T11:19:14.726 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 162497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/ufs/ufs.ko 2024-01-15T11:19:14.726 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/xfs/ 2024-01-15T11:19:14.726 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 4011017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/fs/xfs/xfs.ko 2024-01-15T11:19:14.726 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/kernel/ 2024-01-15T11:19:14.726 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/kernel/locking/ 2024-01-15T11:19:14.726 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 75489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/kernel/locking/locktorture.ko 2024-01-15T11:19:14.726 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/kernel/time/ 2024-01-15T11:19:14.726 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/kernel/time/test_udelay.ko 2024-01-15T11:19:14.726 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 60553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/kernel/torture.ko 2024-01-15T11:19:14.726 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/ 2024-01-15T11:19:14.726 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 6833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/crc-itu-t.ko 2024-01-15T11:19:14.726 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 6529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/crc7.ko 2024-01-15T11:19:14.726 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/crc8.ko 2024-01-15T11:19:14.727 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/crypto/ 2024-01-15T11:19:14.727 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/crypto/libarc4.ko 2024-01-15T11:19:14.727 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/crypto/libdes.ko 2024-01-15T11:19:14.727 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/interval_tree_test.ko 2024-01-15T11:19:14.727 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/libcrc32c.ko 2024-01-15T11:19:14.727 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/lru_cache.ko 2024-01-15T11:19:14.727 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/lz4/ 2024-01-15T11:19:14.727 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/lz4/lz4_compress.ko 2024-01-15T11:19:14.727 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/lz4/lz4hc_compress.ko 2024-01-15T11:19:14.727 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/math/ 2024-01-15T11:19:14.727 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 6617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/math/cordic.ko 2024-01-15T11:19:14.727 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/memory-notifier-error-inject.ko 2024-01-15T11:19:14.727 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/notifier-error-inject.ko 2024-01-15T11:19:14.727 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/percpu_test.ko 2024-01-15T11:19:14.727 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/pm-notifier-error-inject.ko 2024-01-15T11:19:14.727 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/raid6/ 2024-01-15T11:19:14.728 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 143433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/raid6/raid6_pq.ko 2024-01-15T11:19:14.728 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/rbtree_test.ko 2024-01-15T11:19:14.728 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/reed_solomon/ 2024-01-15T11:19:14.728 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-15T11:19:14.728 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/test-kstrtox.ko 2024-01-15T11:19:14.728 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/test-string_helpers.ko 2024-01-15T11:19:14.728 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 4760425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/test_bpf.ko 2024-01-15T11:19:14.728 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 49089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/test_firmware.ko 2024-01-15T11:19:14.728 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 6369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/test_module.ko 2024-01-15T11:19:14.728 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/test_user_copy.ko 2024-01-15T11:19:14.728 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/ts_bm.ko 2024-01-15T11:19:14.728 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/ts_fsm.ko 2024-01-15T11:19:14.728 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/ts_kmp.ko 2024-01-15T11:19:14.728 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/xz/ 2024-01-15T11:19:14.729 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/lib/xz/xz_dec_test.ko 2024-01-15T11:19:14.729 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/mm/ 2024-01-15T11:19:14.729 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/mm/hwpoison-inject.ko 2024-01-15T11:19:14.729 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ 2024-01-15T11:19:14.729 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/ 2024-01-15T11:19:14.729 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 55737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/6lowpan.ko 2024-01-15T11:19:14.729 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_dest.ko 2024-01-15T11:19:14.729 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_fragment.ko 2024-01-15T11:19:14.729 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_hop.ko 2024-01-15T11:19:14.729 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 6985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-15T11:19:14.729 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_mobility.ko 2024-01-15T11:19:14.729 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_routing.ko 2024-01-15T11:19:14.729 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/6lowpan/nhc_udp.ko 2024-01-15T11:19:14.729 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/802/ 2024-01-15T11:19:14.729 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/802/garp.ko 2024-01-15T11:19:14.729 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/802/mrp.ko 2024-01-15T11:19:14.730 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/802/p8022.ko 2024-01-15T11:19:14.730 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/802/psnap.ko 2024-01-15T11:19:14.730 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/802/stp.ko 2024-01-15T11:19:14.730 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/8021q/ 2024-01-15T11:19:14.730 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 81737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/8021q/8021q.ko 2024-01-15T11:19:14.730 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/9p/ 2024-01-15T11:19:14.730 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 198337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/9p/9pnet.ko 2024-01-15T11:19:14.730 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/9p/9pnet_fd.ko 2024-01-15T11:19:14.730 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26345 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/9p/9pnet_rdma.ko 2024-01-15T11:19:14.730 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/9p/9pnet_virtio.ko 2024-01-15T11:19:14.730 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/batman-adv/ 2024-01-15T11:19:14.730 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 649297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/batman-adv/batman-adv.ko 2024-01-15T11:19:14.730 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/ 2024-01-15T11:19:14.730 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 63809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/br_netfilter.ko 2024-01-15T11:19:14.730 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 777689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/bridge.ko 2024-01-15T11:19:14.730 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ 2024-01-15T11:19:14.730 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-15T11:19:14.731 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-15T11:19:14.731 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-15T11:19:14.731 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-15T11:19:14.731 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-15T11:19:14.731 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-15T11:19:14.731 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-15T11:19:14.731 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-15T11:19:14.731 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13217 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-15T11:19:14.731 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-15T11:19:14.731 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-15T11:19:14.731 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8385 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-15T11:19:14.731 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-15T11:19:14.731 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-15T11:19:14.731 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-15T11:19:14.731 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-15T11:19:14.731 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-15T11:19:14.732 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-15T11:19:14.732 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-15T11:19:14.732 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-15T11:19:14.732 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 55929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/ebtables.ko 2024-01-15T11:19:14.732 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-15T11:19:14.732 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-15T11:19:14.732 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ceph/ 2024-01-15T11:19:14.732 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1046897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ceph/libceph.ko 2024-01-15T11:19:14.732 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/core/ 2024-01-15T11:19:14.732 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 125993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/core/pktgen.ko 2024-01-15T11:19:14.732 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dccp/ 2024-01-15T11:19:14.732 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 194209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dccp/dccp.ko 2024-01-15T11:19:14.732 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dccp/dccp_diag.ko 2024-01-15T11:19:14.732 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 57881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dccp/dccp_ipv4.ko 2024-01-15T11:19:14.732 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 60337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dccp/dccp_ipv6.ko 2024-01-15T11:19:14.733 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dsa/ 2024-01-15T11:19:14.733 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 390473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dsa/dsa_core.ko 2024-01-15T11:19:14.733 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dsa/tag_brcm.ko 2024-01-15T11:19:14.733 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dsa/tag_dsa.ko 2024-01-15T11:19:14.733 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dsa/tag_none.ko 2024-01-15T11:19:14.733 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/dsa/tag_trailer.ko 2024-01-15T11:19:14.733 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/hsr/ 2024-01-15T11:19:14.733 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 99729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/hsr/hsr.ko 2024-01-15T11:19:14.733 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ieee802154/ 2024-01-15T11:19:14.733 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ieee802154/6lowpan/ 2024-01-15T11:19:14.733 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 45233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-15T11:19:14.733 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 254625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ieee802154/ieee802154.ko 2024-01-15T11:19:14.733 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-15T11:19:14.733 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ 2024-01-15T11:19:14.733 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ah4.ko 2024-01-15T11:19:14.733 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/esp4.ko 2024-01-15T11:19:14.733 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 48337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/fou.ko 2024-01-15T11:19:14.734 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/gre.ko 2024-01-15T11:19:14.734 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 48657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/inet_diag.ko 2024-01-15T11:19:14.734 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 60633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ip_gre.ko 2024-01-15T11:19:14.734 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 61225 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ip_tunnel.ko 2024-01-15T11:19:14.734 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ip_vti.ko 2024-01-15T11:19:14.734 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ipcomp.ko 2024-01-15T11:19:14.734 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/ipip.ko 2024-01-15T11:19:14.734 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ 2024-01-15T11:19:14.734 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-15T11:19:14.734 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-15T11:19:14.734 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-15T11:19:14.734 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ip_tables.ko 2024-01-15T11:19:14.734 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-15T11:19:14.734 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-01-15T11:19:14.734 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-15T11:19:14.734 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-15T11:19:14.734 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-15T11:19:14.735 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11305 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-01-15T11:19:14.735 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-15T11:19:14.735 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-15T11:19:14.735 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-15T11:19:14.735 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-15T11:19:14.735 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-15T11:19:14.735 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-15T11:19:14.735 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-15T11:19:14.735 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18161 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-15T11:19:14.735 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-15T11:19:14.735 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-01-15T11:19:14.735 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-15T11:19:14.735 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-15T11:19:14.735 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-15T11:19:14.735 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-15T11:19:14.735 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-15T11:19:14.736 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_bic.ko 2024-01-15T11:19:14.736 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_dctcp.ko 2024-01-15T11:19:14.736 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_diag.ko 2024-01-15T11:19:14.736 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_highspeed.ko 2024-01-15T11:19:14.736 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_htcp.ko 2024-01-15T11:19:14.736 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_hybla.ko 2024-01-15T11:19:14.736 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_illinois.ko 2024-01-15T11:19:14.736 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_lp.ko 2024-01-15T11:19:14.736 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_scalable.ko 2024-01-15T11:19:14.736 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_vegas.ko 2024-01-15T11:19:14.736 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_veno.ko 2024-01-15T11:19:14.736 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_westwood.ko 2024-01-15T11:19:14.736 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tcp_yeah.ko 2024-01-15T11:19:14.736 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/tunnel4.ko 2024-01-15T11:19:14.736 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/udp_diag.ko 2024-01-15T11:19:14.736 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/udp_tunnel.ko 2024-01-15T11:19:14.737 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-15T11:19:14.737 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ 2024-01-15T11:19:14.737 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ah6.ko 2024-01-15T11:19:14.737 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/esp6.ko 2024-01-15T11:19:14.737 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/fou6.ko 2024-01-15T11:19:14.737 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 80897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ip6_gre.ko 2024-01-15T11:19:14.737 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 93577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ip6_tunnel.ko 2024-01-15T11:19:14.737 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-15T11:19:14.737 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 53273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ip6_vti.ko 2024-01-15T11:19:14.737 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/ipcomp6.ko 2024-01-15T11:19:14.737 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19017 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/mip6.ko 2024-01-15T11:19:14.737 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ 2024-01-15T11:19:14.737 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 42169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-15T11:19:14.737 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-01-15T11:19:14.737 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-15T11:19:14.737 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-15T11:19:14.738 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-15T11:19:14.738 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-15T11:19:14.738 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-15T11:19:14.738 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-15T11:19:14.738 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-15T11:19:14.738 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-15T11:19:14.738 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-15T11:19:14.738 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-15T11:19:14.738 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-15T11:19:14.738 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11121 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-15T11:19:14.738 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-15T11:19:14.738 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-15T11:19:14.738 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-15T11:19:14.738 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-15T11:19:14.738 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-15T11:19:14.739 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25945 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-15T11:19:14.739 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-15T11:19:14.739 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-15T11:19:14.739 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-15T11:19:14.739 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-15T11:19:14.739 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9009 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-15T11:19:14.739 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 74073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/sit.ko 2024-01-15T11:19:14.739 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/tunnel6.ko 2024-01-15T11:19:14.739 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-15T11:19:14.739 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/key/ 2024-01-15T11:19:14.739 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 82833 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/key/af_key.ko 2024-01-15T11:19:14.739 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/ 2024-01-15T11:19:14.739 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 125281 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_core.ko 2024-01-15T11:19:14.739 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-15T11:19:14.739 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25953 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_eth.ko 2024-01-15T11:19:14.739 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_ip.ko 2024-01-15T11:19:14.740 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36713 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_ip6.ko 2024-01-15T11:19:14.740 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_netlink.ko 2024-01-15T11:19:14.740 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 53241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/l2tp/l2tp_ppp.ko 2024-01-15T11:19:14.740 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/lapb/ 2024-01-15T11:19:14.740 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47977 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/lapb/lapb.ko 2024-01-15T11:19:14.740 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/llc/ 2024-01-15T11:19:14.740 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/llc/llc.ko 2024-01-15T11:19:14.740 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 267913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/llc/llc2.ko 2024-01-15T11:19:14.740 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/mac802154/ 2024-01-15T11:19:14.740 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 290417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/mac802154/mac802154.ko 2024-01-15T11:19:14.740 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/mpls/ 2024-01-15T11:19:14.740 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/mpls/mpls_gso.ko 2024-01-15T11:19:14.740 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ 2024-01-15T11:19:14.740 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ 2024-01-15T11:19:14.740 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 119585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set.ko 2024-01-15T11:19:14.741 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-15T11:19:14.741 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26913 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-15T11:19:14.741 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-15T11:19:14.741 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 100297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-15T11:19:14.741 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 101441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-15T11:19:14.741 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 102817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-15T11:19:14.741 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 103417 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-15T11:19:14.741 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 112849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-15T11:19:14.741 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 60329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-15T11:19:14.741 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 109593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-15T11:19:14.741 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 113129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-15T11:19:14.741 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 112585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-15T11:19:14.741 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 111585 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-15T11:19:14.741 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 114465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-15T11:19:14.741 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-15T11:19:14.741 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ 2024-01-15T11:19:14.742 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 411729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-15T11:19:14.742 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-15T11:19:14.742 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-15T11:19:14.742 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-15T11:19:14.742 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-15T11:19:14.742 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-15T11:19:14.742 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-15T11:19:14.742 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7689 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-15T11:19:14.742 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10681 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-15T11:19:14.742 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-15T11:19:14.742 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-15T11:19:14.742 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-15T11:19:14.742 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7697 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-15T11:19:14.742 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10993 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-15T11:19:14.742 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 49257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conncount.ko 2024-01-15T11:19:14.742 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 408257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack.ko 2024-01-15T11:19:14.743 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-15T11:19:14.743 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-15T11:19:14.743 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33761 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-15T11:19:14.743 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 118145 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-15T11:19:14.743 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-15T11:19:14.743 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-15T11:19:14.743 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 107233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-15T11:19:14.743 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-15T11:19:14.743 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-15T11:19:14.743 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 66641 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-15T11:19:14.743 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-15T11:19:14.743 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-15T11:19:14.743 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10113 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-15T11:19:14.743 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 89425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_flow_table.ko 2024-01-15T11:19:14.743 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9593 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-15T11:19:14.743 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_log_syslog.ko 2024-01-15T11:19:14.744 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 95353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_nat.ko 2024-01-15T11:19:14.744 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-15T11:19:14.744 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-15T11:19:14.744 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11857 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_nat_irc.ko 2024-01-15T11:19:14.744 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28929 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_nat_sip.ko 2024-01-15T11:19:14.744 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-15T11:19:14.744 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 44065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-15T11:19:14.744 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 615649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nf_tables.ko 2024-01-15T11:19:14.744 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 42561 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nfnetlink.ko 2024-01-15T11:19:14.744 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30233 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-15T11:19:14.744 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30569 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-01-15T11:19:14.744 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nfnetlink_log.ko 2024-01-15T11:19:14.744 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-15T11:19:14.744 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 49377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-15T11:19:14.744 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10457 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_chain_nat.ko 2024-01-15T11:19:14.744 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_compat.ko 2024-01-15T11:19:14.745 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 40721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_ct.ko 2024-01-15T11:19:14.745 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9601 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-15T11:19:14.745 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_fib.ko 2024-01-15T11:19:14.745 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-15T11:19:14.745 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14185 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_hash.ko 2024-01-15T11:19:14.745 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_limit.ko 2024-01-15T11:19:14.745 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_log.ko 2024-01-15T11:19:14.745 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_masq.ko 2024-01-15T11:19:14.745 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_nat.ko 2024-01-15T11:19:14.745 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13673 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_numgen.ko 2024-01-15T11:19:14.745 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11841 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_osf.ko 2024-01-15T11:19:14.745 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_queue.ko 2024-01-15T11:19:14.745 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_redir.ko 2024-01-15T11:19:14.745 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_reject.ko 2024-01-15T11:19:14.745 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_reject_inet.ko 2024-01-15T11:19:14.745 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_socket.ko 2024-01-15T11:19:14.746 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_synproxy.ko 2024-01-15T11:19:14.746 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/nft_tproxy.ko 2024-01-15T11:19:14.746 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 89313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/x_tables.ko 2024-01-15T11:19:14.746 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_AUDIT.ko 2024-01-15T11:19:14.746 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-15T11:19:14.746 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-15T11:19:14.746 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-15T11:19:14.746 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_CT.ko 2024-01-15T11:19:14.746 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_DSCP.ko 2024-01-15T11:19:14.746 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_HL.ko 2024-01-15T11:19:14.746 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13369 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_HMARK.ko 2024-01-15T11:19:14.746 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-15T11:19:14.746 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13889 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_LED.ko 2024-01-15T11:19:14.746 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11489 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_LOG.ko 2024-01-15T11:19:14.746 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11753 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-15T11:19:14.746 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_NETMAP.ko 2024-01-15T11:19:14.747 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_NFLOG.ko 2024-01-15T11:19:14.747 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-15T11:19:14.747 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_RATEEST.ko 2024-01-15T11:19:14.747 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-15T11:19:14.747 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14337 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_SECMARK.ko 2024-01-15T11:19:14.747 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-15T11:19:14.747 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-15T11:19:14.747 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17361 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_TEE.ko 2024-01-15T11:19:14.747 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_TPROXY.ko 2024-01-15T11:19:14.747 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8321 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_TRACE.ko 2024-01-15T11:19:14.747 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_addrtype.ko 2024-01-15T11:19:14.747 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_bpf.ko 2024-01-15T11:19:14.747 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_cgroup.ko 2024-01-15T11:19:14.748 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_cluster.ko 2024-01-15T11:19:14.748 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_comment.ko 2024-01-15T11:19:14.748 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10465 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_connbytes.ko 2024-01-15T11:19:14.748 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_connlabel.ko 2024-01-15T11:19:14.748 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_connlimit.ko 2024-01-15T11:19:14.748 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13129 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_connmark.ko 2024-01-15T11:19:14.748 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_conntrack.ko 2024-01-15T11:19:14.748 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_cpu.ko 2024-01-15T11:19:14.748 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_dccp.ko 2024-01-15T11:19:14.748 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_devgroup.ko 2024-01-15T11:19:14.748 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8801 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_dscp.ko 2024-01-15T11:19:14.748 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_ecn.ko 2024-01-15T11:19:14.748 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_esp.ko 2024-01-15T11:19:14.749 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 43289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_hashlimit.ko 2024-01-15T11:19:14.749 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_helper.ko 2024-01-15T11:19:14.749 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7865 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_hl.ko 2024-01-15T11:19:14.749 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11921 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_ipcomp.ko 2024-01-15T11:19:14.749 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_iprange.ko 2024-01-15T11:19:14.749 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11785 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_ipvs.ko 2024-01-15T11:19:14.749 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16041 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_l2tp.ko 2024-01-15T11:19:14.749 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8001 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_length.ko 2024-01-15T11:19:14.749 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10209 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_limit.ko 2024-01-15T11:19:14.749 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7545 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_mac.ko 2024-01-15T11:19:14.749 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_mark.ko 2024-01-15T11:19:14.749 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11825 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_multiport.ko 2024-01-15T11:19:14.750 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_nat.ko 2024-01-15T11:19:14.750 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_nfacct.ko 2024-01-15T11:19:14.750 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_osf.ko 2024-01-15T11:19:14.750 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_owner.ko 2024-01-15T11:19:14.750 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_physdev.ko 2024-01-15T11:19:14.750 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_pkttype.ko 2024-01-15T11:19:14.750 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11985 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_policy.ko 2024-01-15T11:19:14.750 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_quota.ko 2024-01-15T11:19:14.750 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_rateest.ko 2024-01-15T11:19:14.750 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_realm.ko 2024-01-15T11:19:14.750 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_recent.ko 2024-01-15T11:19:14.750 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13329 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_sctp.ko 2024-01-15T11:19:14.750 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_set.ko 2024-01-15T11:19:14.750 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_socket.ko 2024-01-15T11:19:14.750 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9505 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_state.ko 2024-01-15T11:19:14.750 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9473 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_statistic.ko 2024-01-15T11:19:14.751 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8809 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_string.ko 2024-01-15T11:19:14.751 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8553 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_tcpmss.ko 2024-01-15T11:19:14.751 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15777 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_tcpudp.ko 2024-01-15T11:19:14.751 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_time.ko 2024-01-15T11:19:14.751 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netfilter/xt_u32.ko 2024-01-15T11:19:14.751 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netlink/ 2024-01-15T11:19:14.751 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13969 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/netlink/netlink_diag.ko 2024-01-15T11:19:14.751 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/nsh/ 2024-01-15T11:19:14.751 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/nsh/nsh.ko 2024-01-15T11:19:14.751 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/openvswitch/ 2024-01-15T11:19:14.751 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 380033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/openvswitch/openvswitch.ko 2024-01-15T11:19:14.751 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/openvswitch/vport-geneve.ko 2024-01-15T11:19:14.751 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/openvswitch/vport-gre.ko 2024-01-15T11:19:14.751 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/openvswitch/vport-vxlan.ko 2024-01-15T11:19:14.751 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/packet/ 2024-01-15T11:19:14.751 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13057 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/packet/af_packet_diag.ko 2024-01-15T11:19:14.751 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/phonet/ 2024-01-15T11:19:14.752 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 110201 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/phonet/phonet.ko 2024-01-15T11:19:14.752 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 54721 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/phonet/pn_pep.ko 2024-01-15T11:19:14.752 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/rds/ 2024-01-15T11:19:14.752 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 251481 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/rds/rds.ko 2024-01-15T11:19:14.752 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 164937 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/rds/rds_rdma.ko 2024-01-15T11:19:14.752 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 67377 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/rds/rds_tcp.ko 2024-01-15T11:19:14.752 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/rxrpc/ 2024-01-15T11:19:14.752 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 819657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/rxrpc/rxrpc.ko 2024-01-15T11:19:14.752 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/ 2024-01-15T11:19:14.752 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32241 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_csum.ko 2024-01-15T11:19:14.752 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23577 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_gact.ko 2024-01-15T11:19:14.752 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26873 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_ipt.ko 2024-01-15T11:19:14.752 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_mirred.ko 2024-01-15T11:19:14.752 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_nat.ko 2024-01-15T11:19:14.753 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 43449 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_pedit.ko 2024-01-15T11:19:14.753 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_police.ko 2024-01-15T11:19:14.753 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_simple.ko 2024-01-15T11:19:14.753 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35297 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_skbedit.ko 2024-01-15T11:19:14.753 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/act_vlan.ko 2024-01-15T11:19:14.753 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_basic.ko 2024-01-15T11:19:14.753 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33961 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_bpf.ko 2024-01-15T11:19:14.753 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19169 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_cgroup.ko 2024-01-15T11:19:14.753 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31401 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_flow.ko 2024-01-15T11:19:14.753 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31769 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_fw.ko 2024-01-15T11:19:14.753 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38425 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_route.ko 2024-01-15T11:19:14.753 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 61409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/cls_u32.ko 2024-01-15T11:19:14.753 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7441 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/em_cmp.ko 2024-01-15T11:19:14.753 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/em_ipset.ko 2024-01-15T11:19:14.753 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33289 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/em_meta.ko 2024-01-15T11:19:14.753 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/em_nbyte.ko 2024-01-15T11:19:14.753 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/em_text.ko 2024-01-15T11:19:14.754 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7249 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/em_u32.ko 2024-01-15T11:19:14.754 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_choke.ko 2024-01-15T11:19:14.754 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20849 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_codel.ko 2024-01-15T11:19:14.754 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34633 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_drr.ko 2024-01-15T11:19:14.754 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33609 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_fq.ko 2024-01-15T11:19:14.754 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31617 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_fq_codel.ko 2024-01-15T11:19:14.754 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35433 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_gred.ko 2024-01-15T11:19:14.754 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 49817 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_hfsc.ko 2024-01-15T11:19:14.754 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22089 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_hhf.ko 2024-01-15T11:19:14.754 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 66393 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_htb.ko 2024-01-15T11:19:14.754 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26073 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_ingress.ko 2024-01-15T11:19:14.754 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30273 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_mqprio.ko 2024-01-15T11:19:14.754 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10793 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_mqprio_lib.ko 2024-01-15T11:19:14.754 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26065 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_multiq.ko 2024-01-15T11:19:14.754 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36137 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_netem.ko 2024-01-15T11:19:14.754 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27497 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_pie.ko 2024-01-15T11:19:14.755 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10625 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_plug.ko 2024-01-15T11:19:14.755 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_prio.ko 2024-01-15T11:19:14.755 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 48729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_qfq.ko 2024-01-15T11:19:14.755 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32905 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_red.ko 2024-01-15T11:19:14.755 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26881 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_sfb.ko 2024-01-15T11:19:14.755 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31353 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_sfq.ko 2024-01-15T11:19:14.755 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28897 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_tbf.ko 2024-01-15T11:19:14.755 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28105 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sched/sch_teql.ko 2024-01-15T11:19:14.755 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sctp/ 2024-01-15T11:19:14.755 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 929745 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sctp/sctp.ko 2024-01-15T11:19:14.755 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19033 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sctp/sctp_diag.ko 2024-01-15T11:19:14.755 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/ 2024-01-15T11:19:14.755 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/auth_gss/ 2024-01-15T11:19:14.755 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 336529 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-15T11:19:14.755 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 54737 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-15T11:19:14.755 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1520097 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/sunrpc.ko 2024-01-15T11:19:14.756 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/xprtrdma/ 2024-01-15T11:19:14.756 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 707657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-15T11:19:14.756 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/tipc/ 2024-01-15T11:19:14.756 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10025 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/tipc/diag.ko 2024-01-15T11:19:14.756 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 862665 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/tipc/tipc.ko 2024-01-15T11:19:14.756 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/unix/ 2024-01-15T11:19:14.756 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15729 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/unix/unix_diag.ko 2024-01-15T11:19:14.756 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/vmw_vsock/ 2024-01-15T11:19:14.756 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 85409 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-15T11:19:14.756 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 68049 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-15T11:19:14.756 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 96193 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/vmw_vsock/vsock.ko 2024-01-15T11:19:14.756 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10705 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-15T11:19:14.756 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17521 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-15T11:19:14.756 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/x25/ 2024-01-15T11:19:14.756 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 125177 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/x25/x25.ko 2024-01-15T11:19:14.757 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/xfrm/ 2024-01-15T11:19:14.757 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22657 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/xfrm/xfrm_algo.ko 2024-01-15T11:19:14.757 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20649 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-15T11:19:14.757 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 102257 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/net/xfrm/xfrm_user.ko 2024-01-15T11:19:14.757 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/virt/ 2024-01-15T11:19:14.757 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/virt/lib/ 2024-01-15T11:19:14.757 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15537 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/kernel/virt/lib/irqbypass.ko 2024-01-15T11:19:14.757 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 640081 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.alias 2024-01-15T11:19:14.757 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 624107 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.alias.bin 2024-01-15T11:19:14.757 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7663 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.builtin 2024-01-15T11:19:14.757 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23428 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.builtin.alias.bin 2024-01-15T11:19:14.757 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9821 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.builtin.bin 2024-01-15T11:19:14.757 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 70004 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.builtin.modinfo 2024-01-15T11:19:14.757 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 146313 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.dep 2024-01-15T11:19:14.757 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 232548 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.dep.bin 2024-01-15T11:19:14.758 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 210 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.devname 2024-01-15T11:19:14.758 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 72606 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.order 2024-01-15T11:19:14.758 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 879 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.softdep 2024-01-15T11:19:14.758 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 254438 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.symbols 2024-01-15T11:19:14.758 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 309363 2024-01-08 03:37 ./lib/modules/6.6.0-gc719ee96ba78/modules.symbols.bin 2024-01-15T11:19:14.758 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./usr/ 2024-01-15T11:19:14.758 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./usr/share/ 2024-01-15T11:19:14.758 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./usr/share/doc/ 2024-01-15T11:19:14.758 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2024-01-08 03:37 ./usr/share/doc/linux-image-6.6.0-gc719ee96ba78/ 2024-01-15T11:19:14.758 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 170 2024-01-08 03:37 ./usr/share/doc/linux-image-6.6.0-gc719ee96ba78/changelog.Debian.gz 2024-01-15T11:19:14.758 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 691 2024-01-08 03:37 ./usr/share/doc/linux-image-6.6.0-gc719ee96ba78/copyright 2024-01-15T11:19:14.759 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gc719ee96ba78 2024-01-15T11:19:14.759 INFO:teuthology.task.kernel:searching for kernel 6.6.0-gc719ee96ba78 2024-01-15T11:19:14.759 DEBUG:teuthology.orchestra.run.smithi093:> egrep '(submenu|menuentry.*6.6.0-gc719ee96ba78).*{' /boot/grub/grub.cfg 2024-01-15T11:19:14.769 INFO:teuthology.orchestra.run.smithi093.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-15T11:19:14.769 INFO:teuthology.orchestra.run.smithi093.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gc719ee96ba78' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gc719ee96ba78-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-15T11:19:14.769 INFO:teuthology.orchestra.run.smithi093.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gc719ee96ba78 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gc719ee96ba78-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-01-15T11:19:14.770 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-01-15T11:19:14.770 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-gc719ee96ba78 2024-01-15T11:19:14.770 DEBUG:teuthology.orchestra.run.smithi093:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-01-15T11:19:14.813 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi093.front.sepia.ceph.com to complete... 2024-01-15T11:19:15.191 INFO:teuthology.orchestra.run.smithi093.stderr:Sourcing file `/etc/default/grub' 2024-01-15T11:19:15.191 INFO:teuthology.orchestra.run.smithi093.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-01-15T11:19:15.220 INFO:teuthology.orchestra.run.smithi093.stderr:Generating grub configuration file ... 2024-01-15T11:19:15.401 INFO:teuthology.orchestra.run.smithi093.stderr:Found linux image: /boot/vmlinuz-6.6.0-gc719ee96ba78 2024-01-15T11:19:15.407 INFO:teuthology.orchestra.run.smithi093.stderr:Found initrd image: /boot/initrd.img-6.6.0-gc719ee96ba78 2024-01-15T11:19:15.663 INFO:teuthology.orchestra.run.smithi093.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-01-15T11:19:15.669 INFO:teuthology.orchestra.run.smithi093.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-01-15T11:19:15.710 INFO:teuthology.orchestra.run.smithi093.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-01-15T11:19:15.715 INFO:teuthology.orchestra.run.smithi093.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-01-15T11:19:15.858 INFO:teuthology.orchestra.run.smithi093.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-01-15T11:19:15.858 INFO:teuthology.orchestra.run.smithi093.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-01-15T11:19:15.858 INFO:teuthology.orchestra.run.smithi093.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-01-15T11:19:15.871 INFO:teuthology.orchestra.run.smithi093.stderr:done 2024-01-15T11:19:41.360 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-01-15T11:19:41.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T11:19:41.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T11:19:47.016 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-01-15T11:19:47.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2024-01-15T11:19:47.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T11:19:59.808 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T11:20:05.436 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.93 2024-01-15T11:20:08.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T11:20:08.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T11:20:11.868 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T11:20:14.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2024-01-15T11:20:14.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T11:20:17.500 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.93 2024-01-15T11:20:23.875 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T11:20:23.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T11:20:26.941 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T11:20:29.503 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2024-01-15T11:20:29.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T11:20:41.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T11:20:41.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T11:20:47.932 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.93 2024-01-15T11:21:00.476 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T11:21:02.936 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2024-01-15T11:21:02.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T11:21:03.439 DEBUG:teuthology.orchestra.run.smithi093:> true 2024-01-15T11:21:04.578 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2024-01-15T11:21:04.578 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-gc719ee96ba78"... 2024-01-15T11:21:04.578 DEBUG:teuthology.orchestra.run.smithi093:> uname -r 2024-01-15T11:21:04.629 INFO:teuthology.orchestra.run.smithi093.stdout:6.6.0-gc719ee96ba78 2024-01-15T11:21:04.629 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gc719ee96ba78 vs 6.6.0-gc719ee96ba78 2024-01-15T11:21:04.629 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-15T11:21:04.629 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-01-15T11:21:05.630 DEBUG:teuthology.parallel:result is None 2024-01-15T11:21:18.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T11:21:18.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T11:21:21.228 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T11:21:42.229 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T11:21:42.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T11:21:42.533 DEBUG:teuthology.orchestra.run.smithi027:> true 2024-01-15T11:21:43.287 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T11:21:43.287 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-gc719ee96ba78"... 2024-01-15T11:21:43.287 DEBUG:teuthology.orchestra.run.smithi027:> uname -r 2024-01-15T11:21:43.339 INFO:teuthology.orchestra.run.smithi027.stdout:6.6.0-gc719ee96ba78 2024-01-15T11:21:43.339 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gc719ee96ba78 vs 6.6.0-gc719ee96ba78 2024-01-15T11:21:43.340 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-15T11:21:43.340 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-01-15T11:21:44.343 DEBUG:teuthology.parallel:result is None 2024-01-15T11:21:44.343 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-15T11:21:44.352 INFO:teuthology.task.internal:Creating test directory... 2024-01-15T11:21:44.352 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-15T11:21:44.357 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-15T11:21:44.367 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-15T11:21:44.374 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-15T11:21:44.382 INFO:teuthology.task.internal:Creating archive directory... 2024-01-15T11:21:44.382 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-15T11:21:44.409 DEBUG:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-15T11:21:44.437 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-15T11:21:44.444 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-15T11:21:44.444 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-15T11:21:44.474 DEBUG:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-15T11:21:44.561 INFO:teuthology.orchestra.run.smithi093.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-15T11:21:44.568 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-15T11:21:44.579 INFO:teuthology.orchestra.run.smithi093.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-15T11:21:44.588 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-15T11:21:44.591 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-15T11:21:44.598 INFO:teuthology.task.internal:Configuring sudo... 2024-01-15T11:21:44.599 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-15T11:21:44.603 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-15T11:21:44.626 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-15T11:21:44.636 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-15T11:21:44.636 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-15T11:21:44.670 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-15T11:21:44.680 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-15T11:21:44.728 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-15T11:21:44.780 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:21:44.780 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-15T11:21:44.864 DEBUG:teuthology.orchestra.run.smithi093:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-15T11:21:44.873 DEBUG:teuthology.orchestra.run.smithi093:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-15T11:21:44.925 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:21:44.925 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-15T11:21:44.999 DEBUG:teuthology.orchestra.run.smithi027:> sudo service rsyslog restart 2024-01-15T11:21:45.003 DEBUG:teuthology.orchestra.run.smithi093:> sudo service rsyslog restart 2024-01-15T11:21:45.123 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-15T11:21:45.130 INFO:teuthology.task.internal:Starting timer... 2024-01-15T11:21:45.130 INFO:teuthology.run_tasks:Running task pcp... 2024-01-15T11:21:45.141 INFO:teuthology.run_tasks:Running task selinux... 2024-01-15T11:21:45.148 DEBUG:teuthology.task.selinux:Excluding smithi027: OS 'ubuntu' does not support SELinux 2024-01-15T11:21:45.148 DEBUG:teuthology.task.selinux:Excluding smithi093: OS 'ubuntu' does not support SELinux 2024-01-15T11:21:45.148 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-15T11:21:45.148 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-01-15T11:21:45.149 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-15T11:21:45.149 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-15T11:21:45.157 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-01-15T11:21:45.162 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-01-15T11:21:45.318 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-15T11:21:45.334 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-15T11:21:45.335 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi027.front.sepia.ceph.com,smithi093.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-15T11:29:14.244 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi027.front.sepia.ceph.com'), Remote(name='ubuntu@smithi093.front.sepia.ceph.com')] 2024-01-15T11:29:14.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T11:29:14.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T11:29:14.331 DEBUG:teuthology.orchestra.run.smithi027:> true 2024-01-15T11:29:14.443 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T11:29:14.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2024-01-15T11:29:14.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T11:29:14.523 DEBUG:teuthology.orchestra.run.smithi093:> true 2024-01-15T11:29:14.647 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2024-01-15T11:29:14.647 INFO:teuthology.run_tasks:Running task clock... 2024-01-15T11:29:14.658 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-15T11:29:14.658 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-15T11:29:14.659 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-15T11:29:14.663 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-15T11:29:14.663 DEBUG:teuthology.orchestra.run.smithi093:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-15T11:29:14.700 INFO:teuthology.orchestra.run.smithi027.stdout:15 Jan 11:29:14 ntpd[16712]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-01-15T11:29:14.700 INFO:teuthology.orchestra.run.smithi027.stdout:15 Jan 11:29:14 ntpd[16712]: Command line: ntpd -gq 2024-01-15T11:29:14.700 INFO:teuthology.orchestra.run.smithi027.stdout:15 Jan 11:29:14 ntpd[16712]: ---------------------------------------------------- 2024-01-15T11:29:14.700 INFO:teuthology.orchestra.run.smithi027.stdout:15 Jan 11:29:14 ntpd[16712]: ntp-4 is maintained by Network Time Foundation, 2024-01-15T11:29:14.700 INFO:teuthology.orchestra.run.smithi027.stdout:15 Jan 11:29:14 ntpd[16712]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-01-15T11:29:14.700 INFO:teuthology.orchestra.run.smithi027.stdout:15 Jan 11:29:14 ntpd[16712]: corporation. Support and training for ntp-4 are 2024-01-15T11:29:14.700 INFO:teuthology.orchestra.run.smithi027.stdout:15 Jan 11:29:14 ntpd[16712]: available at https://www.nwtime.org/support 2024-01-15T11:29:14.700 INFO:teuthology.orchestra.run.smithi027.stdout:15 Jan 11:29:14 ntpd[16712]: ---------------------------------------------------- 2024-01-15T11:29:14.701 INFO:teuthology.orchestra.run.smithi027.stdout:15 Jan 11:29:14 ntpd[16712]: proto: precision = 0.043 usec (-24) 2024-01-15T11:29:14.701 INFO:teuthology.orchestra.run.smithi027.stdout:15 Jan 11:29:14 ntpd[16712]: basedate set to 2022-02-04 2024-01-15T11:29:14.701 INFO:teuthology.orchestra.run.smithi027.stdout:15 Jan 11:29:14 ntpd[16712]: gps base set to 2022-02-06 (week 2196) 2024-01-15T11:29:14.702 INFO:teuthology.orchestra.run.smithi027.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-15T11:29:14.702 INFO:teuthology.orchestra.run.smithi027.stdout:15 Jan 11:29:14 ntpd[16712]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-15T11:29:14.702 INFO:teuthology.orchestra.run.smithi027.stdout:15 Jan 11:29:14 ntpd[16712]: restrict ::: KOD does nothing without LIMITED. 2024-01-15T11:29:14.702 INFO:teuthology.orchestra.run.smithi027.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-15T11:29:14.703 INFO:teuthology.orchestra.run.smithi027.stdout:15 Jan 11:29:14 ntpd[16712]: Listen and drop on 0 v6wildcard [::]:123 2024-01-15T11:29:14.703 INFO:teuthology.orchestra.run.smithi027.stdout:15 Jan 11:29:14 ntpd[16712]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-15T11:29:14.703 INFO:teuthology.orchestra.run.smithi027.stdout:15 Jan 11:29:14 ntpd[16712]: Listen normally on 2 lo 127.0.0.1:123 2024-01-15T11:29:14.703 INFO:teuthology.orchestra.run.smithi027.stdout:15 Jan 11:29:14 ntpd[16712]: Listen normally on 3 ens1f0 172.21.15.27:123 2024-01-15T11:29:14.703 INFO:teuthology.orchestra.run.smithi027.stdout:15 Jan 11:29:14 ntpd[16712]: Listen normally on 4 lo [::1]:123 2024-01-15T11:29:14.703 INFO:teuthology.orchestra.run.smithi027.stdout:15 Jan 11:29:14 ntpd[16712]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:395a%4]:123 2024-01-15T11:29:14.704 INFO:teuthology.orchestra.run.smithi027.stdout:15 Jan 11:29:14 ntpd[16712]: Listening on routing socket on fd #22 for interface updates 2024-01-15T11:29:14.727 INFO:teuthology.orchestra.run.smithi093.stdout:15 Jan 11:29:14 ntpd[16820]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-01-15T11:29:14.727 INFO:teuthology.orchestra.run.smithi093.stdout:15 Jan 11:29:14 ntpd[16820]: Command line: ntpd -gq 2024-01-15T11:29:14.727 INFO:teuthology.orchestra.run.smithi093.stdout:15 Jan 11:29:14 ntpd[16820]: ---------------------------------------------------- 2024-01-15T11:29:14.727 INFO:teuthology.orchestra.run.smithi093.stdout:15 Jan 11:29:14 ntpd[16820]: ntp-4 is maintained by Network Time Foundation, 2024-01-15T11:29:14.727 INFO:teuthology.orchestra.run.smithi093.stdout:15 Jan 11:29:14 ntpd[16820]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-01-15T11:29:14.727 INFO:teuthology.orchestra.run.smithi093.stdout:15 Jan 11:29:14 ntpd[16820]: corporation. Support and training for ntp-4 are 2024-01-15T11:29:14.727 INFO:teuthology.orchestra.run.smithi093.stdout:15 Jan 11:29:14 ntpd[16820]: available at https://www.nwtime.org/support 2024-01-15T11:29:14.727 INFO:teuthology.orchestra.run.smithi093.stdout:15 Jan 11:29:14 ntpd[16820]: ---------------------------------------------------- 2024-01-15T11:29:14.728 INFO:teuthology.orchestra.run.smithi093.stdout:15 Jan 11:29:14 ntpd[16820]: proto: precision = 0.042 usec (-24) 2024-01-15T11:29:14.728 INFO:teuthology.orchestra.run.smithi093.stdout:15 Jan 11:29:14 ntpd[16820]: basedate set to 2022-02-04 2024-01-15T11:29:14.728 INFO:teuthology.orchestra.run.smithi093.stdout:15 Jan 11:29:14 ntpd[16820]: gps base set to 2022-02-06 (week 2196) 2024-01-15T11:29:14.728 INFO:teuthology.orchestra.run.smithi093.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-15T11:29:14.729 INFO:teuthology.orchestra.run.smithi093.stdout:15 Jan 11:29:14 ntpd[16820]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-01-15T11:29:14.729 INFO:teuthology.orchestra.run.smithi093.stdout:15 Jan 11:29:14 ntpd[16820]: restrict ::: KOD does nothing without LIMITED. 2024-01-15T11:29:14.729 INFO:teuthology.orchestra.run.smithi093.stderr:restrict ::: KOD does nothing without LIMITED. 2024-01-15T11:29:14.730 INFO:teuthology.orchestra.run.smithi093.stdout:15 Jan 11:29:14 ntpd[16820]: Listen and drop on 0 v6wildcard [::]:123 2024-01-15T11:29:14.730 INFO:teuthology.orchestra.run.smithi093.stdout:15 Jan 11:29:14 ntpd[16820]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-01-15T11:29:14.730 INFO:teuthology.orchestra.run.smithi093.stdout:15 Jan 11:29:14 ntpd[16820]: Listen normally on 2 lo 127.0.0.1:123 2024-01-15T11:29:14.730 INFO:teuthology.orchestra.run.smithi093.stdout:15 Jan 11:29:14 ntpd[16820]: Listen normally on 3 enp3s0f1 172.21.15.93:123 2024-01-15T11:29:14.730 INFO:teuthology.orchestra.run.smithi093.stdout:15 Jan 11:29:14 ntpd[16820]: Listen normally on 4 lo [::1]:123 2024-01-15T11:29:14.731 INFO:teuthology.orchestra.run.smithi093.stdout:15 Jan 11:29:14 ntpd[16820]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d635%5]:123 2024-01-15T11:29:14.731 INFO:teuthology.orchestra.run.smithi093.stdout:15 Jan 11:29:14 ntpd[16820]: Listening on routing socket on fd #22 for interface updates 2024-01-15T11:29:15.701 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:15 ntpd[16712]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:15.701 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:15 ntpd[16712]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:15.701 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:15 ntpd[16712]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:15.701 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:15 ntpd[16712]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:15.701 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:15 ntpd[16712]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T11:29:15.701 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:15 ntpd[16712]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T11:29:15.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:15 ntpd[16820]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:15.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:15 ntpd[16820]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:15.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:15 ntpd[16820]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:15.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:15 ntpd[16820]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:15.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:15 ntpd[16820]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:15.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:15 ntpd[16820]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:15.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:15 ntpd[16820]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:15.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:15 ntpd[16820]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:15.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:15 ntpd[16820]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T11:29:15.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:15 ntpd[16820]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T11:29:15.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:15 ntpd[16820]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:15.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:15 ntpd[16820]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:15.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:15 ntpd[16820]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T11:29:15.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:15 ntpd[16820]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T11:29:17.703 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:17 ntpd[16712]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:17.703 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:17 ntpd[16712]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:17.703 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:17 ntpd[16712]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:17.703 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:17 ntpd[16712]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:17.703 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:17 ntpd[16712]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:17.703 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:17 ntpd[16712]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:17.703 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:17 ntpd[16712]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T11:29:17.704 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:17 ntpd[16712]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T11:29:17.704 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:17 ntpd[16712]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:17.704 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:17 ntpd[16712]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:17.704 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:17 ntpd[16712]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T11:29:17.704 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:17 ntpd[16712]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T11:29:17.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:17 ntpd[16820]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:17.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:17 ntpd[16820]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:17.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:17 ntpd[16820]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:17.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:17 ntpd[16820]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:17.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:17 ntpd[16820]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:17.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:17 ntpd[16820]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:17.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:17 ntpd[16820]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:17.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:17 ntpd[16820]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:17.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:17 ntpd[16820]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T11:29:17.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:17 ntpd[16820]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T11:29:17.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:17 ntpd[16820]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:17.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:17 ntpd[16820]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:17.730 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:17 ntpd[16820]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T11:29:17.730 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:17 ntpd[16820]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T11:29:17.730 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:17 ntpd[16820]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:17.730 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:17 ntpd[16820]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:17.730 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:17 ntpd[16820]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T11:29:17.730 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:17 ntpd[16820]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T11:29:18.701 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:18 ntpd[16712]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:18.701 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:18 ntpd[16712]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:19.702 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:19 ntpd[16712]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:19.702 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:19 ntpd[16712]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:19.703 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:19 ntpd[16712]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:19.703 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:19 ntpd[16712]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:19.703 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:19 ntpd[16712]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:19.703 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:19 ntpd[16712]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:19.703 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:19 ntpd[16712]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:19.703 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:19 ntpd[16712]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:19.703 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:19 ntpd[16712]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T11:29:19.703 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:19 ntpd[16712]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T11:29:19.703 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:19 ntpd[16712]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:19.703 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:19 ntpd[16712]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:19.703 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:19 ntpd[16712]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T11:29:19.703 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:19 ntpd[16712]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T11:29:19.703 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:19 ntpd[16712]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:19.703 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:19 ntpd[16712]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:19.703 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:19 ntpd[16712]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T11:29:19.703 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:19 ntpd[16712]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T11:29:19.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:19 ntpd[16820]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:19.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:19 ntpd[16820]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:19.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:19 ntpd[16820]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:19.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:19 ntpd[16820]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:19.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:19 ntpd[16820]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:19.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:19 ntpd[16820]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:19.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:19 ntpd[16820]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:19.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:19 ntpd[16820]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:19.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:19 ntpd[16820]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T11:29:19.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:19 ntpd[16820]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T11:29:19.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:19 ntpd[16820]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:19.730 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:19 ntpd[16820]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:19.730 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:19 ntpd[16820]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T11:29:19.730 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:19 ntpd[16820]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T11:29:19.730 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:19 ntpd[16820]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:19.730 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:19 ntpd[16820]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:19.730 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:19 ntpd[16820]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T11:29:19.730 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:19 ntpd[16820]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T11:29:21.701 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:21 ntpd[16712]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:21.701 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:21 ntpd[16712]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:21.701 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:21 ntpd[16712]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:21.702 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:21 ntpd[16712]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:21.702 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:21 ntpd[16712]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:21.702 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:21 ntpd[16712]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:21.702 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:21 ntpd[16712]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:21.702 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:21 ntpd[16712]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:21.702 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:21 ntpd[16712]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T11:29:21.702 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:21 ntpd[16712]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T11:29:21.702 INFO:teuthology.orchestra.run.smithi027.stdout:15 Jan 11:29:21 ntpd[16712]: ntpd: time slew -0.002853 s 2024-01-15T11:29:21.702 INFO:teuthology.orchestra.run.smithi027.stdout:ntpd: time slew -0.002853s 2024-01-15T11:29:21.703 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:21 ntpd[16712]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-15T11:29:21.703 INFO:teuthology.orchestra.run.smithi027.stderr:15 Jan 11:29:21 ntpd[16712]: can't open /var/log/ntpstats/loopstats.20240115: Permission denied 2024-01-15T11:29:21.728 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:21 ntpd[16820]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:21.728 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:21 ntpd[16820]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:21.728 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:21 ntpd[16820]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:21.728 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:21 ntpd[16820]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:21.728 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:21 ntpd[16820]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:21.728 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:21 ntpd[16820]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:21.728 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:21 ntpd[16820]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-01-15T11:29:21.728 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:21 ntpd[16820]: can't open /var/log/ntpstats/rawstats.20240115: Permission denied 2024-01-15T11:29:21.728 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:21 ntpd[16820]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-01-15T11:29:21.729 INFO:teuthology.orchestra.run.smithi093.stdout:15 Jan 11:29:21 ntpd[16820]: ntpd: time slew -0.002402 s 2024-01-15T11:29:21.729 INFO:teuthology.orchestra.run.smithi093.stdout:ntpd: time slew -0.002402s 2024-01-15T11:29:21.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:21 ntpd[16820]: can't open /var/log/ntpstats/peerstats.20240115: Permission denied 2024-01-15T11:29:21.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:21 ntpd[16820]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-01-15T11:29:21.729 INFO:teuthology.orchestra.run.smithi093.stderr:15 Jan 11:29:21 ntpd[16820]: can't open /var/log/ntpstats/loopstats.20240115: Permission denied 2024-01-15T11:29:21.808 INFO:teuthology.orchestra.run.smithi027.stdout: remote refid st t when poll reach delay offset jitter 2024-01-15T11:29:21.808 INFO:teuthology.orchestra.run.smithi027.stdout:============================================================================== 2024-01-15T11:29:21.808 INFO:teuthology.orchestra.run.smithi027.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-15T11:29:21.809 INFO:teuthology.orchestra.run.smithi027.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-15T11:29:21.809 INFO:teuthology.orchestra.run.smithi027.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-15T11:29:21.809 INFO:teuthology.orchestra.run.smithi027.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-15T11:29:21.815 INFO:teuthology.orchestra.run.smithi093.stdout: remote refid st t when poll reach delay offset jitter 2024-01-15T11:29:21.815 INFO:teuthology.orchestra.run.smithi093.stdout:============================================================================== 2024-01-15T11:29:21.815 INFO:teuthology.orchestra.run.smithi093.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-15T11:29:21.815 INFO:teuthology.orchestra.run.smithi093.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-15T11:29:21.815 INFO:teuthology.orchestra.run.smithi093.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-15T11:29:21.815 INFO:teuthology.orchestra.run.smithi093.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-01-15T11:29:21.816 INFO:teuthology.run_tasks:Running task install... 2024-01-15T11:29:21.826 DEBUG:teuthology.task.install:project ceph 2024-01-15T11:29:21.826 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '95c90f413c4bb65e3e56909855f2308fd9bda05b'}} 2024-01-15T11:29:21.826 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '95c90f413c4bb65e3e56909855f2308fd9bda05b'} 2024-01-15T11:29:21.826 INFO:teuthology.task.install:Using flavor: default 2024-01-15T11:29:21.832 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-01-15T11:29:21.832 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-01-15T11:29:21.832 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-key list | grep Ceph 2024-01-15T11:29:21.833 DEBUG:teuthology.orchestra.run.smithi093:> sudo apt-key list | grep Ceph 2024-01-15T11:29:21.962 INFO:teuthology.orchestra.run.smithi027.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-01-15T11:29:21.965 INFO:teuthology.orchestra.run.smithi093.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-01-15T11:29:22.017 INFO:teuthology.orchestra.run.smithi027.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-15T11:29:22.017 INFO:teuthology.orchestra.run.smithi027.stdout:uid [ unknown] Ceph.com (release key) 2024-01-15T11:29:22.018 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-15T11:29:22.018 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-01-15T11:29:22.018 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=95c90f413c4bb65e3e56909855f2308fd9bda05b 2024-01-15T11:29:22.041 INFO:teuthology.orchestra.run.smithi093.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-01-15T11:29:22.041 INFO:teuthology.orchestra.run.smithi093.stdout:uid [ unknown] Ceph.com (release key) 2024-01-15T11:29:22.041 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-01-15T11:29:22.041 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-01-15T11:29:22.041 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=95c90f413c4bb65e3e56909855f2308fd9bda05b 2024-01-15T11:29:22.255 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default/ 2024-01-15T11:29:22.255 INFO:teuthology.task.install.deb:Package version is 18.0.0-7629-g95c90f41-1jammy 2024-01-15T11:29:22.267 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default/ 2024-01-15T11:29:22.267 INFO:teuthology.task.install.deb:Package version is 18.0.0-7629-g95c90f41-1jammy 2024-01-15T11:29:22.374 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:29:22.374 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-15T11:29:22.395 DEBUG:teuthology.orchestra.run.smithi093:> sudo apt-get update 2024-01-15T11:29:22.428 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:29:22.429 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-01-15T11:29:22.449 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-get update 2024-01-15T11:29:22.630 INFO:teuthology.orchestra.run.smithi093.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-15T11:29:22.643 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-15T11:29:22.643 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-01-15T11:29:22.646 INFO:teuthology.orchestra.run.smithi093.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy InRelease 2024-01-15T11:29:22.651 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-15T11:29:22.670 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-15T11:29:22.672 INFO:teuthology.orchestra.run.smithi093.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-01-15T11:29:22.694 INFO:teuthology.orchestra.run.smithi093.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-01-15T11:29:22.700 INFO:teuthology.orchestra.run.smithi093.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-01-15T11:29:22.767 INFO:teuthology.orchestra.run.smithi093.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,412 B] 2024-01-15T11:29:22.781 INFO:teuthology.orchestra.run.smithi027.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy InRelease 2024-01-15T11:29:22.782 INFO:teuthology.orchestra.run.smithi093.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-01-15T11:29:22.863 INFO:teuthology.orchestra.run.smithi093.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-01-15T11:29:23.250 INFO:teuthology.orchestra.run.smithi027.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-01-15T11:29:23.255 INFO:teuthology.orchestra.run.smithi093.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2024-01-15T11:29:23.287 INFO:teuthology.orchestra.run.smithi027.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-01-15T11:29:23.323 INFO:teuthology.orchestra.run.smithi027.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,412 B] 2024-01-15T11:29:23.365 INFO:teuthology.orchestra.run.smithi093.stdout:Fetched 28.6 kB in 1s (38.3 kB/s) 2024-01-15T11:29:23.371 INFO:teuthology.orchestra.run.smithi027.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2024-01-15T11:29:23.484 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 28.6 kB in 1s (35.4 kB/s) 2024-01-15T11:29:24.297 INFO:teuthology.orchestra.run.smithi093.stdout:Reading package lists... 2024-01-15T11:29:24.314 DEBUG:teuthology.orchestra.run.smithi093:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7629-g95c90f41-1jammy cephadm=18.0.0-7629-g95c90f41-1jammy ceph-mds=18.0.0-7629-g95c90f41-1jammy ceph-mgr=18.0.0-7629-g95c90f41-1jammy ceph-common=18.0.0-7629-g95c90f41-1jammy ceph-fuse=18.0.0-7629-g95c90f41-1jammy ceph-test=18.0.0-7629-g95c90f41-1jammy ceph-volume=18.0.0-7629-g95c90f41-1jammy radosgw=18.0.0-7629-g95c90f41-1jammy python3-rados=18.0.0-7629-g95c90f41-1jammy python3-rgw=18.0.0-7629-g95c90f41-1jammy python3-cephfs=18.0.0-7629-g95c90f41-1jammy python3-rbd=18.0.0-7629-g95c90f41-1jammy libcephfs2=18.0.0-7629-g95c90f41-1jammy libcephfs-dev=18.0.0-7629-g95c90f41-1jammy librados2=18.0.0-7629-g95c90f41-1jammy librbd1=18.0.0-7629-g95c90f41-1jammy rbd-fuse=18.0.0-7629-g95c90f41-1jammy python3-cephfs=18.0.0-7629-g95c90f41-1jammy cephfs-shell=18.0.0-7629-g95c90f41-1jammy cephfs-top=18.0.0-7629-g95c90f41-1jammy cephfs-mirror=18.0.0-7629-g95c90f41-1jammy 2024-01-15T11:29:24.388 INFO:teuthology.orchestra.run.smithi093.stdout:Reading package lists... 2024-01-15T11:29:24.451 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2024-01-15T11:29:24.468 DEBUG:teuthology.orchestra.run.smithi027:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7629-g95c90f41-1jammy cephadm=18.0.0-7629-g95c90f41-1jammy ceph-mds=18.0.0-7629-g95c90f41-1jammy ceph-mgr=18.0.0-7629-g95c90f41-1jammy ceph-common=18.0.0-7629-g95c90f41-1jammy ceph-fuse=18.0.0-7629-g95c90f41-1jammy ceph-test=18.0.0-7629-g95c90f41-1jammy ceph-volume=18.0.0-7629-g95c90f41-1jammy radosgw=18.0.0-7629-g95c90f41-1jammy python3-rados=18.0.0-7629-g95c90f41-1jammy python3-rgw=18.0.0-7629-g95c90f41-1jammy python3-cephfs=18.0.0-7629-g95c90f41-1jammy python3-rbd=18.0.0-7629-g95c90f41-1jammy libcephfs2=18.0.0-7629-g95c90f41-1jammy libcephfs-dev=18.0.0-7629-g95c90f41-1jammy librados2=18.0.0-7629-g95c90f41-1jammy librbd1=18.0.0-7629-g95c90f41-1jammy rbd-fuse=18.0.0-7629-g95c90f41-1jammy python3-cephfs=18.0.0-7629-g95c90f41-1jammy cephfs-shell=18.0.0-7629-g95c90f41-1jammy cephfs-top=18.0.0-7629-g95c90f41-1jammy cephfs-mirror=18.0.0-7629-g95c90f41-1jammy 2024-01-15T11:29:24.545 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2024-01-15T11:29:24.562 INFO:teuthology.orchestra.run.smithi093.stdout:Building dependency tree... 2024-01-15T11:29:24.562 INFO:teuthology.orchestra.run.smithi093.stdout:Reading state information... 2024-01-15T11:29:24.716 INFO:teuthology.orchestra.run.smithi027.stdout:Building dependency tree... 2024-01-15T11:29:24.717 INFO:teuthology.orchestra.run.smithi027.stdout:Reading state information... 2024-01-15T11:29:24.723 INFO:teuthology.orchestra.run.smithi093.stdout:The following packages were automatically installed and are no longer required: 2024-01-15T11:29:24.723 INFO:teuthology.orchestra.run.smithi093.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-15T11:29:24.723 INFO:teuthology.orchestra.run.smithi093.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-15T11:29:24.724 INFO:teuthology.orchestra.run.smithi093.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-15T11:29:24.724 INFO:teuthology.orchestra.run.smithi093.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-15T11:29:24.724 INFO:teuthology.orchestra.run.smithi093.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-15T11:29:24.724 INFO:teuthology.orchestra.run.smithi093.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-15T11:29:24.725 INFO:teuthology.orchestra.run.smithi093.stdout:The following additional packages will be installed: 2024-01-15T11:29:24.725 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-15T11:29:24.725 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-01-15T11:29:24.726 INFO:teuthology.orchestra.run.smithi093.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-15T11:29:24.726 INFO:teuthology.orchestra.run.smithi093.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-01-15T11:29:24.727 INFO:teuthology.orchestra.run.smithi093.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-01-15T11:29:24.727 INFO:teuthology.orchestra.run.smithi093.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-01-15T11:29:24.727 INFO:teuthology.orchestra.run.smithi093.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-01-15T11:29:24.727 INFO:teuthology.orchestra.run.smithi093.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-01-15T11:29:24.727 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-01-15T11:29:24.727 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-01-15T11:29:24.727 INFO:teuthology.orchestra.run.smithi093.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-01-15T11:29:24.727 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-01-15T11:29:24.727 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-01-15T11:29:24.727 INFO:teuthology.orchestra.run.smithi093.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-01-15T11:29:24.727 INFO:teuthology.orchestra.run.smithi093.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-01-15T11:29:24.727 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-01-15T11:29:24.727 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-01-15T11:29:24.727 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-01-15T11:29:24.728 INFO:teuthology.orchestra.run.smithi093.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-01-15T11:29:24.728 INFO:teuthology.orchestra.run.smithi093.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-01-15T11:29:24.728 INFO:teuthology.orchestra.run.smithi093.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-01-15T11:29:24.728 INFO:teuthology.orchestra.run.smithi093.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-01-15T11:29:24.728 INFO:teuthology.orchestra.run.smithi093.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-01-15T11:29:24.728 INFO:teuthology.orchestra.run.smithi093.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-01-15T11:29:24.728 INFO:teuthology.orchestra.run.smithi093.stdout:Suggested packages: 2024-01-15T11:29:24.728 INFO:teuthology.orchestra.run.smithi093.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-01-15T11:29:24.728 INFO:teuthology.orchestra.run.smithi093.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-01-15T11:29:24.729 INFO:teuthology.orchestra.run.smithi093.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-01-15T11:29:24.729 INFO:teuthology.orchestra.run.smithi093.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-01-15T11:29:24.729 INFO:teuthology.orchestra.run.smithi093.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-01-15T11:29:24.729 INFO:teuthology.orchestra.run.smithi093.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-01-15T11:29:24.729 INFO:teuthology.orchestra.run.smithi093.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-01-15T11:29:24.729 INFO:teuthology.orchestra.run.smithi093.stdout:Recommended packages: 2024-01-15T11:29:24.729 INFO:teuthology.orchestra.run.smithi093.stdout: btrfs-tools 2024-01-15T11:29:24.874 INFO:teuthology.orchestra.run.smithi093.stdout:The following NEW packages will be installed: 2024-01-15T11:29:24.874 INFO:teuthology.orchestra.run.smithi093.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-01-15T11:29:24.874 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-01-15T11:29:24.874 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-01-15T11:29:24.874 INFO:teuthology.orchestra.run.smithi093.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-01-15T11:29:24.876 INFO:teuthology.orchestra.run.smithi093.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-15T11:29:24.876 INFO:teuthology.orchestra.run.smithi093.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-01-15T11:29:24.876 INFO:teuthology.orchestra.run.smithi093.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-01-15T11:29:24.876 INFO:teuthology.orchestra.run.smithi093.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-01-15T11:29:24.877 INFO:teuthology.orchestra.run.smithi093.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-01-15T11:29:24.877 INFO:teuthology.orchestra.run.smithi093.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-01-15T11:29:24.877 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-15T11:29:24.877 INFO:teuthology.orchestra.run.smithi093.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-01-15T11:29:24.877 INFO:teuthology.orchestra.run.smithi093.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-01-15T11:29:24.877 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-01-15T11:29:24.877 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-01-15T11:29:24.877 INFO:teuthology.orchestra.run.smithi093.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-01-15T11:29:24.877 INFO:teuthology.orchestra.run.smithi093.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-01-15T11:29:24.877 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-01-15T11:29:24.877 INFO:teuthology.orchestra.run.smithi093.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-01-15T11:29:24.877 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-01-15T11:29:24.877 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-01-15T11:29:24.877 INFO:teuthology.orchestra.run.smithi093.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-15T11:29:24.877 INFO:teuthology.orchestra.run.smithi093.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-01-15T11:29:24.877 INFO:teuthology.orchestra.run.smithi093.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-01-15T11:29:24.878 INFO:teuthology.orchestra.run.smithi093.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-01-15T11:29:24.878 INFO:teuthology.orchestra.run.smithi093.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-01-15T11:29:24.878 INFO:teuthology.orchestra.run.smithi093.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-01-15T11:29:24.878 INFO:teuthology.orchestra.run.smithi093.stdout: socat unzip xmlstarlet zip 2024-01-15T11:29:24.879 INFO:teuthology.orchestra.run.smithi027.stdout:The following packages were automatically installed and are no longer required: 2024-01-15T11:29:24.879 INFO:teuthology.orchestra.run.smithi027.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-15T11:29:24.879 INFO:teuthology.orchestra.run.smithi027.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-15T11:29:24.879 INFO:teuthology.orchestra.run.smithi027.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-15T11:29:24.879 INFO:teuthology.orchestra.run.smithi027.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-15T11:29:24.879 INFO:teuthology.orchestra.run.smithi027.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-15T11:29:24.879 INFO:teuthology.orchestra.run.smithi027.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-15T11:29:24.880 INFO:teuthology.orchestra.run.smithi027.stdout:The following additional packages will be installed: 2024-01-15T11:29:24.880 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-01-15T11:29:24.880 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-01-15T11:29:24.880 INFO:teuthology.orchestra.run.smithi027.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-15T11:29:24.880 INFO:teuthology.orchestra.run.smithi027.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-01-15T11:29:24.882 INFO:teuthology.orchestra.run.smithi027.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-01-15T11:29:24.882 INFO:teuthology.orchestra.run.smithi027.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-01-15T11:29:24.882 INFO:teuthology.orchestra.run.smithi027.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-01-15T11:29:24.882 INFO:teuthology.orchestra.run.smithi027.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-01-15T11:29:24.882 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-01-15T11:29:24.882 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-01-15T11:29:24.882 INFO:teuthology.orchestra.run.smithi027.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-01-15T11:29:24.882 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-01-15T11:29:24.882 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-01-15T11:29:24.882 INFO:teuthology.orchestra.run.smithi027.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-01-15T11:29:24.882 INFO:teuthology.orchestra.run.smithi027.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-01-15T11:29:24.883 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-01-15T11:29:24.883 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-01-15T11:29:24.883 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-01-15T11:29:24.883 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-01-15T11:29:24.883 INFO:teuthology.orchestra.run.smithi027.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-01-15T11:29:24.883 INFO:teuthology.orchestra.run.smithi027.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-01-15T11:29:24.883 INFO:teuthology.orchestra.run.smithi027.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-01-15T11:29:24.883 INFO:teuthology.orchestra.run.smithi027.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-01-15T11:29:24.883 INFO:teuthology.orchestra.run.smithi027.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-01-15T11:29:24.883 INFO:teuthology.orchestra.run.smithi027.stdout:Suggested packages: 2024-01-15T11:29:24.883 INFO:teuthology.orchestra.run.smithi027.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-01-15T11:29:24.884 INFO:teuthology.orchestra.run.smithi027.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-01-15T11:29:24.884 INFO:teuthology.orchestra.run.smithi027.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-01-15T11:29:24.884 INFO:teuthology.orchestra.run.smithi027.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-01-15T11:29:24.884 INFO:teuthology.orchestra.run.smithi027.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-01-15T11:29:24.884 INFO:teuthology.orchestra.run.smithi027.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-01-15T11:29:24.884 INFO:teuthology.orchestra.run.smithi027.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-01-15T11:29:24.884 INFO:teuthology.orchestra.run.smithi027.stdout:Recommended packages: 2024-01-15T11:29:24.884 INFO:teuthology.orchestra.run.smithi027.stdout: btrfs-tools 2024-01-15T11:29:24.950 INFO:teuthology.orchestra.run.smithi093.stdout:0 upgraded, 124 newly installed, 0 to remove and 269 not upgraded. 2024-01-15T11:29:24.950 INFO:teuthology.orchestra.run.smithi093.stdout:Need to get 187 MB of archives. 2024-01-15T11:29:24.950 INFO:teuthology.orchestra.run.smithi093.stdout:After this operation, 835 MB of additional disk space will be used. 2024-01-15T11:29:24.951 INFO:teuthology.orchestra.run.smithi093.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-01-15T11:29:24.972 INFO:teuthology.orchestra.run.smithi093.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-01-15T11:29:24.983 INFO:teuthology.orchestra.run.smithi093.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-01-15T11:29:25.034 INFO:teuthology.orchestra.run.smithi093.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-01-15T11:29:25.034 INFO:teuthology.orchestra.run.smithi027.stdout:The following NEW packages will be installed: 2024-01-15T11:29:25.034 INFO:teuthology.orchestra.run.smithi027.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-01-15T11:29:25.034 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-01-15T11:29:25.034 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-01-15T11:29:25.036 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-01-15T11:29:25.036 INFO:teuthology.orchestra.run.smithi027.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-01-15T11:29:25.037 INFO:teuthology.orchestra.run.smithi027.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-01-15T11:29:25.037 INFO:teuthology.orchestra.run.smithi027.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-01-15T11:29:25.037 INFO:teuthology.orchestra.run.smithi027.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-01-15T11:29:25.037 INFO:teuthology.orchestra.run.smithi027.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-01-15T11:29:25.037 INFO:teuthology.orchestra.run.smithi027.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-01-15T11:29:25.037 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-01-15T11:29:25.037 INFO:teuthology.orchestra.run.smithi027.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-01-15T11:29:25.037 INFO:teuthology.orchestra.run.smithi027.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-01-15T11:29:25.037 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-01-15T11:29:25.037 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-01-15T11:29:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-01-15T11:29:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-01-15T11:29:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-01-15T11:29:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-01-15T11:29:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-01-15T11:29:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-01-15T11:29:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-01-15T11:29:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-01-15T11:29:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-01-15T11:29:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-01-15T11:29:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-01-15T11:29:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-01-15T11:29:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: socat unzip xmlstarlet zip 2024-01-15T11:29:25.059 INFO:teuthology.orchestra.run.smithi093.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-01-15T11:29:25.062 INFO:teuthology.orchestra.run.smithi093.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-01-15T11:29:25.075 INFO:teuthology.orchestra.run.smithi093.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-01-15T11:29:25.110 INFO:teuthology.orchestra.run.smithi093.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7629-g95c90f41-1jammy [3,468 kB] 2024-01-15T11:29:25.121 INFO:teuthology.orchestra.run.smithi093.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-01-15T11:29:25.123 INFO:teuthology.orchestra.run.smithi093.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-01-15T11:29:25.130 INFO:teuthology.orchestra.run.smithi093.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-01-15T11:29:25.133 INFO:teuthology.orchestra.run.smithi093.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-01-15T11:29:25.134 INFO:teuthology.orchestra.run.smithi093.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-01-15T11:29:25.139 INFO:teuthology.orchestra.run.smithi093.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-01-15T11:29:25.141 INFO:teuthology.orchestra.run.smithi093.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-01-15T11:29:25.143 INFO:teuthology.orchestra.run.smithi093.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-01-15T11:29:25.144 INFO:teuthology.orchestra.run.smithi093.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-01-15T11:29:25.145 INFO:teuthology.orchestra.run.smithi093.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-01-15T11:29:25.164 INFO:teuthology.orchestra.run.smithi093.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2024-01-15T11:29:25.166 INFO:teuthology.orchestra.run.smithi093.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-01-15T11:29:25.168 INFO:teuthology.orchestra.run.smithi093.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-01-15T11:29:25.168 INFO:teuthology.orchestra.run.smithi093.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-01-15T11:29:25.169 INFO:teuthology.orchestra.run.smithi093.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-01-15T11:29:25.185 INFO:teuthology.orchestra.run.smithi093.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-01-15T11:29:25.185 INFO:teuthology.orchestra.run.smithi093.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-01-15T11:29:25.185 INFO:teuthology.orchestra.run.smithi093.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-01-15T11:29:25.186 INFO:teuthology.orchestra.run.smithi093.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-01-15T11:29:25.186 INFO:teuthology.orchestra.run.smithi093.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-01-15T11:29:25.187 INFO:teuthology.orchestra.run.smithi027.stdout:0 upgraded, 124 newly installed, 0 to remove and 269 not upgraded. 2024-01-15T11:29:25.188 INFO:teuthology.orchestra.run.smithi027.stdout:Need to get 187 MB of archives. 2024-01-15T11:29:25.188 INFO:teuthology.orchestra.run.smithi027.stdout:After this operation, 835 MB of additional disk space will be used. 2024-01-15T11:29:25.188 INFO:teuthology.orchestra.run.smithi027.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7629-g95c90f41-1jammy [3,468 kB] 2024-01-15T11:29:25.205 INFO:teuthology.orchestra.run.smithi093.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-01-15T11:29:25.206 INFO:teuthology.orchestra.run.smithi093.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-01-15T11:29:25.208 INFO:teuthology.orchestra.run.smithi093.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-01-15T11:29:25.208 INFO:teuthology.orchestra.run.smithi093.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-01-15T11:29:25.209 INFO:teuthology.orchestra.run.smithi093.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-01-15T11:29:25.226 INFO:teuthology.orchestra.run.smithi093.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-01-15T11:29:25.227 INFO:teuthology.orchestra.run.smithi093.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-15T11:29:25.227 INFO:teuthology.orchestra.run.smithi093.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-01-15T11:29:25.227 INFO:teuthology.orchestra.run.smithi093.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-01-15T11:29:25.228 INFO:teuthology.orchestra.run.smithi093.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-01-15T11:29:25.233 INFO:teuthology.orchestra.run.smithi027.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-01-15T11:29:25.246 INFO:teuthology.orchestra.run.smithi093.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-01-15T11:29:25.247 INFO:teuthology.orchestra.run.smithi093.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-01-15T11:29:25.251 INFO:teuthology.orchestra.run.smithi093.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-01-15T11:29:25.252 INFO:teuthology.orchestra.run.smithi093.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-01-15T11:29:25.252 INFO:teuthology.orchestra.run.smithi093.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-01-15T11:29:25.267 INFO:teuthology.orchestra.run.smithi093.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-01-15T11:29:25.268 INFO:teuthology.orchestra.run.smithi093.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-01-15T11:29:25.270 INFO:teuthology.orchestra.run.smithi093.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-01-15T11:29:25.270 INFO:teuthology.orchestra.run.smithi093.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-01-15T11:29:25.272 INFO:teuthology.orchestra.run.smithi093.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-01-15T11:29:25.288 INFO:teuthology.orchestra.run.smithi093.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-01-15T11:29:25.290 INFO:teuthology.orchestra.run.smithi093.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-01-15T11:29:25.291 INFO:teuthology.orchestra.run.smithi093.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-01-15T11:29:25.292 INFO:teuthology.orchestra.run.smithi093.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-01-15T11:29:25.294 INFO:teuthology.orchestra.run.smithi093.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-01-15T11:29:25.316 INFO:teuthology.orchestra.run.smithi027.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-01-15T11:29:25.346 INFO:teuthology.orchestra.run.smithi093.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-01-15T11:29:25.347 INFO:teuthology.orchestra.run.smithi093.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2024-01-15T11:29:25.349 INFO:teuthology.orchestra.run.smithi093.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-15T11:29:25.349 INFO:teuthology.orchestra.run.smithi093.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-01-15T11:29:25.350 INFO:teuthology.orchestra.run.smithi093.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-01-15T11:29:25.361 INFO:teuthology.orchestra.run.smithi027.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-01-15T11:29:25.369 INFO:teuthology.orchestra.run.smithi093.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-01-15T11:29:25.371 INFO:teuthology.orchestra.run.smithi093.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-01-15T11:29:25.371 INFO:teuthology.orchestra.run.smithi093.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-01-15T11:29:25.389 INFO:teuthology.orchestra.run.smithi093.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-01-15T11:29:25.390 INFO:teuthology.orchestra.run.smithi093.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-01-15T11:29:25.390 INFO:teuthology.orchestra.run.smithi093.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-01-15T11:29:25.391 INFO:teuthology.orchestra.run.smithi093.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-01-15T11:29:25.391 INFO:teuthology.orchestra.run.smithi093.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-01-15T11:29:25.392 INFO:teuthology.orchestra.run.smithi093.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-01-15T11:29:25.408 INFO:teuthology.orchestra.run.smithi093.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-01-15T11:29:25.409 INFO:teuthology.orchestra.run.smithi093.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-01-15T11:29:25.413 INFO:teuthology.orchestra.run.smithi093.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-01-15T11:29:25.429 INFO:teuthology.orchestra.run.smithi093.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-01-15T11:29:25.430 INFO:teuthology.orchestra.run.smithi093.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-01-15T11:29:25.431 INFO:teuthology.orchestra.run.smithi093.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-01-15T11:29:25.435 INFO:teuthology.orchestra.run.smithi093.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-01-15T11:29:25.438 INFO:teuthology.orchestra.run.smithi093.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-01-15T11:29:25.438 INFO:teuthology.orchestra.run.smithi093.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-01-15T11:29:25.439 INFO:teuthology.orchestra.run.smithi093.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-01-15T11:29:25.449 INFO:teuthology.orchestra.run.smithi093.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-01-15T11:29:25.454 INFO:teuthology.orchestra.run.smithi093.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-01-15T11:29:25.455 INFO:teuthology.orchestra.run.smithi093.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-01-15T11:29:25.470 INFO:teuthology.orchestra.run.smithi093.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-01-15T11:29:25.470 INFO:teuthology.orchestra.run.smithi093.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-15T11:29:25.471 INFO:teuthology.orchestra.run.smithi093.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-01-15T11:29:25.471 INFO:teuthology.orchestra.run.smithi093.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-01-15T11:29:25.473 INFO:teuthology.orchestra.run.smithi093.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-01-15T11:29:25.474 INFO:teuthology.orchestra.run.smithi093.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-01-15T11:29:25.481 INFO:teuthology.orchestra.run.smithi093.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-01-15T11:29:25.491 INFO:teuthology.orchestra.run.smithi093.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-01-15T11:29:25.491 INFO:teuthology.orchestra.run.smithi093.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-01-15T11:29:25.493 INFO:teuthology.orchestra.run.smithi093.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-01-15T11:29:25.498 INFO:teuthology.orchestra.run.smithi027.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7629-g95c90f41-1jammy [3,112 kB] 2024-01-15T11:29:25.511 INFO:teuthology.orchestra.run.smithi093.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-01-15T11:29:25.531 INFO:teuthology.orchestra.run.smithi093.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7629-g95c90f41-1jammy [3,112 kB] 2024-01-15T11:29:25.567 INFO:teuthology.orchestra.run.smithi027.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-01-15T11:29:25.665 INFO:teuthology.orchestra.run.smithi027.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7629-g95c90f41-1jammy [690 kB] 2024-01-15T11:29:25.667 INFO:teuthology.orchestra.run.smithi027.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-01-15T11:29:25.680 INFO:teuthology.orchestra.run.smithi027.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-01-15T11:29:25.731 INFO:teuthology.orchestra.run.smithi093.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7629-g95c90f41-1jammy [690 kB] 2024-01-15T11:29:25.734 INFO:teuthology.orchestra.run.smithi027.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-01-15T11:29:25.908 INFO:teuthology.orchestra.run.smithi027.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-01-15T11:29:25.914 INFO:teuthology.orchestra.run.smithi027.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7629-g95c90f41-1jammy [356 kB] 2024-01-15T11:29:25.917 INFO:teuthology.orchestra.run.smithi027.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-01-15T11:29:25.929 INFO:teuthology.orchestra.run.smithi093.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7629-g95c90f41-1jammy [356 kB] 2024-01-15T11:29:25.940 INFO:teuthology.orchestra.run.smithi027.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7629-g95c90f41-1jammy [32.8 kB] 2024-01-15T11:29:25.945 INFO:teuthology.orchestra.run.smithi027.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-01-15T11:29:25.953 INFO:teuthology.orchestra.run.smithi027.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-01-15T11:29:25.961 INFO:teuthology.orchestra.run.smithi093.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7629-g95c90f41-1jammy [32.8 kB] 2024-01-15T11:29:25.962 INFO:teuthology.orchestra.run.smithi027.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7629-g95c90f41-1jammy [180 kB] 2024-01-15T11:29:25.965 INFO:teuthology.orchestra.run.smithi027.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7629-g95c90f41-1jammy [63.5 kB] 2024-01-15T11:29:25.970 INFO:teuthology.orchestra.run.smithi027.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7629-g95c90f41-1jammy [330 kB] 2024-01-15T11:29:25.977 INFO:teuthology.orchestra.run.smithi093.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7629-g95c90f41-1jammy [180 kB] 2024-01-15T11:29:25.980 INFO:teuthology.orchestra.run.smithi093.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7629-g95c90f41-1jammy [63.5 kB] 2024-01-15T11:29:25.986 INFO:teuthology.orchestra.run.smithi093.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7629-g95c90f41-1jammy [330 kB] 2024-01-15T11:29:26.006 INFO:teuthology.orchestra.run.smithi027.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7629-g95c90f41-1jammy [6,223 kB] 2024-01-15T11:29:26.021 INFO:teuthology.orchestra.run.smithi093.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7629-g95c90f41-1jammy [6,223 kB] 2024-01-15T11:29:26.117 INFO:teuthology.orchestra.run.smithi027.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-01-15T11:29:26.491 INFO:teuthology.orchestra.run.smithi027.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7629-g95c90f41-1jammy [112 kB] 2024-01-15T11:29:26.498 INFO:teuthology.orchestra.run.smithi027.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7629-g95c90f41-1jammy [439 kB] 2024-01-15T11:29:26.507 INFO:teuthology.orchestra.run.smithi093.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7629-g95c90f41-1jammy [112 kB] 2024-01-15T11:29:26.513 INFO:teuthology.orchestra.run.smithi093.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7629-g95c90f41-1jammy [439 kB] 2024-01-15T11:29:26.526 INFO:teuthology.orchestra.run.smithi027.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7629-g95c90f41-1jammy [22.6 MB] 2024-01-15T11:29:26.541 INFO:teuthology.orchestra.run.smithi093.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7629-g95c90f41-1jammy [22.6 MB] 2024-01-15T11:29:26.702 INFO:teuthology.orchestra.run.smithi027.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-01-15T11:29:26.717 INFO:teuthology.orchestra.run.smithi027.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-01-15T11:29:26.733 INFO:teuthology.orchestra.run.smithi027.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-01-15T11:29:26.741 INFO:teuthology.orchestra.run.smithi027.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-01-15T11:29:26.742 INFO:teuthology.orchestra.run.smithi027.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-01-15T11:29:26.758 INFO:teuthology.orchestra.run.smithi027.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2024-01-15T11:29:26.796 INFO:teuthology.orchestra.run.smithi027.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-01-15T11:29:26.808 INFO:teuthology.orchestra.run.smithi027.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-01-15T11:29:26.813 INFO:teuthology.orchestra.run.smithi027.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-01-15T11:29:26.813 INFO:teuthology.orchestra.run.smithi027.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-01-15T11:29:26.984 INFO:teuthology.orchestra.run.smithi027.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-01-15T11:29:27.067 INFO:teuthology.orchestra.run.smithi027.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-01-15T11:29:27.073 INFO:teuthology.orchestra.run.smithi027.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-01-15T11:29:27.148 INFO:teuthology.orchestra.run.smithi027.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-01-15T11:29:27.177 INFO:teuthology.orchestra.run.smithi027.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-01-15T11:29:27.188 INFO:teuthology.orchestra.run.smithi027.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-01-15T11:29:27.229 INFO:teuthology.orchestra.run.smithi027.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-01-15T11:29:27.407 INFO:teuthology.orchestra.run.smithi027.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-01-15T11:29:27.422 INFO:teuthology.orchestra.run.smithi027.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-01-15T11:29:27.429 INFO:teuthology.orchestra.run.smithi027.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-01-15T11:29:27.434 INFO:teuthology.orchestra.run.smithi027.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-01-15T11:29:27.618 INFO:teuthology.orchestra.run.smithi027.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-01-15T11:29:27.701 INFO:teuthology.orchestra.run.smithi027.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-01-15T11:29:27.717 INFO:teuthology.orchestra.run.smithi027.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-01-15T11:29:27.902 INFO:teuthology.orchestra.run.smithi027.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-01-15T11:29:27.953 INFO:teuthology.orchestra.run.smithi027.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-01-15T11:29:27.966 INFO:teuthology.orchestra.run.smithi027.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-01-15T11:29:27.978 INFO:teuthology.orchestra.run.smithi027.stdout:Get:52 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7629-g95c90f41-1jammy [6,900 kB] 2024-01-15T11:29:28.123 INFO:teuthology.orchestra.run.smithi027.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-01-15T11:29:28.124 INFO:teuthology.orchestra.run.smithi027.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-01-15T11:29:28.129 INFO:teuthology.orchestra.run.smithi027.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-01-15T11:29:28.133 INFO:teuthology.orchestra.run.smithi027.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-01-15T11:29:28.148 INFO:teuthology.orchestra.run.smithi027.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-01-15T11:29:28.270 INFO:teuthology.orchestra.run.smithi093.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7629-g95c90f41-1jammy [6,900 kB] 2024-01-15T11:29:28.358 INFO:teuthology.orchestra.run.smithi027.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-01-15T11:29:28.386 INFO:teuthology.orchestra.run.smithi027.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7629-g95c90f41-1jammy [242 kB] 2024-01-15T11:29:28.397 INFO:teuthology.orchestra.run.smithi027.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7629-g95c90f41-1jammy [124 kB] 2024-01-15T11:29:28.404 INFO:teuthology.orchestra.run.smithi027.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7629-g95c90f41-1jammy [1,496 kB] 2024-01-15T11:29:28.490 INFO:teuthology.orchestra.run.smithi027.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7629-g95c90f41-1jammy [9,955 kB] 2024-01-15T11:29:28.612 INFO:teuthology.orchestra.run.smithi027.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-01-15T11:29:28.745 INFO:teuthology.orchestra.run.smithi027.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-01-15T11:29:28.759 INFO:teuthology.orchestra.run.smithi093.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7629-g95c90f41-1jammy [242 kB] 2024-01-15T11:29:28.775 INFO:teuthology.orchestra.run.smithi093.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7629-g95c90f41-1jammy [124 kB] 2024-01-15T11:29:28.782 INFO:teuthology.orchestra.run.smithi093.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7629-g95c90f41-1jammy [1,496 kB] 2024-01-15T11:29:28.789 INFO:teuthology.orchestra.run.smithi027.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-01-15T11:29:28.879 INFO:teuthology.orchestra.run.smithi027.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-01-15T11:29:28.889 INFO:teuthology.orchestra.run.smithi027.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-01-15T11:29:28.890 INFO:teuthology.orchestra.run.smithi093.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7629-g95c90f41-1jammy [9,955 kB] 2024-01-15T11:29:28.902 INFO:teuthology.orchestra.run.smithi027.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-01-15T11:29:28.945 INFO:teuthology.orchestra.run.smithi027.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-01-15T11:29:29.103 INFO:teuthology.orchestra.run.smithi027.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7629-g95c90f41-1jammy [31.8 MB] 2024-01-15T11:29:29.207 INFO:teuthology.orchestra.run.smithi027.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-01-15T11:29:29.208 INFO:teuthology.orchestra.run.smithi027.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2024-01-15T11:29:29.210 INFO:teuthology.orchestra.run.smithi027.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-01-15T11:29:29.374 INFO:teuthology.orchestra.run.smithi027.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-01-15T11:29:29.484 INFO:teuthology.orchestra.run.smithi093.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7629-g95c90f41-1jammy [31.8 MB] 2024-01-15T11:29:29.717 INFO:teuthology.orchestra.run.smithi027.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-01-15T11:29:30.118 INFO:teuthology.orchestra.run.smithi027.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-01-15T11:29:30.127 INFO:teuthology.orchestra.run.smithi027.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-01-15T11:29:30.128 INFO:teuthology.orchestra.run.smithi027.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-01-15T11:29:30.197 INFO:teuthology.orchestra.run.smithi027.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-01-15T11:29:30.197 INFO:teuthology.orchestra.run.smithi027.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-01-15T11:29:30.198 INFO:teuthology.orchestra.run.smithi027.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-01-15T11:29:30.199 INFO:teuthology.orchestra.run.smithi027.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-01-15T11:29:30.200 INFO:teuthology.orchestra.run.smithi027.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-01-15T11:29:30.201 INFO:teuthology.orchestra.run.smithi027.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-01-15T11:29:30.365 INFO:teuthology.orchestra.run.smithi027.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-01-15T11:29:30.581 INFO:teuthology.orchestra.run.smithi027.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-01-15T11:29:30.911 INFO:teuthology.orchestra.run.smithi027.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-01-15T11:29:30.957 INFO:teuthology.orchestra.run.smithi027.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-01-15T11:29:30.984 INFO:teuthology.orchestra.run.smithi027.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-01-15T11:29:30.993 INFO:teuthology.orchestra.run.smithi027.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-01-15T11:29:31.039 INFO:teuthology.orchestra.run.smithi027.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-01-15T11:29:31.065 INFO:teuthology.orchestra.run.smithi027.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-01-15T11:29:31.067 INFO:teuthology.orchestra.run.smithi027.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-01-15T11:29:31.074 INFO:teuthology.orchestra.run.smithi027.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-01-15T11:29:31.076 INFO:teuthology.orchestra.run.smithi027.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-01-15T11:29:31.272 INFO:teuthology.orchestra.run.smithi027.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-01-15T11:29:31.531 INFO:teuthology.orchestra.run.smithi027.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-01-15T11:29:31.793 INFO:teuthology.orchestra.run.smithi027.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-01-15T11:29:31.795 INFO:teuthology.orchestra.run.smithi027.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-01-15T11:29:31.811 INFO:teuthology.orchestra.run.smithi027.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-01-15T11:29:31.816 INFO:teuthology.orchestra.run.smithi027.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-01-15T11:29:31.854 INFO:teuthology.orchestra.run.smithi027.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-01-15T11:29:31.868 INFO:teuthology.orchestra.run.smithi027.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-01-15T11:29:31.958 INFO:teuthology.orchestra.run.smithi027.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-01-15T11:29:31.960 INFO:teuthology.orchestra.run.smithi027.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-01-15T11:29:31.962 INFO:teuthology.orchestra.run.smithi027.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-01-15T11:29:32.142 INFO:teuthology.orchestra.run.smithi027.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-01-15T11:29:32.416 INFO:teuthology.orchestra.run.smithi027.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-01-15T11:29:39.927 INFO:teuthology.orchestra.run.smithi027.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7629-g95c90f41-1jammy [14.1 kB] 2024-01-15T11:29:39.927 INFO:teuthology.orchestra.run.smithi027.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7629-g95c90f41-1jammy [839 kB] 2024-01-15T11:29:39.960 INFO:teuthology.orchestra.run.smithi027.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7629-g95c90f41-1jammy [2,144 kB] 2024-01-15T11:29:40.071 INFO:teuthology.orchestra.run.smithi093.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7629-g95c90f41-1jammy [14.1 kB] 2024-01-15T11:29:40.072 INFO:teuthology.orchestra.run.smithi093.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7629-g95c90f41-1jammy [839 kB] 2024-01-15T11:29:40.077 INFO:teuthology.orchestra.run.smithi027.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7629-g95c90f41-1jammy [805 kB] 2024-01-15T11:29:40.119 INFO:teuthology.orchestra.run.smithi027.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7629-g95c90f41-1jammy [139 kB] 2024-01-15T11:29:40.125 INFO:teuthology.orchestra.run.smithi027.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7629-g95c90f41-1jammy [1,900 kB] 2024-01-15T11:29:40.135 INFO:teuthology.orchestra.run.smithi093.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7629-g95c90f41-1jammy [2,144 kB] 2024-01-15T11:29:40.229 INFO:teuthology.orchestra.run.smithi027.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7629-g95c90f41-1jammy [8,625 kB] 2024-01-15T11:29:40.318 INFO:teuthology.orchestra.run.smithi093.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7629-g95c90f41-1jammy [805 kB] 2024-01-15T11:29:40.386 INFO:teuthology.orchestra.run.smithi093.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7629-g95c90f41-1jammy [139 kB] 2024-01-15T11:29:40.397 INFO:teuthology.orchestra.run.smithi093.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7629-g95c90f41-1jammy [1,900 kB] 2024-01-15T11:29:40.557 INFO:teuthology.orchestra.run.smithi093.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7629-g95c90f41-1jammy [8,625 kB] 2024-01-15T11:29:40.693 INFO:teuthology.orchestra.run.smithi027.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7629-g95c90f41-1jammy [14.2 kB] 2024-01-15T11:29:40.694 INFO:teuthology.orchestra.run.smithi027.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7629-g95c90f41-1jammy [48.6 MB] 2024-01-15T11:29:41.266 INFO:teuthology.orchestra.run.smithi093.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7629-g95c90f41-1jammy [14.2 kB] 2024-01-15T11:29:41.267 INFO:teuthology.orchestra.run.smithi093.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7629-g95c90f41-1jammy [48.6 MB] 2024-01-15T11:29:43.511 INFO:teuthology.orchestra.run.smithi027.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7629-g95c90f41-1jammy [121 kB] 2024-01-15T11:29:43.512 INFO:teuthology.orchestra.run.smithi027.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7629-g95c90f41-1jammy [226 kB] 2024-01-15T11:29:43.536 INFO:teuthology.orchestra.run.smithi027.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7629-g95c90f41-1jammy [34.0 kB] 2024-01-15T11:29:43.537 INFO:teuthology.orchestra.run.smithi027.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7629-g95c90f41-1jammy [23.4 kB] 2024-01-15T11:29:43.537 INFO:teuthology.orchestra.run.smithi027.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7629-g95c90f41-1jammy [38.3 kB] 2024-01-15T11:29:43.538 INFO:teuthology.orchestra.run.smithi027.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7629-g95c90f41-1jammy [12.3 MB] 2024-01-15T11:29:44.288 INFO:teuthology.orchestra.run.smithi027.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7629-g95c90f41-1jammy [91.4 kB] 2024-01-15T11:29:44.560 INFO:teuthology.orchestra.run.smithi093.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7629-g95c90f41-1jammy [121 kB] 2024-01-15T11:29:44.561 INFO:teuthology.orchestra.run.smithi093.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7629-g95c90f41-1jammy [226 kB] 2024-01-15T11:29:44.563 INFO:teuthology.orchestra.run.smithi093.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7629-g95c90f41-1jammy [34.0 kB] 2024-01-15T11:29:44.563 INFO:teuthology.orchestra.run.smithi093.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7629-g95c90f41-1jammy [23.4 kB] 2024-01-15T11:29:44.564 INFO:teuthology.orchestra.run.smithi093.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7629-g95c90f41-1jammy [38.3 kB] 2024-01-15T11:29:44.564 INFO:teuthology.orchestra.run.smithi093.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7629-g95c90f41-1jammy [12.3 MB] 2024-01-15T11:29:44.963 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 187 MB in 19s (9,709 kB/s) 2024-01-15T11:29:44.971 INFO:teuthology.orchestra.run.smithi093.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/rishabh-clone-stats/95c90f413c4bb65e3e56909855f2308fd9bda05b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7629-g95c90f41-1jammy [91.4 kB] 2024-01-15T11:29:45.126 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-15T11:29:45.195 INFO:teuthology.orchestra.run.smithi027.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2024-01-15T11:29:45.199 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-01-15T11:29:45.242 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-01-15T11:29:45.607 INFO:teuthology.orchestra.run.smithi093.stdout:Fetched 187 MB in 20s (9,303 kB/s) 2024-01-15T11:29:45.695 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-15T11:29:45.709 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-01-15T11:29:45.750 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-pyperclip. 2024-01-15T11:29:45.753 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-15T11:29:45.819 INFO:teuthology.orchestra.run.smithi093.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2024-01-15T11:29:45.822 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-01-15T11:29:45.866 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-01-15T11:29:46.022 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cmd2. 2024-01-15T11:29:46.036 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-01-15T11:29:46.072 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-01-15T11:29:46.310 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-wcwidth. 2024-01-15T11:29:46.323 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-01-15T11:29:46.359 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-15T11:29:46.408 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-01-15T11:29:46.423 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-01-15T11:29:46.508 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-15T11:29:46.612 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-cmd2. 2024-01-15T11:29:46.625 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-01-15T11:29:46.692 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-01-15T11:29:46.828 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-01-15T11:29:46.844 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-01-15T11:29:46.887 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-15T11:29:47.048 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-01-15T11:29:47.063 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-01-15T11:29:47.148 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-15T11:29:47.214 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-01-15T11:29:47.230 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-15T11:29:47.298 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-15T11:29:47.486 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-01-15T11:29:47.499 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-01-15T11:29:47.543 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-15T11:29:47.735 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-01-15T11:29:47.750 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-15T11:29:47.794 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-15T11:29:47.829 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-01-15T11:29:47.843 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-01-15T11:29:47.904 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-15T11:29:48.163 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-01-15T11:29:48.178 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-15T11:29:48.221 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-15T11:29:48.332 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-01-15T11:29:48.347 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-15T11:29:48.399 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-15T11:29:48.591 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-01-15T11:29:48.606 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-15T11:29:48.649 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-15T11:29:48.785 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-01-15T11:29:48.800 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-15T11:29:48.843 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-15T11:29:48.994 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-01-15T11:29:49.009 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-01-15T11:29:49.043 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-15T11:29:49.229 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-01-15T11:29:49.244 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-01-15T11:29:49.288 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-15T11:29:49.321 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package librados2. 2024-01-15T11:29:49.337 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../010-librados2_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:29:49.380 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librados2 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:29:49.583 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-01-15T11:29:49.597 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-01-15T11:29:49.632 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-15T11:29:49.936 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package librados2. 2024-01-15T11:29:49.950 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../010-librados2_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:29:49.991 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package librbd1. 2024-01-15T11:29:49.993 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking librados2 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:29:50.006 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../011-librbd1_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:29:50.040 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librbd1 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:29:50.429 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package librbd1. 2024-01-15T11:29:50.443 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../011-librbd1_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:29:50.460 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libcephfs2. 2024-01-15T11:29:50.475 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:29:50.487 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking librbd1 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:29:50.518 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libcephfs2 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:29:50.812 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-rados. 2024-01-15T11:29:50.828 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:29:50.862 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-rados (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:29:50.898 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libcephfs2. 2024-01-15T11:29:50.912 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:29:50.957 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libcephfs2 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:29:51.157 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-15T11:29:51.172 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T11:29:51.215 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-ceph-argparse (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:29:51.217 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-rados. 2024-01-15T11:29:51.231 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:29:51.267 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-rados (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:29:51.467 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cephfs. 2024-01-15T11:29:51.483 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:29:51.526 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cephfs (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:29:51.586 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-01-15T11:29:51.601 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T11:29:51.644 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-ceph-argparse (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:29:51.879 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-15T11:29:51.893 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T11:29:51.897 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-cephfs. 2024-01-15T11:29:51.911 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:29:51.937 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-ceph-common (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:29:51.963 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-cephfs (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:29:52.265 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-prettytable. 2024-01-15T11:29:52.274 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-ceph-common. 2024-01-15T11:29:52.280 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-01-15T11:29:52.289 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T11:29:52.323 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-01-15T11:29:52.332 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-ceph-common (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:29:52.559 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-rbd. 2024-01-15T11:29:52.574 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:29:52.608 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-rbd (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:29:52.711 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-prettytable. 2024-01-15T11:29:52.725 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-01-15T11:29:52.769 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-01-15T11:29:52.937 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-15T11:29:52.952 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-01-15T11:29:52.988 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-rbd. 2024-01-15T11:29:53.002 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:29:53.020 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-15T11:29:53.046 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-rbd (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:29:53.297 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-01-15T11:29:53.312 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-01-15T11:29:53.355 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-01-15T11:29:53.390 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-01-15T11:29:53.405 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-01-15T11:29:53.449 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-15T11:29:53.635 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-01-15T11:29:53.648 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-01-15T11:29:53.691 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-15T11:29:53.718 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-01-15T11:29:53.732 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-01-15T11:29:53.811 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-01-15T11:29:53.978 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package lua5.1. 2024-01-15T11:29:53.994 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-01-15T11:29:54.028 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-01-15T11:29:54.112 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-01-15T11:29:54.126 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-01-15T11:29:54.170 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-15T11:29:54.381 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package lua-any. 2024-01-15T11:29:54.396 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-01-15T11:29:54.439 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking lua-any (27ubuntu1) ... 2024-01-15T11:29:54.473 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package lua5.1. 2024-01-15T11:29:54.488 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-01-15T11:29:54.531 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-01-15T11:29:54.691 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package zip. 2024-01-15T11:29:54.707 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-01-15T11:29:54.749 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking zip (3.0-12build2) ... 2024-01-15T11:29:54.817 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package lua-any. 2024-01-15T11:29:54.832 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-01-15T11:29:54.876 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking lua-any (27ubuntu1) ... 2024-01-15T11:29:55.061 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package unzip. 2024-01-15T11:29:55.077 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2024-01-15T11:29:55.119 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2024-01-15T11:29:55.153 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package zip. 2024-01-15T11:29:55.168 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-01-15T11:29:55.211 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking zip (3.0-12build2) ... 2024-01-15T11:29:55.498 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package unzip. 2024-01-15T11:29:55.512 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2024-01-15T11:29:55.548 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2024-01-15T11:29:55.548 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package luarocks. 2024-01-15T11:29:55.563 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-01-15T11:29:55.606 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-01-15T11:29:55.910 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package luarocks. 2024-01-15T11:29:55.924 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-01-15T11:29:55.968 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-01-15T11:29:55.981 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package librgw2. 2024-01-15T11:29:55.995 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../027-librgw2_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:29:56.030 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librgw2 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:29:56.367 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package librgw2. 2024-01-15T11:29:56.380 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../027-librgw2_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:29:56.425 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking librgw2 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:29:56.516 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-rgw. 2024-01-15T11:29:56.530 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../028-python3-rgw_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:29:56.575 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-rgw (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:29:56.877 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-rgw. 2024-01-15T11:29:56.891 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../028-python3-rgw_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:29:56.920 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package liboath0:amd64. 2024-01-15T11:29:56.934 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-01-15T11:29:56.935 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-rgw (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:29:56.977 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-01-15T11:29:57.238 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package liboath0:amd64. 2024-01-15T11:29:57.239 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libradosstriper1. 2024-01-15T11:29:57.253 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-01-15T11:29:57.254 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../030-libradosstriper1_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:29:57.289 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libradosstriper1 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:29:57.298 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-01-15T11:29:57.684 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-common. 2024-01-15T11:29:57.707 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../031-ceph-common_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:29:58.235 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libradosstriper1. 2024-01-15T11:29:58.248 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../030-libradosstriper1_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:29:58.291 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libradosstriper1 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:29:58.361 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-common (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:29:58.736 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-common. 2024-01-15T11:29:58.750 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../031-ceph-common_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:29:58.793 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-common (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:29:59.381 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-base. 2024-01-15T11:29:59.396 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../032-ceph-base_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:29:59.440 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-base (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:29:59.765 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-base. 2024-01-15T11:29:59.780 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../032-ceph-base_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:29:59.833 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-base (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:00.302 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-01-15T11:30:00.316 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-01-15T11:30:00.360 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-01-15T11:30:00.477 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-01-15T11:30:00.490 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-01-15T11:30:00.527 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-01-15T11:30:00.646 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cheroot. 2024-01-15T11:30:00.661 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-01-15T11:30:00.704 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-15T11:30:00.830 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-cheroot. 2024-01-15T11:30:00.843 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-01-15T11:30:00.917 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-15T11:30:01.049 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-01-15T11:30:01.064 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-01-15T11:30:01.107 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-01-15T11:30:01.193 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-01-15T11:30:01.204 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-01-15T11:30:01.241 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-01-15T11:30:01.410 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-jaraco.text. 2024-01-15T11:30:01.425 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-01-15T11:30:01.468 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-01-15T11:30:01.544 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-jaraco.text. 2024-01-15T11:30:01.558 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-01-15T11:30:01.602 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-01-15T11:30:01.738 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-01-15T11:30:01.753 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-01-15T11:30:01.788 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-01-15T11:30:02.074 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-tempora. 2024-01-15T11:30:02.089 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-01-15T11:30:02.121 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-01-15T11:30:02.136 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-01-15T11:30:02.157 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-01-15T11:30:02.179 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-01-15T11:30:02.441 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-tempora. 2024-01-15T11:30:02.455 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-01-15T11:30:02.460 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-portend. 2024-01-15T11:30:02.475 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-01-15T11:30:02.498 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-01-15T11:30:02.518 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-01-15T11:30:02.785 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-portend. 2024-01-15T11:30:02.799 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-01-15T11:30:02.805 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-01-15T11:30:02.820 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-01-15T11:30:02.843 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-01-15T11:30:02.854 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-01-15T11:30:03.074 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-15T11:30:03.089 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-01-15T11:30:03.124 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-01-15T11:30:03.128 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-01-15T11:30:03.143 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-01-15T11:30:03.186 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-01-15T11:30:03.502 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-natsort. 2024-01-15T11:30:03.517 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-01-15T11:30:03.539 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-cherrypy3. 2024-01-15T11:30:03.554 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-01-15T11:30:03.569 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-01-15T11:30:03.589 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-01-15T11:30:03.840 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-logutils. 2024-01-15T11:30:03.854 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-01-15T11:30:03.889 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-01-15T11:30:03.926 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-natsort. 2024-01-15T11:30:03.941 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-01-15T11:30:03.984 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-01-15T11:30:04.183 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-15T11:30:04.199 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-01-15T11:30:04.241 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-01-15T11:30:04.295 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-logutils. 2024-01-15T11:30:04.310 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-01-15T11:30:04.353 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-01-15T11:30:04.544 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-mako. 2024-01-15T11:30:04.559 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-01-15T11:30:04.602 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-15T11:30:04.698 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-markupsafe. 2024-01-15T11:30:04.712 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-01-15T11:30:04.765 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-01-15T11:30:04.931 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-15T11:30:04.946 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-15T11:30:04.989 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-15T11:30:05.034 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-mako. 2024-01-15T11:30:05.048 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-01-15T11:30:05.083 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-15T11:30:05.268 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-15T11:30:05.282 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-01-15T11:30:05.316 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-01-15T11:30:05.395 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-simplegeneric. 2024-01-15T11:30:05.410 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-01-15T11:30:05.453 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-01-15T11:30:05.619 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-webob. 2024-01-15T11:30:05.635 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-01-15T11:30:05.678 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-01-15T11:30:05.772 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-singledispatch. 2024-01-15T11:30:05.787 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-01-15T11:30:05.830 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-01-15T11:30:05.972 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-waitress. 2024-01-15T11:30:05.987 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-01-15T11:30:06.025 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-15T11:30:06.142 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-webob. 2024-01-15T11:30:06.156 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-01-15T11:30:06.199 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-01-15T11:30:06.283 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-tempita. 2024-01-15T11:30:06.298 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-01-15T11:30:06.341 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-01-15T11:30:06.552 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-waitress. 2024-01-15T11:30:06.567 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-01-15T11:30:06.614 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-15T11:30:06.645 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-paste. 2024-01-15T11:30:06.660 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-01-15T11:30:06.728 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-01-15T11:30:06.972 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-tempita. 2024-01-15T11:30:06.986 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-01-15T11:30:07.030 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-01-15T11:30:07.056 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-15T11:30:07.071 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-01-15T11:30:07.114 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-01-15T11:30:07.325 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-paste. 2024-01-15T11:30:07.340 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-01-15T11:30:07.383 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-01-15T11:30:07.417 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-15T11:30:07.432 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-01-15T11:30:07.475 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-01-15T11:30:07.694 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-01-15T11:30:07.708 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-01-15T11:30:07.752 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-01-15T11:30:07.812 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-webtest. 2024-01-15T11:30:07.827 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-01-15T11:30:07.869 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-01-15T11:30:08.071 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-pastedeploy. 2024-01-15T11:30:08.086 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-01-15T11:30:08.129 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-01-15T11:30:08.156 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pecan. 2024-01-15T11:30:08.171 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-01-15T11:30:08.206 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-01-15T11:30:08.416 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-webtest. 2024-01-15T11:30:08.431 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-01-15T11:30:08.474 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-01-15T11:30:08.552 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-certifi. 2024-01-15T11:30:08.568 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-01-15T11:30:08.610 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-01-15T11:30:08.793 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-pecan. 2024-01-15T11:30:08.808 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-01-15T11:30:08.851 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-01-15T11:30:08.963 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-idna. 2024-01-15T11:30:08.978 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-01-15T11:30:09.013 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-idna (3.3-1) ... 2024-01-15T11:30:09.239 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-certifi. 2024-01-15T11:30:09.254 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-01-15T11:30:09.274 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-urllib3. 2024-01-15T11:30:09.290 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-01-15T11:30:09.297 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-01-15T11:30:09.324 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-15T11:30:09.594 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-requests. 2024-01-15T11:30:09.609 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-01-15T11:30:09.633 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-idna. 2024-01-15T11:30:09.648 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-01-15T11:30:09.652 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-15T11:30:09.692 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-idna (3.3-1) ... 2024-01-15T11:30:09.964 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-15T11:30:09.979 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-01-15T11:30:10.003 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-urllib3. 2024-01-15T11:30:10.018 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-01-15T11:30:10.021 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-15T11:30:10.061 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-15T11:30:10.389 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-requests. 2024-01-15T11:30:10.404 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-01-15T11:30:10.446 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-15T11:30:10.467 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-15T11:30:10.482 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T11:30:10.524 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:10.742 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-werkzeug. 2024-01-15T11:30:10.756 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-01-15T11:30:10.792 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-15T11:30:10.905 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-15T11:30:10.919 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:10.963 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:11.102 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-01-15T11:30:11.117 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T11:30:11.160 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:11.257 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-15T11:30:11.273 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-01-15T11:30:11.307 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-01-15T11:30:11.560 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-openssl. 2024-01-15T11:30:11.573 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-01-15T11:30:11.575 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-01-15T11:30:11.588 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:11.618 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-01-15T11:30:11.631 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:11.951 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-bcrypt. 2024-01-15T11:30:11.954 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr. 2024-01-15T11:30:11.965 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-01-15T11:30:11.970 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../065-ceph-mgr_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:12.009 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-01-15T11:30:12.012 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:12.311 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-openssl. 2024-01-15T11:30:12.326 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-01-15T11:30:12.370 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-01-15T11:30:12.424 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mon. 2024-01-15T11:30:12.440 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../066-ceph-mon_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:12.482 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mon (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:12.648 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-mgr. 2024-01-15T11:30:12.662 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../065-ceph-mgr_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:12.706 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-mgr (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:13.109 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-mon. 2024-01-15T11:30:13.123 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../066-ceph-mon_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:13.167 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-mon (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:13.327 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-osd. 2024-01-15T11:30:13.343 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../067-ceph-osd_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:13.377 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-osd (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:13.962 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-osd. 2024-01-15T11:30:13.977 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../067-ceph-osd_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:14.020 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-osd (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:14.614 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph. 2024-01-15T11:30:14.629 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../068-ceph_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:14.672 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:14.933 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-fuse. 2024-01-15T11:30:14.948 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../069-ceph-fuse_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:14.983 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-fuse (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:15.156 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph. 2024-01-15T11:30:15.171 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../068-ceph_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:15.206 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:15.336 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mds. 2024-01-15T11:30:15.351 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../070-ceph-mds_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:15.394 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mds (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:15.483 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-fuse. 2024-01-15T11:30:15.498 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../069-ceph-fuse_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:15.542 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-fuse (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:15.780 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package cephadm. 2024-01-15T11:30:15.796 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../071-cephadm_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:15.838 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking cephadm (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:15.895 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-mds. 2024-01-15T11:30:15.909 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../070-ceph-mds_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:15.953 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-mds (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:16.150 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-asyncssh. 2024-01-15T11:30:16.165 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-01-15T11:30:16.207 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-01-15T11:30:16.356 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package cephadm. 2024-01-15T11:30:16.370 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../071-cephadm_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:16.413 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking cephadm (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:16.477 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python-babel-localedata. 2024-01-15T11:30:16.492 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-01-15T11:30:16.535 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-15T11:30:16.716 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-asyncssh. 2024-01-15T11:30:16.732 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-01-15T11:30:16.766 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-01-15T11:30:17.210 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python-babel-localedata. 2024-01-15T11:30:17.226 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-01-15T11:30:17.268 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-15T11:30:17.532 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-babel. 2024-01-15T11:30:17.546 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-01-15T11:30:17.581 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-01-15T11:30:17.859 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-jinja2. 2024-01-15T11:30:17.873 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2024-01-15T11:30:17.909 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2024-01-15T11:30:18.156 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-babel. 2024-01-15T11:30:18.170 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-01-15T11:30:18.214 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-01-15T11:30:18.270 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-15T11:30:18.285 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T11:30:18.331 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:18.525 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-jinja2. 2024-01-15T11:30:18.539 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2024-01-15T11:30:18.583 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2024-01-15T11:30:18.634 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-15T11:30:18.649 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-01-15T11:30:18.684 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-15T11:30:18.944 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-01-15T11:30:18.958 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T11:30:19.003 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:19.153 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-routes. 2024-01-15T11:30:19.169 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-01-15T11:30:19.211 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-01-15T11:30:19.422 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-repoze.lru. 2024-01-15T11:30:19.437 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-01-15T11:30:19.480 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-01-15T11:30:19.540 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-15T11:30:19.555 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T11:30:19.598 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:19.783 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-routes. 2024-01-15T11:30:19.798 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-01-15T11:30:19.866 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-01-15T11:30:20.010 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-01-15T11:30:20.024 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-01-15T11:30:20.059 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-15T11:30:20.203 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-01-15T11:30:20.218 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T11:30:20.261 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:20.680 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-joblib. 2024-01-15T11:30:20.689 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-01-15T11:30:20.695 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-01-15T11:30:20.703 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-01-15T11:30:20.738 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-01-15T11:30:20.738 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-15T11:30:21.100 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-01-15T11:30:21.115 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-01-15T11:30:21.235 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-01-15T11:30:21.260 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-joblib. 2024-01-15T11:30:21.275 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-01-15T11:30:21.319 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-01-15T11:30:21.530 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-sklearn. 2024-01-15T11:30:21.545 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-01-15T11:30:21.588 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-15T11:30:21.672 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-01-15T11:30:21.686 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-01-15T11:30:21.799 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-01-15T11:30:22.103 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-sklearn. 2024-01-15T11:30:22.117 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-01-15T11:30:22.160 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-15T11:30:22.231 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-15T11:30:22.245 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T11:30:22.297 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:22.836 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-01-15T11:30:22.850 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T11:30:22.894 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:23.259 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cachetools. 2024-01-15T11:30:23.275 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-01-15T11:30:23.317 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-01-15T11:30:23.578 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-15T11:30:23.594 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-01-15T11:30:23.636 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-01-15T11:30:23.830 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-cachetools. 2024-01-15T11:30:23.845 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-01-15T11:30:23.880 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-01-15T11:30:23.974 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-15T11:30:23.990 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-01-15T11:30:24.032 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-01-15T11:30:24.183 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-pyasn1. 2024-01-15T11:30:24.198 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-01-15T11:30:24.241 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-01-15T11:30:24.343 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-rsa. 2024-01-15T11:30:24.359 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-01-15T11:30:24.401 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-rsa (4.8-1) ... 2024-01-15T11:30:24.570 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-01-15T11:30:24.585 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-01-15T11:30:24.628 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-01-15T11:30:24.722 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-google-auth. 2024-01-15T11:30:24.738 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-01-15T11:30:24.805 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-01-15T11:30:24.972 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-rsa. 2024-01-15T11:30:24.987 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-01-15T11:30:25.030 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-rsa (4.8-1) ... 2024-01-15T11:30:25.125 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-15T11:30:25.141 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-01-15T11:30:25.183 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-15T11:30:25.343 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-google-auth. 2024-01-15T11:30:25.358 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-01-15T11:30:25.401 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-01-15T11:30:25.461 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-websocket. 2024-01-15T11:30:25.477 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-01-15T11:30:25.511 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-01-15T11:30:25.679 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-01-15T11:30:25.694 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-01-15T11:30:25.729 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-15T11:30:25.815 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-15T11:30:25.831 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-01-15T11:30:25.872 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-15T11:30:26.065 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-websocket. 2024-01-15T11:30:26.081 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-01-15T11:30:26.123 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-01-15T11:30:26.443 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-kubernetes. 2024-01-15T11:30:26.459 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-01-15T11:30:26.493 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-15T11:30:26.520 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-15T11:30:26.534 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T11:30:26.570 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:26.847 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-15T11:30:26.862 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-01-15T11:30:26.914 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-15T11:30:27.165 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-01-15T11:30:27.179 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T11:30:27.223 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:27.359 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-15T11:30:27.374 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-01-15T11:30:27.425 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-15T11:30:27.501 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libonig5:amd64. 2024-01-15T11:30:27.515 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-01-15T11:30:27.560 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-15T11:30:27.712 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package jq. 2024-01-15T11:30:27.726 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-01-15T11:30:27.770 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-01-15T11:30:27.871 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libjq1:amd64. 2024-01-15T11:30:27.885 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-01-15T11:30:27.929 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-15T11:30:28.022 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package socat. 2024-01-15T11:30:28.037 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-01-15T11:30:28.089 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-01-15T11:30:28.181 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package jq. 2024-01-15T11:30:28.197 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-01-15T11:30:28.240 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-01-15T11:30:28.459 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package xmlstarlet. 2024-01-15T11:30:28.474 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-01-15T11:30:28.517 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package socat. 2024-01-15T11:30:28.526 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-01-15T11:30:28.533 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-01-15T11:30:28.575 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-01-15T11:30:28.837 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package xmlstarlet. 2024-01-15T11:30:28.853 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-01-15T11:30:28.880 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-test. 2024-01-15T11:30:28.887 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-01-15T11:30:28.895 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../099-ceph-test_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:28.938 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-test (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:29.249 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-test. 2024-01-15T11:30:29.263 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../099-ceph-test_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:29.307 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-test (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:31.002 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-volume. 2024-01-15T11:30:31.017 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../100-ceph-volume_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T11:30:31.059 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-volume (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:31.062 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-volume. 2024-01-15T11:30:31.077 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../100-ceph-volume_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T11:30:31.120 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-volume (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:31.397 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-15T11:30:31.413 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../101-cephfs-mirror_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:31.415 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package cephfs-mirror. 2024-01-15T11:30:31.430 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../101-cephfs-mirror_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:31.455 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking cephfs-mirror (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:31.465 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking cephfs-mirror (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:31.760 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-colorama. 2024-01-15T11:30:31.775 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-01-15T11:30:31.783 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-colorama. 2024-01-15T11:30:31.800 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-01-15T11:30:31.827 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-01-15T11:30:31.841 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-01-15T11:30:32.085 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package cephfs-shell. 2024-01-15T11:30:32.101 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../103-cephfs-shell_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T11:30:32.121 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package cephfs-shell. 2024-01-15T11:30:32.136 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../103-cephfs-shell_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T11:30:32.143 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking cephfs-shell (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:32.179 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking cephfs-shell (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:32.371 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package cephfs-top. 2024-01-15T11:30:32.387 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../104-cephfs-top_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T11:30:32.414 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package cephfs-top. 2024-01-15T11:30:32.422 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking cephfs-top (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:32.429 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../104-cephfs-top_18.0.0-7629-g95c90f41-1jammy_all.deb ... 2024-01-15T11:30:32.473 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking cephfs-top (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:32.640 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-15T11:30:32.656 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../105-libcephfs-dev_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:32.698 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libcephfs-dev (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:32.725 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libcephfs-dev. 2024-01-15T11:30:32.740 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../105-libcephfs-dev_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:32.783 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libcephfs-dev (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:33.035 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package lua-socket:amd64. 2024-01-15T11:30:33.051 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-01-15T11:30:33.093 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-15T11:30:33.111 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package lua-socket:amd64. 2024-01-15T11:30:33.126 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-01-15T11:30:33.161 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-15T11:30:33.422 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package lua-sec:amd64. 2024-01-15T11:30:33.439 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-01-15T11:30:33.480 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-01-15T11:30:33.490 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package lua-sec:amd64. 2024-01-15T11:30:33.505 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-01-15T11:30:33.548 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-01-15T11:30:33.785 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package nvme-cli. 2024-01-15T11:30:33.801 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-01-15T11:30:33.859 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-01-15T11:30:33.910 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package nvme-cli. 2024-01-15T11:30:33.926 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-01-15T11:30:33.969 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-01-15T11:30:34.273 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package pkg-config. 2024-01-15T11:30:34.288 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-01-15T11:30:34.331 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-01-15T11:30:34.399 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package pkg-config. 2024-01-15T11:30:34.414 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-01-15T11:30:34.456 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-01-15T11:30:34.592 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-01-15T11:30:34.609 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-01-15T11:30:34.650 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-01-15T11:30:34.701 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-01-15T11:30:34.717 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-01-15T11:30:34.760 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-01-15T11:30:35.070 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-iniconfig. 2024-01-15T11:30:35.086 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-01-15T11:30:35.162 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-01-15T11:30:35.179 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-iniconfig. 2024-01-15T11:30:35.194 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-01-15T11:30:35.238 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-01-15T11:30:35.465 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pastescript. 2024-01-15T11:30:35.481 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-01-15T11:30:35.490 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-pastescript. 2024-01-15T11:30:35.506 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-01-15T11:30:35.522 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-15T11:30:35.582 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-01-15T11:30:35.843 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pluggy. 2024-01-15T11:30:35.859 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-01-15T11:30:35.876 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-pluggy. 2024-01-15T11:30:35.891 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-01-15T11:30:35.901 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-01-15T11:30:35.935 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-01-15T11:30:36.212 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-psutil. 2024-01-15T11:30:36.229 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-01-15T11:30:36.246 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-psutil. 2024-01-15T11:30:36.261 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-01-15T11:30:36.296 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-01-15T11:30:36.304 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-01-15T11:30:36.607 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-py. 2024-01-15T11:30:36.623 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-01-15T11:30:36.632 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-py. 2024-01-15T11:30:36.647 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-01-15T11:30:36.665 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-py (1.10.0-1) ... 2024-01-15T11:30:36.690 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-py (1.10.0-1) ... 2024-01-15T11:30:36.986 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pygments. 2024-01-15T11:30:37.002 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-01-15T11:30:37.043 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-01-15T11:30:37.052 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-pygments. 2024-01-15T11:30:37.067 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-01-15T11:30:37.110 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-01-15T11:30:37.506 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-15T11:30:37.523 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-01-15T11:30:37.564 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-01-15T11:30:37.597 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-pyinotify. 2024-01-15T11:30:37.612 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-01-15T11:30:37.647 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-01-15T11:30:37.884 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-toml. 2024-01-15T11:30:37.900 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-01-15T11:30:37.942 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-01-15T11:30:37.983 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-toml. 2024-01-15T11:30:37.998 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-01-15T11:30:38.041 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-01-15T11:30:38.245 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pytest. 2024-01-15T11:30:38.261 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-01-15T11:30:38.303 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-01-15T11:30:38.344 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-pytest. 2024-01-15T11:30:38.359 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-01-15T11:30:38.402 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-01-15T11:30:38.665 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-simplejson. 2024-01-15T11:30:38.681 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-01-15T11:30:38.722 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-simplejson. 2024-01-15T11:30:38.722 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-01-15T11:30:38.737 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-01-15T11:30:38.772 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-01-15T11:30:38.993 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-01-15T11:30:39.009 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-01-15T11:30:39.016 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-01-15T11:30:39.031 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-01-15T11:30:39.051 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-01-15T11:30:39.066 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-01-15T11:30:39.713 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package radosgw. 2024-01-15T11:30:39.728 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../122-radosgw_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:39.771 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking radosgw (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:39.787 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package radosgw. 2024-01-15T11:30:39.801 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../122-radosgw_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:39.845 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking radosgw (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:40.349 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package rbd-fuse. 2024-01-15T11:30:40.364 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../123-rbd-fuse_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:40.407 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking rbd-fuse (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:40.439 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package rbd-fuse. 2024-01-15T11:30:40.454 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../123-rbd-fuse_18.0.0-7629-g95c90f41-1jammy_amd64.deb ... 2024-01-15T11:30:40.498 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking rbd-fuse (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:40.694 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-01-15T11:30:40.783 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-01-15T11:30:41.046 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-15T11:30:41.070 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-01-15T11:30:41.172 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-01-15T11:30:41.195 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-01-15T11:30:41.435 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-01-15T11:30:41.454 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-01-15T11:30:41.834 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-01-15T11:30:41.854 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-01-15T11:30:42.446 INFO:teuthology.orchestra.run.smithi093.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-01-15T11:30:42.456 INFO:teuthology.orchestra.run.smithi027.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-01-15T11:30:42.471 INFO:teuthology.orchestra.run.smithi027.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-01-15T11:30:42.488 INFO:teuthology.orchestra.run.smithi093.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-01-15T11:30:42.525 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up cephadm (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:42.530 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up cephadm (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:43.084 INFO:teuthology.orchestra.run.smithi093.stdout:Adding system user cephadm....done 2024-01-15T11:30:43.236 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-15T11:30:43.447 INFO:teuthology.orchestra.run.smithi027.stdout:Adding system user cephadm....done 2024-01-15T11:30:43.512 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-01-15T11:30:43.589 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-01-15T11:30:43.780 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-01-15T11:30:43.891 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-01-15T11:30:43.922 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-01-15T11:30:44.182 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-15T11:30:44.267 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-01-15T11:30:44.377 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-01-15T11:30:44.450 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-01-15T11:30:44.576 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-py (1.10.0-1) ... 2024-01-15T11:30:44.645 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-01-15T11:30:44.878 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-01-15T11:30:44.921 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-01-15T11:30:45.047 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-py (1.10.0-1) ... 2024-01-15T11:30:45.246 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-01-15T11:30:45.365 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-01-15T11:30:45.514 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-01-15T11:30:45.768 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-01-15T11:30:45.774 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-01-15T11:30:46.035 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-01-15T11:30:46.058 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2024-01-15T11:30:46.321 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-01-15T11:30:46.385 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-01-15T11:30:46.653 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-01-15T11:30:46.921 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-01-15T11:30:47.038 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2024-01-15T11:30:47.188 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-ceph-argparse (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:47.272 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-01-15T11:30:47.447 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-15T11:30:47.524 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-01-15T11:30:47.565 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-15T11:30:47.691 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-01-15T11:30:47.817 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-01-15T11:30:48.084 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-ceph-argparse (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:48.301 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-01-15T11:30:48.361 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-01-15T11:30:48.427 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-01-15T11:30:48.487 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-01-15T11:30:48.613 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-01-15T11:30:48.695 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-01-15T11:30:48.880 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-01-15T11:30:49.014 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-01-15T11:30:49.153 INFO:teuthology.orchestra.run.smithi093.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-01-15T11:30:49.183 INFO:teuthology.orchestra.run.smithi093.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-01-15T11:30:49.239 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-15T11:30:49.257 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-01-15T11:30:49.373 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-01-15T11:30:49.640 INFO:teuthology.orchestra.run.smithi027.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-01-15T11:30:49.671 INFO:teuthology.orchestra.run.smithi027.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-01-15T11:30:49.752 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-01-15T11:30:49.759 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-15T11:30:49.878 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-01-15T11:30:49.884 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-01-15T11:30:50.161 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-01-15T11:30:50.263 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-01-15T11:30:50.380 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-01-15T11:30:50.437 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-01-15T11:30:50.640 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-01-15T11:30:50.755 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up zip (3.0-12build2) ... 2024-01-15T11:30:50.872 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-01-15T11:30:50.891 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-01-15T11:30:51.242 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up zip (3.0-12build2) ... 2024-01-15T11:30:51.368 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-01-15T11:30:51.574 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-01-15T11:30:51.850 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-01-15T11:30:51.976 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-01-15T11:30:52.087 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-01-15T11:30:52.102 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-15T11:30:52.363 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-01-15T11:30:52.445 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-01-15T11:30:52.481 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-01-15T11:30:52.582 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-01-15T11:30:52.847 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-01-15T11:30:52.891 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-01-15T11:30:53.106 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-01-15T11:30:53.301 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-01-15T11:30:53.482 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-15T11:30:53.569 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-01-15T11:30:53.783 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-01-15T11:30:53.970 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-01-15T11:30:54.101 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-15T11:30:54.280 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-01-15T11:30:54.470 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-01-15T11:30:54.597 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-01-15T11:30:54.762 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-01-15T11:30:54.888 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-ceph-common (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:54.940 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-01-15T11:30:55.190 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-idna (3.3-1) ... 2024-01-15T11:30:55.200 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-01-15T11:30:55.334 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-ceph-common (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:30:55.524 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-15T11:30:55.674 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-idna (3.3-1) ... 2024-01-15T11:30:56.029 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-01-15T11:30:56.764 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-01-15T11:30:57.031 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-15T11:30:57.166 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-toml (0.10.2-1) ... 2024-01-15T11:30:57.327 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-01-15T11:30:57.425 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-15T11:30:57.551 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-01-15T11:30:57.578 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-15T11:30:57.685 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-15T11:30:57.713 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-toml (0.10.2-1) ... 2024-01-15T11:30:57.987 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-01-15T11:30:57.989 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-01-15T11:30:58.090 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-01-15T11:30:58.190 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-01-15T11:30:58.288 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-01-15T11:30:58.501 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-01-15T11:30:58.547 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-15T11:30:58.657 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-01-15T11:30:58.768 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-01-15T11:30:58.967 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-01-15T11:30:59.061 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-15T11:30:59.187 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-01-15T11:30:59.251 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-01-15T11:30:59.505 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-01-15T11:30:59.527 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-01-15T11:30:59.756 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-01-15T11:30:59.795 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-15T11:31:00.007 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-01-15T11:31:00.054 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-01-15T11:31:00.278 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-01-15T11:31:00.322 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-15T11:31:00.457 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-01-15T11:31:00.545 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-01-15T11:31:00.749 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-15T11:31:00.829 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-01-15T11:31:00.875 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-15T11:31:00.947 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-01-15T11:31:01.176 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-01-15T11:31:01.223 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-01-15T11:31:01.357 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-01-15T11:31:01.495 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-01-15T11:31:01.642 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-01-15T11:31:01.754 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-15T11:31:01.880 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-01-15T11:31:01.997 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-01-15T11:31:02.069 INFO:teuthology.orchestra.run.smithi093.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-01-15T11:31:02.152 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-01-15T11:31:02.316 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-15T11:31:02.436 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-01-15T11:31:02.442 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-01-15T11:31:02.562 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-01-15T11:31:02.705 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-01-15T11:31:02.785 INFO:teuthology.orchestra.run.smithi027.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-01-15T11:31:02.843 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-01-15T11:31:03.031 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-01-15T11:31:03.128 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up lua-any (27ubuntu1) ... 2024-01-15T11:31:03.132 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-01-15T11:31:03.254 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-portend (3.0.0-1) ... 2024-01-15T11:31:03.521 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-15T11:31:03.534 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-01-15T11:31:03.639 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2024-01-15T11:31:03.811 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up lua-any (27ubuntu1) ... 2024-01-15T11:31:03.936 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-portend (3.0.0-1) ... 2024-01-15T11:31:03.969 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-01-15T11:31:04.204 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-01-15T11:31:04.292 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-15T11:31:04.330 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2024-01-15T11:31:04.576 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-01-15T11:31:04.656 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-01-15T11:31:04.787 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-rsa (4.8-1) ... 2024-01-15T11:31:04.957 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-01-15T11:31:05.064 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-01-15T11:31:05.225 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-01-15T11:31:05.348 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-15T11:31:05.437 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-rsa (4.8-1) ... 2024-01-15T11:31:05.616 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-01-15T11:31:05.713 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-01-15T11:31:06.001 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-15T11:31:06.014 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-01-15T11:31:06.266 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-01-15T11:31:06.296 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-01-15T11:31:06.642 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-01-15T11:31:06.674 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-15T11:31:06.799 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up librados2 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:06.925 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:06.952 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-01-15T11:31:07.043 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-01-15T11:31:07.313 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-01-15T11:31:07.346 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libcephfs2 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:07.431 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librados2 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:07.472 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libradosstriper1 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:07.532 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:07.631 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-01-15T11:31:07.633 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-01-15T11:31:07.916 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up librbd1 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:07.970 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libcephfs2 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:08.042 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-mgr-modules-core (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:08.121 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libradosstriper1 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:08.168 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-fuse (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:08.246 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-01-15T11:31:08.403 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-15T11:31:08.403 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-15T11:31:08.532 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librbd1 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:08.632 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-modules-core (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:08.750 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-fuse (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:08.966 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-15T11:31:08.966 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-01-15T11:31:09.128 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libcephfs-dev (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:09.263 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-rados (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:09.388 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up librgw2 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:09.515 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up cephfs-top (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:09.624 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-15T11:31:09.668 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libcephfs-dev (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:09.794 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-rados (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:09.920 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librgw2 (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:10.046 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up cephfs-top (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:10.172 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-01-15T11:31:10.886 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-rbd (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:11.011 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up rbd-fuse (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:11.179 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-rgw (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:11.297 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-cephfs (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:11.407 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up cephfs-shell (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:11.518 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-rbd (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:11.532 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-common (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:11.644 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up rbd-fuse (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:11.770 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-rgw (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:11.896 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cephfs (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:12.022 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up cephfs-shell (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:12.077 INFO:teuthology.orchestra.run.smithi093.stdout:Adding group ceph....done 2024-01-15T11:31:12.123 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-common (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:12.478 INFO:teuthology.orchestra.run.smithi093.stdout:Adding system user ceph....done 2024-01-15T11:31:12.639 INFO:teuthology.orchestra.run.smithi093.stdout:Setting system user ceph properties....done 2024-01-15T11:31:12.643 INFO:teuthology.orchestra.run.smithi027.stdout:Adding group ceph....done 2024-01-15T11:31:12.655 INFO:teuthology.orchestra.run.smithi093.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-15T11:31:12.796 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-15T11:31:13.027 INFO:teuthology.orchestra.run.smithi027.stdout:Adding system user ceph....done 2024-01-15T11:31:13.185 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-15T11:31:13.189 INFO:teuthology.orchestra.run.smithi027.stdout:Setting system user ceph properties....done 2024-01-15T11:31:13.204 INFO:teuthology.orchestra.run.smithi027.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-01-15T11:31:13.352 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-01-15T11:31:13.771 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-01-15T11:31:13.891 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up cephfs-mirror (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:14.101 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-15T11:31:14.101 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-15T11:31:14.457 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up cephfs-mirror (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:14.658 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-15T11:31:14.658 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-01-15T11:31:14.752 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-test (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:14.877 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up radosgw (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:15.292 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-test (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:15.418 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up radosgw (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:15.423 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-15T11:31:15.424 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-15T11:31:15.978 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-15T11:31:15.978 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-01-15T11:31:16.046 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-base (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:16.383 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-15T11:31:16.612 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-base (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:16.982 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-01-15T11:31:17.040 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-mds (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:17.278 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-15T11:31:17.278 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-15T11:31:17.656 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mds (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:17.869 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-15T11:31:17.869 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-01-15T11:31:17.900 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-mgr (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:18.111 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-15T11:31:18.111 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-15T11:31:18.474 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:18.696 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-15T11:31:18.696 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-01-15T11:31:19.114 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-osd (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:19.351 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-osd (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:19.450 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-15T11:31:19.450 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-15T11:31:19.670 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-15T11:31:19.670 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-01-15T11:31:20.040 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:20.166 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:20.308 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-mon (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:20.363 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:20.517 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-15T11:31:20.517 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-15T11:31:20.583 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:20.844 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mon (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:21.105 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-15T11:31:21.105 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-01-15T11:31:21.151 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-mgr-cephadm (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:21.311 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:21.437 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-mgr-dashboard (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:21.580 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-volume (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:21.732 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-cephadm (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:21.875 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:21.924 INFO:teuthology.orchestra.run.smithi093.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-01-15T11:31:22.000 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-dashboard (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:22.016 INFO:teuthology.orchestra.run.smithi093.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-15T11:31:22.152 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-volume (18.0.0-7629-g95c90f41-1jammy) ... 2024-01-15T11:31:22.160 INFO:teuthology.orchestra.run.smithi093.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-15T11:31:22.513 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-01-15T11:31:22.613 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-15T11:31:22.842 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-15T11:31:23.302 INFO:teuthology.orchestra.run.smithi093.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-15T11:31:23.625 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-15T11:31:23.989 INFO:teuthology.orchestra.run.smithi093.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-15T11:31:23.994 DEBUG:teuthology.orchestra.run.smithi093:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-01-15T11:31:24.070 INFO:teuthology.orchestra.run.smithi093.stdout:Reading package lists... 2024-01-15T11:31:24.239 INFO:teuthology.orchestra.run.smithi093.stdout:Building dependency tree... 2024-01-15T11:31:24.240 INFO:teuthology.orchestra.run.smithi093.stdout:Reading state information... 2024-01-15T11:31:24.392 INFO:teuthology.orchestra.run.smithi093.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-01-15T11:31:24.392 INFO:teuthology.orchestra.run.smithi093.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-15T11:31:24.392 INFO:teuthology.orchestra.run.smithi093.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-01-15T11:31:24.392 INFO:teuthology.orchestra.run.smithi093.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-15T11:31:24.392 INFO:teuthology.orchestra.run.smithi093.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-15T11:31:24.392 INFO:teuthology.orchestra.run.smithi093.stdout:The following packages were automatically installed and are no longer required: 2024-01-15T11:31:24.393 INFO:teuthology.orchestra.run.smithi093.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-15T11:31:24.393 INFO:teuthology.orchestra.run.smithi093.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-15T11:31:24.393 INFO:teuthology.orchestra.run.smithi093.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-15T11:31:24.393 INFO:teuthology.orchestra.run.smithi093.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-15T11:31:24.393 INFO:teuthology.orchestra.run.smithi093.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-15T11:31:24.393 INFO:teuthology.orchestra.run.smithi093.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-15T11:31:24.394 INFO:teuthology.orchestra.run.smithi093.stdout:The following additional packages will be installed: 2024-01-15T11:31:24.394 INFO:teuthology.orchestra.run.smithi093.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-01-15T11:31:24.394 INFO:teuthology.orchestra.run.smithi093.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-01-15T11:31:24.394 INFO:teuthology.orchestra.run.smithi093.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-01-15T11:31:24.395 INFO:teuthology.orchestra.run.smithi093.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-01-15T11:31:24.395 INFO:teuthology.orchestra.run.smithi093.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-15T11:31:24.395 INFO:teuthology.orchestra.run.smithi093.stdout:Suggested packages: 2024-01-15T11:31:24.395 INFO:teuthology.orchestra.run.smithi093.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-01-15T11:31:24.395 INFO:teuthology.orchestra.run.smithi093.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-01-15T11:31:24.395 INFO:teuthology.orchestra.run.smithi093.stdout: libengine-pkcs11-openssl 2024-01-15T11:31:24.446 INFO:teuthology.orchestra.run.smithi093.stdout:The following NEW packages will be installed: 2024-01-15T11:31:24.446 INFO:teuthology.orchestra.run.smithi093.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-01-15T11:31:24.446 INFO:teuthology.orchestra.run.smithi093.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-01-15T11:31:24.446 INFO:teuthology.orchestra.run.smithi093.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-01-15T11:31:24.446 INFO:teuthology.orchestra.run.smithi093.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-01-15T11:31:24.446 INFO:teuthology.orchestra.run.smithi093.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-01-15T11:31:24.446 INFO:teuthology.orchestra.run.smithi093.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-01-15T11:31:24.446 INFO:teuthology.orchestra.run.smithi093.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-15T11:31:24.447 INFO:teuthology.orchestra.run.smithi093.stdout:The following packages will be upgraded: 2024-01-15T11:31:24.447 INFO:teuthology.orchestra.run.smithi093.stdout: libssl3 2024-01-15T11:31:24.531 INFO:teuthology.orchestra.run.smithi027.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-15T11:31:24.535 DEBUG:teuthology.orchestra.run.smithi027:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-01-15T11:31:24.613 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2024-01-15T11:31:24.663 INFO:teuthology.orchestra.run.smithi093.stdout:1 upgraded, 39 newly installed, 0 to remove and 268 not upgraded. 2024-01-15T11:31:24.663 INFO:teuthology.orchestra.run.smithi093.stdout:Need to get 54.6 MB of archives. 2024-01-15T11:31:24.663 INFO:teuthology.orchestra.run.smithi093.stdout:After this operation, 202 MB of additional disk space will be used. 2024-01-15T11:31:24.663 INFO:teuthology.orchestra.run.smithi093.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-01-15T11:31:24.785 INFO:teuthology.orchestra.run.smithi027.stdout:Building dependency tree... 2024-01-15T11:31:24.786 INFO:teuthology.orchestra.run.smithi027.stdout:Reading state information... 2024-01-15T11:31:24.945 INFO:teuthology.orchestra.run.smithi027.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-01-15T11:31:24.945 INFO:teuthology.orchestra.run.smithi027.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-01-15T11:31:24.945 INFO:teuthology.orchestra.run.smithi027.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2024-01-15T11:31:24.945 INFO:teuthology.orchestra.run.smithi027.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2024-01-15T11:31:24.945 INFO:teuthology.orchestra.run.smithi027.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-01-15T11:31:24.945 INFO:teuthology.orchestra.run.smithi027.stdout:The following packages were automatically installed and are no longer required: 2024-01-15T11:31:24.946 INFO:teuthology.orchestra.run.smithi027.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-01-15T11:31:24.946 INFO:teuthology.orchestra.run.smithi027.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-01-15T11:31:24.946 INFO:teuthology.orchestra.run.smithi027.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-01-15T11:31:24.946 INFO:teuthology.orchestra.run.smithi027.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-01-15T11:31:24.946 INFO:teuthology.orchestra.run.smithi027.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-01-15T11:31:24.946 INFO:teuthology.orchestra.run.smithi027.stdout:Use 'sudo apt autoremove' to remove them. 2024-01-15T11:31:24.947 INFO:teuthology.orchestra.run.smithi027.stdout:The following additional packages will be installed: 2024-01-15T11:31:24.947 INFO:teuthology.orchestra.run.smithi027.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-01-15T11:31:24.947 INFO:teuthology.orchestra.run.smithi027.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-01-15T11:31:24.948 INFO:teuthology.orchestra.run.smithi027.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2024-01-15T11:31:24.948 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-01-15T11:31:24.948 INFO:teuthology.orchestra.run.smithi027.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-15T11:31:24.948 INFO:teuthology.orchestra.run.smithi027.stdout:Suggested packages: 2024-01-15T11:31:24.948 INFO:teuthology.orchestra.run.smithi027.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-01-15T11:31:24.949 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2024-01-15T11:31:24.949 INFO:teuthology.orchestra.run.smithi027.stdout: libengine-pkcs11-openssl 2024-01-15T11:31:24.999 INFO:teuthology.orchestra.run.smithi027.stdout:The following NEW packages will be installed: 2024-01-15T11:31:25.000 INFO:teuthology.orchestra.run.smithi027.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-01-15T11:31:25.000 INFO:teuthology.orchestra.run.smithi027.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-01-15T11:31:25.001 INFO:teuthology.orchestra.run.smithi027.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-01-15T11:31:25.001 INFO:teuthology.orchestra.run.smithi027.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-01-15T11:31:25.001 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-01-15T11:31:25.001 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-01-15T11:31:25.001 INFO:teuthology.orchestra.run.smithi027.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-01-15T11:31:25.002 INFO:teuthology.orchestra.run.smithi027.stdout:The following packages will be upgraded: 2024-01-15T11:31:25.002 INFO:teuthology.orchestra.run.smithi027.stdout: libssl3 2024-01-15T11:31:25.065 INFO:teuthology.orchestra.run.smithi027.stdout:1 upgraded, 39 newly installed, 0 to remove and 268 not upgraded. 2024-01-15T11:31:25.065 INFO:teuthology.orchestra.run.smithi027.stdout:Need to get 54.6 MB of archives. 2024-01-15T11:31:25.065 INFO:teuthology.orchestra.run.smithi027.stdout:After this operation, 202 MB of additional disk space will be used. 2024-01-15T11:31:25.066 INFO:teuthology.orchestra.run.smithi027.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-01-15T11:31:25.160 INFO:teuthology.orchestra.run.smithi093.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2024-01-15T11:31:25.191 INFO:teuthology.orchestra.run.smithi027.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2024-01-15T11:31:25.259 INFO:teuthology.orchestra.run.smithi027.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-01-15T11:31:25.268 INFO:teuthology.orchestra.run.smithi027.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-01-15T11:31:25.268 INFO:teuthology.orchestra.run.smithi027.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-01-15T11:31:25.270 INFO:teuthology.orchestra.run.smithi027.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-01-15T11:31:25.271 INFO:teuthology.orchestra.run.smithi027.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-01-15T11:31:25.271 INFO:teuthology.orchestra.run.smithi027.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-01-15T11:31:25.273 INFO:teuthology.orchestra.run.smithi027.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-01-15T11:31:25.274 INFO:teuthology.orchestra.run.smithi027.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-01-15T11:31:25.274 INFO:teuthology.orchestra.run.smithi027.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-01-15T11:31:25.282 INFO:teuthology.orchestra.run.smithi027.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-01-15T11:31:25.295 INFO:teuthology.orchestra.run.smithi027.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-01-15T11:31:25.418 INFO:teuthology.orchestra.run.smithi093.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-01-15T11:31:25.453 INFO:teuthology.orchestra.run.smithi093.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-01-15T11:31:25.454 INFO:teuthology.orchestra.run.smithi093.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-01-15T11:31:25.459 INFO:teuthology.orchestra.run.smithi093.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-01-15T11:31:25.463 INFO:teuthology.orchestra.run.smithi093.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-01-15T11:31:25.464 INFO:teuthology.orchestra.run.smithi093.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-01-15T11:31:25.467 INFO:teuthology.orchestra.run.smithi093.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-01-15T11:31:25.469 INFO:teuthology.orchestra.run.smithi093.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-01-15T11:31:25.520 INFO:teuthology.orchestra.run.smithi027.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-01-15T11:31:25.522 INFO:teuthology.orchestra.run.smithi027.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-01-15T11:31:25.522 INFO:teuthology.orchestra.run.smithi027.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2024-01-15T11:31:25.525 INFO:teuthology.orchestra.run.smithi027.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-01-15T11:31:25.525 INFO:teuthology.orchestra.run.smithi027.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-01-15T11:31:25.530 INFO:teuthology.orchestra.run.smithi027.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-01-15T11:31:25.532 INFO:teuthology.orchestra.run.smithi027.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-01-15T11:31:25.539 INFO:teuthology.orchestra.run.smithi027.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-01-15T11:31:25.539 INFO:teuthology.orchestra.run.smithi027.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2024-01-15T11:31:25.561 INFO:teuthology.orchestra.run.smithi027.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-01-15T11:31:25.565 INFO:teuthology.orchestra.run.smithi027.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2024-01-15T11:31:25.576 INFO:teuthology.orchestra.run.smithi027.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-01-15T11:31:25.597 INFO:teuthology.orchestra.run.smithi027.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-01-15T11:31:25.601 INFO:teuthology.orchestra.run.smithi027.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-01-15T11:31:25.602 INFO:teuthology.orchestra.run.smithi027.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-01-15T11:31:25.602 INFO:teuthology.orchestra.run.smithi027.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-01-15T11:31:25.603 INFO:teuthology.orchestra.run.smithi027.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-01-15T11:31:25.619 INFO:teuthology.orchestra.run.smithi027.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-01-15T11:31:25.627 INFO:teuthology.orchestra.run.smithi027.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-01-15T11:31:25.634 INFO:teuthology.orchestra.run.smithi093.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-01-15T11:31:25.635 INFO:teuthology.orchestra.run.smithi093.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-01-15T11:31:25.844 INFO:teuthology.orchestra.run.smithi027.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-01-15T11:31:25.844 INFO:teuthology.orchestra.run.smithi027.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-01-15T11:31:25.844 INFO:teuthology.orchestra.run.smithi027.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-01-15T11:31:25.844 INFO:teuthology.orchestra.run.smithi027.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-01-15T11:31:25.844 INFO:teuthology.orchestra.run.smithi027.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-01-15T11:31:25.844 INFO:teuthology.orchestra.run.smithi027.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-01-15T11:31:25.858 INFO:teuthology.orchestra.run.smithi027.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-01-15T11:31:25.859 INFO:teuthology.orchestra.run.smithi027.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-01-15T11:31:25.891 INFO:teuthology.orchestra.run.smithi093.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-01-15T11:31:26.259 INFO:teuthology.orchestra.run.smithi027.stdout:Preconfiguring packages ... 2024-01-15T11:31:26.401 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 54.6 MB in 1s (64.3 MB/s) 2024-01-15T11:31:26.549 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package flex. 2024-01-15T11:31:26.626 INFO:teuthology.orchestra.run.smithi027.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140566 files and directories currently installed.) 2024-01-15T11:31:26.629 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-01-15T11:31:26.673 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking flex (2.6.4-8build2) ... 2024-01-15T11:31:26.916 INFO:teuthology.orchestra.run.smithi093.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-01-15T11:31:26.918 INFO:teuthology.orchestra.run.smithi093.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-01-15T11:31:26.918 INFO:teuthology.orchestra.run.smithi093.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2024-01-15T11:31:26.921 INFO:teuthology.orchestra.run.smithi093.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-01-15T11:31:26.921 INFO:teuthology.orchestra.run.smithi093.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-01-15T11:31:26.925 INFO:teuthology.orchestra.run.smithi093.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2024-01-15T11:31:26.944 INFO:teuthology.orchestra.run.smithi093.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-01-15T11:31:26.951 INFO:teuthology.orchestra.run.smithi093.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-01-15T11:31:27.115 INFO:teuthology.orchestra.run.smithi093.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2024-01-15T11:31:27.152 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-15T11:31:27.329 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2024-01-15T11:31:27.747 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-15T11:31:27.865 INFO:teuthology.orchestra.run.smithi093.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-01-15T11:31:27.865 INFO:teuthology.orchestra.run.smithi093.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2024-01-15T11:31:27.892 INFO:teuthology.orchestra.run.smithi093.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-01-15T11:31:27.969 INFO:teuthology.orchestra.run.smithi093.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-01-15T11:31:27.977 INFO:teuthology.orchestra.run.smithi093.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-01-15T11:31:27.978 INFO:teuthology.orchestra.run.smithi093.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-01-15T11:31:27.979 INFO:teuthology.orchestra.run.smithi093.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-01-15T11:31:27.979 INFO:teuthology.orchestra.run.smithi093.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2024-01-15T11:31:28.008 INFO:teuthology.orchestra.run.smithi093.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-01-15T11:31:28.011 INFO:teuthology.orchestra.run.smithi093.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2024-01-15T11:31:28.448 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package bison. 2024-01-15T11:31:28.526 INFO:teuthology.orchestra.run.smithi027.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140639 files and directories currently installed.) 2024-01-15T11:31:28.530 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-01-15T11:31:28.575 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-01-15T11:31:28.636 INFO:teuthology.orchestra.run.smithi093.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-01-15T11:31:28.719 INFO:teuthology.orchestra.run.smithi093.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-01-15T11:31:28.719 INFO:teuthology.orchestra.run.smithi093.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-01-15T11:31:28.740 INFO:teuthology.orchestra.run.smithi093.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-01-15T11:31:28.803 INFO:teuthology.orchestra.run.smithi093.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-01-15T11:31:28.817 INFO:teuthology.orchestra.run.smithi093.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-01-15T11:31:28.951 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-15T11:31:28.965 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-01-15T11:31:29.009 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-01-15T11:31:29.266 INFO:teuthology.orchestra.run.smithi093.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-01-15T11:31:29.268 INFO:teuthology.orchestra.run.smithi093.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-01-15T11:31:29.354 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package dump. 2024-01-15T11:31:29.369 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-01-15T11:31:29.413 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking dump (0.4b47-3) ... 2024-01-15T11:31:29.655 INFO:teuthology.orchestra.run.smithi093.stdout:Preconfiguring packages ... 2024-01-15T11:31:29.691 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package indent. 2024-01-15T11:31:29.707 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-01-15T11:31:29.741 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-15T11:31:29.799 INFO:teuthology.orchestra.run.smithi093.stdout:Fetched 54.6 MB in 5s (11.3 MB/s) 2024-01-15T11:31:29.908 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package flex. 2024-01-15T11:31:29.968 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-15T11:31:29.981 INFO:teuthology.orchestra.run.smithi093.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140566 files and directories currently installed.) 2024-01-15T11:31:29.984 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-01-15T11:31:29.985 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-01-15T11:31:30.026 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-15T11:31:30.040 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking flex (2.6.4-8build2) ... 2024-01-15T11:31:30.356 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-15T11:31:30.371 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-01-15T11:31:30.414 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-15T11:31:30.526 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-15T11:31:30.691 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-15T11:31:30.704 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2024-01-15T11:31:30.708 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-01-15T11:31:30.741 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-01-15T11:31:30.986 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libfl2:amd64. 2024-01-15T11:31:31.002 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-01-15T11:31:31.053 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-01-15T11:31:31.102 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-15T11:31:31.289 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-01-15T11:31:31.305 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-01-15T11:31:31.347 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-15T11:31:31.599 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libjson-perl. 2024-01-15T11:31:31.615 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-01-15T11:31:31.621 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package bison. 2024-01-15T11:31:31.657 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-01-15T11:31:31.694 INFO:teuthology.orchestra.run.smithi093.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140639 files and directories currently installed.) 2024-01-15T11:31:31.697 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-01-15T11:31:31.757 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-01-15T11:31:31.953 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libllvm14:amd64. 2024-01-15T11:31:31.968 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-01-15T11:31:32.002 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-15T11:31:32.149 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-01-15T11:31:32.163 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-01-15T11:31:32.199 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-01-15T11:31:32.518 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package dump. 2024-01-15T11:31:32.533 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-01-15T11:31:32.577 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking dump (0.4b47-3) ... 2024-01-15T11:31:32.838 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package indent. 2024-01-15T11:31:32.853 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-01-15T11:31:32.897 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-15T11:31:33.157 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-01-15T11:31:33.172 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-01-15T11:31:33.215 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-15T11:31:33.544 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-01-15T11:31:33.560 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-01-15T11:31:33.602 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-15T11:31:33.747 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-15T11:31:33.764 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-15T11:31:33.806 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-15T11:31:33.847 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-01-15T11:31:33.862 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-01-15T11:31:33.905 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-01-15T11:31:34.033 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-15T11:31:34.049 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-15T11:31:34.083 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-15T11:31:34.224 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libfl2:amd64. 2024-01-15T11:31:34.240 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-01-15T11:31:34.283 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-01-15T11:31:34.411 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-15T11:31:34.427 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2024-01-15T11:31:34.469 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2024-01-15T11:31:34.535 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-01-15T11:31:34.551 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-01-15T11:31:34.593 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-15T11:31:34.814 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-15T11:31:34.829 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libjson-perl. 2024-01-15T11:31:34.830 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-01-15T11:31:34.845 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-01-15T11:31:34.872 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-15T11:31:34.879 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-01-15T11:31:35.191 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libllvm14:amd64. 2024-01-15T11:31:35.206 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-01-15T11:31:35.242 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-15T11:31:35.249 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-15T11:31:35.258 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-01-15T11:31:35.317 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-15T11:31:35.611 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libpq5:amd64. 2024-01-15T11:31:35.627 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-15T11:31:35.678 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-15T11:31:36.023 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-15T11:31:36.039 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-15T11:31:36.081 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-15T11:31:36.375 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-15T11:31:36.391 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-15T11:31:36.459 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-15T11:31:36.626 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-01-15T11:31:36.642 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-15T11:31:36.669 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-15T11:31:36.684 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-15T11:31:36.685 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-15T11:31:36.719 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-15T11:31:36.945 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libmbim-proxy. 2024-01-15T11:31:36.961 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-01-15T11:31:37.012 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-15T11:31:37.164 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-15T11:31:37.180 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-01-15T11:31:37.215 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-01-15T11:31:37.314 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-01-15T11:31:37.330 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2024-01-15T11:31:37.373 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2024-01-15T11:31:37.601 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package modemmanager. 2024-01-15T11:31:37.617 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2024-01-15T11:31:37.659 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2024-01-15T11:31:37.750 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libndp0:amd64. 2024-01-15T11:31:37.766 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-01-15T11:31:37.808 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-15T11:31:38.136 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libnm0:amd64. 2024-01-15T11:31:38.152 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-01-15T11:31:38.194 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-15T11:31:38.266 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package network-manager. 2024-01-15T11:31:38.282 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-01-15T11:31:38.384 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-01-15T11:31:38.497 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libpq5:amd64. 2024-01-15T11:31:38.513 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-15T11:31:38.547 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-15T11:31:38.891 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-01-15T11:31:38.906 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-15T11:31:38.949 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-15T11:31:39.016 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ppp. 2024-01-15T11:31:39.033 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-01-15T11:31:39.244 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libqmi-proxy. 2024-01-15T11:31:39.259 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-01-15T11:31:39.293 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-15T11:31:39.381 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-01-15T11:31:39.521 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-01-15T11:31:39.537 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2024-01-15T11:31:39.579 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-15T11:31:39.687 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package pptp-linux. 2024-01-15T11:31:39.702 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-01-15T11:31:39.737 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-01-15T11:31:39.990 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-15T11:31:40.005 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-01-15T11:31:40.048 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-01-15T11:31:40.124 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-01-15T11:31:40.139 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-01-15T11:31:40.182 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-01-15T11:31:40.351 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package postgresql-client-common. 2024-01-15T11:31:40.366 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-01-15T11:31:40.410 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking postgresql-client-common (238) ... 2024-01-15T11:31:40.527 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package modemmanager. 2024-01-15T11:31:40.542 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2024-01-15T11:31:40.585 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2024-01-15T11:31:40.722 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package postgresql-client-14. 2024-01-15T11:31:40.737 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-15T11:31:40.780 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-15T11:31:41.240 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package network-manager. 2024-01-15T11:31:41.256 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-01-15T11:31:41.307 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-01-15T11:31:41.360 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package postgresql-common. 2024-01-15T11:31:41.375 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-01-15T11:31:41.436 INFO:teuthology.orchestra.run.smithi027.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-01-15T11:31:41.459 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking postgresql-common (238) ... 2024-01-15T11:31:41.914 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ppp. 2024-01-15T11:31:41.925 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package postgresql-14. 2024-01-15T11:31:41.930 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-01-15T11:31:41.940 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-15T11:31:41.986 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-15T11:31:42.274 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-01-15T11:31:42.601 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package pptp-linux. 2024-01-15T11:31:42.616 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-01-15T11:31:42.651 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-01-15T11:31:42.862 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package network-manager-pptp. 2024-01-15T11:31:42.876 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-01-15T11:31:42.912 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-01-15T11:31:43.054 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package postgresql. 2024-01-15T11:31:43.069 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-01-15T11:31:43.112 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking postgresql (14+238) ... 2024-01-15T11:31:43.215 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package postgresql-client-common. 2024-01-15T11:31:43.230 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-01-15T11:31:43.273 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking postgresql-client-common (238) ... 2024-01-15T11:31:43.390 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package postgresql-client. 2024-01-15T11:31:43.405 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-01-15T11:31:43.610 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package postgresql-client-14. 2024-01-15T11:31:43.616 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking postgresql-client (14+238) ... 2024-01-15T11:31:43.625 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-15T11:31:43.668 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-15T11:31:43.860 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package postgresql-contrib. 2024-01-15T11:31:43.875 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-01-15T11:31:43.918 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking postgresql-contrib (14+238) ... 2024-01-15T11:31:44.187 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package tcl8.6. 2024-01-15T11:31:44.202 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-01-15T11:31:44.245 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-15T11:31:44.281 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package postgresql-common. 2024-01-15T11:31:44.296 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-01-15T11:31:44.365 INFO:teuthology.orchestra.run.smithi093.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-01-15T11:31:44.397 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking postgresql-common (238) ... 2024-01-15T11:31:44.550 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package tcl. 2024-01-15T11:31:44.565 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-01-15T11:31:44.613 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-01-15T11:31:44.880 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package postgresql-14. 2024-01-15T11:31:44.895 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2024-01-15T11:31:44.928 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package wpasupplicant. 2024-01-15T11:31:44.941 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-15T11:31:44.943 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-01-15T11:31:44.986 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-15T11:31:45.324 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-15T11:31:45.339 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-01-15T11:31:45.382 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-01-15T11:31:45.794 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-15T11:31:45.809 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-01-15T11:31:45.860 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-15T11:31:46.074 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package postgresql. 2024-01-15T11:31:46.089 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-01-15T11:31:46.133 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking postgresql (14+238) ... 2024-01-15T11:31:46.154 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up postgresql-client-common (238) ... 2024-01-15T11:31:46.351 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package postgresql-client. 2024-01-15T11:31:46.365 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-01-15T11:31:46.366 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up flex (2.6.4-8build2) ... 2024-01-15T11:31:46.409 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking postgresql-client (14+238) ... 2024-01-15T11:31:46.492 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-15T11:31:46.635 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-15T11:31:46.653 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package postgresql-contrib. 2024-01-15T11:31:46.668 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-01-15T11:31:46.711 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking postgresql-contrib (14+238) ... 2024-01-15T11:31:46.761 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-01-15T11:31:46.879 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-15T11:31:46.980 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-15T11:31:47.055 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package tcl8.6. 2024-01-15T11:31:47.071 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-01-15T11:31:47.114 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-15T11:31:47.375 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package tcl. 2024-01-15T11:31:47.390 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-01-15T11:31:47.442 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-01-15T11:31:47.752 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package wpasupplicant. 2024-01-15T11:31:47.768 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-01-15T11:31:47.810 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-15T11:31:48.006 INFO:teuthology.orchestra.run.smithi027.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-01-15T11:31:48.093 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-15T11:31:48.181 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-01-15T11:31:48.197 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-01-15T11:31:48.239 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-01-15T11:31:48.471 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-15T11:31:48.471 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-15T11:31:48.617 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package usb-modeswitch. 2024-01-15T11:31:48.633 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-01-15T11:31:48.684 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-15T11:31:48.969 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up postgresql-client-common (238) ... 2024-01-15T11:31:49.181 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up flex (2.6.4-8build2) ... 2024-01-15T11:31:49.188 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-01-15T11:31:49.314 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-15T11:31:49.349 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-01-15T11:31:49.448 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-01-15T11:31:49.574 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-01-15T11:31:49.700 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-01-15T11:31:49.826 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-15T11:31:49.831 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2024-01-15T11:31:49.967 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-01-15T11:31:49.977 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-01-15T11:31:50.077 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-01-15T11:31:50.186 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-15T11:31:50.583 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-15T11:31:50.708 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up dump (0.4b47-3) ... 2024-01-15T11:31:50.804 INFO:teuthology.orchestra.run.smithi027.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-15T11:31:50.868 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2024-01-15T11:31:50.994 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-15T11:31:51.120 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up tcl (8.6.11+1build2) ... 2024-01-15T11:31:51.189 INFO:teuthology.orchestra.run.smithi093.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-01-15T11:31:51.221 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libjson-perl (4.04000-1) ... 2024-01-15T11:31:51.300 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-01-15T11:31:51.339 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-01-15T11:31:51.429 INFO:teuthology.orchestra.run.smithi027.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-01-15T11:31:51.491 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-15T11:31:51.616 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-15T11:31:51.678 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-15T11:31:51.678 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-01-15T11:31:51.793 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-15T11:31:51.919 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-15T11:31:52.045 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-01-15T11:31:52.188 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up postgresql-client (14+238) ... 2024-01-15T11:31:52.322 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-01-15T11:31:52.344 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-01-15T11:31:52.470 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2024-01-15T11:31:52.596 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-01-15T11:31:52.730 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-01-15T11:31:52.889 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-01-15T11:31:52.926 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:31:52.926 INFO:teuthology.orchestra.run.smithi027.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-15T11:31:52.927 INFO:teuthology.orchestra.run.smithi027.stdout:which means they are currently configured by ifupdown: 2024-01-15T11:31:52.927 INFO:teuthology.orchestra.run.smithi027.stdout:- ens1f0 2024-01-15T11:31:52.927 INFO:teuthology.orchestra.run.smithi027.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-15T11:31:52.927 INFO:teuthology.orchestra.run.smithi027.stdout:remove their configuration from /etc/network/interfaces. 2024-01-15T11:31:52.927 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:31:53.007 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-01-15T11:31:53.066 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-15T11:31:53.200 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-01-15T11:31:53.486 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-15T11:31:53.857 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-01-15T11:31:53.887 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-15T11:31:53.991 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up dump (0.4b47-3) ... 2024-01-15T11:31:54.095 INFO:teuthology.orchestra.run.smithi093.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-01-15T11:31:54.159 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2024-01-15T11:31:54.285 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-01-15T11:31:54.419 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up tcl (8.6.11+1build2) ... 2024-01-15T11:31:54.545 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libjson-perl (4.04000-1) ... 2024-01-15T11:31:54.566 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-15T11:31:54.671 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-01-15T11:31:54.709 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-15T11:31:54.761 INFO:teuthology.orchestra.run.smithi093.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-01-15T11:31:54.835 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-01-15T11:31:54.883 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-01-15T11:31:54.961 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up postgresql-common (238) ... 2024-01-15T11:31:55.316 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-01-15T11:31:55.467 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-01-15T11:31:55.593 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-01-15T11:31:55.719 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-01-15T11:31:55.862 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up postgresql-client (14+238) ... 2024-01-15T11:31:55.894 INFO:teuthology.orchestra.run.smithi027.stdout:Adding user postgres to group ssl-cert 2024-01-15T11:31:55.979 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-01-15T11:31:56.155 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:31:56.155 INFO:teuthology.orchestra.run.smithi027.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-01-15T11:31:56.411 INFO:teuthology.orchestra.run.smithi027.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-01-15T11:31:56.411 INFO:teuthology.orchestra.run.smithi027.stdout:Removing obsolete dictionary files: 2024-01-15T11:31:56.530 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:31:56.531 INFO:teuthology.orchestra.run.smithi093.stdout:The following network interfaces were found in /etc/network/interfaces 2024-01-15T11:31:56.531 INFO:teuthology.orchestra.run.smithi093.stdout:which means they are currently configured by ifupdown: 2024-01-15T11:31:56.531 INFO:teuthology.orchestra.run.smithi093.stdout:- enp3s0f1 2024-01-15T11:31:56.531 INFO:teuthology.orchestra.run.smithi093.stdout:If you want to manage those interfaces with NetworkManager instead 2024-01-15T11:31:56.531 INFO:teuthology.orchestra.run.smithi093.stdout:remove their configuration from /etc/network/interfaces. 2024-01-15T11:31:56.531 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:31:56.664 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-01-15T11:31:57.030 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-01-15T11:31:57.116 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-01-15T11:31:57.415 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-01-15T11:31:57.579 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-15T11:31:57.909 INFO:teuthology.orchestra.run.smithi027.stdout:Creating new PostgreSQL cluster 14/main ... 2024-01-15T11:31:57.932 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-01-15T11:31:57.987 INFO:teuthology.orchestra.run.smithi027.stdout:The files belonging to this database system will be owned by user "postgres". 2024-01-15T11:31:57.988 INFO:teuthology.orchestra.run.smithi027.stdout:This user must also own the server process. 2024-01-15T11:31:57.988 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:31:57.988 INFO:teuthology.orchestra.run.smithi027.stdout:The database cluster will be initialized with locale "en_US". 2024-01-15T11:31:57.988 INFO:teuthology.orchestra.run.smithi027.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-01-15T11:31:57.988 INFO:teuthology.orchestra.run.smithi027.stdout:The default text search configuration will be set to "english". 2024-01-15T11:31:57.988 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:31:57.988 INFO:teuthology.orchestra.run.smithi027.stdout:Data page checksums are disabled. 2024-01-15T11:31:57.988 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:31:57.988 INFO:teuthology.orchestra.run.smithi027.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-01-15T11:31:57.989 INFO:teuthology.orchestra.run.smithi027.stdout:creating subdirectories ... ok 2024-01-15T11:31:57.989 INFO:teuthology.orchestra.run.smithi027.stdout:selecting dynamic shared memory implementation ... posix 2024-01-15T11:31:58.014 INFO:teuthology.orchestra.run.smithi027.stdout:selecting default max_connections ... 100 2024-01-15T11:31:58.051 INFO:teuthology.orchestra.run.smithi027.stdout:selecting default shared_buffers ... 128MB 2024-01-15T11:31:58.065 INFO:teuthology.orchestra.run.smithi027.stdout:selecting default time zone ... Etc/UTC 2024-01-15T11:31:58.066 INFO:teuthology.orchestra.run.smithi027.stdout:creating configuration files ... ok 2024-01-15T11:31:58.082 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-01-15T11:31:58.216 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-01-15T11:31:58.243 INFO:teuthology.orchestra.run.smithi027.stdout:running bootstrap script ... ok 2024-01-15T11:31:58.343 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-01-15T11:31:58.468 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up postgresql-common (238) ... 2024-01-15T11:31:58.881 INFO:teuthology.orchestra.run.smithi027.stdout:performing post-bootstrap initialization ... ok 2024-01-15T11:31:59.356 INFO:teuthology.orchestra.run.smithi093.stdout:Adding user postgres to group ssl-cert 2024-01-15T11:31:59.441 INFO:teuthology.orchestra.run.smithi027.stdout:syncing data to disk ... ok 2024-01-15T11:31:59.623 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:31:59.623 INFO:teuthology.orchestra.run.smithi093.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-01-15T11:31:59.886 INFO:teuthology.orchestra.run.smithi093.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-01-15T11:31:59.886 INFO:teuthology.orchestra.run.smithi093.stdout:Removing obsolete dictionary files: 2024-01-15T11:31:59.955 INFO:teuthology.orchestra.run.smithi027.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-01-15T11:32:00.604 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-01-15T11:32:01.061 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2024-01-15T11:32:01.450 INFO:teuthology.orchestra.run.smithi093.stdout:Creating new PostgreSQL cluster 14/main ... 2024-01-15T11:32:01.467 INFO:teuthology.orchestra.run.smithi093.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-01-15T11:32:01.515 INFO:teuthology.orchestra.run.smithi093.stdout:The files belonging to this database system will be owned by user "postgres". 2024-01-15T11:32:01.516 INFO:teuthology.orchestra.run.smithi093.stdout:This user must also own the server process. 2024-01-15T11:32:01.516 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:01.516 INFO:teuthology.orchestra.run.smithi093.stdout:The database cluster will be initialized with locale "en_US". 2024-01-15T11:32:01.516 INFO:teuthology.orchestra.run.smithi093.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-01-15T11:32:01.516 INFO:teuthology.orchestra.run.smithi093.stdout:The default text search configuration will be set to "english". 2024-01-15T11:32:01.516 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:01.516 INFO:teuthology.orchestra.run.smithi093.stdout:Data page checksums are disabled. 2024-01-15T11:32:01.516 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:01.516 INFO:teuthology.orchestra.run.smithi093.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-01-15T11:32:01.517 INFO:teuthology.orchestra.run.smithi093.stdout:creating subdirectories ... ok 2024-01-15T11:32:01.517 INFO:teuthology.orchestra.run.smithi093.stdout:selecting dynamic shared memory implementation ... posix 2024-01-15T11:32:01.541 INFO:teuthology.orchestra.run.smithi093.stdout:selecting default max_connections ... 100 2024-01-15T11:32:01.577 INFO:teuthology.orchestra.run.smithi093.stdout:selecting default shared_buffers ... 128MB 2024-01-15T11:32:01.590 INFO:teuthology.orchestra.run.smithi093.stdout:selecting default time zone ... Etc/UTC 2024-01-15T11:32:01.591 INFO:teuthology.orchestra.run.smithi093.stdout:creating configuration files ... ok 2024-01-15T11:32:01.761 INFO:teuthology.orchestra.run.smithi093.stdout:running bootstrap script ... ok 2024-01-15T11:32:02.392 INFO:teuthology.orchestra.run.smithi093.stdout:performing post-bootstrap initialization ... ok 2024-01-15T11:32:02.911 INFO:teuthology.orchestra.run.smithi093.stdout:syncing data to disk ... ok 2024-01-15T11:32:03.361 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-15T11:32:03.408 INFO:teuthology.orchestra.run.smithi093.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-01-15T11:32:03.462 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up postgresql-contrib (14+238) ... 2024-01-15T11:32:03.580 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up postgresql (14+238) ... 2024-01-15T11:32:03.706 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-15T11:32:03.857 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2024-01-15T11:32:04.126 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-15T11:32:04.127 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-15T11:32:04.909 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-15T11:32:05.261 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-15T11:32:05.404 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-15T11:32:06.418 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-01-15T11:32:06.544 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up postgresql-contrib (14+238) ... 2024-01-15T11:32:06.662 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up postgresql (14+238) ... 2024-01-15T11:32:06.763 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-01-15T11:32:06.864 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2024-01-15T11:32:06.865 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-15T11:32:07.007 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-15T11:32:07.106 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-01-15T11:32:07.106 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-01-15T11:32:07.579 INFO:teuthology.orchestra.run.smithi027.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-15T11:32:07.586 DEBUG:teuthology.parallel:result is None 2024-01-15T11:32:07.833 INFO:teuthology.orchestra.run.smithi093.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-01-15T11:32:08.160 INFO:teuthology.orchestra.run.smithi093.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-01-15T11:32:08.370 INFO:teuthology.orchestra.run.smithi093.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-01-15T11:32:10.286 INFO:teuthology.orchestra.run.smithi093.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-01-15T11:32:10.454 INFO:teuthology.orchestra.run.smithi093.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-01-15T11:32:11.190 INFO:teuthology.orchestra.run.smithi093.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-01-15T11:32:11.197 DEBUG:teuthology.parallel:result is None 2024-01-15T11:32:11.198 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=95c90f413c4bb65e3e56909855f2308fd9bda05b 2024-01-15T11:32:11.435 DEBUG:teuthology.orchestra.run.smithi027:> dpkg-query -W -f '${Version}' ceph 2024-01-15T11:32:11.459 INFO:teuthology.orchestra.run.smithi027.stdout:18.0.0-7629-g95c90f41-1jammy 2024-01-15T11:32:11.460 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7629-g95c90f41-1jammy 2024-01-15T11:32:11.460 INFO:teuthology.task.install:The correct ceph version 18.0.0-7629-g95c90f41-1jammy is installed. 2024-01-15T11:32:11.461 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=95c90f413c4bb65e3e56909855f2308fd9bda05b 2024-01-15T11:32:11.673 DEBUG:teuthology.orchestra.run.smithi093:> dpkg-query -W -f '${Version}' ceph 2024-01-15T11:32:11.696 INFO:teuthology.orchestra.run.smithi093.stdout:18.0.0-7629-g95c90f41-1jammy 2024-01-15T11:32:11.696 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7629-g95c90f41-1jammy 2024-01-15T11:32:11.696 INFO:teuthology.task.install:The correct ceph version 18.0.0-7629-g95c90f41-1jammy is installed. 2024-01-15T11:32:11.698 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-15T11:32:11.698 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:32:11.698 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-15T11:32:11.722 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:32:11.722 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-15T11:32:11.757 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-15T11:32:11.758 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:32:11.758 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/daemon-helper 2024-01-15T11:32:11.787 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-15T11:32:11.851 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:32:11.851 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/usr/bin/daemon-helper 2024-01-15T11:32:11.872 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-15T11:32:11.933 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-15T11:32:11.933 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:32:11.933 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-15T11:32:11.956 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-15T11:32:12.022 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:32:12.022 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-15T11:32:12.043 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-15T11:32:12.105 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-15T11:32:12.105 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:32:12.105 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/stdin-killer 2024-01-15T11:32:12.128 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-15T11:32:12.195 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:32:12.195 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/usr/bin/stdin-killer 2024-01-15T11:32:12.215 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-15T11:32:12.281 INFO:teuthology.run_tasks:Running task ceph... 2024-01-15T11:32:12.362 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-01-15T11:32:12.362 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 777 /var/log/ceph 2024-01-15T11:32:12.365 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 777 /var/log/ceph 2024-01-15T11:32:12.385 INFO:tasks.ceph:Disabling ceph logrotate... 2024-01-15T11:32:12.385 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-15T11:32:12.428 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-15T11:32:12.448 INFO:tasks.ceph:Creating extra log directories... 2024-01-15T11:32:12.448 DEBUG:teuthology.orchestra.run.smithi027:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-15T11:32:12.492 DEBUG:teuthology.orchestra.run.smithi093:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-15T11:32:12.518 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-01-15T11:32:12.519 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-01-15T11:32:12.519 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-01-15T11:32:12.519 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:32:12.519 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-15T11:32:12.562 DEBUG:teuthology.orchestra.run.smithi027:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-15T11:32:12.661 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:32:12.662 DEBUG:teuthology.orchestra.run.smithi093:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-15T11:32:12.670 DEBUG:teuthology.orchestra.run.smithi093:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-15T11:32:12.767 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-01-15T11:32:12.767 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-01-15T11:32:12.768 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-01-15_11:07:32-fs:volumes-rishabh-clone-stats-testing-default-smithi/7517066', 'branch': 'rishabh-clone-stats', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone-progress}}', 'email': None, 'first_in_suite': False, 'job_id': '7517066', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2024-01-15_11:07:32-fs:volumes-rishabh-clone-stats-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'rishabh-clone-stats'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '95c90f413c4bb65e3e56909855f2308fd9bda05b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '95c90f413c4bb65e3e56909855f2308fd9bda05b'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'mgr-vol-clone-stats-temp', 'sha1': '73a4532fc4d97adee0b985d4d42874ea351a1c86'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9877, 'sha1': '95c90f413c4bb65e3e56909855f2308fd9bda05b', 'sleep_before_teardown': 0, 'suite': 'fs:volumes', 'suite_branch': 'mgr-vol-clone-stats-temp', 'suite_path': '/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/rishabh-d-dave/ceph', 'suite_sha1': '73a4532fc4d97adee0b985d4d42874ea351a1c86', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi027.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPBnOYlMQZHvWwfRYzDYI90m0b2Ib+moa15Lpnog/0M4WWyxTtEegBqhQQxuZnqNOBdau4US96SblQ9RadXUjdM=', 'smithi093.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMzxXsvE+yYOk/I5Pd5RHOAYL4opbzOhvVRVsnTWbJZUQYmMi3dUgNFEJYyITebwHf0tYQgIOC62SsEqOtZLbJI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '95c90f413c4bb65e3e56909855f2308fd9bda05b'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '95c90f413c4bb65e3e56909855f2308fd9bda05b', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestCloneProgress']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'cd45576300487d997e5a85abed65500b9f5d143b', 'timestamp': '2024-01-15_11:07:32', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-01-15T11:32:12.768 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-15T11:32:12.772 DEBUG:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-15T11:32:12.781 DEBUG:teuthology.orchestra.run.smithi027:> sudo install -d -m0777 -- /var/run/ceph 2024-01-15T11:32:12.824 DEBUG:teuthology.orchestra.run.smithi093:> sudo install -d -m0777 -- /var/run/ceph 2024-01-15T11:32:12.845 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:32:12.845 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/scratch_devs of=/dev/stdout 2024-01-15T11:32:12.894 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-15T11:32:12.894 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_1 2024-01-15T11:32:12.946 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-15T11:32:12.946 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-15T11:32:12.946 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 901 Links: 1 2024-01-15T11:32:12.946 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-15T11:32:12.946 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-01-15 11:25:38.084136571 +0000 2024-01-15T11:32:12.947 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-01-15 11:25:37.776139323 +0000 2024-01-15T11:32:12.947 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-01-15 11:25:37.776139323 +0000 2024-01-15T11:32:12.947 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2024-01-15 11:25:37.776139323 +0000 2024-01-15T11:32:12.947 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-15T11:32:13.009 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-01-15T11:32:13.009 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-01-15T11:32:13.009 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000390214 s, 1.3 MB/s 2024-01-15T11:32:13.011 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-15T11:32:13.068 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_2 2024-01-15T11:32:13.119 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-15T11:32:13.119 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-15T11:32:13.119 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 918 Links: 1 2024-01-15T11:32:13.119 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-15T11:32:13.119 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-01-15 11:25:38.652131497 +0000 2024-01-15T11:32:13.119 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-01-15 11:25:38.360134106 +0000 2024-01-15T11:32:13.119 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-01-15 11:25:38.360134106 +0000 2024-01-15T11:32:13.119 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2024-01-15 11:25:38.360134106 +0000 2024-01-15T11:32:13.120 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-15T11:32:13.186 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-01-15T11:32:13.186 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-01-15T11:32:13.186 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000379062 s, 1.4 MB/s 2024-01-15T11:32:13.188 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-15T11:32:13.245 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_3 2024-01-15T11:32:13.303 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-15T11:32:13.303 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-15T11:32:13.303 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 933 Links: 1 2024-01-15T11:32:13.303 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-15T11:32:13.303 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-01-15 11:25:39.192126674 +0000 2024-01-15T11:32:13.303 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-01-15 11:25:38.916129139 +0000 2024-01-15T11:32:13.304 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-01-15 11:25:38.916129139 +0000 2024-01-15T11:32:13.304 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2024-01-15 11:25:38.916129139 +0000 2024-01-15T11:32:13.304 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-15T11:32:13.369 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-01-15T11:32:13.370 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-01-15T11:32:13.370 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000381723 s, 1.3 MB/s 2024-01-15T11:32:13.372 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-15T11:32:13.424 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_4 2024-01-15T11:32:13.475 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-15T11:32:13.475 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-15T11:32:13.475 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 953 Links: 1 2024-01-15T11:32:13.475 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-15T11:32:13.475 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-01-15 11:25:39.740121780 +0000 2024-01-15T11:32:13.475 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-01-15 11:25:39.452124352 +0000 2024-01-15T11:32:13.475 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-01-15 11:25:39.452124352 +0000 2024-01-15T11:32:13.475 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2024-01-15 11:25:39.452124352 +0000 2024-01-15T11:32:13.476 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-15T11:32:13.538 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-01-15T11:32:13.538 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-01-15T11:32:13.538 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000376795 s, 1.4 MB/s 2024-01-15T11:32:13.540 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-15T11:32:13.592 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-15T11:32:13.593 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:32:13.593 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/scratch_devs of=/dev/stdout 2024-01-15T11:32:13.603 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-15T11:32:13.603 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_1 2024-01-15T11:32:13.655 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-15T11:32:13.655 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-15T11:32:13.655 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-01-15T11:32:13.655 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-15T11:32:13.656 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2024-01-15 11:25:32.390244576 +0000 2024-01-15T11:32:13.656 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2024-01-15 11:25:32.386244612 +0000 2024-01-15T11:32:13.656 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2024-01-15 11:25:32.386244612 +0000 2024-01-15T11:32:13.656 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: 2024-01-15 11:25:32.386244612 +0000 2024-01-15T11:32:13.656 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-15T11:32:13.717 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2024-01-15T11:32:13.717 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2024-01-15T11:32:13.717 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000395928 s, 1.3 MB/s 2024-01-15T11:32:13.719 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-15T11:32:13.772 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_2 2024-01-15T11:32:13.822 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-15T11:32:13.823 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-15T11:32:13.823 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 5h/5d Inode: 919 Links: 1 2024-01-15T11:32:13.823 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-15T11:32:13.823 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2024-01-15 11:25:33.166237645 +0000 2024-01-15T11:32:13.823 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2024-01-15 11:25:32.906239966 +0000 2024-01-15T11:32:13.823 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2024-01-15 11:25:32.906239966 +0000 2024-01-15T11:32:13.823 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: 2024-01-15 11:25:32.906239966 +0000 2024-01-15T11:32:13.823 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-15T11:32:13.885 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2024-01-15T11:32:13.885 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2024-01-15T11:32:13.885 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000382891 s, 1.3 MB/s 2024-01-15T11:32:13.887 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-15T11:32:13.940 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_3 2024-01-15T11:32:13.990 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-15T11:32:13.990 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-15T11:32:13.990 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 5h/5d Inode: 935 Links: 1 2024-01-15T11:32:13.990 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-15T11:32:13.990 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2024-01-15 11:25:33.730232607 +0000 2024-01-15T11:32:13.990 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2024-01-15 11:25:33.438235215 +0000 2024-01-15T11:32:13.990 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2024-01-15 11:25:33.438235215 +0000 2024-01-15T11:32:13.990 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: 2024-01-15 11:25:33.438235215 +0000 2024-01-15T11:32:13.991 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-15T11:32:14.052 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2024-01-15T11:32:14.052 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2024-01-15T11:32:14.052 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000367587 s, 1.4 MB/s 2024-01-15T11:32:14.054 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-15T11:32:14.108 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_4 2024-01-15T11:32:14.158 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-15T11:32:14.158 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-15T11:32:14.158 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 5h/5d Inode: 952 Links: 1 2024-01-15T11:32:14.158 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-15T11:32:14.158 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2024-01-15 11:25:34.258227890 +0000 2024-01-15T11:32:14.158 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2024-01-15 11:25:33.982230355 +0000 2024-01-15T11:32:14.158 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2024-01-15 11:25:33.982230355 +0000 2024-01-15T11:32:14.158 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: 2024-01-15 11:25:33.982230355 +0000 2024-01-15T11:32:14.159 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-15T11:32:14.221 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2024-01-15T11:32:14.221 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2024-01-15T11:32:14.221 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000393404 s, 1.3 MB/s 2024-01-15T11:32:14.223 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-15T11:32:14.277 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-15T11:32:14.277 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi027.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi093.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-15T11:32:14.277 INFO:tasks.ceph:Generating config... 2024-01-15T11:32:14.278 INFO:tasks.ceph:[client] client mount timeout = 600 2024-01-15T11:32:14.278 INFO:tasks.ceph:[client] debug client = 20 2024-01-15T11:32:14.278 INFO:tasks.ceph:[client] debug ms = 1 2024-01-15T11:32:14.278 INFO:tasks.ceph:[client] pid file = 2024-01-15T11:32:14.278 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-01-15T11:32:14.278 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-01-15T11:32:14.278 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-01-15T11:32:14.278 INFO:tasks.ceph:[mds] debug mds = 20 2024-01-15T11:32:14.279 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-01-15T11:32:14.279 INFO:tasks.ceph:[mds] debug ms = 1 2024-01-15T11:32:14.279 INFO:tasks.ceph:[mds] mds debug frag = True 2024-01-15T11:32:14.279 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-01-15T11:32:14.279 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-01-15T11:32:14.279 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-01-15T11:32:14.279 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-01-15T11:32:14.279 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-01-15T11:32:14.279 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-01-15T11:32:14.279 INFO:tasks.ceph:[mgr] debug client = 20 2024-01-15T11:32:14.279 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-01-15T11:32:14.279 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-01-15T11:32:14.279 INFO:tasks.ceph:[mgr] debug ms = 1 2024-01-15T11:32:14.279 INFO:tasks.ceph:[mon] debug mon = 20 2024-01-15T11:32:14.279 INFO:tasks.ceph:[mon] debug ms = 1 2024-01-15T11:32:14.279 INFO:tasks.ceph:[mon] debug paxos = 20 2024-01-15T11:32:14.280 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-01-15T11:32:14.280 INFO:tasks.ceph:[osd] bdev async discard = True 2024-01-15T11:32:14.280 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-01-15T11:32:14.280 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-01-15T11:32:14.280 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-01-15T11:32:14.280 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-01-15T11:32:14.280 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-01-15T11:32:14.280 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-01-15T11:32:14.280 INFO:tasks.ceph:[osd] debug ms = 1 2024-01-15T11:32:14.280 INFO:tasks.ceph:[osd] debug osd = 20 2024-01-15T11:32:14.280 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-01-15T11:32:14.280 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-01-15T11:32:14.280 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-01-15T11:32:14.281 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-01-15T11:32:14.281 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-01-15T11:32:14.281 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-01-15T11:32:14.281 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-01-15T11:32:14.281 INFO:tasks.ceph:Setting up mon.a... 2024-01-15T11:32:14.281 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-01-15T11:32:14.329 INFO:teuthology.orchestra.run.smithi027.stdout:creating /etc/ceph/ceph.keyring 2024-01-15T11:32:14.348 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-01-15T11:32:14.399 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-15T11:32:14.420 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.27'), ('mon.b', '172.21.15.93'), ('mon.c', '[v2:172.21.15.93:3301,v1:172.21.15.93:6790]')] 2024-01-15T11:32:14.421 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.27,172.21.15.93,[v2:172.21.15.93:3301,v1:172.21.15.93:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-01-15T11:32:14.422 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:32:14.422 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-01-15T11:32:14.470 DEBUG:teuthology.orchestra.run.smithi027:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.27 --add b 172.21.15.93 --addv c '[v2:172.21.15.93:3301,v1:172.21.15.93:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-01-15T11:32:14.560 INFO:teuthology.orchestra.run.smithi027.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-01-15T11:32:14.560 INFO:teuthology.orchestra.run.smithi027.stdout:monmaptool: generated fsid adeed595-43d7-47b7-9d6d-c1a89f44a694 2024-01-15T11:32:14.560 INFO:teuthology.orchestra.run.smithi027.stdout:setting min_mon_release = pacific 2024-01-15T11:32:14.561 INFO:teuthology.orchestra.run.smithi027.stdout:epoch 0 2024-01-15T11:32:14.561 INFO:teuthology.orchestra.run.smithi027.stdout:fsid adeed595-43d7-47b7-9d6d-c1a89f44a694 2024-01-15T11:32:14.561 INFO:teuthology.orchestra.run.smithi027.stdout:last_changed 2024-01-15T11:32:14.560458+0000 2024-01-15T11:32:14.561 INFO:teuthology.orchestra.run.smithi027.stdout:created 2024-01-15T11:32:14.560458+0000 2024-01-15T11:32:14.561 INFO:teuthology.orchestra.run.smithi027.stdout:min_mon_release 16 (pacific) 2024-01-15T11:32:14.561 INFO:teuthology.orchestra.run.smithi027.stdout:election_strategy: 1 2024-01-15T11:32:14.561 INFO:teuthology.orchestra.run.smithi027.stdout:0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2024-01-15T11:32:14.561 INFO:teuthology.orchestra.run.smithi027.stdout:1: [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] mon.b 2024-01-15T11:32:14.561 INFO:teuthology.orchestra.run.smithi027.stdout:2: [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] mon.c 2024-01-15T11:32:14.561 INFO:teuthology.orchestra.run.smithi027.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-01-15T11:32:14.563 DEBUG:teuthology.orchestra.run.smithi027:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-01-15T11:32:14.572 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID adeed595-43d7-47b7-9d6d-c1a89f44a694... 2024-01-15T11:32:14.573 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-15T11:32:14.616 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-15T11:32:14.659 INFO:teuthology.orchestra.run.smithi027.stdout:[global] 2024-01-15T11:32:14.659 INFO:teuthology.orchestra.run.smithi027.stdout: chdir = "" 2024-01-15T11:32:14.659 INFO:teuthology.orchestra.run.smithi027.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-15T11:32:14.659 INFO:teuthology.orchestra.run.smithi027.stdout: auth supported = cephx 2024-01-15T11:32:14.659 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.659 INFO:teuthology.orchestra.run.smithi027.stdout: filestore xattr use omap = true 2024-01-15T11:32:14.659 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.660 INFO:teuthology.orchestra.run.smithi027.stdout: mon clock drift allowed = 1.000 2024-01-15T11:32:14.660 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.660 INFO:teuthology.orchestra.run.smithi027.stdout: osd crush chooseleaf type = 0 2024-01-15T11:32:14.660 INFO:teuthology.orchestra.run.smithi027.stdout: auth debug = true 2024-01-15T11:32:14.660 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.660 INFO:teuthology.orchestra.run.smithi027.stdout: ms die on old message = true 2024-01-15T11:32:14.660 INFO:teuthology.orchestra.run.smithi027.stdout: ms die on bug = true 2024-01-15T11:32:14.660 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.660 INFO:teuthology.orchestra.run.smithi027.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-15T11:32:14.660 INFO:teuthology.orchestra.run.smithi027.stdout: mon pg warn max object skew = 0 2024-01-15T11:32:14.660 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.660 INFO:teuthology.orchestra.run.smithi027.stdout: # disable pg_autoscaler by default for new pools 2024-01-15T11:32:14.661 INFO:teuthology.orchestra.run.smithi027.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-15T11:32:14.661 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.661 INFO:teuthology.orchestra.run.smithi027.stdout: osd pool default size = 2 2024-01-15T11:32:14.661 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.661 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd allow primary affinity = true 2024-01-15T11:32:14.661 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd allow pg remap = true 2024-01-15T11:32:14.661 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on legacy crush tunables = false 2024-01-15T11:32:14.661 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on crush straw calc version zero = false 2024-01-15T11:32:14.661 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on no sortbitwise = false 2024-01-15T11:32:14.661 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on osd down out interval zero = false 2024-01-15T11:32:14.661 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on too few osds = false 2024-01-15T11:32:14.661 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-15T11:32:14.661 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-15T11:32:14.662 INFO:teuthology.orchestra.run.smithi027.stdout: mon_allow_pool_size_one = true 2024-01-15T11:32:14.662 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.662 INFO:teuthology.orchestra.run.smithi027.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-15T11:32:14.662 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.662 INFO:teuthology.orchestra.run.smithi027.stdout: osd default data pool replay window = 5 2024-01-15T11:32:14.662 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.662 INFO:teuthology.orchestra.run.smithi027.stdout: mon allow pool delete = true 2024-01-15T11:32:14.662 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.662 INFO:teuthology.orchestra.run.smithi027.stdout: mon cluster log file level = debug 2024-01-15T11:32:14.662 INFO:teuthology.orchestra.run.smithi027.stdout: debug asserts on shutdown = true 2024-01-15T11:32:14.662 INFO:teuthology.orchestra.run.smithi027.stdout: mon health detail to clog = false 2024-01-15T11:32:14.662 INFO:teuthology.orchestra.run.smithi027.stdout: mon host = "172.21.15.27,172.21.15.93,[v2:172.21.15.93:3301,v1:172.21.15.93:6790]" 2024-01-15T11:32:14.663 INFO:teuthology.orchestra.run.smithi027.stdout: ms die on skipped message = False 2024-01-15T11:32:14.663 INFO:teuthology.orchestra.run.smithi027.stdout: fsid = adeed595-43d7-47b7-9d6d-c1a89f44a694 2024-01-15T11:32:14.663 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.663 INFO:teuthology.orchestra.run.smithi027.stdout:[osd] 2024-01-15T11:32:14.663 INFO:teuthology.orchestra.run.smithi027.stdout: osd journal size = 100 2024-01-15T11:32:14.663 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.663 INFO:teuthology.orchestra.run.smithi027.stdout: osd scrub load threshold = 5.0 2024-01-15T11:32:14.663 INFO:teuthology.orchestra.run.smithi027.stdout: osd scrub max interval = 600 2024-01-15T11:32:14.663 INFO:teuthology.orchestra.run.smithi027.stdout: osd mclock profile = high_recovery_ops 2024-01-15T11:32:14.663 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.663 INFO:teuthology.orchestra.run.smithi027.stdout: osd recover clone overlap = true 2024-01-15T11:32:14.663 INFO:teuthology.orchestra.run.smithi027.stdout: osd recovery max chunk = 1048576 2024-01-15T11:32:14.663 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.664 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug shutdown = true 2024-01-15T11:32:14.664 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug op order = true 2024-01-15T11:32:14.664 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug verify stray on activate = true 2024-01-15T11:32:14.664 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug trim objects = true 2024-01-15T11:32:14.664 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.664 INFO:teuthology.orchestra.run.smithi027.stdout: osd open classes on start = true 2024-01-15T11:32:14.664 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug pg log writeout = true 2024-01-15T11:32:14.664 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.664 INFO:teuthology.orchestra.run.smithi027.stdout: osd deep scrub update digest min age = 30 2024-01-15T11:32:14.664 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.664 INFO:teuthology.orchestra.run.smithi027.stdout: osd map max advance = 10 2024-01-15T11:32:14.664 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.664 INFO:teuthology.orchestra.run.smithi027.stdout: journal zero on create = true 2024-01-15T11:32:14.665 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.665 INFO:teuthology.orchestra.run.smithi027.stdout: filestore ondisk finisher threads = 3 2024-01-15T11:32:14.665 INFO:teuthology.orchestra.run.smithi027.stdout: filestore apply finisher threads = 3 2024-01-15T11:32:14.665 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.665 INFO:teuthology.orchestra.run.smithi027.stdout: bdev debug aio = true 2024-01-15T11:32:14.665 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug misdirected ops = true 2024-01-15T11:32:14.665 INFO:teuthology.orchestra.run.smithi027.stdout: bdev async discard = True 2024-01-15T11:32:14.665 INFO:teuthology.orchestra.run.smithi027.stdout: bdev enable discard = True 2024-01-15T11:32:14.665 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore allocator = bitmap 2024-01-15T11:32:14.665 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore block size = 96636764160 2024-01-15T11:32:14.665 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore fsck on mount = True 2024-01-15T11:32:14.665 INFO:teuthology.orchestra.run.smithi027.stdout: debug bluefs = 1/20 2024-01-15T11:32:14.665 INFO:teuthology.orchestra.run.smithi027.stdout: debug bluestore = 1/20 2024-01-15T11:32:14.665 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2024-01-15T11:32:14.666 INFO:teuthology.orchestra.run.smithi027.stdout: debug osd = 20 2024-01-15T11:32:14.666 INFO:teuthology.orchestra.run.smithi027.stdout: debug rocksdb = 4/10 2024-01-15T11:32:14.666 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd backfillfull_ratio = 0.85 2024-01-15T11:32:14.666 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd full ratio = 0.9 2024-01-15T11:32:14.666 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd nearfull ratio = 0.8 2024-01-15T11:32:14.666 INFO:teuthology.orchestra.run.smithi027.stdout: osd failsafe full ratio = 0.95 2024-01-15T11:32:14.666 INFO:teuthology.orchestra.run.smithi027.stdout: osd objectstore = bluestore 2024-01-15T11:32:14.666 INFO:teuthology.orchestra.run.smithi027.stdout: osd op complaint time = 180 2024-01-15T11:32:14.666 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.666 INFO:teuthology.orchestra.run.smithi027.stdout:[mgr] 2024-01-15T11:32:14.666 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2024-01-15T11:32:14.666 INFO:teuthology.orchestra.run.smithi027.stdout: debug mgr = 20 2024-01-15T11:32:14.666 INFO:teuthology.orchestra.run.smithi027.stdout: debug mon = 20 2024-01-15T11:32:14.666 INFO:teuthology.orchestra.run.smithi027.stdout: debug auth = 20 2024-01-15T11:32:14.667 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min pgs per osd = 4 2024-01-15T11:32:14.667 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min bytes per osd = 10 2024-01-15T11:32:14.667 INFO:teuthology.orchestra.run.smithi027.stdout: mgr/telemetry/nag = false 2024-01-15T11:32:14.667 INFO:teuthology.orchestra.run.smithi027.stdout: debug client = 20 2024-01-15T11:32:14.667 INFO:teuthology.orchestra.run.smithi027.stdout: debug finisher = 20 2024-01-15T11:32:14.667 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.667 INFO:teuthology.orchestra.run.smithi027.stdout:[mon] 2024-01-15T11:32:14.667 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2024-01-15T11:32:14.667 INFO:teuthology.orchestra.run.smithi027.stdout: debug mon = 20 2024-01-15T11:32:14.667 INFO:teuthology.orchestra.run.smithi027.stdout: debug paxos = 20 2024-01-15T11:32:14.667 INFO:teuthology.orchestra.run.smithi027.stdout: debug auth = 20 2024-01-15T11:32:14.667 INFO:teuthology.orchestra.run.smithi027.stdout: mon data avail warn = 5 2024-01-15T11:32:14.667 INFO:teuthology.orchestra.run.smithi027.stdout: mon mgr mkfs grace = 240 2024-01-15T11:32:14.667 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min pgs per osd = 4 2024-01-15T11:32:14.667 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd reporter subtree level = osd 2024-01-15T11:32:14.668 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd prime pg temp = true 2024-01-15T11:32:14.668 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min bytes per osd = 10 2024-01-15T11:32:14.668 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.668 INFO:teuthology.orchestra.run.smithi027.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-15T11:32:14.668 INFO:teuthology.orchestra.run.smithi027.stdout: auth mon ticket ttl = 660 # 11m 2024-01-15T11:32:14.668 INFO:teuthology.orchestra.run.smithi027.stdout: auth service ticket ttl = 240 # 4m 2024-01-15T11:32:14.668 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.668 INFO:teuthology.orchestra.run.smithi027.stdout: # don't complain about insecure global_id in the test suite 2024-01-15T11:32:14.668 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-15T11:32:14.668 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-15T11:32:14.668 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.668 INFO:teuthology.orchestra.run.smithi027.stdout: # 1m isn't quite enough 2024-01-15T11:32:14.668 INFO:teuthology.orchestra.run.smithi027.stdout: mon_down_mkfs_grace = 2m 2024-01-15T11:32:14.668 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.669 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_filestore_osds = false 2024-01-15T11:32:14.669 INFO:teuthology.orchestra.run.smithi027.stdout: mon op complaint time = 120 2024-01-15T11:32:14.669 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:14.669 INFO:teuthology.orchestra.run.smithi027.stdout:[client] 2024-01-15T11:32:14.669 INFO:teuthology.orchestra.run.smithi027.stdout: rgw cache enabled = true 2024-01-15T11:32:14.669 INFO:teuthology.orchestra.run.smithi027.stdout: rgw enable ops log = true 2024-01-15T11:32:14.669 INFO:teuthology.orchestra.run.smithi027.stdout: rgw enable usage log = true 2024-01-15T11:32:14.669 INFO:teuthology.orchestra.run.smithi027.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-15T11:32:14.669 INFO:teuthology.orchestra.run.smithi027.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-15T11:32:14.669 INFO:teuthology.orchestra.run.smithi027.stdout: client mount timeout = 600 2024-01-15T11:32:14.669 INFO:teuthology.orchestra.run.smithi027.stdout: debug client = 20 2024-01-15T11:32:14.669 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2024-01-15T11:32:14.669 INFO:teuthology.orchestra.run.smithi027.stdout: pid file = "" 2024-01-15T11:32:14.669 INFO:teuthology.orchestra.run.smithi027.stdout: rados mon op timeout = 900 2024-01-15T11:32:14.670 INFO:teuthology.orchestra.run.smithi027.stdout: rados osd op timeout = 900 2024-01-15T11:32:14.670 INFO:teuthology.orchestra.run.smithi027.stdout:[mon.a] 2024-01-15T11:32:14.670 INFO:teuthology.orchestra.run.smithi027.stdout:[mon.b] 2024-01-15T11:32:14.670 INFO:teuthology.orchestra.run.smithi027.stdout:[mon.c] 2024-01-15T11:32:14.670 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.a] 2024-01-15T11:32:14.670 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.c] 2024-01-15T11:32:14.670 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.b] 2024-01-15T11:32:14.670 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.d] 2024-01-15T11:32:14.670 INFO:teuthology.orchestra.run.smithi027.stdout:[mds] 2024-01-15T11:32:14.670 INFO:teuthology.orchestra.run.smithi027.stdout: debug mds = 20 2024-01-15T11:32:14.670 INFO:teuthology.orchestra.run.smithi027.stdout: debug mds balancer = 20 2024-01-15T11:32:14.670 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2024-01-15T11:32:14.670 INFO:teuthology.orchestra.run.smithi027.stdout: mds debug frag = True 2024-01-15T11:32:14.670 INFO:teuthology.orchestra.run.smithi027.stdout: mds debug scatterstat = True 2024-01-15T11:32:14.670 INFO:teuthology.orchestra.run.smithi027.stdout: mds op complaint time = 180 2024-01-15T11:32:14.671 INFO:teuthology.orchestra.run.smithi027.stdout: mds verify scatter = True 2024-01-15T11:32:14.671 INFO:teuthology.orchestra.run.smithi027.stdout: osd op complaint time = 180 2024-01-15T11:32:14.671 INFO:teuthology.orchestra.run.smithi027.stdout: rados mon op timeout = 900 2024-01-15T11:32:14.671 INFO:teuthology.orchestra.run.smithi027.stdout: rados osd op timeout = 900 2024-01-15T11:32:14.671 INFO:teuthology.orchestra.run.smithi093.stdout:[global] 2024-01-15T11:32:14.671 INFO:teuthology.orchestra.run.smithi093.stdout: chdir = "" 2024-01-15T11:32:14.671 INFO:teuthology.orchestra.run.smithi093.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-15T11:32:14.671 INFO:teuthology.orchestra.run.smithi093.stdout: auth supported = cephx 2024-01-15T11:32:14.671 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.672 INFO:teuthology.orchestra.run.smithi093.stdout: filestore xattr use omap = true 2024-01-15T11:32:14.672 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.672 INFO:teuthology.orchestra.run.smithi093.stdout: mon clock drift allowed = 1.000 2024-01-15T11:32:14.672 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.672 INFO:teuthology.orchestra.run.smithi093.stdout: osd crush chooseleaf type = 0 2024-01-15T11:32:14.672 INFO:teuthology.orchestra.run.smithi093.stdout: auth debug = true 2024-01-15T11:32:14.672 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.672 INFO:teuthology.orchestra.run.smithi093.stdout: ms die on old message = true 2024-01-15T11:32:14.672 INFO:teuthology.orchestra.run.smithi093.stdout: ms die on bug = true 2024-01-15T11:32:14.672 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.672 INFO:teuthology.orchestra.run.smithi093.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-15T11:32:14.672 INFO:teuthology.orchestra.run.smithi093.stdout: mon pg warn max object skew = 0 2024-01-15T11:32:14.672 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.672 INFO:teuthology.orchestra.run.smithi093.stdout: # disable pg_autoscaler by default for new pools 2024-01-15T11:32:14.673 INFO:teuthology.orchestra.run.smithi093.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-15T11:32:14.673 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.673 INFO:teuthology.orchestra.run.smithi093.stdout: osd pool default size = 2 2024-01-15T11:32:14.673 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.673 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd allow primary affinity = true 2024-01-15T11:32:14.673 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd allow pg remap = true 2024-01-15T11:32:14.673 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on legacy crush tunables = false 2024-01-15T11:32:14.673 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on crush straw calc version zero = false 2024-01-15T11:32:14.673 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on no sortbitwise = false 2024-01-15T11:32:14.673 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on osd down out interval zero = false 2024-01-15T11:32:14.673 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on too few osds = false 2024-01-15T11:32:14.673 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-15T11:32:14.673 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-15T11:32:14.673 INFO:teuthology.orchestra.run.smithi093.stdout: mon_allow_pool_size_one = true 2024-01-15T11:32:14.674 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.674 INFO:teuthology.orchestra.run.smithi093.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-15T11:32:14.674 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.674 INFO:teuthology.orchestra.run.smithi093.stdout: osd default data pool replay window = 5 2024-01-15T11:32:14.674 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.674 INFO:teuthology.orchestra.run.smithi093.stdout: mon allow pool delete = true 2024-01-15T11:32:14.674 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.674 INFO:teuthology.orchestra.run.smithi093.stdout: mon cluster log file level = debug 2024-01-15T11:32:14.674 INFO:teuthology.orchestra.run.smithi093.stdout: debug asserts on shutdown = true 2024-01-15T11:32:14.674 INFO:teuthology.orchestra.run.smithi093.stdout: mon health detail to clog = false 2024-01-15T11:32:14.674 INFO:teuthology.orchestra.run.smithi093.stdout: mon host = "172.21.15.27,172.21.15.93,[v2:172.21.15.93:3301,v1:172.21.15.93:6790]" 2024-01-15T11:32:14.674 INFO:teuthology.orchestra.run.smithi093.stdout: ms die on skipped message = False 2024-01-15T11:32:14.674 INFO:teuthology.orchestra.run.smithi093.stdout: fsid = adeed595-43d7-47b7-9d6d-c1a89f44a694 2024-01-15T11:32:14.675 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.675 INFO:teuthology.orchestra.run.smithi093.stdout:[osd] 2024-01-15T11:32:14.675 INFO:teuthology.orchestra.run.smithi093.stdout: osd journal size = 100 2024-01-15T11:32:14.675 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.675 INFO:teuthology.orchestra.run.smithi093.stdout: osd scrub load threshold = 5.0 2024-01-15T11:32:14.675 INFO:teuthology.orchestra.run.smithi093.stdout: osd scrub max interval = 600 2024-01-15T11:32:14.675 INFO:teuthology.orchestra.run.smithi093.stdout: osd mclock profile = high_recovery_ops 2024-01-15T11:32:14.675 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.675 INFO:teuthology.orchestra.run.smithi093.stdout: osd recover clone overlap = true 2024-01-15T11:32:14.675 INFO:teuthology.orchestra.run.smithi093.stdout: osd recovery max chunk = 1048576 2024-01-15T11:32:14.675 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.675 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug shutdown = true 2024-01-15T11:32:14.675 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug op order = true 2024-01-15T11:32:14.675 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug verify stray on activate = true 2024-01-15T11:32:14.676 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug trim objects = true 2024-01-15T11:32:14.676 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.676 INFO:teuthology.orchestra.run.smithi093.stdout: osd open classes on start = true 2024-01-15T11:32:14.676 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug pg log writeout = true 2024-01-15T11:32:14.677 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.677 INFO:teuthology.orchestra.run.smithi093.stdout: osd deep scrub update digest min age = 30 2024-01-15T11:32:14.677 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.677 INFO:teuthology.orchestra.run.smithi093.stdout: osd map max advance = 10 2024-01-15T11:32:14.677 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.678 INFO:teuthology.orchestra.run.smithi093.stdout: journal zero on create = true 2024-01-15T11:32:14.678 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.678 INFO:teuthology.orchestra.run.smithi093.stdout: filestore ondisk finisher threads = 3 2024-01-15T11:32:14.678 INFO:teuthology.orchestra.run.smithi093.stdout: filestore apply finisher threads = 3 2024-01-15T11:32:14.678 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.679 INFO:teuthology.orchestra.run.smithi093.stdout: bdev debug aio = true 2024-01-15T11:32:14.679 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug misdirected ops = true 2024-01-15T11:32:14.679 INFO:teuthology.orchestra.run.smithi093.stdout: bdev async discard = True 2024-01-15T11:32:14.679 INFO:teuthology.orchestra.run.smithi093.stdout: bdev enable discard = True 2024-01-15T11:32:14.679 INFO:teuthology.orchestra.run.smithi093.stdout: bluestore allocator = bitmap 2024-01-15T11:32:14.679 INFO:teuthology.orchestra.run.smithi093.stdout: bluestore block size = 96636764160 2024-01-15T11:32:14.680 INFO:teuthology.orchestra.run.smithi093.stdout: bluestore fsck on mount = True 2024-01-15T11:32:14.680 INFO:teuthology.orchestra.run.smithi093.stdout: debug bluefs = 1/20 2024-01-15T11:32:14.680 INFO:teuthology.orchestra.run.smithi093.stdout: debug bluestore = 1/20 2024-01-15T11:32:14.680 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2024-01-15T11:32:14.680 INFO:teuthology.orchestra.run.smithi093.stdout: debug osd = 20 2024-01-15T11:32:14.681 INFO:teuthology.orchestra.run.smithi093.stdout: debug rocksdb = 4/10 2024-01-15T11:32:14.681 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd backfillfull_ratio = 0.85 2024-01-15T11:32:14.681 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd full ratio = 0.9 2024-01-15T11:32:14.681 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd nearfull ratio = 0.8 2024-01-15T11:32:14.681 INFO:teuthology.orchestra.run.smithi093.stdout: osd failsafe full ratio = 0.95 2024-01-15T11:32:14.681 INFO:teuthology.orchestra.run.smithi093.stdout: osd objectstore = bluestore 2024-01-15T11:32:14.681 INFO:teuthology.orchestra.run.smithi093.stdout: osd op complaint time = 180 2024-01-15T11:32:14.681 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.681 INFO:teuthology.orchestra.run.smithi093.stdout:[mgr] 2024-01-15T11:32:14.682 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2024-01-15T11:32:14.682 INFO:teuthology.orchestra.run.smithi093.stdout: debug mgr = 20 2024-01-15T11:32:14.682 INFO:teuthology.orchestra.run.smithi093.stdout: debug mon = 20 2024-01-15T11:32:14.682 INFO:teuthology.orchestra.run.smithi093.stdout: debug auth = 20 2024-01-15T11:32:14.682 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min pgs per osd = 4 2024-01-15T11:32:14.682 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min bytes per osd = 10 2024-01-15T11:32:14.682 INFO:teuthology.orchestra.run.smithi093.stdout: mgr/telemetry/nag = false 2024-01-15T11:32:14.682 INFO:teuthology.orchestra.run.smithi093.stdout: debug client = 20 2024-01-15T11:32:14.682 INFO:teuthology.orchestra.run.smithi093.stdout: debug finisher = 20 2024-01-15T11:32:14.682 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.682 INFO:teuthology.orchestra.run.smithi093.stdout:[mon] 2024-01-15T11:32:14.682 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2024-01-15T11:32:14.682 INFO:teuthology.orchestra.run.smithi093.stdout: debug mon = 20 2024-01-15T11:32:14.682 INFO:teuthology.orchestra.run.smithi093.stdout: debug paxos = 20 2024-01-15T11:32:14.683 INFO:teuthology.orchestra.run.smithi093.stdout: debug auth = 20 2024-01-15T11:32:14.683 INFO:teuthology.orchestra.run.smithi093.stdout: mon data avail warn = 5 2024-01-15T11:32:14.683 INFO:teuthology.orchestra.run.smithi093.stdout: mon mgr mkfs grace = 240 2024-01-15T11:32:14.683 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min pgs per osd = 4 2024-01-15T11:32:14.683 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd reporter subtree level = osd 2024-01-15T11:32:14.683 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd prime pg temp = true 2024-01-15T11:32:14.683 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min bytes per osd = 10 2024-01-15T11:32:14.683 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.683 INFO:teuthology.orchestra.run.smithi093.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-15T11:32:14.683 INFO:teuthology.orchestra.run.smithi093.stdout: auth mon ticket ttl = 660 # 11m 2024-01-15T11:32:14.683 INFO:teuthology.orchestra.run.smithi093.stdout: auth service ticket ttl = 240 # 4m 2024-01-15T11:32:14.683 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.683 INFO:teuthology.orchestra.run.smithi093.stdout: # don't complain about insecure global_id in the test suite 2024-01-15T11:32:14.683 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-15T11:32:14.683 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-15T11:32:14.684 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.684 INFO:teuthology.orchestra.run.smithi093.stdout: # 1m isn't quite enough 2024-01-15T11:32:14.684 INFO:teuthology.orchestra.run.smithi093.stdout: mon_down_mkfs_grace = 2m 2024-01-15T11:32:14.684 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.684 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_filestore_osds = false 2024-01-15T11:32:14.684 INFO:teuthology.orchestra.run.smithi093.stdout: mon op complaint time = 120 2024-01-15T11:32:14.684 INFO:teuthology.orchestra.run.smithi093.stdout: 2024-01-15T11:32:14.684 INFO:teuthology.orchestra.run.smithi093.stdout:[client] 2024-01-15T11:32:14.684 INFO:teuthology.orchestra.run.smithi093.stdout: rgw cache enabled = true 2024-01-15T11:32:14.684 INFO:teuthology.orchestra.run.smithi093.stdout: rgw enable ops log = true 2024-01-15T11:32:14.684 INFO:teuthology.orchestra.run.smithi093.stdout: rgw enable usage log = true 2024-01-15T11:32:14.684 INFO:teuthology.orchestra.run.smithi093.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-15T11:32:14.684 INFO:teuthology.orchestra.run.smithi093.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-15T11:32:14.684 INFO:teuthology.orchestra.run.smithi093.stdout: client mount timeout = 600 2024-01-15T11:32:14.685 INFO:teuthology.orchestra.run.smithi093.stdout: debug client = 20 2024-01-15T11:32:14.685 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2024-01-15T11:32:14.685 INFO:teuthology.orchestra.run.smithi093.stdout: pid file = "" 2024-01-15T11:32:14.685 INFO:teuthology.orchestra.run.smithi093.stdout: rados mon op timeout = 900 2024-01-15T11:32:14.685 INFO:teuthology.orchestra.run.smithi093.stdout: rados osd op timeout = 900 2024-01-15T11:32:14.685 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.a] 2024-01-15T11:32:14.685 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.b] 2024-01-15T11:32:14.685 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.c] 2024-01-15T11:32:14.686 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.a] 2024-01-15T11:32:14.686 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.c] 2024-01-15T11:32:14.686 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.b] 2024-01-15T11:32:14.686 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.d] 2024-01-15T11:32:14.686 INFO:teuthology.orchestra.run.smithi093.stdout:[mds] 2024-01-15T11:32:14.686 INFO:teuthology.orchestra.run.smithi093.stdout: debug mds = 20 2024-01-15T11:32:14.686 INFO:teuthology.orchestra.run.smithi093.stdout: debug mds balancer = 20 2024-01-15T11:32:14.686 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2024-01-15T11:32:14.686 INFO:teuthology.orchestra.run.smithi093.stdout: mds debug frag = True 2024-01-15T11:32:14.687 INFO:teuthology.orchestra.run.smithi093.stdout: mds debug scatterstat = True 2024-01-15T11:32:14.687 INFO:teuthology.orchestra.run.smithi093.stdout: mds op complaint time = 180 2024-01-15T11:32:14.687 INFO:teuthology.orchestra.run.smithi093.stdout: mds verify scatter = True 2024-01-15T11:32:14.687 INFO:teuthology.orchestra.run.smithi093.stdout: osd op complaint time = 180 2024-01-15T11:32:14.687 INFO:teuthology.orchestra.run.smithi093.stdout: rados mon op timeout = 900 2024-01-15T11:32:14.687 INFO:teuthology.orchestra.run.smithi093.stdout: rados osd op timeout = 900 2024-01-15T11:32:14.688 INFO:tasks.ceph:Creating admin key on mon.a... 2024-01-15T11:32:14.689 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-01-15T11:32:14.788 INFO:tasks.ceph:Copying monmap to all nodes... 2024-01-15T11:32:14.788 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:32:14.788 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-01-15T11:32:14.797 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:32:14.797 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-01-15T11:32:14.853 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi027.front.sepia.ceph.com 2024-01-15T11:32:14.853 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:32:14.853 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-15T11:32:14.853 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-15T11:32:14.934 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:32:14.934 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-15T11:32:14.985 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi093.front.sepia.ceph.com 2024-01-15T11:32:14.985 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:32:14.986 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-15T11:32:14.986 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-15T11:32:15.021 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:32:15.022 DEBUG:teuthology.orchestra.run.smithi093:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-15T11:32:15.074 INFO:tasks.ceph:Setting up mon nodes... 2024-01-15T11:32:15.075 INFO:tasks.ceph:Setting up mgr nodes... 2024-01-15T11:32:15.075 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-01-15T11:32:15.132 INFO:teuthology.orchestra.run.smithi027.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-01-15T11:32:15.137 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-01-15T11:32:15.198 INFO:teuthology.orchestra.run.smithi093.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-01-15T11:32:15.213 INFO:tasks.ceph:Setting up mds nodes... 2024-01-15T11:32:15.213 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-01-15T11:32:15.271 INFO:teuthology.orchestra.run.smithi027.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-01-15T11:32:15.276 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-01-15T11:32:15.297 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-01-15T11:32:15.399 INFO:teuthology.orchestra.run.smithi027.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-01-15T11:32:15.403 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-01-15T11:32:15.425 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-01-15T11:32:15.484 INFO:teuthology.orchestra.run.smithi093.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-01-15T11:32:15.489 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-01-15T11:32:15.510 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-01-15T11:32:15.610 INFO:teuthology.orchestra.run.smithi093.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-01-15T11:32:15.614 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-01-15T11:32:15.635 INFO:tasks.ceph_client:Setting up client nodes... 2024-01-15T11:32:15.635 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-15T11:32:15.680 INFO:teuthology.orchestra.run.smithi027.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-01-15T11:32:15.698 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-01-15T11:32:15.785 INFO:teuthology.orchestra.run.smithi027.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-01-15T11:32:15.802 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-01-15T11:32:15.846 INFO:teuthology.orchestra.run.smithi093.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-01-15T11:32:15.863 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-01-15T11:32:15.951 INFO:teuthology.orchestra.run.smithi093.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-01-15T11:32:15.969 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-01-15T11:32:15.969 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi027.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi093.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-15T11:32:15.969 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-01-15T11:32:15.990 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-15T11:32:15.990 INFO:tasks.ceph:role: osd.0 2024-01-15T11:32:15.990 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi027.front.sepia.ceph.com 2024-01-15T11:32:15.991 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-15T11:32:16.061 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-15T11:32:16.062 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-15T11:32:16.062 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-15T11:32:16.062 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-15T11:32:16.062 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-15T11:32:16.062 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2024-01-15T11:32:16.062 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-15T11:32:16.062 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-15T11:32:16.062 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-15T11:32:16.062 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-15T11:32:16.526 INFO:teuthology.orchestra.run.smithi027.stdout:Discarding blocks...Done. 2024-01-15T11:32:16.529 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2024-01-15T11:32:16.529 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-01-15T11:32:16.664 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-01-15T11:32:16.681 INFO:teuthology.orchestra.run.smithi027.stderr:sudo: /sbin/restorecon: command not found 2024-01-15T11:32:16.682 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T11:32:16.683 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-01-15T11:32:16.750 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-15T11:32:16.750 INFO:tasks.ceph:role: osd.1 2024-01-15T11:32:16.750 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi027.front.sepia.ceph.com 2024-01-15T11:32:16.750 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-15T11:32:16.822 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-15T11:32:16.822 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-15T11:32:16.822 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-15T11:32:16.822 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-15T11:32:16.822 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-15T11:32:16.822 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2024-01-15T11:32:16.822 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-15T11:32:16.822 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-15T11:32:16.822 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-15T11:32:16.823 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-15T11:32:17.277 INFO:teuthology.orchestra.run.smithi027.stdout:Discarding blocks...Done. 2024-01-15T11:32:17.281 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2024-01-15T11:32:17.281 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-01-15T11:32:17.390 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-01-15T11:32:17.408 INFO:teuthology.orchestra.run.smithi027.stderr:sudo: /sbin/restorecon: command not found 2024-01-15T11:32:17.409 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T11:32:17.409 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-01-15T11:32:17.474 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-15T11:32:17.474 INFO:tasks.ceph:role: osd.2 2024-01-15T11:32:17.474 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi027.front.sepia.ceph.com 2024-01-15T11:32:17.474 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-15T11:32:17.551 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-15T11:32:17.551 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-15T11:32:17.551 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-15T11:32:17.551 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-15T11:32:17.551 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-15T11:32:17.551 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2024-01-15T11:32:17.551 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-15T11:32:17.551 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-15T11:32:17.551 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-15T11:32:17.551 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-15T11:32:18.021 INFO:teuthology.orchestra.run.smithi027.stdout:Discarding blocks...Done. 2024-01-15T11:32:18.024 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2024-01-15T11:32:18.025 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-01-15T11:32:18.194 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-01-15T11:32:18.213 INFO:teuthology.orchestra.run.smithi027.stderr:sudo: /sbin/restorecon: command not found 2024-01-15T11:32:18.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T11:32:18.215 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-01-15T11:32:18.283 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-15T11:32:18.283 INFO:tasks.ceph:role: osd.3 2024-01-15T11:32:18.284 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi027.front.sepia.ceph.com 2024-01-15T11:32:18.284 DEBUG:teuthology.orchestra.run.smithi027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-15T11:32:18.355 INFO:teuthology.orchestra.run.smithi027.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-15T11:32:18.355 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-15T11:32:18.355 INFO:teuthology.orchestra.run.smithi027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-15T11:32:18.356 INFO:teuthology.orchestra.run.smithi027.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-15T11:32:18.356 INFO:teuthology.orchestra.run.smithi027.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-15T11:32:18.356 INFO:teuthology.orchestra.run.smithi027.stdout: = sunit=0 swidth=0 blks 2024-01-15T11:32:18.356 INFO:teuthology.orchestra.run.smithi027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-15T11:32:18.356 INFO:teuthology.orchestra.run.smithi027.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-15T11:32:18.356 INFO:teuthology.orchestra.run.smithi027.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-15T11:32:18.356 INFO:teuthology.orchestra.run.smithi027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-15T11:32:18.835 INFO:teuthology.orchestra.run.smithi027.stdout:Discarding blocks...Done. 2024-01-15T11:32:18.838 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi027.front.sepia.ceph.com -o noatime 2024-01-15T11:32:18.839 DEBUG:teuthology.orchestra.run.smithi027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-01-15T11:32:18.964 DEBUG:teuthology.orchestra.run.smithi027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-01-15T11:32:18.983 INFO:teuthology.orchestra.run.smithi027.stderr:sudo: /sbin/restorecon: command not found 2024-01-15T11:32:18.983 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T11:32:18.984 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-15T11:32:19.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:19.108+0000 7ff76b880640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-01-15T11:32:19.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:19.112+0000 7ff76b880640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-01-15T11:32:19.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:19.112+0000 7ff76b880640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-15T11:32:19.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:19.112+0000 7ff76b880640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-15T11:32:19.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:19.112+0000 7ff76b880640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-15T11:32:19.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:19.116+0000 7ff76b880640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-01-15T11:32:22.101 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-15T11:32:22.123 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-15T11:32:22.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:22.216+0000 7f3d9b5b2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-01-15T11:32:22.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:22.220+0000 7f3d9b5b2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-01-15T11:32:22.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:22.220+0000 7f3d9b5b2640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-15T11:32:22.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:22.220+0000 7f3d9b5b2640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-15T11:32:22.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:22.220+0000 7f3d9b5b2640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-15T11:32:22.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:22.220+0000 7f3d9b5b2640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-01-15T11:32:25.217 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-15T11:32:25.240 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-15T11:32:25.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:25.336+0000 7fe80ef7e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-01-15T11:32:25.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:25.336+0000 7fe80ef7e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-01-15T11:32:25.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:25.336+0000 7fe80ef7e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-15T11:32:25.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:25.336+0000 7fe80ef7e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-15T11:32:25.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:25.336+0000 7fe80ef7e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-15T11:32:25.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:25.336+0000 7fe80ef7e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-01-15T11:32:28.329 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-15T11:32:28.351 DEBUG:teuthology.orchestra.run.smithi027:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-15T11:32:28.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:28.452+0000 7f3863e04640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-01-15T11:32:28.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:28.452+0000 7f3863e04640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-01-15T11:32:28.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:28.452+0000 7f3863e04640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-15T11:32:28.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:28.452+0000 7f3863e04640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-15T11:32:28.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:28.452+0000 7f3863e04640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-15T11:32:28.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:28.452+0000 7f3863e04640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-01-15T11:32:31.438 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-15T11:32:31.460 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-01-15T11:32:31.483 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-15T11:32:31.484 INFO:tasks.ceph:role: osd.4 2024-01-15T11:32:31.484 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi093.front.sepia.ceph.com 2024-01-15T11:32:31.484 DEBUG:teuthology.orchestra.run.smithi093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-15T11:32:31.554 INFO:teuthology.orchestra.run.smithi093.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-15T11:32:31.554 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-15T11:32:31.554 INFO:teuthology.orchestra.run.smithi093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-15T11:32:31.554 INFO:teuthology.orchestra.run.smithi093.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-15T11:32:31.555 INFO:teuthology.orchestra.run.smithi093.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-15T11:32:31.555 INFO:teuthology.orchestra.run.smithi093.stdout: = sunit=0 swidth=0 blks 2024-01-15T11:32:31.555 INFO:teuthology.orchestra.run.smithi093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-15T11:32:31.555 INFO:teuthology.orchestra.run.smithi093.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-15T11:32:31.555 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-15T11:32:31.555 INFO:teuthology.orchestra.run.smithi093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-15T11:32:32.002 INFO:teuthology.orchestra.run.smithi093.stdout:Discarding blocks...Done. 2024-01-15T11:32:32.006 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi093.front.sepia.ceph.com -o noatime 2024-01-15T11:32:32.006 DEBUG:teuthology.orchestra.run.smithi093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-01-15T11:32:32.117 DEBUG:teuthology.orchestra.run.smithi093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-01-15T11:32:32.135 INFO:teuthology.orchestra.run.smithi093.stderr:sudo: /sbin/restorecon: command not found 2024-01-15T11:32:32.136 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T11:32:32.136 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-01-15T11:32:32.202 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-15T11:32:32.202 INFO:tasks.ceph:role: osd.5 2024-01-15T11:32:32.203 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi093.front.sepia.ceph.com 2024-01-15T11:32:32.203 DEBUG:teuthology.orchestra.run.smithi093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-15T11:32:32.274 INFO:teuthology.orchestra.run.smithi093.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-15T11:32:32.274 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-15T11:32:32.274 INFO:teuthology.orchestra.run.smithi093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-15T11:32:32.274 INFO:teuthology.orchestra.run.smithi093.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-15T11:32:32.274 INFO:teuthology.orchestra.run.smithi093.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-15T11:32:32.275 INFO:teuthology.orchestra.run.smithi093.stdout: = sunit=0 swidth=0 blks 2024-01-15T11:32:32.275 INFO:teuthology.orchestra.run.smithi093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-15T11:32:32.275 INFO:teuthology.orchestra.run.smithi093.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-15T11:32:32.275 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-15T11:32:32.275 INFO:teuthology.orchestra.run.smithi093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-15T11:32:32.780 INFO:teuthology.orchestra.run.smithi093.stdout:Discarding blocks...Done. 2024-01-15T11:32:32.783 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi093.front.sepia.ceph.com -o noatime 2024-01-15T11:32:32.783 DEBUG:teuthology.orchestra.run.smithi093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-01-15T11:32:32.958 DEBUG:teuthology.orchestra.run.smithi093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-01-15T11:32:32.976 INFO:teuthology.orchestra.run.smithi093.stderr:sudo: /sbin/restorecon: command not found 2024-01-15T11:32:32.977 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T11:32:32.978 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-01-15T11:32:33.047 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-15T11:32:33.047 INFO:tasks.ceph:role: osd.6 2024-01-15T11:32:33.047 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi093.front.sepia.ceph.com 2024-01-15T11:32:33.048 DEBUG:teuthology.orchestra.run.smithi093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-15T11:32:33.119 INFO:teuthology.orchestra.run.smithi093.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-15T11:32:33.119 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-15T11:32:33.119 INFO:teuthology.orchestra.run.smithi093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-15T11:32:33.119 INFO:teuthology.orchestra.run.smithi093.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-15T11:32:33.120 INFO:teuthology.orchestra.run.smithi093.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-15T11:32:33.120 INFO:teuthology.orchestra.run.smithi093.stdout: = sunit=0 swidth=0 blks 2024-01-15T11:32:33.120 INFO:teuthology.orchestra.run.smithi093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-15T11:32:33.120 INFO:teuthology.orchestra.run.smithi093.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-15T11:32:33.120 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-15T11:32:33.120 INFO:teuthology.orchestra.run.smithi093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-15T11:32:33.588 INFO:teuthology.orchestra.run.smithi093.stdout:Discarding blocks...Done. 2024-01-15T11:32:33.591 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi093.front.sepia.ceph.com -o noatime 2024-01-15T11:32:33.591 DEBUG:teuthology.orchestra.run.smithi093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-01-15T11:32:33.682 DEBUG:teuthology.orchestra.run.smithi093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-01-15T11:32:33.701 INFO:teuthology.orchestra.run.smithi093.stderr:sudo: /sbin/restorecon: command not found 2024-01-15T11:32:33.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T11:32:33.702 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-01-15T11:32:33.766 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-15T11:32:33.766 INFO:tasks.ceph:role: osd.7 2024-01-15T11:32:33.767 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi093.front.sepia.ceph.com 2024-01-15T11:32:33.767 DEBUG:teuthology.orchestra.run.smithi093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-15T11:32:33.838 INFO:teuthology.orchestra.run.smithi093.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-15T11:32:33.839 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-15T11:32:33.839 INFO:teuthology.orchestra.run.smithi093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-15T11:32:33.839 INFO:teuthology.orchestra.run.smithi093.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-15T11:32:33.839 INFO:teuthology.orchestra.run.smithi093.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-15T11:32:33.839 INFO:teuthology.orchestra.run.smithi093.stdout: = sunit=0 swidth=0 blks 2024-01-15T11:32:33.840 INFO:teuthology.orchestra.run.smithi093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-15T11:32:33.840 INFO:teuthology.orchestra.run.smithi093.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-15T11:32:33.840 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-15T11:32:33.840 INFO:teuthology.orchestra.run.smithi093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-15T11:32:34.286 INFO:teuthology.orchestra.run.smithi093.stdout:Discarding blocks...Done. 2024-01-15T11:32:34.289 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi093.front.sepia.ceph.com -o noatime 2024-01-15T11:32:34.289 DEBUG:teuthology.orchestra.run.smithi093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-01-15T11:32:34.383 DEBUG:teuthology.orchestra.run.smithi093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-01-15T11:32:34.399 INFO:teuthology.orchestra.run.smithi093.stderr:sudo: /sbin/restorecon: command not found 2024-01-15T11:32:34.400 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T11:32:34.400 DEBUG:teuthology.orchestra.run.smithi093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-15T11:32:34.534 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:34.531+0000 7f9ec9c4a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-01-15T11:32:34.538 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:34.535+0000 7f9ec9c4a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-01-15T11:32:34.538 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:34.535+0000 7f9ec9c4a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-15T11:32:34.538 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:34.535+0000 7f9ec9c4a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-15T11:32:34.538 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:34.535+0000 7f9ec9c4a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-15T11:32:34.540 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:34.535+0000 7f9ec9c4a640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-01-15T11:32:37.530 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-15T11:32:37.552 DEBUG:teuthology.orchestra.run.smithi093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-15T11:32:37.651 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:37.647+0000 7f56339fd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-01-15T11:32:37.651 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:37.647+0000 7f56339fd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-01-15T11:32:37.652 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:37.647+0000 7f56339fd640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-15T11:32:37.652 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:37.647+0000 7f56339fd640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-15T11:32:37.652 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:37.647+0000 7f56339fd640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-15T11:32:37.653 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:37.647+0000 7f56339fd640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-01-15T11:32:40.658 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-15T11:32:40.680 DEBUG:teuthology.orchestra.run.smithi093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-15T11:32:40.775 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:40.770+0000 7f03e8e2b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-01-15T11:32:40.776 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:40.770+0000 7f03e8e2b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-01-15T11:32:40.776 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:40.770+0000 7f03e8e2b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-15T11:32:40.776 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:40.770+0000 7f03e8e2b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-15T11:32:40.776 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:40.770+0000 7f03e8e2b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-15T11:32:40.777 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:40.770+0000 7f03e8e2b640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-01-15T11:32:42.772 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:32:42.780 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:32:43.793 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-15T11:32:43.814 DEBUG:teuthology.orchestra.run.smithi093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-15T11:32:43.913 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:43.906+0000 7fee2c3ef640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-01-15T11:32:43.914 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:43.906+0000 7fee2c3ef640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-01-15T11:32:43.914 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:43.906+0000 7fee2c3ef640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-15T11:32:43.914 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:43.906+0000 7fee2c3ef640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-15T11:32:43.914 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:43.906+0000 7fee2c3ef640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-15T11:32:43.915 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:43.910+0000 7fee2c3ef640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-01-15T11:32:46.901 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-15T11:32:46.922 INFO:tasks.ceph:Reading keys from all nodes... 2024-01-15T11:32:46.922 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:32:46.922 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-01-15T11:32:46.947 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:32:46.947 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-01-15T11:32:47.011 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:32:47.011 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-01-15T11:32:47.075 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:32:47.075 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-01-15T11:32:47.139 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:32:47.139 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-01-15T11:32:47.203 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:32:47.203 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-01-15T11:32:47.267 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:32:47.267 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-01-15T11:32:47.330 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:32:47.331 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-01-15T11:32:47.352 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:32:47.352 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-01-15T11:32:47.414 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:32:47.414 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-01-15T11:32:47.477 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:32:47.478 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-01-15T11:32:47.537 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:32:47.537 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-01-15T11:32:47.598 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:32:47.598 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-01-15T11:32:47.661 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:32:47.661 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-01-15T11:32:47.721 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:32:47.722 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-01-15T11:32:47.732 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:32:47.732 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-01-15T11:32:47.786 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:32:47.786 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-01-15T11:32:47.795 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:32:47.795 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-01-15T11:32:47.846 INFO:tasks.ceph:Adding keys to all mons... 2024-01-15T11:32:47.847 DEBUG:teuthology.orchestra.run.smithi027:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-15T11:32:47.851 DEBUG:teuthology.orchestra.run.smithi093:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-15T11:32:47.898 INFO:teuthology.orchestra.run.smithi027.stdout:[mgr.y] 2024-01-15T11:32:47.898 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQC/F6Vl0YbpBxAA+3H7PeENvRGq2RCxm1H1Rg== 2024-01-15T11:32:47.898 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.a] 2024-01-15T11:32:47.898 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQC/F6VlkQEwEBAA64qIAc+BZqfvKf4MxjK5vQ== 2024-01-15T11:32:47.898 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.c] 2024-01-15T11:32:47.898 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQC/F6VlRTDJFxAAptWtTuoQ/zgNLuoVOHH7/Q== 2024-01-15T11:32:47.899 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.0] 2024-01-15T11:32:47.899 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDDF6VlWTWsBhAA+zuBPc/TWd+lmwHHLQQjGQ== 2024-01-15T11:32:47.899 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.1] 2024-01-15T11:32:47.899 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDGF6Vl7KktDRAA2tGIsiVfz9SbwJ2n+e37Cw== 2024-01-15T11:32:47.899 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.2] 2024-01-15T11:32:47.899 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDJF6VlXOIlFBAAaF2Yhzgcak/sPzGSX+hghA== 2024-01-15T11:32:47.899 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.3] 2024-01-15T11:32:47.899 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDMF6VlD18TGxAA7zzIX8ZQs4RtdjrmnNA3aA== 2024-01-15T11:32:47.899 INFO:teuthology.orchestra.run.smithi027.stdout:[mgr.x] 2024-01-15T11:32:47.899 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQC/F6VlxzrRCxAAgWBI+Amt0FR1D4R8o4evuw== 2024-01-15T11:32:47.899 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.b] 2024-01-15T11:32:47.899 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQC/F6VlEJzaHBAAuFV9d3S7QfnlmLs2i1fHdQ== 2024-01-15T11:32:47.900 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.d] 2024-01-15T11:32:47.900 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQC/F6Vl/2tQJBAAnmPf3qvrV+9fBCci2718qA== 2024-01-15T11:32:47.900 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.4] 2024-01-15T11:32:47.900 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDSF6VlLqDOHxAAokLZvbakoKitnoncRqC07Q== 2024-01-15T11:32:47.900 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.5] 2024-01-15T11:32:47.900 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDVF6VlXm3KJhAA2AR8RdY+n75c7ojqtuaiqA== 2024-01-15T11:32:47.900 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.6] 2024-01-15T11:32:47.900 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDYF6VlWpAuLhAAH7/X4yyIoQLJ0JJmPun67w== 2024-01-15T11:32:47.900 INFO:teuthology.orchestra.run.smithi027.stdout:[osd.7] 2024-01-15T11:32:47.900 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQDbF6Vlw5RkNhAA4mli4D4sevDuKSkFhq0h0g== 2024-01-15T11:32:47.900 INFO:teuthology.orchestra.run.smithi027.stdout:[client.0] 2024-01-15T11:32:47.900 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQC/F6Vlh3mVKBAAfHmOP/4KjAs9i7VdmSNMDA== 2024-01-15T11:32:47.901 INFO:teuthology.orchestra.run.smithi027.stdout:[client.2] 2024-01-15T11:32:47.901 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQC/F6Vly/LOLhAAGNJNBcSD+uTOrSvLAu5Gpw== 2024-01-15T11:32:47.901 INFO:teuthology.orchestra.run.smithi027.stdout:[client.1] 2024-01-15T11:32:47.901 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQC/F6VltiRpMhAAO8VTZJHKfyRl818K6KTyug== 2024-01-15T11:32:47.901 INFO:teuthology.orchestra.run.smithi027.stdout:[client.3] 2024-01-15T11:32:47.901 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQC/F6VlhRiyOBAA16k+wHXOOl8BH09KVs396A== 2024-01-15T11:32:47.911 INFO:teuthology.orchestra.run.smithi093.stdout:[mgr.y] 2024-01-15T11:32:47.912 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQC/F6Vl0YbpBxAA+3H7PeENvRGq2RCxm1H1Rg== 2024-01-15T11:32:47.912 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.a] 2024-01-15T11:32:47.912 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQC/F6VlkQEwEBAA64qIAc+BZqfvKf4MxjK5vQ== 2024-01-15T11:32:47.912 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.c] 2024-01-15T11:32:47.912 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQC/F6VlRTDJFxAAptWtTuoQ/zgNLuoVOHH7/Q== 2024-01-15T11:32:47.912 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.0] 2024-01-15T11:32:47.912 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDDF6VlWTWsBhAA+zuBPc/TWd+lmwHHLQQjGQ== 2024-01-15T11:32:47.912 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.1] 2024-01-15T11:32:47.912 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDGF6Vl7KktDRAA2tGIsiVfz9SbwJ2n+e37Cw== 2024-01-15T11:32:47.912 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.2] 2024-01-15T11:32:47.912 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDJF6VlXOIlFBAAaF2Yhzgcak/sPzGSX+hghA== 2024-01-15T11:32:47.913 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.3] 2024-01-15T11:32:47.913 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDMF6VlD18TGxAA7zzIX8ZQs4RtdjrmnNA3aA== 2024-01-15T11:32:47.913 INFO:teuthology.orchestra.run.smithi093.stdout:[mgr.x] 2024-01-15T11:32:47.913 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQC/F6VlxzrRCxAAgWBI+Amt0FR1D4R8o4evuw== 2024-01-15T11:32:47.913 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.b] 2024-01-15T11:32:47.913 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQC/F6VlEJzaHBAAuFV9d3S7QfnlmLs2i1fHdQ== 2024-01-15T11:32:47.913 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.d] 2024-01-15T11:32:47.913 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQC/F6Vl/2tQJBAAnmPf3qvrV+9fBCci2718qA== 2024-01-15T11:32:47.913 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.4] 2024-01-15T11:32:47.913 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDSF6VlLqDOHxAAokLZvbakoKitnoncRqC07Q== 2024-01-15T11:32:47.913 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.5] 2024-01-15T11:32:47.913 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDVF6VlXm3KJhAA2AR8RdY+n75c7ojqtuaiqA== 2024-01-15T11:32:47.913 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.6] 2024-01-15T11:32:47.914 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDYF6VlWpAuLhAAH7/X4yyIoQLJ0JJmPun67w== 2024-01-15T11:32:47.914 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.7] 2024-01-15T11:32:47.914 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDbF6Vlw5RkNhAA4mli4D4sevDuKSkFhq0h0g== 2024-01-15T11:32:47.914 INFO:teuthology.orchestra.run.smithi093.stdout:[client.0] 2024-01-15T11:32:47.914 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQC/F6Vlh3mVKBAAfHmOP/4KjAs9i7VdmSNMDA== 2024-01-15T11:32:47.914 INFO:teuthology.orchestra.run.smithi093.stdout:[client.2] 2024-01-15T11:32:47.914 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQC/F6Vly/LOLhAAGNJNBcSD+uTOrSvLAu5Gpw== 2024-01-15T11:32:47.914 INFO:teuthology.orchestra.run.smithi093.stdout:[client.1] 2024-01-15T11:32:47.914 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQC/F6VltiRpMhAAO8VTZJHKfyRl818K6KTyug== 2024-01-15T11:32:47.914 INFO:teuthology.orchestra.run.smithi093.stdout:[client.3] 2024-01-15T11:32:47.914 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQC/F6VlhRiyOBAA16k+wHXOOl8BH09KVs396A== 2024-01-15T11:32:47.915 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-15T11:32:47.949 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-15T11:32:48.010 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-15T11:32:48.015 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-15T11:32:48.072 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-15T11:32:48.077 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-15T11:32:48.134 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T11:32:48.138 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T11:32:48.193 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T11:32:48.197 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T11:32:48.252 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T11:32:48.256 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T11:32:48.310 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T11:32:48.315 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T11:32:48.369 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-15T11:32:48.374 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-15T11:32:48.429 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-15T11:32:48.432 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-15T11:32:48.490 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-15T11:32:48.494 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-15T11:32:48.552 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T11:32:48.556 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T11:32:48.611 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T11:32:48.616 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T11:32:48.671 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T11:32:48.676 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T11:32:48.730 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T11:32:48.734 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-15T11:32:48.788 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-15T11:32:48.793 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-15T11:32:48.850 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-15T11:32:48.870 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-15T11:32:48.928 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-15T11:32:48.932 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-15T11:32:48.990 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-15T11:32:48.994 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-15T11:32:49.051 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-01-15T11:32:49.051 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-01-15T11:32:49.072 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-15T11:32:49.190 DEBUG:teuthology.orchestra.run.smithi027:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-01-15T11:32:49.211 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-01-15T11:32:49.232 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-15T11:32:49.349 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-01-15T11:32:49.369 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-01-15T11:32:49.430 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-15T11:32:49.546 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-01-15T11:32:49.567 DEBUG:teuthology.orchestra.run.smithi027:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-15T11:32:49.571 DEBUG:teuthology.orchestra.run.smithi093:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-15T11:32:49.622 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-01-15T11:32:49.622 INFO:tasks.ceph.mon.a:Restarting daemon 2024-01-15T11:32:49.622 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-01-15T11:32:49.626 INFO:tasks.ceph.mon.a:Started 2024-01-15T11:32:49.626 INFO:tasks.ceph.mon.b:Restarting daemon 2024-01-15T11:32:49.626 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-01-15T11:32:49.669 INFO:tasks.ceph.mon.b:Started 2024-01-15T11:32:49.669 INFO:tasks.ceph.mon.c:Restarting daemon 2024-01-15T11:32:49.669 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-01-15T11:32:49.673 INFO:tasks.ceph.mon.c:Started 2024-01-15T11:32:49.673 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-01-15T11:32:49.673 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-01-15T11:32:49.673 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-01-15T11:32:49.678 INFO:tasks.ceph.mgr.y:Started 2024-01-15T11:32:49.678 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-01-15T11:32:49.678 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-01-15T11:32:49.682 INFO:tasks.ceph.mgr.x:Started 2024-01-15T11:32:49.682 INFO:tasks.ceph:Setting crush tunables to default 2024-01-15T11:32:49.682 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --cluster ceph osd crush tunables default 2024-01-15T11:32:49.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:49.824+0000 7feb6e05a640 1 Processor -- start 2024-01-15T11:32:49.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:49.824+0000 7feb6e05a640 1 -- start start 2024-01-15T11:32:49.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:49.824+0000 7feb6e05a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7feb68146820 0x7feb68070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:49.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:49.824+0000 7feb6e05a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feb680b4210 0x7feb680b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:49.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:49.824+0000 7feb6e05a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb68147190 con 0x7feb68161180 2024-01-15T11:32:49.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:49.824+0000 7feb6e05a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb680b4be0 con 0x7feb680b4210 2024-01-15T11:32:49.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:49.824+0000 7feb6e05a640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb68146c00 con 0x7feb68146820 2024-01-15T11:32:49.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:49.824+0000 7feb5ffff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feb680b4210 0x7feb680b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:49.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:49.824+0000 7feb5ffff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feb680b4210 0x7feb680b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:37944/0 (socket says 172.21.15.27:37944) 2024-01-15T11:32:49.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:49.824+0000 7feb5ffff640 1 -- 172.21.15.27:0/819086977 learned_addr learned my addr 172.21.15.27:0/819086977 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:32:49.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:49.824+0000 7feb5ffff640 1 -- 172.21.15.27:0/819086977 >> v2:172.21.15.27:3300/0 conn(0x7feb680b4210 msgr2=0x7feb680b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-15T11:32:49.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:49.824+0000 7feb5ffff640 1 -- 172.21.15.27:0/819086977 >> v2:172.21.15.27:3300/0 conn(0x7feb680b4210 msgr2=0x7feb680b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-15T11:32:49.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:49.824+0000 7feb5ffff640 1 --2- 172.21.15.27:0/819086977 >> v2:172.21.15.27:3300/0 conn(0x7feb680b4210 0x7feb680b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-15T11:32:49.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:49.824+0000 7feb5ffff640 1 --2- 172.21.15.27:0/819086977 >> v2:172.21.15.27:3300/0 conn(0x7feb680b4210 0x7feb680b46a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-15T11:32:49.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:49.824+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> v2:172.21.15.93:3300/0 conn(0x7feb68146820 0x7feb68070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:49.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:49.824+0000 7feb677fe640 1 -- 172.21.15.27:0/819086977 >> v2:172.21.15.93:3300/0 conn(0x7feb68146820 msgr2=0x7feb68070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-15T11:32:49.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:49.824+0000 7feb677fe640 1 -- 172.21.15.27:0/819086977 >> v2:172.21.15.93:3300/0 conn(0x7feb68146820 msgr2=0x7feb68070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-15T11:32:49.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:49.824+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> v2:172.21.15.93:3300/0 conn(0x7feb68146820 0x7feb68070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-15T11:32:49.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:49.824+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> v2:172.21.15.93:3300/0 conn(0x7feb68146820 0x7feb68070a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-15T11:32:50.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:50.028+0000 7feb5ffff640 1 --2- 172.21.15.27:0/819086977 >> v2:172.21.15.27:3300/0 conn(0x7feb680b4210 0x7feb680b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:50.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:50.028+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> v2:172.21.15.93:3300/0 conn(0x7feb68146820 0x7feb68070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:50.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:50.028+0000 7feb5ffff640 1 -- 172.21.15.27:0/819086977 >> v2:172.21.15.27:3300/0 conn(0x7feb680b4210 msgr2=0x7feb680b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-15T11:32:50.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:50.028+0000 7feb5ffff640 1 -- 172.21.15.27:0/819086977 >> v2:172.21.15.27:3300/0 conn(0x7feb680b4210 msgr2=0x7feb680b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-15T11:32:50.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:50.028+0000 7feb5ffff640 1 --2- 172.21.15.27:0/819086977 >> v2:172.21.15.27:3300/0 conn(0x7feb680b4210 0x7feb680b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-15T11:32:50.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:50.028+0000 7feb677fe640 1 -- 172.21.15.27:0/819086977 >> v2:172.21.15.93:3300/0 conn(0x7feb68146820 msgr2=0x7feb68070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-15T11:32:50.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:50.028+0000 7feb677fe640 1 -- 172.21.15.27:0/819086977 >> v2:172.21.15.93:3300/0 conn(0x7feb68146820 msgr2=0x7feb68070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-15T11:32:50.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:50.028+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> v2:172.21.15.93:3300/0 conn(0x7feb68146820 0x7feb68070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-15T11:32:50.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:50.028+0000 7feb5ffff640 1 --2- 172.21.15.27:0/819086977 >> v2:172.21.15.27:3300/0 conn(0x7feb680b4210 0x7feb680b46a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-15T11:32:50.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:50.028+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> v2:172.21.15.93:3300/0 conn(0x7feb68146820 0x7feb68070a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-15T11:32:50.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:50.432+0000 7feb5ffff640 1 --2- 172.21.15.27:0/819086977 >> v2:172.21.15.27:3300/0 conn(0x7feb680b4210 0x7feb680b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:50.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:50.432+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> v2:172.21.15.93:3300/0 conn(0x7feb68146820 0x7feb68070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:50.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:50.432+0000 7feb5ffff640 1 -- 172.21.15.27:0/819086977 >> v2:172.21.15.27:3300/0 conn(0x7feb680b4210 msgr2=0x7feb680b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-15T11:32:50.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:50.432+0000 7feb5ffff640 1 -- 172.21.15.27:0/819086977 >> v2:172.21.15.27:3300/0 conn(0x7feb680b4210 msgr2=0x7feb680b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-15T11:32:50.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:50.432+0000 7feb5ffff640 1 --2- 172.21.15.27:0/819086977 >> v2:172.21.15.27:3300/0 conn(0x7feb680b4210 0x7feb680b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-15T11:32:50.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:50.432+0000 7feb5ffff640 1 --2- 172.21.15.27:0/819086977 >> v2:172.21.15.27:3300/0 conn(0x7feb680b4210 0x7feb680b46a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-15T11:32:50.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:50.432+0000 7feb677fe640 1 -- 172.21.15.27:0/819086977 >> v2:172.21.15.93:3300/0 conn(0x7feb68146820 msgr2=0x7feb68070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-15T11:32:50.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:50.432+0000 7feb677fe640 1 -- 172.21.15.27:0/819086977 >> v2:172.21.15.93:3300/0 conn(0x7feb68146820 msgr2=0x7feb68070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-15T11:32:50.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:50.432+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> v2:172.21.15.93:3300/0 conn(0x7feb68146820 0x7feb68070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-15T11:32:50.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:50.432+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> v2:172.21.15.93:3300/0 conn(0x7feb68146820 0x7feb68070a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-15T11:32:51.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:51.236+0000 7feb5ffff640 1 --2- 172.21.15.27:0/819086977 >> v2:172.21.15.27:3300/0 conn(0x7feb680b4210 0x7feb680b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:51.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:51.236+0000 7feb5ffff640 1 -- 172.21.15.27:0/819086977 >> v2:172.21.15.27:3300/0 conn(0x7feb680b4210 msgr2=0x7feb680b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-15T11:32:51.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:51.236+0000 7feb5ffff640 1 -- 172.21.15.27:0/819086977 >> v2:172.21.15.27:3300/0 conn(0x7feb680b4210 msgr2=0x7feb680b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-15T11:32:51.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:51.236+0000 7feb5ffff640 1 --2- 172.21.15.27:0/819086977 >> v2:172.21.15.27:3300/0 conn(0x7feb680b4210 0x7feb680b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-15T11:32:51.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:51.236+0000 7feb5ffff640 1 --2- 172.21.15.27:0/819086977 >> v2:172.21.15.27:3300/0 conn(0x7feb680b4210 0x7feb680b46a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-15T11:32:51.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:51.236+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> v2:172.21.15.93:3300/0 conn(0x7feb68146820 0x7feb68070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:51.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:51.236+0000 7feb677fe640 1 -- 172.21.15.27:0/819086977 >> v2:172.21.15.93:3300/0 conn(0x7feb68146820 msgr2=0x7feb68070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-15T11:32:51.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:51.236+0000 7feb677fe640 1 -- 172.21.15.27:0/819086977 >> v2:172.21.15.93:3300/0 conn(0x7feb68146820 msgr2=0x7feb68070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-15T11:32:51.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:51.236+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> v2:172.21.15.93:3300/0 conn(0x7feb68146820 0x7feb68070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-15T11:32:51.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:51.236+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> v2:172.21.15.93:3300/0 conn(0x7feb68146820 0x7feb68070a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-15T11:32:52.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:52.824+0000 7feb65ffb640 1 -- 172.21.15.27:0/819086977 >> v2:172.21.15.93:3300/0 conn(0x7feb68146820 msgr2=0x7feb68070a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-15T11:32:52.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:52.824+0000 7feb65ffb640 1 --2- 172.21.15.27:0/819086977 >> v2:172.21.15.93:3300/0 conn(0x7feb68146820 0x7feb68070a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:52.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:52.824+0000 7feb65ffb640 1 -- 172.21.15.27:0/819086977 >> v2:172.21.15.27:3300/0 conn(0x7feb680b4210 msgr2=0x7feb680b46a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-15T11:32:52.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:52.824+0000 7feb65ffb640 1 --2- 172.21.15.27:0/819086977 >> v2:172.21.15.27:3300/0 conn(0x7feb680b4210 0x7feb680b46a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:52.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:52.824+0000 7feb65ffb640 1 -- 172.21.15.27:0/819086977 >> v1:172.21.15.93:6789/0 conn(0x7feb68161180 legacy=0x7feb68161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:52.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:52.824+0000 7feb65ffb640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb48003680 0x7feb48005ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:52.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:52.824+0000 7feb65ffb640 1 -- 172.21.15.27:0/819086977 --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb6806d030 con 0x7feb48006160 2024-01-15T11:32:52.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:52.824+0000 7feb65ffb640 1 -- 172.21.15.27:0/819086977 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb680b4be0 con 0x7feb48003680 2024-01-15T11:32:52.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:52.824+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb48003680 0x7feb48005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:52.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:52.824+0000 7feb677fe640 1 -- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb48003680 msgr2=0x7feb48005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-15T11:32:52.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:52.824+0000 7feb677fe640 1 -- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb48003680 msgr2=0x7feb48005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-15T11:32:52.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:52.824+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb48003680 0x7feb48005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-15T11:32:52.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:52.824+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb48003680 0x7feb48005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-15T11:32:53.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:53.028+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb48003680 0x7feb48005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:53.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:53.028+0000 7feb677fe640 1 -- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb48003680 msgr2=0x7feb48005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-15T11:32:53.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:53.028+0000 7feb677fe640 1 -- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb48003680 msgr2=0x7feb48005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-15T11:32:53.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:53.028+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb48003680 0x7feb48005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-15T11:32:53.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:53.028+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb48003680 0x7feb48005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-15T11:32:53.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:53.432+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb48003680 0x7feb48005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:53.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:53.432+0000 7feb677fe640 1 -- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb48003680 msgr2=0x7feb48005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-15T11:32:53.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:53.432+0000 7feb677fe640 1 -- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb48003680 msgr2=0x7feb48005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-15T11:32:53.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:53.432+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb48003680 0x7feb48005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-15T11:32:53.434 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:53.432+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb48003680 0x7feb48005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-15T11:32:54.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:54.236+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb48003680 0x7feb48005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:54.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:54.236+0000 7feb677fe640 1 -- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb48003680 msgr2=0x7feb48005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-15T11:32:54.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:54.236+0000 7feb677fe640 1 -- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb48003680 msgr2=0x7feb48005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-15T11:32:54.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:54.236+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb48003680 0x7feb48005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-15T11:32:54.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:54.236+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb48003680 0x7feb48005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-15T11:32:55.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.000+0000 7feb66ffd640 1 -- 172.21.15.27:0/819086977 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072587720 0 0) 0x7feb6806d030 con 0x7feb48006160 2024-01-15T11:32:55.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.000+0000 7feb66ffd640 1 -- 172.21.15.27:0/819086977 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb54003530 con 0x7feb48006160 2024-01-15T11:32:55.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.000+0000 7feb66ffd640 1 -- 172.21.15.27:0/819086977 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3926506292 0 0) 0x7feb54003530 con 0x7feb48006160 2024-01-15T11:32:55.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.000+0000 7feb66ffd640 1 -- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb48003680 msgr2=0x7feb48005ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-15T11:32:55.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.000+0000 7feb66ffd640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb48003680 0x7feb48005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.000+0000 7feb66ffd640 1 -- 172.21.15.27:0/819086977 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4800af30 con 0x7feb48006160 2024-01-15T11:32:55.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.000+0000 7feb66ffd640 1 -- 172.21.15.27:0/819086977 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1394381265 0 0) 0x7feb5000c570 con 0x7feb48006160 2024-01-15T11:32:55.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.000+0000 7feb66ffd640 1 -- 172.21.15.27:0/819086977 >> v1:172.21.15.27:6789/0 conn(0x7feb48006160 legacy=0x7feb48008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:55.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.000+0000 7feb67fff640 1 -- 172.21.15.27:0/819086977 reap_dead start 2024-01-15T11:32:55.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.000+0000 7feb66ffd640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb54003980 0x7feb54003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:55.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.000+0000 7feb66ffd640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb540047d0 0x7feb54004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:55.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.000+0000 7feb66ffd640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb54005260 0x7feb5400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:55.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.000+0000 7feb66ffd640 1 -- 172.21.15.27:0/819086977 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb680b4be0 con 0x7feb540047d0 2024-01-15T11:32:55.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.000+0000 7feb66ffd640 1 -- 172.21.15.27:0/819086977 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5400c1b0 con 0x7feb54005260 2024-01-15T11:32:55.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.000+0000 7feb66ffd640 1 -- 172.21.15.27:0/819086977 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5400c370 con 0x7feb54003980 2024-01-15T11:32:55.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.000+0000 7feb5ffff640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb540047d0 0x7feb54004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:55.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.000+0000 7feb67fff640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb54005260 0x7feb5400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:55.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.000+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb54003980 0x7feb54003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:55.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.000+0000 7feb5ffff640 1 -- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb54003980 msgr2=0x7feb54003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:32:55.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.000+0000 7feb5ffff640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb54003980 0x7feb54003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.000+0000 7feb5ffff640 1 -- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb54005260 msgr2=0x7feb5400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:32:55.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.000+0000 7feb5ffff640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb54005260 0x7feb5400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.000+0000 7feb5ffff640 1 -- 172.21.15.27:0/819086977 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb54003530 con 0x7feb540047d0 2024-01-15T11:32:55.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.000+0000 7feb677fe640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb54003980 0x7feb54003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:32:55.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.004+0000 7feb5ffff640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb540047d0 0x7feb54004c50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feb50014370 tx=0x7feb5001d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fedc0cd3c63008d7 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:32:55.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.004+0000 7feb66ffd640 1 -- 172.21.15.27:0/819086977 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb500a6790 con 0x7feb540047d0 2024-01-15T11:32:55.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.004+0000 7feb66ffd640 1 -- 172.21.15.27:0/819086977 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb500aa070 con 0x7feb540047d0 2024-01-15T11:32:55.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.004+0000 7feb66ffd640 1 -- 172.21.15.27:0/819086977 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb500a6b50 con 0x7feb540047d0 2024-01-15T11:32:55.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.004+0000 7feb6e05a640 1 -- 172.21.15.27:0/819086977 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb540047d0 msgr2=0x7feb54004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:55.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.004+0000 7feb6e05a640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb540047d0 0x7feb54004c50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feb50014370 tx=0x7feb5001d960 comp rx=0 tx=0).stop 2024-01-15T11:32:55.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.004+0000 7feb6e05a640 1 -- 172.21.15.27:0/819086977 shutdown_connections 2024-01-15T11:32:55.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.004+0000 7feb6e05a640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb54005260 0x7feb5400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.004+0000 7feb6e05a640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb540047d0 0x7feb54004c50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.004+0000 7feb6e05a640 1 --2- 172.21.15.27:0/819086977 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb54003980 0x7feb54003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.004+0000 7feb6e05a640 1 -- 172.21.15.27:0/819086977 >> 172.21.15.27:0/819086977 conn(0x7feb680b2f10 msgr2=0x7feb680b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:32:55.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.004+0000 7feb6e05a640 1 -- 172.21.15.27:0/819086977 shutdown_connections 2024-01-15T11:32:55.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.004+0000 7feb6e05a640 1 -- 172.21.15.27:0/819086977 wait complete. 2024-01-15T11:32:55.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.008+0000 7feb6e05a640 1 Processor -- start 2024-01-15T11:32:55.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.008+0000 7feb6e05a640 1 -- start start 2024-01-15T11:32:55.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.008+0000 7feb6e05a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb54003980 0x7feb68141060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:55.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.008+0000 7feb6e05a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb540047d0 0x7feb680cd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:55.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.008+0000 7feb6e05a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb54005260 0x7feb68144380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:55.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.008+0000 7feb6e05a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb681f6190 con 0x7feb54003980 2024-01-15T11:32:55.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.008+0000 7feb6e05a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb681415a0 con 0x7feb54005260 2024-01-15T11:32:55.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.008+0000 7feb6e05a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb680cdab0 con 0x7feb540047d0 2024-01-15T11:32:55.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.008+0000 7feb677fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb54003980 0x7feb68141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:55.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.008+0000 7feb677fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb54003980 0x7feb68141060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38030/0 (socket says 172.21.15.27:38030) 2024-01-15T11:32:55.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.008+0000 7feb677fe640 1 -- 172.21.15.27:0/3496551868 learned_addr learned my addr 172.21.15.27:0/3496551868 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:32:55.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.008+0000 7feb67fff640 1 --2- 172.21.15.27:0/3496551868 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb54005260 0x7feb68144380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:55.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.008+0000 7feb5ffff640 1 --2- 172.21.15.27:0/3496551868 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb540047d0 0x7feb680cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:55.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.008+0000 7feb677fe640 1 -- 172.21.15.27:0/3496551868 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb540047d0 msgr2=0x7feb680cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:55.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.008+0000 7feb677fe640 1 --2- 172.21.15.27:0/3496551868 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb540047d0 0x7feb680cd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.008+0000 7feb677fe640 1 -- 172.21.15.27:0/3496551868 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb54005260 msgr2=0x7feb68144380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:55.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.008+0000 7feb677fe640 1 --2- 172.21.15.27:0/3496551868 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb54005260 0x7feb68144380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.008+0000 7feb677fe640 1 -- 172.21.15.27:0/3496551868 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb680cdd90 con 0x7feb54003980 2024-01-15T11:32:55.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.008+0000 7feb677fe640 1 --2- 172.21.15.27:0/3496551868 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb54003980 0x7feb68141060 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feb58019710 tx=0x7feb58019b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:32:55.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.012+0000 7feb64ff9640 1 -- 172.21.15.27:0/3496551868 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb58017bc0 con 0x7feb54003980 2024-01-15T11:32:55.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.012+0000 7feb6e05a640 1 -- 172.21.15.27:0/3496551868 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb680ce070 con 0x7feb54003980 2024-01-15T11:32:55.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.012+0000 7feb64ff9640 1 -- 172.21.15.27:0/3496551868 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5801f040 con 0x7feb54003980 2024-01-15T11:32:55.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.012+0000 7feb64ff9640 1 -- 172.21.15.27:0/3496551868 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb58019e50 con 0x7feb54003980 2024-01-15T11:32:55.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.012+0000 7feb6e05a640 1 -- 172.21.15.27:0/3496551868 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb680ccbe0 con 0x7feb54003980 2024-01-15T11:32:55.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.012+0000 7feb64ff9640 1 -- 172.21.15.27:0/3496551868 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7feb5802d740 con 0x7feb54003980 2024-01-15T11:32:55.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.012+0000 7feb64ff9640 1 -- 172.21.15.27:0/3496551868 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7feb58023ad0 con 0x7feb54003980 2024-01-15T11:32:55.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.012+0000 7feb6e05a640 1 -- 172.21.15.27:0/3496551868 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb6804e850 con 0x7feb54003980 2024-01-15T11:32:55.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.024+0000 7feb64ff9640 1 -- 172.21.15.27:0/3496551868 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7feb58032060 con 0x7feb54003980 2024-01-15T11:32:55.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.092+0000 7feb6e05a640 1 -- 172.21.15.27:0/3496551868 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7feb680d1f00 con 0x7feb54003980 2024-01-15T11:32:55.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.096+0000 7feb64ff9640 1 -- 172.21.15.27:0/3496551868 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7feb58028070 con 0x7feb54003980 2024-01-15T11:32:55.097 INFO:teuthology.orchestra.run.smithi027.stderr:adjusted tunables profile to default 2024-01-15T11:32:55.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.096+0000 7feb6e05a640 1 -- 172.21.15.27:0/3496551868 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb54003980 msgr2=0x7feb68141060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:55.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.096+0000 7feb6e05a640 1 --2- 172.21.15.27:0/3496551868 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb54003980 0x7feb68141060 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feb58019710 tx=0x7feb58019b10 comp rx=0 tx=0).stop 2024-01-15T11:32:55.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.096+0000 7feb6e05a640 1 -- 172.21.15.27:0/3496551868 shutdown_connections 2024-01-15T11:32:55.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.096+0000 7feb6e05a640 1 --2- 172.21.15.27:0/3496551868 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feb54005260 0x7feb68144380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.096+0000 7feb6e05a640 1 --2- 172.21.15.27:0/3496551868 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feb540047d0 0x7feb680cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.096+0000 7feb6e05a640 1 --2- 172.21.15.27:0/3496551868 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feb54003980 0x7feb68141060 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.096+0000 7feb6e05a640 1 -- 172.21.15.27:0/3496551868 >> 172.21.15.27:0/3496551868 conn(0x7feb680b2f10 msgr2=0x7feb68145d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:32:55.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.096+0000 7feb6e05a640 1 -- 172.21.15.27:0/3496551868 shutdown_connections 2024-01-15T11:32:55.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:55.096+0000 7feb6e05a640 1 -- 172.21.15.27:0/3496551868 wait complete. 2024-01-15T11:32:55.118 INFO:tasks.ceph:check_enable_crimson: False 2024-01-15T11:32:55.118 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-01-15T11:32:55.119 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:32:55.119 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-01-15T11:32:55.140 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:32:55.140 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-01-15T11:32:55.201 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:32:55.201 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-01-15T11:32:55.213 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:32:55.206+0000 7fbf08f99180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-15T11:32:55.228 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-15T11:32:55.224+0000 7f9f6429b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-15T11:32:55.249 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:32:55.249 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-01-15T11:32:55.313 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:32:55.313 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-01-15T11:32:55.334 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:32:55.334 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-01-15T11:32:55.398 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:32:55.398 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-01-15T11:32:55.462 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:32:55.462 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-01-15T11:32:55.530 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph --cluster ceph osd new dbacd381-9dea-4b4e-8773-41d5cba18117 0 2024-01-15T11:32:55.713 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.706+0000 7f6437b01640 1 Processor -- start 2024-01-15T11:32:55.713 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.706+0000 7f6437b01640 1 -- start start 2024-01-15T11:32:55.715 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.710+0000 7f6437b01640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f643015d8f0 0x7f643015e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:55.715 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.710+0000 7f6437b01640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f64300d0510 0x7f64300d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:55.715 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.710+0000 7f6437b01640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f643015ecc0 con 0x7f64300ced30 2024-01-15T11:32:55.715 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.710+0000 7f6437b01640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64300d4420 con 0x7f64300d0510 2024-01-15T11:32:55.716 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.710+0000 7f6437b01640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64300cdfb0 con 0x7f643015d8f0 2024-01-15T11:32:55.716 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.710+0000 7f643589d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f643015d8f0 0x7f643015e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:55.716 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.710+0000 7f643589d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f643015d8f0 0x7f643015e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:50672/0 (socket says 172.21.15.93:50672) 2024-01-15T11:32:55.716 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.710+0000 7f643589d640 1 -- 172.21.15.93:0/29788414 learned_addr learned my addr 172.21.15.93:0/29788414 (peer_addr_for_me v2:172.21.15.93:0/0) 2024-01-15T11:32:55.716 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.710+0000 7f643609e640 1 --2- 172.21.15.93:0/29788414 >> v2:172.21.15.27:3300/0 conn(0x7f64300d0510 0x7f64300d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:55.716 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.710+0000 7f643589d640 1 -- 172.21.15.93:0/29788414 >> v2:172.21.15.27:3300/0 conn(0x7f64300d0510 msgr2=0x7f64300d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:32:55.716 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.710+0000 7f643589d640 1 --2- 172.21.15.93:0/29788414 >> v2:172.21.15.27:3300/0 conn(0x7f64300d0510 0x7f64300d1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.716 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.710+0000 7f643589d640 1 -- 172.21.15.93:0/29788414 >> v1:172.21.15.27:6789/0 conn(0x7f64300ced30 legacy=0x7f64300cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:32:55.716 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.710+0000 7f643589d640 1 -- 172.21.15.93:0/29788414 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64300d4140 con 0x7f643015d8f0 2024-01-15T11:32:55.718 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.710+0000 7f643589d640 1 --2- 172.21.15.93:0/29788414 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f643015d8f0 0x7f643015e780 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f642c009870 tx=0x7f642c01c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71035502df78d809 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:32:55.718 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.714+0000 7f643489b640 1 -- 172.21.15.93:0/29788414 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c0aa5f0 con 0x7f643015d8f0 2024-01-15T11:32:55.718 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.714+0000 7f643489b640 1 -- 172.21.15.93:0/29788414 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c0aa750 con 0x7f643015d8f0 2024-01-15T11:32:55.719 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.714+0000 7f643489b640 1 -- 172.21.15.93:0/29788414 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c0aaae0 con 0x7f643015d8f0 2024-01-15T11:32:55.719 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.714+0000 7f6437b01640 1 -- 172.21.15.93:0/29788414 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f643015d8f0 msgr2=0x7f643015e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:55.719 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.714+0000 7f6437b01640 1 --2- 172.21.15.93:0/29788414 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f643015d8f0 0x7f643015e780 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f642c009870 tx=0x7f642c01c490 comp rx=0 tx=0).stop 2024-01-15T11:32:55.720 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.714+0000 7f6437b01640 1 -- 172.21.15.93:0/29788414 shutdown_connections 2024-01-15T11:32:55.720 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.714+0000 7f6437b01640 1 --2- 172.21.15.93:0/29788414 >> v2:172.21.15.27:3300/0 conn(0x7f64300d0510 0x7f64300d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.720 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.714+0000 7f6437b01640 1 --2- 172.21.15.93:0/29788414 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f643015d8f0 0x7f643015e780 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.720 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.714+0000 7f6437b01640 1 -- 172.21.15.93:0/29788414 >> 172.21.15.93:0/29788414 conn(0x7f643009c750 msgr2=0x7f64300d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:32:55.720 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.714+0000 7f6437b01640 1 -- 172.21.15.93:0/29788414 shutdown_connections 2024-01-15T11:32:55.720 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.714+0000 7f6437b01640 1 -- 172.21.15.93:0/29788414 wait complete. 2024-01-15T11:32:55.720 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:32:55.714+0000 7fbf08f99180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-15T11:32:55.721 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.714+0000 7f6437b01640 1 Processor -- start 2024-01-15T11:32:55.721 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.714+0000 7f6437b01640 1 -- start start 2024-01-15T11:32:55.724 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.714+0000 7f6437b01640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f64300ced30 0x7f643015a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:55.724 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.714+0000 7f6437b01640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64300d0510 0x7f64300cba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:55.724 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.714+0000 7f6437b01640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f643015d8f0 0x7f64300cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:55.724 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.714+0000 7f6437b01640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64300b7270 con 0x7f643015d8f0 2024-01-15T11:32:55.724 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.714+0000 7f6437b01640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64300a08a0 con 0x7f64300ced30 2024-01-15T11:32:55.724 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.714+0000 7f6437b01640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64300a0b80 con 0x7f64300d0510 2024-01-15T11:32:55.725 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.718+0000 7f643589d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f64300ced30 0x7f643015a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:55.725 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.718+0000 7f643509c640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64300d0510 0x7f64300cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:55.725 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.718+0000 7f643589d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f64300ced30 0x7f643015a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:50686/0 (socket says 172.21.15.93:50686) 2024-01-15T11:32:55.725 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.718+0000 7f643589d640 1 -- 172.21.15.93:0/1389289625 learned_addr learned my addr 172.21.15.93:0/1389289625 (peer_addr_for_me v2:172.21.15.93:0/0) 2024-01-15T11:32:55.725 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.718+0000 7f643609e640 1 --2- 172.21.15.93:0/1389289625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f643015d8f0 0x7f64300cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:55.725 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.718+0000 7f643589d640 1 -- 172.21.15.93:0/1389289625 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64300d0510 msgr2=0x7f64300cba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:55.725 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.718+0000 7f643589d640 1 --2- 172.21.15.93:0/1389289625 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64300d0510 0x7f64300cba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.725 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.718+0000 7f643589d640 1 -- 172.21.15.93:0/1389289625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f643015d8f0 msgr2=0x7f64300cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:55.725 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.718+0000 7f643589d640 1 --2- 172.21.15.93:0/1389289625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f643015d8f0 0x7f64300cbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.725 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.718+0000 7f643589d640 1 -- 172.21.15.93:0/1389289625 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c0094d0 con 0x7f64300ced30 2024-01-15T11:32:55.725 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.718+0000 7f643509c640 1 --2- 172.21.15.93:0/1389289625 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64300d0510 0x7f64300cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:32:55.725 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.718+0000 7f643609e640 1 --2- 172.21.15.93:0/1389289625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f643015d8f0 0x7f64300cbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:32:55.725 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.718+0000 7f643589d640 1 --2- 172.21.15.93:0/1389289625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f64300ced30 0x7f643015a220 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f642c0ac040 tx=0x7f642c01acd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:32:55.725 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.718+0000 7f64267fc640 1 -- 172.21.15.93:0/1389289625 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c0aa5f0 con 0x7f64300ced30 2024-01-15T11:32:55.726 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.718+0000 7f64267fc640 1 -- 172.21.15.93:0/1389289625 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c0b3800 con 0x7f64300ced30 2024-01-15T11:32:55.726 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.718+0000 7f64267fc640 1 -- 172.21.15.93:0/1389289625 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c0b3bb0 con 0x7f64300ced30 2024-01-15T11:32:55.726 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.718+0000 7f6437b01640 1 -- 172.21.15.93:0/1389289625 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64300a0e60 con 0x7f64300ced30 2024-01-15T11:32:55.726 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.718+0000 7f6437b01640 1 -- 172.21.15.93:0/1389289625 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64300a1140 con 0x7f64300ced30 2024-01-15T11:32:55.726 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.718+0000 7f64267fc640 1 -- 172.21.15.93:0/1389289625 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f642c0bd6f0 con 0x7f64300ced30 2024-01-15T11:32:55.726 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.718+0000 7f64267fc640 1 -- 172.21.15.93:0/1389289625 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f642c0a7070 con 0x7f64300ced30 2024-01-15T11:32:55.726 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.718+0000 7f6437b01640 1 -- 172.21.15.93:0/1389289625 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f643004e850 con 0x7f64300ced30 2024-01-15T11:32:55.728 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.722+0000 7f64267fc640 1 -- 172.21.15.93:0/1389289625 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f642c0c3060 con 0x7f64300ced30 2024-01-15T11:32:55.810 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.806+0000 7f6437b01640 1 -- 172.21.15.93:0/1389289625 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dbacd381-9dea-4b4e-8773-41d5cba18117", "id": 0} v 0) v1 -- 0x7f64300cd650 con 0x7f64300ced30 2024-01-15T11:32:55.818 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.810+0000 7f64267fc640 1 -- 172.21.15.93:0/1389289625 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dbacd381-9dea-4b4e-8773-41d5cba18117", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f642c0cc0b0 con 0x7f64300ced30 2024-01-15T11:32:55.818 INFO:teuthology.orchestra.run.smithi093.stdout:0 2024-01-15T11:32:55.819 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.814+0000 7f6437b01640 1 -- 172.21.15.93:0/1389289625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f64300ced30 msgr2=0x7f643015a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:55.819 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.814+0000 7f6437b01640 1 --2- 172.21.15.93:0/1389289625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f64300ced30 0x7f643015a220 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f642c0ac040 tx=0x7f642c01acd0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.819 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.814+0000 7f6437b01640 1 -- 172.21.15.93:0/1389289625 shutdown_connections 2024-01-15T11:32:55.819 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.814+0000 7f6437b01640 1 --2- 172.21.15.93:0/1389289625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f643015d8f0 0x7f64300cbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.819 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.814+0000 7f6437b01640 1 --2- 172.21.15.93:0/1389289625 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64300d0510 0x7f64300cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.819 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.814+0000 7f6437b01640 1 --2- 172.21.15.93:0/1389289625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f64300ced30 0x7f643015a220 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.819 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.814+0000 7f6437b01640 1 -- 172.21.15.93:0/1389289625 >> 172.21.15.93:0/1389289625 conn(0x7f643009c750 msgr2=0x7f64300b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:32:55.819 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.814+0000 7f6437b01640 1 -- 172.21.15.93:0/1389289625 shutdown_connections 2024-01-15T11:32:55.819 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.814+0000 7f6437b01640 1 -- 172.21.15.93:0/1389289625 wait complete. 2024-01-15T11:32:55.835 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-15T11:32:55.832+0000 7f9f6429b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-15T11:32:55.837 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph --cluster ceph osd new 40901daa-dded-4309-9f19-e932950da9ae 1 2024-01-15T11:32:55.962 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:32:55.954+0000 7fbf08f99180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-15T11:32:55.974 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48ca556640 1 Processor -- start 2024-01-15T11:32:55.974 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48ca556640 1 -- start start 2024-01-15T11:32:55.978 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48ca556640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f48c40d0190 0x7f48c4168400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:55.979 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48ca556640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c40d4230 con 0x7f48c415d550 2024-01-15T11:32:55.979 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48ca556640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c415dd00 con 0x7f48c40d3a00 2024-01-15T11:32:55.979 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48ca556640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c40d1210 con 0x7f48c40d0190 2024-01-15T11:32:55.979 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48c8d53640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f48c40d3a00 0x7f48c40cfa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:45156/0 (socket says 172.21.15.93:45156) 2024-01-15T11:32:55.979 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48c8d53640 1 -- 172.21.15.93:0/1673860400 learned_addr learned my addr 172.21.15.93:0/1673860400 (peer_addr_for_me v1:172.21.15.93:0/0) 2024-01-15T11:32:55.979 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48c9d55640 1 --2- 172.21.15.93:0/1673860400 >> v2:172.21.15.27:3300/0 conn(0x7f48c40d0190 0x7f48c4168400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:55.979 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48bbfff640 1 -- 172.21.15.93:0/1673860400 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975514105 0 0) 0x7f48c415dd00 con 0x7f48c40d3a00 2024-01-15T11:32:55.979 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48bbfff640 1 -- 172.21.15.93:0/1673860400 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48b0003530 con 0x7f48c40d3a00 2024-01-15T11:32:55.979 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48bbfff640 1 -- 172.21.15.93:0/1673860400 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838508412 0 0) 0x7f48c40d4230 con 0x7f48c415d550 2024-01-15T11:32:55.979 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48bbfff640 1 -- 172.21.15.93:0/1673860400 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48c415dd00 con 0x7f48c415d550 2024-01-15T11:32:55.979 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48bbfff640 1 -- 172.21.15.93:0/1673860400 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2874479957 0 0) 0x7f48b0003530 con 0x7f48c40d3a00 2024-01-15T11:32:55.980 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48bbfff640 1 -- 172.21.15.93:0/1673860400 >> v2:172.21.15.27:3300/0 conn(0x7f48c40d0190 msgr2=0x7f48c4168400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:32:55.980 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48bbfff640 1 --2- 172.21.15.93:0/1673860400 >> v2:172.21.15.27:3300/0 conn(0x7f48c40d0190 0x7f48c4168400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.980 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48bbfff640 1 -- 172.21.15.93:0/1673860400 >> v1:172.21.15.27:6789/0 conn(0x7f48c415d550 legacy=0x7f48c4161ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:55.980 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48bbfff640 1 -- 172.21.15.93:0/1673860400 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c40d3f50 con 0x7f48c40d3a00 2024-01-15T11:32:55.980 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48bbfff640 1 -- 172.21.15.93:0/1673860400 <== mon.1 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1394381265 0 0) 0x7f48b4001680 con 0x7f48c40d3a00 2024-01-15T11:32:55.980 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48bbfff640 1 -- 172.21.15.93:0/1673860400 >> v1:172.21.15.93:6789/0 conn(0x7f48c40d3a00 legacy=0x7f48c40cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:55.980 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48bbfff640 1 --2- 172.21.15.93:0/1673860400 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f48b0004b70 0x7f48b0004f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:55.980 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48bbfff640 1 --2- 172.21.15.93:0/1673860400 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f48b0003770 0x7f48b0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:55.980 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48bbfff640 1 --2- 172.21.15.93:0/1673860400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48b0004130 0x7f48b000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:55.980 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48bbfff640 1 -- 172.21.15.93:0/1673860400 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c0001240 con 0x7f48b0004130 2024-01-15T11:32:55.980 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48bbfff640 1 -- 172.21.15.93:0/1673860400 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c40d1210 con 0x7f48b0003770 2024-01-15T11:32:55.980 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48bbfff640 1 -- 172.21.15.93:0/1673860400 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b000bf80 con 0x7f48b0004b70 2024-01-15T11:32:55.981 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48c9d55640 1 --2- 172.21.15.93:0/1673860400 >> v2:172.21.15.27:3300/0 conn(0x7f48c40d0190 0x7f48c4168400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:32:55.981 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48c9554640 1 --2- 172.21.15.93:0/1673860400 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f48b0004b70 0x7f48b0004f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:55.981 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48c8d53640 1 --2- 172.21.15.93:0/1673860400 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f48b0003770 0x7f48b0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:55.981 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48c9d55640 1 --2- 172.21.15.93:0/1673860400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48b0004130 0x7f48b000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:55.981 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48c9554640 1 -- 172.21.15.93:0/1673860400 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f48b0003770 msgr2=0x7f48b0003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:32:55.981 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48c9554640 1 --2- 172.21.15.93:0/1673860400 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f48b0003770 0x7f48b0003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.981 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48c9554640 1 -- 172.21.15.93:0/1673860400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48b0004130 msgr2=0x7f48b000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:32:55.981 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48c9554640 1 --2- 172.21.15.93:0/1673860400 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48b0004130 0x7f48b000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.981 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48c9554640 1 -- 172.21.15.93:0/1673860400 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b0003530 con 0x7f48b0004b70 2024-01-15T11:32:55.981 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.970+0000 7f48c9d55640 1 -- 172.21.15.93:0/1673860400 reap_dead start 2024-01-15T11:32:55.982 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.974+0000 7f48c9554640 1 --2- 172.21.15.93:0/1673860400 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f48b0004b70 0x7f48b0004f50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f48c0007f10 tx=0x7f48c001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5acba9147665c128 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:32:55.982 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.974+0000 7f48bbfff640 1 -- 172.21.15.93:0/1673860400 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c0005270 con 0x7f48b0004b70 2024-01-15T11:32:55.983 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.974+0000 7f48bbfff640 1 -- 172.21.15.93:0/1673860400 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c00053f0 con 0x7f48b0004b70 2024-01-15T11:32:55.983 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.974+0000 7f48bbfff640 1 -- 172.21.15.93:0/1673860400 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c00a5850 con 0x7f48b0004b70 2024-01-15T11:32:55.983 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.974+0000 7f48ca556640 1 -- 172.21.15.93:0/1673860400 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f48b0004b70 msgr2=0x7f48b0004f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:55.983 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.974+0000 7f48ca556640 1 --2- 172.21.15.93:0/1673860400 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f48b0004b70 0x7f48b0004f50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f48c0007f10 tx=0x7f48c001c920 comp rx=0 tx=0).stop 2024-01-15T11:32:55.983 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.974+0000 7f48ca556640 1 -- 172.21.15.93:0/1673860400 shutdown_connections 2024-01-15T11:32:55.983 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.974+0000 7f48ca556640 1 --2- 172.21.15.93:0/1673860400 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f48b0004b70 0x7f48b0004f50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.983 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.974+0000 7f48ca556640 1 -- 172.21.15.93:0/1673860400 >> 172.21.15.93:0/1673860400 conn(0x7f48c409c670 msgr2=0x7f48c40d32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:32:55.983 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.974+0000 7f48ca556640 1 -- 172.21.15.93:0/1673860400 shutdown_connections 2024-01-15T11:32:55.983 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.974+0000 7f48ca556640 1 -- 172.21.15.93:0/1673860400 wait complete. 2024-01-15T11:32:55.984 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.978+0000 7f48ca556640 1 Processor -- start 2024-01-15T11:32:55.985 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.978+0000 7f48ca556640 1 -- start start 2024-01-15T11:32:55.988 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.982+0000 7f48ca556640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48b0004b70 0x7f48c415b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:55.988 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.982+0000 7f48ca556640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f48c415b740 0x7f48c40b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:55.989 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.982+0000 7f48ca556640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f48c4153540 0x7f48c40b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:55.989 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.982+0000 7f48ca556640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c415abf0 con 0x7f48b0004b70 2024-01-15T11:32:55.989 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.982+0000 7f48ca556640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c40b8500 con 0x7f48c4153540 2024-01-15T11:32:55.989 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.982+0000 7f48ca556640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c4159b50 con 0x7f48c415b740 2024-01-15T11:32:55.989 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.982+0000 7f48c9d55640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f48c4153540 0x7f48c40b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:55.989 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.982+0000 7f48c8d53640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f48c415b740 0x7f48c40b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:55.989 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.982+0000 7f48c8d53640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f48c415b740 0x7f48c40b0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.93:47456/0 (socket says 172.21.15.93:47456) 2024-01-15T11:32:55.989 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.982+0000 7f48c8d53640 1 -- 172.21.15.93:0/730781281 learned_addr learned my addr 172.21.15.93:0/730781281 (peer_addr_for_me v2:172.21.15.93:0/0) 2024-01-15T11:32:55.989 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.982+0000 7f48c9554640 1 --2- 172.21.15.93:0/730781281 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48b0004b70 0x7f48c415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:55.989 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.982+0000 7f48c8d53640 1 -- 172.21.15.93:0/730781281 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f48c4153540 msgr2=0x7f48c40b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:55.989 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.982+0000 7f48c8d53640 1 --2- 172.21.15.93:0/730781281 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f48c4153540 0x7f48c40b13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.990 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.982+0000 7f48c8d53640 1 -- 172.21.15.93:0/730781281 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48b0004b70 msgr2=0x7f48c415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:55.990 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.982+0000 7f48c8d53640 1 --2- 172.21.15.93:0/730781281 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48b0004b70 0x7f48c415b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:55.990 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.982+0000 7f48c8d53640 1 -- 172.21.15.93:0/730781281 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c4159e30 con 0x7f48c415b740 2024-01-15T11:32:55.990 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.982+0000 7f48c8d53640 1 --2- 172.21.15.93:0/730781281 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f48c415b740 0x7f48c40b0e70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f48b4004ed0 tx=0x7f48b4007430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:32:55.990 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.982+0000 7f48b9ffb640 1 -- 172.21.15.93:0/730781281 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b400f730 con 0x7f48c415b740 2024-01-15T11:32:55.990 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.982+0000 7f48b9ffb640 1 -- 172.21.15.93:0/730781281 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b400f8b0 con 0x7f48c415b740 2024-01-15T11:32:55.990 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.982+0000 7f48b9ffb640 1 -- 172.21.15.93:0/730781281 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b400fc60 con 0x7f48c415b740 2024-01-15T11:32:55.990 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.982+0000 7f48ca556640 1 -- 172.21.15.93:0/730781281 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c415a110 con 0x7f48c415b740 2024-01-15T11:32:55.990 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.982+0000 7f48b9ffb640 1 -- 172.21.15.93:0/730781281 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f48b401d760 con 0x7f48c415b740 2024-01-15T11:32:55.990 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.982+0000 7f48ca556640 1 -- 172.21.15.93:0/730781281 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c415a6d0 con 0x7f48c415b740 2024-01-15T11:32:55.990 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.982+0000 7f48b9ffb640 1 -- 172.21.15.93:0/730781281 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f48b40134e0 con 0x7f48c415b740 2024-01-15T11:32:55.991 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.982+0000 7f48ca556640 1 -- 172.21.15.93:0/730781281 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c415a8c0 con 0x7f48c415b740 2024-01-15T11:32:55.992 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:55.986+0000 7f48b9ffb640 1 -- 172.21.15.93:0/730781281 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f48b40136a0 con 0x7f48c415b740 2024-01-15T11:32:56.060 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.054+0000 7f48ca556640 1 -- 172.21.15.93:0/730781281 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "osd new", "uuid": "40901daa-dded-4309-9f19-e932950da9ae", "id": 1} v 0) v1 -- 0x7f48c4074990 con 0x7f48c415b740 2024-01-15T11:32:56.062 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-15T11:32:56.060+0000 7f9f6429b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-15T11:32:56.067 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.062+0000 7f48b9ffb640 1 -- 172.21.15.93:0/730781281 <== mon.2 v2:172.21.15.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "40901daa-dded-4309-9f19-e932950da9ae", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f48b4013840 con 0x7f48c415b740 2024-01-15T11:32:56.068 INFO:teuthology.orchestra.run.smithi093.stdout:1 2024-01-15T11:32:56.069 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.062+0000 7f48ca556640 1 -- 172.21.15.93:0/730781281 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f48c415b740 msgr2=0x7f48c40b0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:56.069 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.062+0000 7f48ca556640 1 --2- 172.21.15.93:0/730781281 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f48c415b740 0x7f48c40b0e70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f48b4004ed0 tx=0x7f48b4007430 comp rx=0 tx=0).stop 2024-01-15T11:32:56.069 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.062+0000 7f48ca556640 1 -- 172.21.15.93:0/730781281 shutdown_connections 2024-01-15T11:32:56.069 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.062+0000 7f48ca556640 1 --2- 172.21.15.93:0/730781281 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f48c4153540 0x7f48c40b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.070 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.062+0000 7f48ca556640 1 --2- 172.21.15.93:0/730781281 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f48c415b740 0x7f48c40b0e70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.070 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.062+0000 7f48ca556640 1 --2- 172.21.15.93:0/730781281 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48b0004b70 0x7f48c415b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.070 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.062+0000 7f48ca556640 1 -- 172.21.15.93:0/730781281 >> 172.21.15.93:0/730781281 conn(0x7f48c409c670 msgr2=0x7f48c40d1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:32:56.070 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.062+0000 7f48ca556640 1 -- 172.21.15.93:0/730781281 shutdown_connections 2024-01-15T11:32:56.070 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.062+0000 7f48ca556640 1 -- 172.21.15.93:0/730781281 wait complete. 2024-01-15T11:32:56.095 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph --cluster ceph osd new 39d921fb-8f9c-477c-9d98-a9507c560242 2 2024-01-15T11:32:56.231 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.226+0000 7fa742f2a640 1 Processor -- start 2024-01-15T11:32:56.232 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.226+0000 7fa742f2a640 1 -- start start 2024-01-15T11:32:56.233 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.226+0000 7fa742f2a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa73c0d0510 0x7fa73c0d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:56.234 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.226+0000 7fa742f2a640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73c0cdfb0 con 0x7fa73c0ced30 2024-01-15T11:32:56.234 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.226+0000 7fa742f2a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73c0d4140 con 0x7fa73c15d8f0 2024-01-15T11:32:56.234 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.226+0000 7fa742f2a640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c0d4420 con 0x7fa73c0d0510 2024-01-15T11:32:56.234 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.226+0000 7fa7414c7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa73c0d0510 0x7fa73c0d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:56.234 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.226+0000 7fa7414c7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa73c0d0510 0x7fa73c0d1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:50698/0 (socket says 172.21.15.93:50698) 2024-01-15T11:32:56.234 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.226+0000 7fa7414c7640 1 -- 172.21.15.93:0/4075064451 learned_addr learned my addr 172.21.15.93:0/4075064451 (peer_addr_for_me v2:172.21.15.93:0/0) 2024-01-15T11:32:56.234 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.226+0000 7fa7414c7640 1 -- 172.21.15.93:0/4075064451 >> v1:172.21.15.93:6789/0 conn(0x7fa73c15d8f0 legacy=0x7fa73c15e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:56.234 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.226+0000 7fa7414c7640 1 -- 172.21.15.93:0/4075064451 >> v1:172.21.15.27:6789/0 conn(0x7fa73c0ced30 legacy=0x7fa73c0cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:56.234 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.226+0000 7fa7414c7640 1 -- 172.21.15.93:0/4075064451 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c0ce250 con 0x7fa73c0d0510 2024-01-15T11:32:56.237 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.230+0000 7fa7414c7640 1 --2- 172.21.15.93:0/4075064451 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa73c0d0510 0x7fa73c0d1000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa734009e50 tx=0x7fa73401c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79906db68be5df31 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:32:56.238 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.230+0000 7fa73b7fe640 1 -- 172.21.15.93:0/4075064451 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7340a57c0 con 0x7fa73c0d0510 2024-01-15T11:32:56.238 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.230+0000 7fa73b7fe640 1 -- 172.21.15.93:0/4075064451 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7340a5920 con 0x7fa73c0d0510 2024-01-15T11:32:56.238 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.230+0000 7fa73b7fe640 1 -- 172.21.15.93:0/4075064451 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7340a5cb0 con 0x7fa73c0d0510 2024-01-15T11:32:56.238 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.230+0000 7fa742f2a640 1 -- 172.21.15.93:0/4075064451 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa73c0d0510 msgr2=0x7fa73c0d1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:56.238 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.230+0000 7fa742f2a640 1 --2- 172.21.15.93:0/4075064451 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa73c0d0510 0x7fa73c0d1000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa734009e50 tx=0x7fa73401c9e0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.238 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.230+0000 7fa742f2a640 1 -- 172.21.15.93:0/4075064451 shutdown_connections 2024-01-15T11:32:56.238 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.230+0000 7fa742f2a640 1 --2- 172.21.15.93:0/4075064451 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa73c0d0510 0x7fa73c0d1000 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.238 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.230+0000 7fa742f2a640 1 -- 172.21.15.93:0/4075064451 >> 172.21.15.93:0/4075064451 conn(0x7fa73c09c750 msgr2=0x7fa73c0d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:32:56.238 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.230+0000 7fa742f2a640 1 -- 172.21.15.93:0/4075064451 shutdown_connections 2024-01-15T11:32:56.238 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.230+0000 7fa742f2a640 1 -- 172.21.15.93:0/4075064451 wait complete. 2024-01-15T11:32:56.240 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.234+0000 7fa742f2a640 1 Processor -- start 2024-01-15T11:32:56.240 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.234+0000 7fa742f2a640 1 -- start start 2024-01-15T11:32:56.245 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.234+0000 7fa742f2a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa73c0ced30 0x7fa73c0cb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:56.245 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.234+0000 7fa742f2a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa73c0d0510 0x7fa73c0cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:56.245 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.234+0000 7fa742f2a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa73c15d8f0 0x7fa73c151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:56.245 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.234+0000 7fa742f2a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0cc570 con 0x7fa73c15d8f0 2024-01-15T11:32:56.245 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.234+0000 7fa742f2a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c152a70 con 0x7fa73c0d0510 2024-01-15T11:32:56.245 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.234+0000 7fa742f2a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0cd3f0 con 0x7fa73c0ced30 2024-01-15T11:32:56.245 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.234+0000 7fa73bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa73c0d0510 0x7fa73c0cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:56.245 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.234+0000 7fa740cc6640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa73c0ced30 0x7fa73c0cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:56.246 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.238+0000 7fa73bfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa73c0d0510 0x7fa73c0cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:50714/0 (socket says 172.21.15.93:50714) 2024-01-15T11:32:56.246 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.238+0000 7fa73bfff640 1 -- 172.21.15.93:0/2949989784 learned_addr learned my addr 172.21.15.93:0/2949989784 (peer_addr_for_me v2:172.21.15.93:0/0) 2024-01-15T11:32:56.246 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.238+0000 7fa7414c7640 1 --2- 172.21.15.93:0/2949989784 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa73c15d8f0 0x7fa73c151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:56.246 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.238+0000 7fa73bfff640 1 -- 172.21.15.93:0/2949989784 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa73c0ced30 msgr2=0x7fa73c0cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:56.246 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.238+0000 7fa73bfff640 1 --2- 172.21.15.93:0/2949989784 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa73c0ced30 0x7fa73c0cb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.246 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.238+0000 7fa73bfff640 1 -- 172.21.15.93:0/2949989784 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa73c15d8f0 msgr2=0x7fa73c151f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:56.246 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.238+0000 7fa73bfff640 1 --2- 172.21.15.93:0/2949989784 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa73c15d8f0 0x7fa73c151f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.246 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.238+0000 7fa73bfff640 1 -- 172.21.15.93:0/2949989784 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa734009b30 con 0x7fa73c0d0510 2024-01-15T11:32:56.246 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.238+0000 7fa740cc6640 1 --2- 172.21.15.93:0/2949989784 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa73c0ced30 0x7fa73c0cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:32:56.246 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.238+0000 7fa73bfff640 1 --2- 172.21.15.93:0/2949989784 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa73c0d0510 0x7fa73c0cceb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa72800c3c0 tx=0x7fa72800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:32:56.247 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.238+0000 7fa7397fa640 1 -- 172.21.15.93:0/2949989784 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7280052d0 con 0x7fa73c0d0510 2024-01-15T11:32:56.247 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.238+0000 7fa7397fa640 1 -- 172.21.15.93:0/2949989784 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa728005430 con 0x7fa73c0d0510 2024-01-15T11:32:56.247 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.238+0000 7fa7397fa640 1 -- 172.21.15.93:0/2949989784 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728003840 con 0x7fa73c0d0510 2024-01-15T11:32:56.247 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.238+0000 7fa742f2a640 1 -- 172.21.15.93:0/2949989784 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c0cb8f0 con 0x7fa73c0d0510 2024-01-15T11:32:56.247 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.238+0000 7fa742f2a640 1 -- 172.21.15.93:0/2949989784 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c0cbeb0 con 0x7fa73c0d0510 2024-01-15T11:32:56.247 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.238+0000 7fa7397fa640 1 -- 172.21.15.93:0/2949989784 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa728003ca0 con 0x7fa73c0d0510 2024-01-15T11:32:56.247 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.238+0000 7fa7397fa640 1 -- 172.21.15.93:0/2949989784 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fa728011ea0 con 0x7fa73c0d0510 2024-01-15T11:32:56.247 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.238+0000 7fa742f2a640 1 -- 172.21.15.93:0/2949989784 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73c0cc6b0 con 0x7fa73c0d0510 2024-01-15T11:32:56.248 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.242+0000 7fa7397fa640 1 -- 172.21.15.93:0/2949989784 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fa73c0cc6b0 con 0x7fa73c0d0510 2024-01-15T11:32:56.313 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.306+0000 7fa742f2a640 1 -- 172.21.15.93:0/2949989784 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd new", "uuid": "39d921fb-8f9c-477c-9d98-a9507c560242", "id": 2} v 0) v1 -- 0x7fa73c04e850 con 0x7fa73c0d0510 2024-01-15T11:32:56.319 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.314+0000 7fa7397fa640 1 -- 172.21.15.93:0/2949989784 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "39d921fb-8f9c-477c-9d98-a9507c560242", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa728017070 con 0x7fa73c0d0510 2024-01-15T11:32:56.320 INFO:teuthology.orchestra.run.smithi093.stdout:2 2024-01-15T11:32:56.321 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.314+0000 7fa742f2a640 1 -- 172.21.15.93:0/2949989784 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa73c0d0510 msgr2=0x7fa73c0cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:56.321 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.314+0000 7fa742f2a640 1 --2- 172.21.15.93:0/2949989784 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa73c0d0510 0x7fa73c0cceb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa72800c3c0 tx=0x7fa72800c880 comp rx=0 tx=0).stop 2024-01-15T11:32:56.321 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.314+0000 7fa742f2a640 1 -- 172.21.15.93:0/2949989784 shutdown_connections 2024-01-15T11:32:56.321 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.314+0000 7fa742f2a640 1 --2- 172.21.15.93:0/2949989784 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa73c15d8f0 0x7fa73c151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.321 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.314+0000 7fa742f2a640 1 --2- 172.21.15.93:0/2949989784 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa73c0d0510 0x7fa73c0cceb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.321 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.314+0000 7fa742f2a640 1 --2- 172.21.15.93:0/2949989784 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa73c0ced30 0x7fa73c0cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.321 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.314+0000 7fa742f2a640 1 -- 172.21.15.93:0/2949989784 >> 172.21.15.93:0/2949989784 conn(0x7fa73c09c750 msgr2=0x7fa73c06c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:32:56.321 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.314+0000 7fa742f2a640 1 -- 172.21.15.93:0/2949989784 shutdown_connections 2024-01-15T11:32:56.322 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.314+0000 7fa742f2a640 1 -- 172.21.15.93:0/2949989784 wait complete. 2024-01-15T11:32:56.339 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph --cluster ceph osd new 8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0 3 2024-01-15T11:32:56.477 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.470+0000 7f21d9710640 1 Processor -- start 2024-01-15T11:32:56.477 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.470+0000 7f21d9710640 1 -- start start 2024-01-15T11:32:56.479 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.470+0000 7f21d9710640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f21d415d550 0x7f21d4161ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:56.479 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.470+0000 7f21d9710640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f21d40d3a00 0x7f21d40cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:56.479 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.470+0000 7f21d9710640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d4161ff0 con 0x7f21d415e7a0 2024-01-15T11:32:56.479 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.470+0000 7f21d9710640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d40d1210 con 0x7f21d40d3a00 2024-01-15T11:32:56.479 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.470+0000 7f21d9710640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d40d4230 con 0x7f21d415d550 2024-01-15T11:32:56.479 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.470+0000 7f21d3fff640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f21d415d550 0x7f21d4161ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:56.479 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.474+0000 7f21d3fff640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f21d415d550 0x7f21d4161ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.93:47462/0 (socket says 172.21.15.93:47462) 2024-01-15T11:32:56.480 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.474+0000 7f21d3fff640 1 -- 172.21.15.93:0/3354929876 learned_addr learned my addr 172.21.15.93:0/3354929876 (peer_addr_for_me v2:172.21.15.93:0/0) 2024-01-15T11:32:56.480 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.474+0000 7f21d37fe640 1 --2- 172.21.15.93:0/3354929876 >> v2:172.21.15.27:3300/0 conn(0x7f21d40d3a00 0x7f21d40cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:56.480 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.474+0000 7f21d3fff640 1 -- 172.21.15.93:0/3354929876 >> v2:172.21.15.27:3300/0 conn(0x7f21d40d3a00 msgr2=0x7f21d40cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:32:56.480 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.474+0000 7f21d3fff640 1 --2- 172.21.15.93:0/3354929876 >> v2:172.21.15.27:3300/0 conn(0x7f21d40d3a00 0x7f21d40cfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.480 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.474+0000 7f21d3fff640 1 -- 172.21.15.93:0/3354929876 >> v1:172.21.15.27:6789/0 conn(0x7f21d415e7a0 legacy=0x7f21d40d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:56.480 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.474+0000 7f21d3fff640 1 -- 172.21.15.93:0/3354929876 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d415dd00 con 0x7f21d415d550 2024-01-15T11:32:56.482 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.474+0000 7f21d3fff640 1 --2- 172.21.15.93:0/3354929876 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f21d415d550 0x7f21d4161ab0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009870 tx=0x7f21c401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10dc22a9055ed2cc server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:32:56.482 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.474+0000 7f21d2ffd640 1 -- 172.21.15.93:0/3354929876 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c40ab620 con 0x7f21d415d550 2024-01-15T11:32:56.482 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.474+0000 7f21d2ffd640 1 -- 172.21.15.93:0/3354929876 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c40ab780 con 0x7f21d415d550 2024-01-15T11:32:56.482 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.474+0000 7f21d2ffd640 1 -- 172.21.15.93:0/3354929876 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c40abb10 con 0x7f21d415d550 2024-01-15T11:32:56.483 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.478+0000 7f21d9710640 1 -- 172.21.15.93:0/3354929876 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f21d415d550 msgr2=0x7f21d4161ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:56.483 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.478+0000 7f21d9710640 1 --2- 172.21.15.93:0/3354929876 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f21d415d550 0x7f21d4161ab0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009870 tx=0x7f21c401c510 comp rx=0 tx=0).stop 2024-01-15T11:32:56.484 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.478+0000 7f21d9710640 1 -- 172.21.15.93:0/3354929876 shutdown_connections 2024-01-15T11:32:56.484 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.478+0000 7f21d9710640 1 --2- 172.21.15.93:0/3354929876 >> v2:172.21.15.27:3300/0 conn(0x7f21d40d3a00 0x7f21d40cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.484 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.478+0000 7f21d9710640 1 --2- 172.21.15.93:0/3354929876 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f21d415d550 0x7f21d4161ab0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.484 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.478+0000 7f21d9710640 1 -- 172.21.15.93:0/3354929876 >> 172.21.15.93:0/3354929876 conn(0x7f21d409c670 msgr2=0x7f21d40d32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:32:56.484 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.478+0000 7f21d9710640 1 -- 172.21.15.93:0/3354929876 shutdown_connections 2024-01-15T11:32:56.484 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.478+0000 7f21d9710640 1 -- 172.21.15.93:0/3354929876 wait complete. 2024-01-15T11:32:56.485 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.478+0000 7f21d9710640 1 Processor -- start 2024-01-15T11:32:56.485 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.478+0000 7f21d9710640 1 -- start start 2024-01-15T11:32:56.488 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.478+0000 7f21d9710640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21d40d3a00 0x7f21d4151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:56.488 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.478+0000 7f21d9710640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21d415d550 0x7f21d415ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:56.488 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.478+0000 7f21d9710640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f21d415e7a0 0x7f21d4156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:56.488 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.478+0000 7f21d9710640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d4152390 con 0x7f21d415d550 2024-01-15T11:32:56.488 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.478+0000 7f21d9710640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d4152f10 con 0x7f21d40d3a00 2024-01-15T11:32:56.488 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.478+0000 7f21d9710640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d4153190 con 0x7f21d415e7a0 2024-01-15T11:32:56.489 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.478+0000 7f21d3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21d40d3a00 0x7f21d4151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:56.489 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.478+0000 7f21d8f0f640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f21d415e7a0 0x7f21d4156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:56.489 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.478+0000 7f21d3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21d40d3a00 0x7f21d4151e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:50720/0 (socket says 172.21.15.93:50720) 2024-01-15T11:32:56.489 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.478+0000 7f21d3fff640 1 -- 172.21.15.93:0/1325002769 learned_addr learned my addr 172.21.15.93:0/1325002769 (peer_addr_for_me v2:172.21.15.93:0/0) 2024-01-15T11:32:56.489 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.478+0000 7f21d8f0f640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f21d415e7a0 0x7f21d4156d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.93:47464/0 (socket says 172.21.15.93:47464) 2024-01-15T11:32:56.489 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.478+0000 7f21d37fe640 1 --2- 172.21.15.93:0/1325002769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21d415d550 0x7f21d415ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:56.489 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.482+0000 7f21d3fff640 1 -- 172.21.15.93:0/1325002769 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f21d415e7a0 msgr2=0x7f21d4156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:56.489 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.482+0000 7f21d3fff640 1 --2- 172.21.15.93:0/1325002769 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f21d415e7a0 0x7f21d4156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.489 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.482+0000 7f21d3fff640 1 -- 172.21.15.93:0/1325002769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21d415d550 msgr2=0x7f21d415ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:56.489 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.482+0000 7f21d3fff640 1 --2- 172.21.15.93:0/1325002769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21d415d550 0x7f21d415ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.489 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.482+0000 7f21d3fff640 1 -- 172.21.15.93:0/1325002769 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c40094d0 con 0x7f21d40d3a00 2024-01-15T11:32:56.489 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.482+0000 7f21d8f0f640 1 --2- 172.21.15.93:0/1325002769 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f21d415e7a0 0x7f21d4156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:32:56.490 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.482+0000 7f21d3fff640 1 --2- 172.21.15.93:0/1325002769 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21d40d3a00 0x7f21d4151e50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f21c401a140 tx=0x7f21c401ad50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:32:56.490 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.482+0000 7f21d0ff9640 1 -- 172.21.15.93:0/1325002769 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c40abe80 con 0x7f21d40d3a00 2024-01-15T11:32:56.490 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.482+0000 7f21d0ff9640 1 -- 172.21.15.93:0/1325002769 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c40be3f0 con 0x7f21d40d3a00 2024-01-15T11:32:56.490 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.482+0000 7f21d9710640 1 -- 172.21.15.93:0/1325002769 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d4153470 con 0x7f21d40d3a00 2024-01-15T11:32:56.490 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.482+0000 7f21d0ff9640 1 -- 172.21.15.93:0/1325002769 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c40be7a0 con 0x7f21d40d3a00 2024-01-15T11:32:56.490 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.482+0000 7f21d9710640 1 -- 172.21.15.93:0/1325002769 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d415c0c0 con 0x7f21d40d3a00 2024-01-15T11:32:56.490 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.482+0000 7f21d0ff9640 1 -- 172.21.15.93:0/1325002769 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f21c40bec00 con 0x7f21d40d3a00 2024-01-15T11:32:56.490 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.482+0000 7f21d0ff9640 1 -- 172.21.15.93:0/1325002769 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f21c40b4c10 con 0x7f21d40d3a00 2024-01-15T11:32:56.491 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.482+0000 7f21d9710640 1 -- 172.21.15.93:0/1325002769 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d415c2b0 con 0x7f21d40d3a00 2024-01-15T11:32:56.491 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.486+0000 7f21d0ff9640 1 -- 172.21.15.93:0/1325002769 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f21c40b43f0 con 0x7f21d40d3a00 2024-01-15T11:32:56.570 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.566+0000 7f21d9710640 1 -- 172.21.15.93:0/1325002769 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0", "id": 3} v 0) v1 -- 0x7f21d4074990 con 0x7f21d40d3a00 2024-01-15T11:32:56.576 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.570+0000 7f21d0ff9640 1 -- 172.21.15.93:0/1325002769 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f21c40b4e60 con 0x7f21d40d3a00 2024-01-15T11:32:56.577 INFO:teuthology.orchestra.run.smithi093.stdout:3 2024-01-15T11:32:56.578 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.570+0000 7f21d9710640 1 -- 172.21.15.93:0/1325002769 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21d40d3a00 msgr2=0x7f21d4151e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:56.578 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.570+0000 7f21d9710640 1 --2- 172.21.15.93:0/1325002769 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21d40d3a00 0x7f21d4151e50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f21c401a140 tx=0x7f21c401ad50 comp rx=0 tx=0).stop 2024-01-15T11:32:56.578 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.570+0000 7f21d9710640 1 -- 172.21.15.93:0/1325002769 shutdown_connections 2024-01-15T11:32:56.578 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.570+0000 7f21d9710640 1 --2- 172.21.15.93:0/1325002769 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f21d415e7a0 0x7f21d4156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.578 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.570+0000 7f21d9710640 1 --2- 172.21.15.93:0/1325002769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21d415d550 0x7f21d415ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.578 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.570+0000 7f21d9710640 1 --2- 172.21.15.93:0/1325002769 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21d40d3a00 0x7f21d4151e50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.579 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.570+0000 7f21d9710640 1 -- 172.21.15.93:0/1325002769 >> 172.21.15.93:0/1325002769 conn(0x7f21d409c670 msgr2=0x7f21d40b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:32:56.579 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.570+0000 7f21d9710640 1 -- 172.21.15.93:0/1325002769 shutdown_connections 2024-01-15T11:32:56.579 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.570+0000 7f21d9710640 1 -- 172.21.15.93:0/1325002769 wait complete. 2024-01-15T11:32:56.596 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph --cluster ceph osd new e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f 4 2024-01-15T11:32:56.639 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:32:56.634+0000 7fbf08f99180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-15T11:32:56.703 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:32:56.698+0000 7fbf08f99180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-15T11:32:56.725 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-15T11:32:56.724+0000 7f9f6429b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-15T11:32:56.731 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.726+0000 7f019c10f640 1 Processor -- start 2024-01-15T11:32:56.732 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.726+0000 7f019c10f640 1 -- start start 2024-01-15T11:32:56.734 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.726+0000 7f019c10f640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f019415d8f0 0x7f019415e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:56.734 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.726+0000 7f019c10f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f01940ced30 0x7f01940cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:56.734 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.726+0000 7f019c10f640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f01940cf1b0 0x7f01940d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:56.734 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.726+0000 7f019c10f640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01940d4420 con 0x7f01940cf1b0 2024-01-15T11:32:56.734 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.726+0000 7f019c10f640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f019415ecc0 con 0x7f01940ced30 2024-01-15T11:32:56.734 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.726+0000 7f019c10f640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01940cdfb0 con 0x7f019415d8f0 2024-01-15T11:32:56.735 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.726+0000 7f0199eab640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f019415d8f0 0x7f019415e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:56.735 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.726+0000 7f01996aa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f01940ced30 0x7f01940cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:56.735 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.726+0000 7f01996aa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f01940ced30 0x7f01940cfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:50726/0 (socket says 172.21.15.93:50726) 2024-01-15T11:32:56.735 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.726+0000 7f01996aa640 1 -- 172.21.15.93:0/91156232 learned_addr learned my addr 172.21.15.93:0/91156232 (peer_addr_for_me v2:172.21.15.93:0/0) 2024-01-15T11:32:56.735 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.726+0000 7f0199eab640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f019415d8f0 0x7f019415e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.93:47474/0 (socket says 172.21.15.93:47474) 2024-01-15T11:32:56.735 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.726+0000 7f019a6ac640 1 --2- 172.21.15.93:0/91156232 >> v2:172.21.15.27:3300/0 conn(0x7f01940cf1b0 0x7f01940d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:56.735 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.726+0000 7f0199eab640 1 -- 172.21.15.93:0/91156232 >> v2:172.21.15.93:3300/0 conn(0x7f01940ced30 msgr2=0x7f01940cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:32:56.735 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.726+0000 7f0199eab640 1 --2- 172.21.15.93:0/91156232 >> v2:172.21.15.93:3300/0 conn(0x7f01940ced30 0x7f01940cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.735 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.726+0000 7f0199eab640 1 -- 172.21.15.93:0/91156232 >> v2:172.21.15.27:3300/0 conn(0x7f01940cf1b0 msgr2=0x7f01940d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:32:56.735 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.726+0000 7f0199eab640 1 --2- 172.21.15.93:0/91156232 >> v2:172.21.15.27:3300/0 conn(0x7f01940cf1b0 0x7f01940d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.735 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.726+0000 7f0199eab640 1 -- 172.21.15.93:0/91156232 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01940d4140 con 0x7f019415d8f0 2024-01-15T11:32:56.736 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.730+0000 7f0199eab640 1 --2- 172.21.15.93:0/91156232 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f019415d8f0 0x7f019415e780 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f019408c040 tx=0x7f019001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e11c332a807a15e server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:32:56.737 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.730+0000 7f0198ea9640 1 -- 172.21.15.93:0/91156232 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01900ab5f0 con 0x7f019415d8f0 2024-01-15T11:32:56.737 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.730+0000 7f0198ea9640 1 -- 172.21.15.93:0/91156232 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01900ab750 con 0x7f019415d8f0 2024-01-15T11:32:56.737 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.730+0000 7f0198ea9640 1 -- 172.21.15.93:0/91156232 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01900abae0 con 0x7f019415d8f0 2024-01-15T11:32:56.738 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.730+0000 7f019c10f640 1 -- 172.21.15.93:0/91156232 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f019415d8f0 msgr2=0x7f019415e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:56.738 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.730+0000 7f019c10f640 1 --2- 172.21.15.93:0/91156232 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f019415d8f0 0x7f019415e780 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f019408c040 tx=0x7f019001c430 comp rx=0 tx=0).stop 2024-01-15T11:32:56.738 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.730+0000 7f019c10f640 1 -- 172.21.15.93:0/91156232 shutdown_connections 2024-01-15T11:32:56.738 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.730+0000 7f019c10f640 1 --2- 172.21.15.93:0/91156232 >> v2:172.21.15.27:3300/0 conn(0x7f01940cf1b0 0x7f01940d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.738 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.730+0000 7f019c10f640 1 --2- 172.21.15.93:0/91156232 >> v2:172.21.15.93:3300/0 conn(0x7f01940ced30 0x7f01940cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.739 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.730+0000 7f019c10f640 1 --2- 172.21.15.93:0/91156232 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f019415d8f0 0x7f019415e780 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.739 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.730+0000 7f019c10f640 1 -- 172.21.15.93:0/91156232 >> 172.21.15.93:0/91156232 conn(0x7f019409c750 msgr2=0x7f01940d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:32:56.739 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.730+0000 7f019c10f640 1 -- 172.21.15.93:0/91156232 shutdown_connections 2024-01-15T11:32:56.739 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.730+0000 7f019c10f640 1 -- 172.21.15.93:0/91156232 wait complete. 2024-01-15T11:32:56.739 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f019c10f640 1 Processor -- start 2024-01-15T11:32:56.740 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f019c10f640 1 -- start start 2024-01-15T11:32:56.743 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f019c10f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01940ced30 0x7f01940b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:56.743 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f019c10f640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f01940cf1b0 0x7f0194151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:56.743 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f019c10f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f019415d8f0 0x7f01941551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:56.743 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f019c10f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01940b11b0 con 0x7f019415d8f0 2024-01-15T11:32:56.743 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f019c10f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01940b08e0 con 0x7f01940ced30 2024-01-15T11:32:56.743 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f019c10f640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0194156500 con 0x7f01940cf1b0 2024-01-15T11:32:56.743 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f0199eab640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01940ced30 0x7f01940b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:56.743 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f0199eab640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01940ced30 0x7f01940b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:50738/0 (socket says 172.21.15.93:50738) 2024-01-15T11:32:56.743 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f0199eab640 1 -- 172.21.15.93:0/3161032996 learned_addr learned my addr 172.21.15.93:0/3161032996 (peer_addr_for_me v2:172.21.15.93:0/0) 2024-01-15T11:32:56.744 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f01996aa640 1 --2- 172.21.15.93:0/3161032996 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f01940cf1b0 0x7f0194151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:56.744 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f019a6ac640 1 --2- 172.21.15.93:0/3161032996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f019415d8f0 0x7f01941551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:56.744 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f0199eab640 1 -- 172.21.15.93:0/3161032996 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f01940cf1b0 msgr2=0x7f0194151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:56.744 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f0199eab640 1 --2- 172.21.15.93:0/3161032996 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f01940cf1b0 0x7f0194151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.744 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f0199eab640 1 -- 172.21.15.93:0/3161032996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f019415d8f0 msgr2=0x7f01941551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:56.744 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f0199eab640 1 --2- 172.21.15.93:0/3161032996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f019415d8f0 0x7f01941551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.744 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f0199eab640 1 -- 172.21.15.93:0/3161032996 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0190009420 con 0x7f01940ced30 2024-01-15T11:32:56.744 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f0199eab640 1 --2- 172.21.15.93:0/3161032996 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01940ced30 0x7f01940b15d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f019001aae0 tx=0x7f01900191d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:32:56.744 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f018a7fc640 1 -- 172.21.15.93:0/3161032996 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01900abcd0 con 0x7f01940ced30 2024-01-15T11:32:56.745 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f018a7fc640 1 -- 172.21.15.93:0/3161032996 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01900abe30 con 0x7f01940ced30 2024-01-15T11:32:56.745 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f019c10f640 1 -- 172.21.15.93:0/3161032996 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0194154be0 con 0x7f01940ced30 2024-01-15T11:32:56.745 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f018a7fc640 1 -- 172.21.15.93:0/3161032996 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01900bf650 con 0x7f01940ced30 2024-01-15T11:32:56.745 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f019c10f640 1 -- 172.21.15.93:0/3161032996 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01940b0af0 con 0x7f01940ced30 2024-01-15T11:32:56.745 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f018a7fc640 1 -- 172.21.15.93:0/3161032996 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f01900bfab0 con 0x7f01940ced30 2024-01-15T11:32:56.745 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.734+0000 7f018a7fc640 1 -- 172.21.15.93:0/3161032996 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f01900a8050 con 0x7f01940ced30 2024-01-15T11:32:56.745 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.738+0000 7f019c10f640 1 -- 172.21.15.93:0/3161032996 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f019404e850 con 0x7f01940ced30 2024-01-15T11:32:56.745 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.738+0000 7f018a7fc640 1 -- 172.21.15.93:0/3161032996 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f01900bfd60 con 0x7f01940ced30 2024-01-15T11:32:56.767 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:32:56.762+0000 7fbf08f99180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-15T11:32:56.790 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-15T11:32:56.788+0000 7f9f6429b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-15T11:32:56.811 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.806+0000 7f019c10f640 1 -- 172.21.15.93:0/3161032996 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f", "id": 4} v 0) v1 -- 0x7f01940ca290 con 0x7f01940ced30 2024-01-15T11:32:56.817 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.810+0000 7f018a7fc640 1 -- 172.21.15.93:0/3161032996 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f01900c83f0 con 0x7f01940ced30 2024-01-15T11:32:56.817 INFO:teuthology.orchestra.run.smithi093.stdout:4 2024-01-15T11:32:56.818 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.810+0000 7f019c10f640 1 -- 172.21.15.93:0/3161032996 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01940ced30 msgr2=0x7f01940b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:56.818 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.810+0000 7f019c10f640 1 --2- 172.21.15.93:0/3161032996 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01940ced30 0x7f01940b15d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f019001aae0 tx=0x7f01900191d0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.818 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.810+0000 7f019c10f640 1 -- 172.21.15.93:0/3161032996 shutdown_connections 2024-01-15T11:32:56.819 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.810+0000 7f019c10f640 1 --2- 172.21.15.93:0/3161032996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f019415d8f0 0x7f01941551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.819 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.810+0000 7f019c10f640 1 --2- 172.21.15.93:0/3161032996 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f01940cf1b0 0x7f0194151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.819 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.810+0000 7f019c10f640 1 --2- 172.21.15.93:0/3161032996 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01940ced30 0x7f01940b15d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:56.819 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.810+0000 7f019c10f640 1 -- 172.21.15.93:0/3161032996 >> 172.21.15.93:0/3161032996 conn(0x7f019409c750 msgr2=0x7f01940735a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:32:56.819 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.810+0000 7f019c10f640 1 -- 172.21.15.93:0/3161032996 shutdown_connections 2024-01-15T11:32:56.819 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.810+0000 7f019c10f640 1 -- 172.21.15.93:0/3161032996 wait complete. 2024-01-15T11:32:56.837 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph --cluster ceph osd new 96910818-78ef-48a1-9c95-ba3c0efc7d73 5 2024-01-15T11:32:56.854 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-15T11:32:56.852+0000 7f9f6429b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-15T11:32:56.859 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:32:56.854+0000 7fbf08f99180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-15T11:32:56.922 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:32:56.918+0000 7fbf08f99180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-15T11:32:56.946 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-15T11:32:56.944+0000 7f9f6429b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-15T11:32:56.996 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.990+0000 7fbb66cd6640 1 Processor -- start 2024-01-15T11:32:56.997 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.990+0000 7fbb66cd6640 1 -- start start 2024-01-15T11:32:56.999 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.990+0000 7fbb66cd6640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbb6015d8f0 0x7fbb6015e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:56.999 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.990+0000 7fbb66cd6640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbb600d0510 0x7fbb600d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:56.999 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.990+0000 7fbb66cd6640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb6015ecc0 con 0x7fbb600ced30 2024-01-15T11:32:56.999 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.990+0000 7fbb66cd6640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb600d4420 con 0x7fbb6015d8f0 2024-01-15T11:32:56.999 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.990+0000 7fbb66cd6640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb600cdfb0 con 0x7fbb600d0510 2024-01-15T11:32:56.999 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.990+0000 7fbb5ffff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fbb600ced30 0x7fbb600cfe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:45178/0 (socket says 172.21.15.93:45178) 2024-01-15T11:32:56.999 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.990+0000 7fbb5ffff640 1 -- 172.21.15.93:0/1777259054 learned_addr learned my addr 172.21.15.93:0/1777259054 (peer_addr_for_me v1:172.21.15.93:0/0) 2024-01-15T11:32:57.000 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.990+0000 7fbb65273640 1 --2- 172.21.15.93:0/1777259054 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbb600d0510 0x7fbb600d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:57.000 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.994+0000 7fbb64a72640 1 --2- 172.21.15.93:0/1777259054 >> v2:172.21.15.27:3300/0 conn(0x7fbb6015d8f0 0x7fbb6015e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:57.000 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.994+0000 7fbb65273640 1 -- 172.21.15.93:0/1777259054 >> v2:172.21.15.27:3300/0 conn(0x7fbb6015d8f0 msgr2=0x7fbb6015e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:32:57.000 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.994+0000 7fbb65273640 1 --2- 172.21.15.93:0/1777259054 >> v2:172.21.15.27:3300/0 conn(0x7fbb6015d8f0 0x7fbb6015e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.000 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.994+0000 7fbb65273640 1 -- 172.21.15.93:0/1777259054 >> v1:172.21.15.93:6789/0 conn(0x7fbb600ced30 legacy=0x7fbb600cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:57.000 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.994+0000 7fbb65273640 1 -- 172.21.15.93:0/1777259054 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb600d4140 con 0x7fbb600d0510 2024-01-15T11:32:57.002 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.994+0000 7fbb65273640 1 --2- 172.21.15.93:0/1777259054 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbb600d0510 0x7fbb600d1000 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009dc0 tx=0x7fbb5801c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77a014a17ed86b6 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:32:57.003 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.998+0000 7fbb5f7fe640 1 -- 172.21.15.93:0/1777259054 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb580a58d0 con 0x7fbb600d0510 2024-01-15T11:32:57.003 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.998+0000 7fbb5f7fe640 1 -- 172.21.15.93:0/1777259054 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb580a5a30 con 0x7fbb600d0510 2024-01-15T11:32:57.003 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.998+0000 7fbb5f7fe640 1 -- 172.21.15.93:0/1777259054 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb580a5dc0 con 0x7fbb600d0510 2024-01-15T11:32:57.004 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.998+0000 7fbb66cd6640 1 -- 172.21.15.93:0/1777259054 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbb600d0510 msgr2=0x7fbb600d1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:57.004 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.998+0000 7fbb66cd6640 1 --2- 172.21.15.93:0/1777259054 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbb600d0510 0x7fbb600d1000 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009dc0 tx=0x7fbb5801c900 comp rx=0 tx=0).stop 2024-01-15T11:32:57.004 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.998+0000 7fbb66cd6640 1 -- 172.21.15.93:0/1777259054 shutdown_connections 2024-01-15T11:32:57.004 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.998+0000 7fbb66cd6640 1 --2- 172.21.15.93:0/1777259054 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbb600d0510 0x7fbb600d1000 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.004 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.998+0000 7fbb66cd6640 1 --2- 172.21.15.93:0/1777259054 >> v2:172.21.15.27:3300/0 conn(0x7fbb6015d8f0 0x7fbb6015e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.004 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.998+0000 7fbb66cd6640 1 -- 172.21.15.93:0/1777259054 >> 172.21.15.93:0/1777259054 conn(0x7fbb6009c750 msgr2=0x7fbb600d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:32:57.004 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.998+0000 7fbb66cd6640 1 -- 172.21.15.93:0/1777259054 shutdown_connections 2024-01-15T11:32:57.004 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.998+0000 7fbb66cd6640 1 -- 172.21.15.93:0/1777259054 wait complete. 2024-01-15T11:32:57.005 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.998+0000 7fbb66cd6640 1 Processor -- start 2024-01-15T11:32:57.005 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:56.998+0000 7fbb66cd6640 1 -- start start 2024-01-15T11:32:57.008 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb66cd6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb600ced30 0x7fbb600b6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:57.008 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb66cd6640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbb600d0510 0x7fbb600b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:57.008 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb66cd6640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb6015d8f0 0x7fbb600b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:57.009 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb66cd6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb600b7d70 con 0x7fbb600ced30 2024-01-15T11:32:57.009 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb66cd6640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb60154b90 con 0x7fbb6015d8f0 2024-01-15T11:32:57.009 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb66cd6640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb600b7160 con 0x7fbb600d0510 2024-01-15T11:32:57.009 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb65273640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb6015d8f0 0x7fbb600b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:57.009 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb5ffff640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbb600d0510 0x7fbb600b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:57.009 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb5ffff640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbb600d0510 0x7fbb600b4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.93:47498/0 (socket says 172.21.15.93:47498) 2024-01-15T11:32:57.009 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb5ffff640 1 -- 172.21.15.93:0/3513228741 learned_addr learned my addr 172.21.15.93:0/3513228741 (peer_addr_for_me v2:172.21.15.93:0/0) 2024-01-15T11:32:57.009 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb64a72640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb600ced30 0x7fbb600b6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:57.009 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb5ffff640 1 -- 172.21.15.93:0/3513228741 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb6015d8f0 msgr2=0x7fbb600b4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:57.009 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb5ffff640 1 --2- 172.21.15.93:0/3513228741 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb6015d8f0 0x7fbb600b4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.009 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb5ffff640 1 -- 172.21.15.93:0/3513228741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb600ced30 msgr2=0x7fbb600b6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:57.009 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb5ffff640 1 --2- 172.21.15.93:0/3513228741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb600ced30 0x7fbb600b6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.010 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb5ffff640 1 -- 172.21.15.93:0/3513228741 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb58009a70 con 0x7fbb600d0510 2024-01-15T11:32:57.010 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb65273640 1 --2- 172.21.15.93:0/3513228741 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb6015d8f0 0x7fbb600b4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:32:57.010 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb5ffff640 1 --2- 172.21.15.93:0/3513228741 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbb600d0510 0x7fbb600b4820 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c00c400 tx=0x7fbb4c00c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:32:57.010 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb5d7fa640 1 -- 172.21.15.93:0/3513228741 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c005cf0 con 0x7fbb600d0510 2024-01-15T11:32:57.010 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb5d7fa640 1 -- 172.21.15.93:0/3513228741 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4c005e50 con 0x7fbb600d0510 2024-01-15T11:32:57.010 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb66cd6640 1 -- 172.21.15.93:0/3513228741 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb600b7440 con 0x7fbb600d0510 2024-01-15T11:32:57.010 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb5d7fa640 1 -- 172.21.15.93:0/3513228741 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c0072d0 con 0x7fbb600d0510 2024-01-15T11:32:57.010 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb66cd6640 1 -- 172.21.15.93:0/3513228741 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb600b7a00 con 0x7fbb600d0510 2024-01-15T11:32:57.010 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb5d7fa640 1 -- 172.21.15.93:0/3513228741 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbb4c01c440 con 0x7fbb600d0510 2024-01-15T11:32:57.010 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb5d7fa640 1 -- 172.21.15.93:0/3513228741 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fbb4c01cc70 con 0x7fbb600d0510 2024-01-15T11:32:57.011 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-15T11:32:57.008+0000 7f9f6429b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-15T11:32:57.011 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.002+0000 7fbb66cd6640 1 -- 172.21.15.93:0/3513228741 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb6004e850 con 0x7fbb600d0510 2024-01-15T11:32:57.011 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.006+0000 7fbb5d7fa640 1 -- 172.21.15.93:0/3513228741 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fbb4c021060 con 0x7fbb600d0510 2024-01-15T11:32:57.018 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:32:57.014+0000 7fbf08f99180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-15T11:32:57.078 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.070+0000 7fbb66cd6640 1 -- 172.21.15.93:0/3513228741 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "osd new", "uuid": "96910818-78ef-48a1-9c95-ba3c0efc7d73", "id": 5} v 0) v1 -- 0x7fbb600cf9d0 con 0x7fbb600d0510 2024-01-15T11:32:57.079 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:32:57.074+0000 7fbf08f99180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-15T11:32:57.084 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.078+0000 7fbb5d7fa640 1 -- 172.21.15.93:0/3513228741 <== mon.2 v2:172.21.15.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "96910818-78ef-48a1-9c95-ba3c0efc7d73", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbb4c017070 con 0x7fbb600d0510 2024-01-15T11:32:57.084 INFO:teuthology.orchestra.run.smithi093.stdout:5 2024-01-15T11:32:57.085 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.078+0000 7fbb66cd6640 1 -- 172.21.15.93:0/3513228741 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbb600d0510 msgr2=0x7fbb600b4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:57.085 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.078+0000 7fbb66cd6640 1 --2- 172.21.15.93:0/3513228741 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbb600d0510 0x7fbb600b4820 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c00c400 tx=0x7fbb4c00c8c0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.086 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.078+0000 7fbb66cd6640 1 -- 172.21.15.93:0/3513228741 shutdown_connections 2024-01-15T11:32:57.086 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.078+0000 7fbb66cd6640 1 --2- 172.21.15.93:0/3513228741 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb6015d8f0 0x7fbb600b4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.086 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.078+0000 7fbb66cd6640 1 --2- 172.21.15.93:0/3513228741 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbb600d0510 0x7fbb600b4820 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.086 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.078+0000 7fbb66cd6640 1 --2- 172.21.15.93:0/3513228741 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbb600ced30 0x7fbb600b6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.086 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.078+0000 7fbb66cd6640 1 -- 172.21.15.93:0/3513228741 >> 172.21.15.93:0/3513228741 conn(0x7fbb6009c750 msgr2=0x7fbb6006c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:32:57.086 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.078+0000 7fbb66cd6640 1 -- 172.21.15.93:0/3513228741 shutdown_connections 2024-01-15T11:32:57.086 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.078+0000 7fbb66cd6640 1 -- 172.21.15.93:0/3513228741 wait complete. 2024-01-15T11:32:57.102 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-15T11:32:57.100+0000 7f9f6429b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-15T11:32:57.104 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph --cluster ceph osd new 23b0f723-79e4-414c-a01e-e7befa7ca49d 6 2024-01-15T11:32:57.165 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-15T11:32:57.164+0000 7f9f6429b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-15T11:32:57.241 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.234+0000 7f013c13e640 1 Processor -- start 2024-01-15T11:32:57.241 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.234+0000 7f013c13e640 1 -- start start 2024-01-15T11:32:57.243 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.234+0000 7f013c13e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f013415d950 0x7f01340d3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:57.243 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.234+0000 7f013c13e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f01340ce9f0 0x7f01340d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:57.244 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.234+0000 7f013c13e640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01340cef60 con 0x7f01340d1a20 2024-01-15T11:32:57.244 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.234+0000 7f013c13e640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01340d1e90 con 0x7f01340ce9f0 2024-01-15T11:32:57.244 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.234+0000 7f013c13e640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01340cf240 con 0x7f013415d950 2024-01-15T11:32:57.244 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.238+0000 7f0139eda640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f013415d950 0x7f01340d3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:57.244 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.238+0000 7f0139eda640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f013415d950 0x7f01340d3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:50758/0 (socket says 172.21.15.93:50758) 2024-01-15T11:32:57.244 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.238+0000 7f0139eda640 1 -- 172.21.15.93:0/3348485010 learned_addr learned my addr 172.21.15.93:0/3348485010 (peer_addr_for_me v2:172.21.15.93:0/0) 2024-01-15T11:32:57.244 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.238+0000 7f01396d9640 1 --2- 172.21.15.93:0/3348485010 >> v2:172.21.15.27:3300/0 conn(0x7f01340ce9f0 0x7f01340d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:57.244 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.238+0000 7f0139eda640 1 -- 172.21.15.93:0/3348485010 >> v2:172.21.15.27:3300/0 conn(0x7f01340ce9f0 msgr2=0x7f01340d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:32:57.245 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.238+0000 7f0139eda640 1 --2- 172.21.15.93:0/3348485010 >> v2:172.21.15.27:3300/0 conn(0x7f01340ce9f0 0x7f01340d14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.245 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.238+0000 7f0139eda640 1 -- 172.21.15.93:0/3348485010 >> v1:172.21.15.27:6789/0 conn(0x7f01340d1a20 legacy=0x7f01340cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:57.245 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.238+0000 7f0139eda640 1 -- 172.21.15.93:0/3348485010 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013406b710 con 0x7f013415d950 2024-01-15T11:32:57.245 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:32:57.238+0000 7fbf08f99180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-15T11:32:57.246 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.238+0000 7f0139eda640 1 --2- 172.21.15.93:0/3348485010 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f013415d950 0x7f01340d3ca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f013408d3f0 tx=0x7f013001c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb459fbda2e1e8be server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:32:57.247 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.242+0000 7f0138ed8640 1 -- 172.21.15.93:0/3348485010 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01300aa430 con 0x7f013415d950 2024-01-15T11:32:57.248 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.242+0000 7f0138ed8640 1 -- 172.21.15.93:0/3348485010 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01300aa590 con 0x7f013415d950 2024-01-15T11:32:57.248 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.242+0000 7f0138ed8640 1 -- 172.21.15.93:0/3348485010 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01300aa920 con 0x7f013415d950 2024-01-15T11:32:57.248 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.242+0000 7f013c13e640 1 -- 172.21.15.93:0/3348485010 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f013415d950 msgr2=0x7f01340d3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:57.248 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.242+0000 7f013c13e640 1 --2- 172.21.15.93:0/3348485010 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f013415d950 0x7f01340d3ca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f013408d3f0 tx=0x7f013001c4d0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.248 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.242+0000 7f013c13e640 1 -- 172.21.15.93:0/3348485010 shutdown_connections 2024-01-15T11:32:57.248 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.242+0000 7f013c13e640 1 --2- 172.21.15.93:0/3348485010 >> v2:172.21.15.27:3300/0 conn(0x7f01340ce9f0 0x7f01340d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.248 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.242+0000 7f013c13e640 1 --2- 172.21.15.93:0/3348485010 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f013415d950 0x7f01340d3ca0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.248 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.242+0000 7f013c13e640 1 -- 172.21.15.93:0/3348485010 >> 172.21.15.93:0/3348485010 conn(0x7f013408afc0 msgr2=0x7f01340d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:32:57.248 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.242+0000 7f013c13e640 1 -- 172.21.15.93:0/3348485010 shutdown_connections 2024-01-15T11:32:57.248 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.242+0000 7f013c13e640 1 -- 172.21.15.93:0/3348485010 wait complete. 2024-01-15T11:32:57.249 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.242+0000 7f013c13e640 1 Processor -- start 2024-01-15T11:32:57.249 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.242+0000 7f013c13e640 1 -- start start 2024-01-15T11:32:57.252 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.242+0000 7f013c13e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01340ce9f0 0x7f01340c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:57.252 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.242+0000 7f013c13e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f01340d1a20 0x7f0134158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:57.252 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.242+0000 7f013c13e640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f013415c280 0x7f01341589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:57.252 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.242+0000 7f013c13e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013415ce80 con 0x7f01340d1a20 2024-01-15T11:32:57.252 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.242+0000 7f013c13e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013415c830 con 0x7f01340ce9f0 2024-01-15T11:32:57.253 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.242+0000 7f013c13e640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013414c830 con 0x7f013415c280 2024-01-15T11:32:57.253 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.246+0000 7f0139eda640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01340ce9f0 0x7f01340c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:57.253 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.246+0000 7f0139eda640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01340ce9f0 0x7f01340c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:50762/0 (socket says 172.21.15.93:50762) 2024-01-15T11:32:57.253 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.246+0000 7f0139eda640 1 -- 172.21.15.93:0/3391892645 learned_addr learned my addr 172.21.15.93:0/3391892645 (peer_addr_for_me v2:172.21.15.93:0/0) 2024-01-15T11:32:57.253 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.246+0000 7f01396d9640 1 --2- 172.21.15.93:0/3391892645 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f01340d1a20 0x7f0134158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:57.253 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.246+0000 7f013a6db640 1 --2- 172.21.15.93:0/3391892645 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f013415c280 0x7f01341589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:57.253 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.246+0000 7f0139eda640 1 -- 172.21.15.93:0/3391892645 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f013415c280 msgr2=0x7f01341589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:57.253 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.246+0000 7f0139eda640 1 --2- 172.21.15.93:0/3391892645 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f013415c280 0x7f01341589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.253 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.246+0000 7f0139eda640 1 -- 172.21.15.93:0/3391892645 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f01340d1a20 msgr2=0x7f0134158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:57.253 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.246+0000 7f0139eda640 1 --2- 172.21.15.93:0/3391892645 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f01340d1a20 0x7f0134158490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.253 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.246+0000 7f0139eda640 1 -- 172.21.15.93:0/3391892645 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01300094d0 con 0x7f01340ce9f0 2024-01-15T11:32:57.254 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.246+0000 7f0139eda640 1 --2- 172.21.15.93:0/3391892645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01340ce9f0 0x7f01340c8660 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f01300ac040 tx=0x7f013001ad10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:32:57.254 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.246+0000 7f012a7fc640 1 -- 172.21.15.93:0/3391892645 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01300aa430 con 0x7f01340ce9f0 2024-01-15T11:32:57.254 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.246+0000 7f012a7fc640 1 -- 172.21.15.93:0/3391892645 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01300b3820 con 0x7f01340ce9f0 2024-01-15T11:32:57.254 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.246+0000 7f013c13e640 1 -- 172.21.15.93:0/3391892645 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f013415caa0 con 0x7f01340ce9f0 2024-01-15T11:32:57.254 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.246+0000 7f012a7fc640 1 -- 172.21.15.93:0/3391892645 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01300b3bd0 con 0x7f01340ce9f0 2024-01-15T11:32:57.254 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.246+0000 7f013c13e640 1 -- 172.21.15.93:0/3391892645 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f013414cb10 con 0x7f01340ce9f0 2024-01-15T11:32:57.254 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.246+0000 7f012a7fc640 1 -- 172.21.15.93:0/3391892645 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f01300bd6f0 con 0x7f01340ce9f0 2024-01-15T11:32:57.254 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.246+0000 7f012a7fc640 1 -- 172.21.15.93:0/3391892645 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f01300bca70 con 0x7f01340ce9f0 2024-01-15T11:32:57.255 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.246+0000 7f013c13e640 1 -- 172.21.15.93:0/3391892645 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f013415d1a0 con 0x7f01340ce9f0 2024-01-15T11:32:57.255 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.250+0000 7f012a7fc640 1 -- 172.21.15.93:0/3391892645 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f01300c3060 con 0x7f01340ce9f0 2024-01-15T11:32:57.314 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:32:57.310+0000 7fbf08f99180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-15T11:32:57.320 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.314+0000 7f013c13e640 1 -- 172.21.15.93:0/3391892645 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd new", "uuid": "23b0f723-79e4-414c-a01e-e7befa7ca49d", "id": 6} v 0) v1 -- 0x7f013404e850 con 0x7f01340ce9f0 2024-01-15T11:32:57.326 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.322+0000 7f012a7fc640 1 -- 172.21.15.93:0/3391892645 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "23b0f723-79e4-414c-a01e-e7befa7ca49d", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f01300bcc80 con 0x7f01340ce9f0 2024-01-15T11:32:57.327 INFO:teuthology.orchestra.run.smithi093.stdout:6 2024-01-15T11:32:57.328 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.322+0000 7f013c13e640 1 -- 172.21.15.93:0/3391892645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01340ce9f0 msgr2=0x7f01340c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:57.328 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.322+0000 7f013c13e640 1 --2- 172.21.15.93:0/3391892645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01340ce9f0 0x7f01340c8660 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f01300ac040 tx=0x7f013001ad10 comp rx=0 tx=0).stop 2024-01-15T11:32:57.328 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.322+0000 7f013c13e640 1 -- 172.21.15.93:0/3391892645 shutdown_connections 2024-01-15T11:32:57.328 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.322+0000 7f013c13e640 1 --2- 172.21.15.93:0/3391892645 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f013415c280 0x7f01341589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.328 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.322+0000 7f013c13e640 1 --2- 172.21.15.93:0/3391892645 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f01340d1a20 0x7f0134158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.328 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.322+0000 7f013c13e640 1 --2- 172.21.15.93:0/3391892645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01340ce9f0 0x7f01340c8660 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.328 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.322+0000 7f013c13e640 1 -- 172.21.15.93:0/3391892645 >> 172.21.15.93:0/3391892645 conn(0x7f013408afc0 msgr2=0x7f01340b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:32:57.329 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.322+0000 7f013c13e640 1 -- 172.21.15.93:0/3391892645 shutdown_connections 2024-01-15T11:32:57.329 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.322+0000 7f013c13e640 1 -- 172.21.15.93:0/3391892645 wait complete. 2024-01-15T11:32:57.329 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-15T11:32:57.328+0000 7f9f6429b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-15T11:32:57.346 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph --cluster ceph osd new a2b44835-210e-4e2a-aa00-2847ac6ac735 7 2024-01-15T11:32:57.401 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-15T11:32:57.400+0000 7f9f6429b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-15T11:32:57.482 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.474+0000 7f7588efe640 1 Processor -- start 2024-01-15T11:32:57.482 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.474+0000 7f7588efe640 1 -- start start 2024-01-15T11:32:57.484 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.478+0000 7f7588efe640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f75840ced30 0x7f75840cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:57.484 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.478+0000 7f7588efe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75840cdfb0 con 0x7f758415d8f0 2024-01-15T11:32:57.484 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.478+0000 7f7588efe640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75840d4140 con 0x7f75840cf1b0 2024-01-15T11:32:57.484 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.478+0000 7f7588efe640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75840d4420 con 0x7f75840ced30 2024-01-15T11:32:57.484 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.478+0000 7f7579d9b640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f75840ced30 0x7f75840cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:57.484 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.478+0000 7f7582d9d640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f75840cf1b0 0x7f75840d1000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:45194/0 (socket says 172.21.15.93:45194) 2024-01-15T11:32:57.484 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.478+0000 7f7582d9d640 1 -- 172.21.15.93:0/1700483820 learned_addr learned my addr 172.21.15.93:0/1700483820 (peer_addr_for_me v1:172.21.15.93:0/0) 2024-01-15T11:32:57.484 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.478+0000 7f7579d9b640 1 -- 172.21.15.93:0/1700483820 >> v1:172.21.15.93:6789/0 conn(0x7f75840cf1b0 legacy=0x7f75840d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:57.484 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.478+0000 7f7579d9b640 1 -- 172.21.15.93:0/1700483820 >> v1:172.21.15.27:6789/0 conn(0x7f758415d8f0 legacy=0x7f758415e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:57.485 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.478+0000 7f7579d9b640 1 -- 172.21.15.93:0/1700483820 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75840ce250 con 0x7f75840ced30 2024-01-15T11:32:57.487 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.482+0000 7f7579d9b640 1 --2- 172.21.15.93:0/1700483820 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f75840ced30 0x7f75840cfe00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f75740097f0 tx=0x7f757401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e738d078691daba5 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:32:57.488 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.482+0000 7f7581d9b640 1 -- 172.21.15.93:0/1700483820 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75740aa5f0 con 0x7f75840ced30 2024-01-15T11:32:57.488 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.482+0000 7f7581d9b640 1 -- 172.21.15.93:0/1700483820 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75740aa750 con 0x7f75840ced30 2024-01-15T11:32:57.488 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.482+0000 7f7581d9b640 1 -- 172.21.15.93:0/1700483820 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75740aaae0 con 0x7f75840ced30 2024-01-15T11:32:57.488 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.482+0000 7f7588efe640 1 -- 172.21.15.93:0/1700483820 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f75840ced30 msgr2=0x7f75840cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:57.488 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.482+0000 7f7588efe640 1 --2- 172.21.15.93:0/1700483820 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f75840ced30 0x7f75840cfe00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f75740097f0 tx=0x7f757401c490 comp rx=0 tx=0).stop 2024-01-15T11:32:57.488 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.482+0000 7f7588efe640 1 -- 172.21.15.93:0/1700483820 shutdown_connections 2024-01-15T11:32:57.488 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.482+0000 7f7588efe640 1 --2- 172.21.15.93:0/1700483820 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f75840ced30 0x7f75840cfe00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.488 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.482+0000 7f7588efe640 1 -- 172.21.15.93:0/1700483820 >> 172.21.15.93:0/1700483820 conn(0x7f758409c750 msgr2=0x7f75840d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:32:57.488 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.482+0000 7f7588efe640 1 -- 172.21.15.93:0/1700483820 shutdown_connections 2024-01-15T11:32:57.489 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.482+0000 7f7588efe640 1 -- 172.21.15.93:0/1700483820 wait complete. 2024-01-15T11:32:57.489 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.482+0000 7f7588efe640 1 Processor -- start 2024-01-15T11:32:57.490 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.482+0000 7f7588efe640 1 -- start start 2024-01-15T11:32:57.493 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.486+0000 7f7588efe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f75840ced30 0x7f75840cce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:57.493 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.486+0000 7f7588efe640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f75840cf1b0 0x7f75841580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:57.493 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.486+0000 7f7588efe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f758415d8f0 0x7f758414dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:57.493 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.486+0000 7f7588efe640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7584159400 con 0x7f758415d8f0 2024-01-15T11:32:57.493 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.486+0000 7f7588efe640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758414d240 con 0x7f75840ced30 2024-01-15T11:32:57.493 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.486+0000 7f7588efe640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7584158b60 con 0x7f75840cf1b0 2024-01-15T11:32:57.494 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.486+0000 7f7579d9b640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f75840cf1b0 0x7f75841580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:57.494 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.486+0000 7f758259c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f75840ced30 0x7f75840cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:57.494 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.486+0000 7f7579d9b640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f75840cf1b0 0x7f75841580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.93:47512/0 (socket says 172.21.15.93:47512) 2024-01-15T11:32:57.494 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.486+0000 7f7579d9b640 1 -- 172.21.15.93:0/678866343 learned_addr learned my addr 172.21.15.93:0/678866343 (peer_addr_for_me v2:172.21.15.93:0/0) 2024-01-15T11:32:57.494 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.486+0000 7f7582d9d640 1 --2- 172.21.15.93:0/678866343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f758415d8f0 0x7f758414dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:57.494 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.486+0000 7f7579d9b640 1 -- 172.21.15.93:0/678866343 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f75840ced30 msgr2=0x7f75840cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:57.494 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.486+0000 7f7579d9b640 1 --2- 172.21.15.93:0/678866343 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f75840ced30 0x7f75840cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.494 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.486+0000 7f7579d9b640 1 -- 172.21.15.93:0/678866343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f758415d8f0 msgr2=0x7f758414dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:57.494 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.486+0000 7f7579d9b640 1 --2- 172.21.15.93:0/678866343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f758415d8f0 0x7f758414dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.494 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.486+0000 7f7579d9b640 1 -- 172.21.15.93:0/678866343 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7574009420 con 0x7f75840cf1b0 2024-01-15T11:32:57.494 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.486+0000 7f7579d9b640 1 --2- 172.21.15.93:0/678866343 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f75840cf1b0 0x7f75841580a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f75740190a0 tx=0x7f757401acd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:32:57.495 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.486+0000 7f757b7fe640 1 -- 172.21.15.93:0/678866343 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75740b4810 con 0x7f75840cf1b0 2024-01-15T11:32:57.495 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.486+0000 7f757b7fe640 1 -- 172.21.15.93:0/678866343 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75740b4990 con 0x7f75840cf1b0 2024-01-15T11:32:57.495 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.486+0000 7f757b7fe640 1 -- 172.21.15.93:0/678866343 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75740b4d40 con 0x7f75840cf1b0 2024-01-15T11:32:57.495 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.486+0000 7f7588efe640 1 -- 172.21.15.93:0/678866343 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7584158e40 con 0x7f75840cf1b0 2024-01-15T11:32:57.495 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.486+0000 7f7588efe640 1 -- 172.21.15.93:0/678866343 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f758414d5b0 con 0x7f75840cf1b0 2024-01-15T11:32:57.495 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.486+0000 7f757b7fe640 1 -- 172.21.15.93:0/678866343 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f75740be710 con 0x7f75840cf1b0 2024-01-15T11:32:57.495 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.486+0000 7f757b7fe640 1 -- 172.21.15.93:0/678866343 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f75740a7070 con 0x7f75840cf1b0 2024-01-15T11:32:57.495 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.486+0000 7f7588efe640 1 -- 172.21.15.93:0/678866343 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f758414d410 con 0x7f75840cf1b0 2024-01-15T11:32:57.496 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.490+0000 7f757b7fe640 1 -- 172.21.15.93:0/678866343 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f758414d410 con 0x7f75840cf1b0 2024-01-15T11:32:57.561 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.554+0000 7f7588efe640 1 -- 172.21.15.93:0/678866343 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a2b44835-210e-4e2a-aa00-2847ac6ac735", "id": 7} v 0) v1 -- 0x7f758414d7a0 con 0x7f75840cf1b0 2024-01-15T11:32:57.568 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.562+0000 7f757b7fe640 1 -- 172.21.15.93:0/678866343 <== mon.2 v2:172.21.15.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a2b44835-210e-4e2a-aa00-2847ac6ac735", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f75740be9c0 con 0x7f75840cf1b0 2024-01-15T11:32:57.568 INFO:teuthology.orchestra.run.smithi093.stdout:7 2024-01-15T11:32:57.570 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.562+0000 7f7588efe640 1 -- 172.21.15.93:0/678866343 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f75840cf1b0 msgr2=0x7f75841580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:57.570 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.562+0000 7f7588efe640 1 --2- 172.21.15.93:0/678866343 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f75840cf1b0 0x7f75841580a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f75740190a0 tx=0x7f757401acd0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.570 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.562+0000 7f7588efe640 1 -- 172.21.15.93:0/678866343 shutdown_connections 2024-01-15T11:32:57.570 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.562+0000 7f7588efe640 1 --2- 172.21.15.93:0/678866343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f758415d8f0 0x7f758414dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.570 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.562+0000 7f7588efe640 1 --2- 172.21.15.93:0/678866343 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f75840cf1b0 0x7f75841580a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.570 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.562+0000 7f7588efe640 1 --2- 172.21.15.93:0/678866343 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f75840ced30 0x7f75840cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.570 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.562+0000 7f7588efe640 1 -- 172.21.15.93:0/678866343 >> 172.21.15.93:0/678866343 conn(0x7f758409c750 msgr2=0x7f758406c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:32:57.571 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.562+0000 7f7588efe640 1 -- 172.21.15.93:0/678866343 shutdown_connections 2024-01-15T11:32:57.571 INFO:teuthology.orchestra.run.smithi093.stderr:2024-01-15T11:32:57.562+0000 7f7588efe640 1 -- 172.21.15.93:0/678866343 wait complete. 2024-01-15T11:32:57.587 INFO:tasks.ceph.osd.0:Restarting daemon 2024-01-15T11:32:57.587 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-01-15T11:32:57.591 INFO:tasks.ceph.osd.0:Started 2024-01-15T11:32:57.591 INFO:tasks.ceph.osd.1:Restarting daemon 2024-01-15T11:32:57.592 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-01-15T11:32:57.598 INFO:tasks.ceph.osd.1:Started 2024-01-15T11:32:57.598 INFO:tasks.ceph.osd.2:Restarting daemon 2024-01-15T11:32:57.598 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-01-15T11:32:57.602 INFO:tasks.ceph.osd.2:Started 2024-01-15T11:32:57.602 INFO:tasks.ceph.osd.3:Restarting daemon 2024-01-15T11:32:57.602 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-01-15T11:32:57.606 INFO:tasks.ceph.osd.3:Started 2024-01-15T11:32:57.606 INFO:tasks.ceph.osd.4:Restarting daemon 2024-01-15T11:32:57.606 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-01-15T11:32:57.610 INFO:tasks.ceph.osd.4:Started 2024-01-15T11:32:57.610 INFO:tasks.ceph.osd.5:Restarting daemon 2024-01-15T11:32:57.611 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-01-15T11:32:57.614 INFO:tasks.ceph.osd.5:Started 2024-01-15T11:32:57.615 INFO:tasks.ceph.osd.6:Restarting daemon 2024-01-15T11:32:57.615 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-01-15T11:32:57.618 INFO:tasks.ceph.osd.6:Started 2024-01-15T11:32:57.619 INFO:tasks.ceph.osd.7:Restarting daemon 2024-01-15T11:32:57.619 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-01-15T11:32:57.623 INFO:tasks.ceph.osd.7:Started 2024-01-15T11:32:57.623 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:32:57.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.840+0000 7fac7626b640 1 Processor -- start 2024-01-15T11:32:57.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.840+0000 7fac7626b640 1 -- start start 2024-01-15T11:32:57.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.840+0000 7fac7626b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fac7015d7b0 0x7fac700d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:57.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.840+0000 7fac7626b640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fac700d2080 0x7fac7006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:57.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.840+0000 7fac7626b640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac700cefd0 con 0x7fac700cead0 2024-01-15T11:32:57.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.840+0000 7fac7626b640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac700cf2b0 con 0x7fac7015d7b0 2024-01-15T11:32:57.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.840+0000 7fac7626b640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7006b3f0 con 0x7fac700d2080 2024-01-15T11:32:57.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.840+0000 7fac74808640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fac700d2080 0x7fac7006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:57.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.840+0000 7fac6ffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fac7015d7b0 0x7fac700d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:57.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.840+0000 7fac6f7fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fac700cead0 0x7fac700d1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.27:43134/0 (socket says 172.21.15.27:43134) 2024-01-15T11:32:57.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.840+0000 7fac6f7fe640 1 -- 172.21.15.27:0/1198354834 learned_addr learned my addr 172.21.15.27:0/1198354834 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:32:57.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.840+0000 7fac6effd640 1 -- 172.21.15.27:0/1198354834 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852629394 0 0) 0x7fac700cefd0 con 0x7fac700cead0 2024-01-15T11:32:57.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.840+0000 7fac6effd640 1 -- 172.21.15.27:0/1198354834 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac58003530 con 0x7fac700cead0 2024-01-15T11:32:57.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.840+0000 7fac6ffff640 1 -- 172.21.15.27:0/1198354834 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fac700d2080 msgr2=0x7fac7006bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:32:57.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.840+0000 7fac6ffff640 1 --2- 172.21.15.27:0/1198354834 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fac700d2080 0x7fac7006bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.840+0000 7fac6ffff640 1 -- 172.21.15.27:0/1198354834 >> v1:172.21.15.93:6789/0 conn(0x7fac700cead0 legacy=0x7fac700d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:57.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.840+0000 7fac6ffff640 1 -- 172.21.15.27:0/1198354834 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7006b6d0 con 0x7fac7015d7b0 2024-01-15T11:32:57.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.840+0000 7fac74808640 1 --2- 172.21.15.27:0/1198354834 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fac700d2080 0x7fac7006bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:32:57.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.844+0000 7fac6ffff640 1 --2- 172.21.15.27:0/1198354834 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac7015d7b0 0x7fac700d10d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fac600097c0 tx=0x7fac6001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=539615e5f69862e server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:32:57.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.844+0000 7fac6effd640 1 -- 172.21.15.27:0/1198354834 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac60004230 con 0x7fac7015d7b0 2024-01-15T11:32:57.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.844+0000 7fac6effd640 1 -- 172.21.15.27:0/1198354834 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac600a7050 con 0x7fac7015d7b0 2024-01-15T11:32:57.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.844+0000 7fac6effd640 1 -- 172.21.15.27:0/1198354834 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac60003620 con 0x7fac7015d7b0 2024-01-15T11:32:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.844+0000 7fac7626b640 1 -- 172.21.15.27:0/1198354834 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac7015d7b0 msgr2=0x7fac700d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.844+0000 7fac7626b640 1 --2- 172.21.15.27:0/1198354834 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac7015d7b0 0x7fac700d10d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fac600097c0 tx=0x7fac6001c330 comp rx=0 tx=0).stop 2024-01-15T11:32:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.844+0000 7fac7626b640 1 -- 172.21.15.27:0/1198354834 shutdown_connections 2024-01-15T11:32:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.844+0000 7fac7626b640 1 --2- 172.21.15.27:0/1198354834 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fac700d2080 0x7fac7006bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.844+0000 7fac7626b640 1 --2- 172.21.15.27:0/1198354834 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac7015d7b0 0x7fac700d10d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.844+0000 7fac7626b640 1 -- 172.21.15.27:0/1198354834 >> 172.21.15.27:0/1198354834 conn(0x7fac700d33b0 msgr2=0x7fac700d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:32:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.844+0000 7fac7626b640 1 -- 172.21.15.27:0/1198354834 shutdown_connections 2024-01-15T11:32:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.844+0000 7fac7626b640 1 -- 172.21.15.27:0/1198354834 wait complete. 2024-01-15T11:32:57.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.848+0000 7fac7626b640 1 Processor -- start 2024-01-15T11:32:57.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.848+0000 7fac7626b640 1 -- start start 2024-01-15T11:32:57.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.848+0000 7fac7626b640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fac700cead0 0x7fac70142c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:57.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.848+0000 7fac7626b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac700d2080 0x7fac700c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:57.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.848+0000 7fac7626b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac7015d7b0 0x7fac70154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:57.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.848+0000 7fac7626b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac70143140 con 0x7fac7015d7b0 2024-01-15T11:32:57.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.848+0000 7fac7626b640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac700ccec0 con 0x7fac700d2080 2024-01-15T11:32:57.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.848+0000 7fac7626b640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac700cd1a0 con 0x7fac700cead0 2024-01-15T11:32:57.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.848+0000 7fac74808640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac7015d7b0 0x7fac70154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:57.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.848+0000 7fac74808640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac7015d7b0 0x7fac70154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54838/0 (socket says 172.21.15.27:54838) 2024-01-15T11:32:57.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.848+0000 7fac74808640 1 -- 172.21.15.27:0/1964762052 learned_addr learned my addr 172.21.15.27:0/1964762052 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:32:57.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.848+0000 7fac6ffff640 1 --2- 172.21.15.27:0/1964762052 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fac700cead0 0x7fac70142c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:57.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.848+0000 7fac6f7fe640 1 --2- 172.21.15.27:0/1964762052 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac700d2080 0x7fac700c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:57.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.848+0000 7fac74808640 1 -- 172.21.15.27:0/1964762052 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fac700cead0 msgr2=0x7fac70142c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:57.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.848+0000 7fac74808640 1 --2- 172.21.15.27:0/1964762052 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fac700cead0 0x7fac70142c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.848+0000 7fac74808640 1 -- 172.21.15.27:0/1964762052 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac700d2080 msgr2=0x7fac700c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:57.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.848+0000 7fac74808640 1 --2- 172.21.15.27:0/1964762052 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac700d2080 0x7fac700c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.848+0000 7fac74808640 1 -- 172.21.15.27:0/1964762052 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac68009a70 con 0x7fac7015d7b0 2024-01-15T11:32:57.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.848+0000 7fac74808640 1 --2- 172.21.15.27:0/1964762052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac7015d7b0 0x7fac70154d50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fac6800efb0 tx=0x7fac6800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:32:57.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.848+0000 7fac6cff9640 1 -- 172.21.15.27:0/1964762052 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac68009c00 con 0x7fac7015d7b0 2024-01-15T11:32:57.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.848+0000 7fac6cff9640 1 -- 172.21.15.27:0/1964762052 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6800f040 con 0x7fac7015d7b0 2024-01-15T11:32:57.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.848+0000 7fac7626b640 1 -- 172.21.15.27:0/1964762052 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac60009420 con 0x7fac7015d7b0 2024-01-15T11:32:57.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.848+0000 7fac6cff9640 1 -- 172.21.15.27:0/1964762052 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac680146c0 con 0x7fac7015d7b0 2024-01-15T11:32:57.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.848+0000 7fac7626b640 1 -- 172.21.15.27:0/1964762052 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac70154550 con 0x7fac7015d7b0 2024-01-15T11:32:57.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.848+0000 7fac6cff9640 1 -- 172.21.15.27:0/1964762052 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fac68014b20 con 0x7fac7015d7b0 2024-01-15T11:32:57.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.852+0000 7fac6cff9640 1 -- 172.21.15.27:0/1964762052 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fac6801dcc0 con 0x7fac7015d7b0 2024-01-15T11:32:57.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.852+0000 7fac7626b640 1 -- 172.21.15.27:0/1964762052 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac7004e850 con 0x7fac7015d7b0 2024-01-15T11:32:57.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.852+0000 7fac6cff9640 1 -- 172.21.15.27:0/1964762052 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fac6803bce0 con 0x7fac7015d7b0 2024-01-15T11:32:57.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.912+0000 7fac7626b640 1 -- 172.21.15.27:0/1964762052 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac7008ce20 con 0x7fac7015d7b0 2024-01-15T11:32:57.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.912+0000 7fac6cff9640 1 -- 172.21.15.27:0/1964762052 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fac6802a070 con 0x7fac7015d7b0 2024-01-15T11:32:57.915 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:32:57.915 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":10,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:32:57.562518+0000","last_up_change":"0.000000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:32:57.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.912+0000 7fac7626b640 1 -- 172.21.15.27:0/1964762052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac7015d7b0 msgr2=0x7fac70154d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:57.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.912+0000 7fac7626b640 1 --2- 172.21.15.27:0/1964762052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac7015d7b0 0x7fac70154d50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fac6800efb0 tx=0x7fac6800c490 comp rx=0 tx=0).stop 2024-01-15T11:32:57.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.912+0000 7fac7626b640 1 -- 172.21.15.27:0/1964762052 shutdown_connections 2024-01-15T11:32:57.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.912+0000 7fac7626b640 1 --2- 172.21.15.27:0/1964762052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac7015d7b0 0x7fac70154d50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.912+0000 7fac7626b640 1 --2- 172.21.15.27:0/1964762052 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac700d2080 0x7fac700c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.912+0000 7fac7626b640 1 --2- 172.21.15.27:0/1964762052 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fac700cead0 0x7fac70142c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:57.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.912+0000 7fac7626b640 1 -- 172.21.15.27:0/1964762052 >> 172.21.15.27:0/1964762052 conn(0x7fac700d33b0 msgr2=0x7fac700d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:32:57.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.912+0000 7fac7626b640 1 -- 172.21.15.27:0/1964762052 shutdown_connections 2024-01-15T11:32:57.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:32:57.912+0000 7fac7626b640 1 -- 172.21.15.27:0/1964762052 wait complete. 2024-01-15T11:32:57.934 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-01-15T11:32:57.935 INFO:tasks.ceph:Waiting for OSDs to come up 2024-01-15T11:32:57.996 INFO:tasks.ceph.mgr.x.smithi093.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-01-15T11:32:57.996 INFO:tasks.ceph.mgr.x.smithi093.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-01-15T11:32:57.996 INFO:tasks.ceph.mgr.x.smithi093.stderr: from numpy import show_config as show_numpy_config 2024-01-15T11:32:58.057 INFO:tasks.ceph.mgr.y.smithi027.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-01-15T11:32:58.057 INFO:tasks.ceph.mgr.y.smithi027.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-01-15T11:32:58.057 INFO:tasks.ceph.mgr.y.smithi027.stderr: from numpy import show_config as show_numpy_config 2024-01-15T11:32:58.081 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:32:58.074+0000 7fbf08f99180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-15T11:32:58.142 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-15T11:32:58.140+0000 7f9f6429b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-15T11:32:58.216 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:32:58.210+0000 7fbf08f99180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-15T11:32:58.238 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-01-15T11:32:58.236+0000 7fae0c0ba640 -1 Falling back to public interface 2024-01-15T11:32:58.258 INFO:tasks.ceph.osd.1.smithi027.stderr:2024-01-15T11:32:58.256+0000 7f2b9aa85640 -1 Falling back to public interface 2024-01-15T11:32:58.274 INFO:tasks.ceph.osd.2.smithi027.stderr:2024-01-15T11:32:58.272+0000 7f6baf719640 -1 Falling back to public interface 2024-01-15T11:32:58.287 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-15T11:32:58.284+0000 7f9f6429b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-15T11:32:58.288 INFO:tasks.ceph.osd.5.smithi093.stderr:2024-01-15T11:32:58.282+0000 7f128cde1640 -1 Falling back to public interface 2024-01-15T11:32:58.290 INFO:tasks.ceph.osd.3.smithi027.stderr:2024-01-15T11:32:58.288+0000 7fd930ed8640 -1 Falling back to public interface 2024-01-15T11:32:58.295 INFO:tasks.ceph.osd.4.smithi093.stderr:2024-01-15T11:32:58.290+0000 7f5fc0420640 -1 Falling back to public interface 2024-01-15T11:32:58.315 INFO:tasks.ceph.osd.6.smithi093.stderr:2024-01-15T11:32:58.310+0000 7fbe830e2640 -1 Falling back to public interface 2024-01-15T11:32:58.331 INFO:tasks.ceph.osd.7.smithi093.stderr:2024-01-15T11:32:58.326+0000 7f28f842b640 -1 Falling back to public interface 2024-01-15T11:32:58.395 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:32:58.390+0000 7fbf08f99180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-15T11:32:58.467 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:32:58.462+0000 7fbf08f99180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-15T11:32:58.476 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-15T11:32:58.472+0000 7f9f6429b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-15T11:32:58.552 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-15T11:32:58.548+0000 7f9f6429b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-15T11:32:58.605 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:32:58.598+0000 7fbf08f99180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-15T11:32:58.697 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-15T11:32:58.696+0000 7f9f6429b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-15T11:32:58.743 DEBUG:teuthology.orchestra.run.smithi027:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-15T11:32:58.876 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.872+0000 7f0cebf80640 1 Processor -- start 2024-01-15T11:32:58.876 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.872+0000 7f0cebf80640 1 -- start start 2024-01-15T11:32:58.880 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.876+0000 7f0cebf80640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0ce40b3020 0x7f0ce415de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:58.880 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.876+0000 7f0cebf80640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce415e470 con 0x7f0ce406e7d0 2024-01-15T11:32:58.880 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.876+0000 7f0cebf80640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce40b2260 con 0x7f0ce4159b20 2024-01-15T11:32:58.880 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.876+0000 7f0cebf80640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce40b2540 con 0x7f0ce40b3020 2024-01-15T11:32:58.880 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.876+0000 7f0ce951b640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f0ce406e7d0 0x7f0ce415d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:51554/0 (socket says 172.21.15.27:51554) 2024-01-15T11:32:58.880 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.876+0000 7f0ce951b640 1 -- 172.21.15.27:0/4022799513 learned_addr learned my addr 172.21.15.27:0/4022799513 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:32:58.880 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.876+0000 7f0cea51d640 1 --2- 172.21.15.27:0/4022799513 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0ce40b3020 0x7f0ce415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:58.880 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.876+0000 7f0ce8d1a640 1 -- 172.21.15.27:0/4022799513 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 91954767 0 0) 0x7f0ce415e470 con 0x7f0ce406e7d0 2024-01-15T11:32:58.880 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.876+0000 7f0ce8d1a640 1 -- 172.21.15.27:0/4022799513 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cd0003450 con 0x7f0ce406e7d0 2024-01-15T11:32:58.881 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.876+0000 7f0ce8d1a640 1 -- 172.21.15.27:0/4022799513 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3392384702 0 0) 0x7f0ce40b2260 con 0x7f0ce4159b20 2024-01-15T11:32:58.881 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.876+0000 7f0ce8d1a640 1 -- 172.21.15.27:0/4022799513 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ce415e470 con 0x7f0ce4159b20 2024-01-15T11:32:58.881 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.876+0000 7f0cea51d640 1 -- 172.21.15.27:0/4022799513 >> v1:172.21.15.93:6789/0 conn(0x7f0ce4159b20 legacy=0x7f0ce406e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:58.881 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.876+0000 7f0cea51d640 1 -- 172.21.15.27:0/4022799513 >> v1:172.21.15.27:6789/0 conn(0x7f0ce406e7d0 legacy=0x7f0ce415d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:58.881 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.876+0000 7f0cea51d640 1 -- 172.21.15.27:0/4022799513 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce40b2820 con 0x7f0ce40b3020 2024-01-15T11:32:58.883 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.880+0000 7f0cea51d640 1 --2- 172.21.15.27:0/4022799513 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0ce40b3020 0x7f0ce415de50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc009dc0 tx=0x7f0cdc01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ded5088b6cf74fe2 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:32:58.883 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.880+0000 7f0ce8d1a640 1 -- 172.21.15.27:0/4022799513 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc0a58c0 con 0x7f0ce40b3020 2024-01-15T11:32:58.883 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.880+0000 7f0ce8d1a640 1 -- 172.21.15.27:0/4022799513 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc0a5a20 con 0x7f0ce40b3020 2024-01-15T11:32:58.883 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.880+0000 7f0ce8d1a640 1 -- 172.21.15.27:0/4022799513 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc0a5db0 con 0x7f0ce40b3020 2024-01-15T11:32:58.884 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.880+0000 7f0cebf80640 1 -- 172.21.15.27:0/4022799513 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0ce40b3020 msgr2=0x7f0ce415de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:58.884 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.880+0000 7f0cebf80640 1 --2- 172.21.15.27:0/4022799513 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0ce40b3020 0x7f0ce415de50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc009dc0 tx=0x7f0cdc01c970 comp rx=0 tx=0).stop 2024-01-15T11:32:58.885 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.880+0000 7f0cebf80640 1 -- 172.21.15.27:0/4022799513 shutdown_connections 2024-01-15T11:32:58.885 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.880+0000 7f0cebf80640 1 --2- 172.21.15.27:0/4022799513 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0ce40b3020 0x7f0ce415de50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:58.885 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.880+0000 7f0cebf80640 1 -- 172.21.15.27:0/4022799513 >> 172.21.15.27:0/4022799513 conn(0x7f0ce40b0ec0 msgr2=0x7f0ce40b12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:32:58.885 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.880+0000 7f0cebf80640 1 -- 172.21.15.27:0/4022799513 shutdown_connections 2024-01-15T11:32:58.885 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.880+0000 7f0cebf80640 1 -- 172.21.15.27:0/4022799513 wait complete. 2024-01-15T11:32:58.886 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.884+0000 7f0cebf80640 1 Processor -- start 2024-01-15T11:32:58.887 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.884+0000 7f0cebf80640 1 -- start start 2024-01-15T11:32:58.890 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.884+0000 7f0cebf80640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ce406e7d0 0x7f0ce4098b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:58.890 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.884+0000 7f0cebf80640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ce40b3020 0x7f0ce40cc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:58.890 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.884+0000 7f0cebf80640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0ce4159b20 0x7f0ce415c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:32:58.890 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.884+0000 7f0cebf80640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce4163570 con 0x7f0ce40b3020 2024-01-15T11:32:58.890 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.884+0000 7f0cebf80640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce40cc6a0 con 0x7f0ce406e7d0 2024-01-15T11:32:58.891 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.884+0000 7f0cebf80640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce414e560 con 0x7f0ce4159b20 2024-01-15T11:32:58.891 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.884+0000 7f0ce951b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ce40b3020 0x7f0ce40cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:58.891 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.884+0000 7f0ce951b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ce40b3020 0x7f0ce40cc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54846/0 (socket says 172.21.15.27:54846) 2024-01-15T11:32:58.891 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.884+0000 7f0ce951b640 1 -- 172.21.15.27:0/218066626 learned_addr learned my addr 172.21.15.27:0/218066626 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:32:58.891 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.884+0000 7f0ce9d1c640 1 --2- 172.21.15.27:0/218066626 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ce406e7d0 0x7f0ce4098b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:58.891 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.884+0000 7f0cea51d640 1 --2- 172.21.15.27:0/218066626 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0ce4159b20 0x7f0ce415c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:32:58.891 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.888+0000 7f0ce951b640 1 -- 172.21.15.27:0/218066626 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0ce4159b20 msgr2=0x7f0ce415c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:58.891 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.888+0000 7f0ce951b640 1 --2- 172.21.15.27:0/218066626 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0ce4159b20 0x7f0ce415c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:58.891 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.888+0000 7f0ce951b640 1 -- 172.21.15.27:0/218066626 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ce406e7d0 msgr2=0x7f0ce4098b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:58.891 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.888+0000 7f0ce951b640 1 --2- 172.21.15.27:0/218066626 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ce406e7d0 0x7f0ce4098b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:58.891 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.888+0000 7f0ce951b640 1 -- 172.21.15.27:0/218066626 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc009a70 con 0x7f0ce40b3020 2024-01-15T11:32:58.891 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.888+0000 7f0ce951b640 1 --2- 172.21.15.27:0/218066626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ce40b3020 0x7f0ce40cc160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0cd400c420 tx=0x7f0cd400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:32:58.892 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.888+0000 7f0cda7fc640 1 -- 172.21.15.27:0/218066626 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd4005cf0 con 0x7f0ce40b3020 2024-01-15T11:32:58.892 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.888+0000 7f0cda7fc640 1 -- 172.21.15.27:0/218066626 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd4005e50 con 0x7f0ce40b3020 2024-01-15T11:32:58.892 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.888+0000 7f0cebf80640 1 -- 172.21.15.27:0/218066626 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce4162c40 con 0x7f0ce40b3020 2024-01-15T11:32:58.892 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.888+0000 7f0cda7fc640 1 -- 172.21.15.27:0/218066626 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd40072d0 con 0x7f0ce40b3020 2024-01-15T11:32:58.892 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.888+0000 7f0cebf80640 1 -- 172.21.15.27:0/218066626 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce4163200 con 0x7f0ce40b3020 2024-01-15T11:32:58.892 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.888+0000 7f0cda7fc640 1 -- 172.21.15.27:0/218066626 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0cd401c440 con 0x7f0ce40b3020 2024-01-15T11:32:58.892 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.888+0000 7f0cda7fc640 1 -- 172.21.15.27:0/218066626 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f0cd401cdc0 con 0x7f0ce40b3020 2024-01-15T11:32:58.893 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.888+0000 7f0cebf80640 1 -- 172.21.15.27:0/218066626 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce4072670 con 0x7f0ce40b3020 2024-01-15T11:32:58.893 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.892+0000 7f0cda7fc640 1 -- 172.21.15.27:0/218066626 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f0cd4021060 con 0x7f0ce40b3020 2024-01-15T11:32:58.951 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.948+0000 7f0cebf80640 1 -- 172.21.15.27:0/218066626 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ce404e850 con 0x7f0ce40b3020 2024-01-15T11:32:58.952 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.948+0000 7f0cda7fc640 1 -- 172.21.15.27:0/218066626 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f0cd4017070 con 0x7f0ce40b3020 2024-01-15T11:32:58.952 INFO:teuthology.misc.health.smithi027.stdout: 2024-01-15T11:32:58.952 INFO:teuthology.misc.health.smithi027.stdout:{"epoch":10,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:32:57.562518+0000","last_up_change":"0.000000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:32:58.954 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.952+0000 7f0cebf80640 1 -- 172.21.15.27:0/218066626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ce40b3020 msgr2=0x7f0ce40cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:32:58.954 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.952+0000 7f0cebf80640 1 --2- 172.21.15.27:0/218066626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ce40b3020 0x7f0ce40cc160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0cd400c420 tx=0x7f0cd400c8e0 comp rx=0 tx=0).stop 2024-01-15T11:32:58.954 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.952+0000 7f0cebf80640 1 -- 172.21.15.27:0/218066626 shutdown_connections 2024-01-15T11:32:58.954 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.952+0000 7f0cebf80640 1 --2- 172.21.15.27:0/218066626 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0ce4159b20 0x7f0ce415c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:58.954 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.952+0000 7f0cebf80640 1 --2- 172.21.15.27:0/218066626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ce40b3020 0x7f0ce40cc160 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:58.954 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.952+0000 7f0cebf80640 1 --2- 172.21.15.27:0/218066626 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ce406e7d0 0x7f0ce4098b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:32:58.954 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.952+0000 7f0cebf80640 1 -- 172.21.15.27:0/218066626 >> 172.21.15.27:0/218066626 conn(0x7f0ce40b0ec0 msgr2=0x7f0ce40ad660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:32:58.954 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.952+0000 7f0cebf80640 1 -- 172.21.15.27:0/218066626 shutdown_connections 2024-01-15T11:32:58.954 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:32:58.952+0000 7f0cebf80640 1 -- 172.21.15.27:0/218066626 wait complete. 2024-01-15T11:32:58.970 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-15T11:32:59.286 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:32:59.282+0000 7fbf08f99180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-15T11:32:59.373 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:32:59.366+0000 7fbf08f99180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-15T11:32:59.407 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-15T11:32:59.403+0000 7f9f6429b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-15T11:32:59.499 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-15T11:32:59.495+0000 7f9f6429b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-15T11:32:59.566 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:32:59.562+0000 7fbf08f99180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-15T11:32:59.651 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:32:59.646+0000 7fbf08f99180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-15T11:32:59.702 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-15T11:32:59.699+0000 7f9f6429b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-15T11:32:59.790 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-15T11:32:59.787+0000 7f9f6429b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-15T11:32:59.980 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:32:59.974+0000 7fbf08f99180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-15T11:33:00.049 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:33:00.042+0000 7fbf08f99180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-15T11:33:00.136 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-15T11:33:00.131+0000 7f9f6429b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-15T11:33:00.208 INFO:tasks.ceph.mgr.y.smithi027.stderr:2024-01-15T11:33:00.203+0000 7f9f6429b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-15T11:33:01.073 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:33:01.066+0000 7fbeb080a640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-01-15T11:33:01.073 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:33:01.066+0000 7fbeb080a640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-01-15T11:33:02.049 INFO:tasks.ceph.osd.5.smithi093.stderr:2024-01-15T11:33:02.042+0000 7f128cde1640 -1 osd.5 0 log_to_monitors true 2024-01-15T11:33:02.141 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-01-15T11:33:02.139+0000 7fae0c0ba640 -1 osd.0 0 log_to_monitors true 2024-01-15T11:33:02.169 INFO:tasks.ceph.osd.4.smithi093.stderr:2024-01-15T11:33:02.162+0000 7f5fc0420640 -1 osd.4 0 log_to_monitors true 2024-01-15T11:33:02.229 INFO:tasks.ceph.osd.1.smithi027.stderr:2024-01-15T11:33:02.227+0000 7f2b9aa85640 -1 osd.1 0 log_to_monitors true 2024-01-15T11:33:02.239 INFO:tasks.ceph.osd.6.smithi093.stderr:2024-01-15T11:33:02.234+0000 7fbe830e2640 -1 osd.6 0 log_to_monitors true 2024-01-15T11:33:02.283 INFO:tasks.ceph.osd.2.smithi027.stderr:2024-01-15T11:33:02.279+0000 7f6baf719640 -1 osd.2 0 log_to_monitors true 2024-01-15T11:33:02.302 INFO:tasks.ceph.osd.7.smithi093.stderr:2024-01-15T11:33:02.298+0000 7f28f842b640 -1 osd.7 0 log_to_monitors true 2024-01-15T11:33:02.314 INFO:tasks.ceph.osd.3.smithi027.stderr:2024-01-15T11:33:02.311+0000 7fd930ed8640 -1 osd.3 0 log_to_monitors true 2024-01-15T11:33:04.209 INFO:tasks.ceph.osd.5.smithi093.stderr:2024-01-15T11:33:04.202+0000 7f1288569640 -1 osd.5 0 waiting for initial osdmap 2024-01-15T11:33:04.338 INFO:tasks.ceph.osd.5.smithi093.stderr:2024-01-15T11:33:04.330+0000 7f1280bb6640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-15T11:33:05.778 DEBUG:teuthology.orchestra.run.smithi027:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-15T11:33:05.936 INFO:tasks.ceph.osd.4.smithi093.stderr:2024-01-15T11:33:05.930+0000 7f5fbd3dc640 -1 osd.4 0 waiting for initial osdmap 2024-01-15T11:33:05.964 INFO:tasks.ceph.osd.4.smithi093.stderr:2024-01-15T11:33:05.958+0000 7f5fb41f3640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-15T11:33:05.992 INFO:tasks.ceph.osd.7.smithi093.stderr:2024-01-15T11:33:05.986+0000 7f28f49c6640 -1 osd.7 0 waiting for initial osdmap 2024-01-15T11:33:06.016 INFO:tasks.ceph.osd.7.smithi093.stderr:2024-01-15T11:33:06.010+0000 7f28eb7dd640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-15T11:33:06.024 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.019+0000 7f4effb65640 1 Processor -- start 2024-01-15T11:33:06.025 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.019+0000 7f4effb65640 1 -- start start 2024-01-15T11:33:06.025 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.019+0000 7f4effb65640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4ef8160c40 0x7f4ef80cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:06.026 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.019+0000 7f4effb65640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4ef80d2190 0x7f4ef80b6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:06.026 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.019+0000 7f4effb65640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef80d0ac0 con 0x7f4ef80d0260 2024-01-15T11:33:06.026 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.019+0000 7f4effb65640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef80b6a90 con 0x7f4ef8160c40 2024-01-15T11:33:06.026 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.019+0000 7f4effb65640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80d07e0 con 0x7f4ef80d2190 2024-01-15T11:33:06.026 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.019+0000 7f4efe102640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4ef80d2190 0x7f4ef80b6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:06.026 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.023+0000 7f4efe102640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4ef80d2190 0x7f4ef80b6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:33000/0 (socket says 172.21.15.27:33000) 2024-01-15T11:33:06.026 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.023+0000 7f4efe102640 1 -- 172.21.15.27:0/3191063500 learned_addr learned my addr 172.21.15.27:0/3191063500 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:06.026 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.023+0000 7f4efe102640 1 -- 172.21.15.27:0/3191063500 >> v2:172.21.15.27:3300/0 conn(0x7f4ef8160c40 msgr2=0x7f4ef80cfd20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-15T11:33:06.026 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.023+0000 7f4efe102640 1 --2- 172.21.15.27:0/3191063500 >> v2:172.21.15.27:3300/0 conn(0x7f4ef8160c40 0x7f4ef80cfd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:06.026 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.023+0000 7f4efe102640 1 -- 172.21.15.27:0/3191063500 >> v1:172.21.15.27:6789/0 conn(0x7f4ef80d0260 legacy=0x7f4ef80d1a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-15T11:33:06.027 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.023+0000 7f4efe102640 1 -- 172.21.15.27:0/3191063500 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef80b6440 con 0x7f4ef80d2190 2024-01-15T11:33:06.030 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.027+0000 7f4efe102640 1 --2- 172.21.15.27:0/3191063500 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4ef80d2190 0x7f4ef80b6f20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009e50 tx=0x7f4ee801c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19ac4fe218b01950 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:06.032 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.027+0000 7f4efc8ff640 1 -- 172.21.15.27:0/3191063500 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee80a5660 con 0x7f4ef80d2190 2024-01-15T11:33:06.032 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.027+0000 7f4efc8ff640 1 -- 172.21.15.27:0/3191063500 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee80a57c0 con 0x7f4ef80d2190 2024-01-15T11:33:06.032 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.027+0000 7f4efc8ff640 1 -- 172.21.15.27:0/3191063500 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee80a5b50 con 0x7f4ef80d2190 2024-01-15T11:33:06.034 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.031+0000 7f4effb65640 1 -- 172.21.15.27:0/3191063500 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4ef80d2190 msgr2=0x7f4ef80b6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:06.034 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.031+0000 7f4effb65640 1 --2- 172.21.15.27:0/3191063500 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4ef80d2190 0x7f4ef80b6f20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009e50 tx=0x7f4ee801c8d0 comp rx=0 tx=0).stop 2024-01-15T11:33:06.035 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.031+0000 7f4effb65640 1 -- 172.21.15.27:0/3191063500 shutdown_connections 2024-01-15T11:33:06.035 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.031+0000 7f4effb65640 1 --2- 172.21.15.27:0/3191063500 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4ef80d2190 0x7f4ef80b6f20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:06.035 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.031+0000 7f4effb65640 1 --2- 172.21.15.27:0/3191063500 >> v2:172.21.15.27:3300/0 conn(0x7f4ef8160c40 0x7f4ef80cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:06.035 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.031+0000 7f4effb65640 1 -- 172.21.15.27:0/3191063500 >> 172.21.15.27:0/3191063500 conn(0x7f4ef808afc0 msgr2=0x7f4ef80d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:06.036 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.031+0000 7f4effb65640 1 -- 172.21.15.27:0/3191063500 shutdown_connections 2024-01-15T11:33:06.036 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.031+0000 7f4effb65640 1 -- 172.21.15.27:0/3191063500 wait complete. 2024-01-15T11:33:06.039 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.035+0000 7f4effb65640 1 Processor -- start 2024-01-15T11:33:06.039 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.035+0000 7f4effb65640 1 -- start start 2024-01-15T11:33:06.041 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.035+0000 7f4effb65640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ef80d0260 0x7f4ef8202f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:06.041 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.035+0000 7f4effb65640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4ef80d2190 0x7f4ef8205e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:06.041 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.035+0000 7f4effb65640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ef8160c40 0x7f4ef81f8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:06.041 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.035+0000 7f4effb65640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef815a200 con 0x7f4ef80d0260 2024-01-15T11:33:06.041 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.035+0000 7f4effb65640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80cc0e0 con 0x7f4ef8160c40 2024-01-15T11:33:06.041 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.035+0000 7f4effb65640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80b16b0 con 0x7f4ef80d2190 2024-01-15T11:33:06.041 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.035+0000 7f4efe102640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ef8160c40 0x7f4ef81f8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:06.041 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.039+0000 7f4efe102640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ef8160c40 0x7f4ef81f8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:36644/0 (socket says 172.21.15.27:36644) 2024-01-15T11:33:06.042 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.039+0000 7f4efe102640 1 -- 172.21.15.27:0/1708311321 learned_addr learned my addr 172.21.15.27:0/1708311321 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:06.042 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.039+0000 7f4efd100640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4ef80d2190 0x7f4ef8205e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:06.043 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.039+0000 7f4efd901640 1 --2- 172.21.15.27:0/1708311321 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ef80d0260 0x7f4ef8202f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:06.043 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.039+0000 7f4efd100640 1 -- 172.21.15.27:0/1708311321 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ef8160c40 msgr2=0x7f4ef81f8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:06.043 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.039+0000 7f4efd100640 1 --2- 172.21.15.27:0/1708311321 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ef8160c40 0x7f4ef81f8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:06.043 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.039+0000 7f4efd100640 1 -- 172.21.15.27:0/1708311321 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ef80d0260 msgr2=0x7f4ef8202f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:06.043 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.039+0000 7f4efd100640 1 --2- 172.21.15.27:0/1708311321 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ef80d0260 0x7f4ef8202f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:06.043 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.039+0000 7f4efd100640 1 -- 172.21.15.27:0/1708311321 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee8009b30 con 0x7f4ef80d2190 2024-01-15T11:33:06.043 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.039+0000 7f4efd100640 1 --2- 172.21.15.27:0/1708311321 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4ef80d2190 0x7f4ef8205e90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4eec00b410 tx=0x7f4eec00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:06.043 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.039+0000 7f4ef67fc640 1 -- 172.21.15.27:0/1708311321 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec011830 con 0x7f4ef80d2190 2024-01-15T11:33:06.043 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.039+0000 7f4ef67fc640 1 -- 172.21.15.27:0/1708311321 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eec011990 con 0x7f4ef80d2190 2024-01-15T11:33:06.044 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.039+0000 7f4ef67fc640 1 -- 172.21.15.27:0/1708311321 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec011d40 con 0x7f4ef80d2190 2024-01-15T11:33:06.044 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.039+0000 7f4effb65640 1 -- 172.21.15.27:0/1708311321 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef80b1990 con 0x7f4ef80d2190 2024-01-15T11:33:06.044 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.039+0000 7f4effb65640 1 -- 172.21.15.27:0/1708311321 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef80cc610 con 0x7f4ef80d2190 2024-01-15T11:33:06.045 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.039+0000 7f4effb65640 1 -- 172.21.15.27:0/1708311321 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef80cc830 con 0x7f4ef80d2190 2024-01-15T11:33:06.048 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.043+0000 7f4ef67fc640 1 -- 172.21.15.27:0/1708311321 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 4) v1 ==== 86104+0+0 (secure 0 0 0) 0x7f4eec01a400 con 0x7f4ef80d2190 2024-01-15T11:33:06.048 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.043+0000 7f4ef67fc640 1 --2- 172.21.15.27:0/1708311321 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4ee4066860 0x7f4ee4068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:06.048 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.043+0000 7f4ef67fc640 1 -- 172.21.15.27:0/1708311321 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2511+0+0 (secure 0 0 0) 0x7f4eec0836c0 con 0x7f4ef80d2190 2024-01-15T11:33:06.048 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.043+0000 7f4efd901640 1 --2- 172.21.15.27:0/1708311321 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4ee4066860 0x7f4ee4068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:06.049 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.047+0000 7f4efd901640 1 --2- 172.21.15.27:0/1708311321 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4ee4066860 0x7f4ee4068d20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0009890 tx=0x7f4ef0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:06.054 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.051+0000 7f4ef67fc640 1 -- 172.21.15.27:0/1708311321 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4eec0516f0 con 0x7f4ef80d2190 2024-01-15T11:33:06.054 INFO:tasks.ceph.osd.6.smithi093.stderr:2024-01-15T11:33:06.046+0000 7fbe7e868640 -1 osd.6 0 waiting for initial osdmap 2024-01-15T11:33:06.096 INFO:tasks.ceph.osd.6.smithi093.stderr:2024-01-15T11:33:06.090+0000 7fbe76eb5640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-15T11:33:06.339 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.335+0000 7f4effb65640 1 -- 172.21.15.27:0/1708311321 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ef804e850 con 0x7f4ef80d2190 2024-01-15T11:33:06.340 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.335+0000 7f4ef67fc640 1 -- 172.21.15.27:0/1708311321 <== mon.2 v2:172.21.15.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7554 (secure 0 0 0) 0x7f4eec015020 con 0x7f4ef80d2190 2024-01-15T11:33:06.340 INFO:teuthology.misc.health.smithi027.stdout: 2024-01-15T11:33:06.340 INFO:teuthology.misc.health.smithi027.stdout:{"epoch":14,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:33:05.273839+0000","last_up_change":"2024-01-15T11:33:05.273839+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:33:06.344 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.339+0000 7f4effb65640 1 -- 172.21.15.27:0/1708311321 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4ee4066860 msgr2=0x7f4ee4068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:06.344 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.339+0000 7f4effb65640 1 --2- 172.21.15.27:0/1708311321 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4ee4066860 0x7f4ee4068d20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0009890 tx=0x7f4ef0008040 comp rx=0 tx=0).stop 2024-01-15T11:33:06.345 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.339+0000 7f4effb65640 1 -- 172.21.15.27:0/1708311321 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4ef80d2190 msgr2=0x7f4ef8205e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:06.345 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.339+0000 7f4effb65640 1 --2- 172.21.15.27:0/1708311321 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4ef80d2190 0x7f4ef8205e90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4eec00b410 tx=0x7f4eec00b8d0 comp rx=0 tx=0).stop 2024-01-15T11:33:06.345 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.339+0000 7f4effb65640 1 -- 172.21.15.27:0/1708311321 shutdown_connections 2024-01-15T11:33:06.345 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.339+0000 7f4effb65640 1 --2- 172.21.15.27:0/1708311321 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4ee4066860 0x7f4ee4068d20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:06.345 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.339+0000 7f4effb65640 1 --2- 172.21.15.27:0/1708311321 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ef8160c40 0x7f4ef81f8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:06.345 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.339+0000 7f4effb65640 1 --2- 172.21.15.27:0/1708311321 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4ef80d2190 0x7f4ef8205e90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:06.345 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.339+0000 7f4effb65640 1 --2- 172.21.15.27:0/1708311321 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4ef80d0260 0x7f4ef8202f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:06.345 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.339+0000 7f4effb65640 1 -- 172.21.15.27:0/1708311321 >> 172.21.15.27:0/1708311321 conn(0x7f4ef808afc0 msgr2=0x7f4ef806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:06.345 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.339+0000 7f4effb65640 1 -- 172.21.15.27:0/1708311321 shutdown_connections 2024-01-15T11:33:06.346 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:06.343+0000 7f4effb65640 1 -- 172.21.15.27:0/1708311321 wait complete. 2024-01-15T11:33:06.378 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-01-15T11:33:06.441 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-01-15T11:33:06.439+0000 7fae07842640 -1 osd.0 0 waiting for initial osdmap 2024-01-15T11:33:06.478 INFO:tasks.ceph.osd.0.smithi027.stderr:2024-01-15T11:33:06.475+0000 7fadffe8f640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-15T11:33:06.529 INFO:tasks.ceph.osd.1.smithi027.stderr:2024-01-15T11:33:06.527+0000 7f2b9620b640 -1 osd.1 0 waiting for initial osdmap 2024-01-15T11:33:06.534 INFO:tasks.ceph.osd.2.smithi027.stderr:2024-01-15T11:33:06.531+0000 7f6baae9f640 -1 osd.2 0 waiting for initial osdmap 2024-01-15T11:33:06.558 INFO:tasks.ceph.osd.2.smithi027.stderr:2024-01-15T11:33:06.555+0000 7f6ba34ec640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-15T11:33:06.562 INFO:tasks.ceph.osd.1.smithi027.stderr:2024-01-15T11:33:06.559+0000 7f2b8e858640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-15T11:33:06.588 INFO:tasks.ceph.osd.3.smithi027.stderr:2024-01-15T11:33:06.583+0000 7fd92c65e640 -1 osd.3 0 waiting for initial osdmap 2024-01-15T11:33:06.614 INFO:tasks.ceph.osd.3.smithi027.stderr:2024-01-15T11:33:06.611+0000 7fd924cab640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-15T11:33:12.862 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:33:12.867 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:33:13.185 DEBUG:teuthology.orchestra.run.smithi027:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-15T11:33:13.328 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.323+0000 7fb552bdf640 1 Processor -- start 2024-01-15T11:33:13.328 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.323+0000 7fb552bdf640 1 -- start start 2024-01-15T11:33:13.330 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.327+0000 7fb552bdf640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb54c15b340 0x7fb54c15f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:13.330 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.327+0000 7fb552bdf640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb54c06df40 0x7fb54c0b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:13.330 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.327+0000 7fb552bdf640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54c15fe70 con 0x7fb54c0cbed0 2024-01-15T11:33:13.330 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.327+0000 7fb552bdf640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54c0b2ee0 con 0x7fb54c06df40 2024-01-15T11:33:13.330 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.327+0000 7fb552bdf640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54c0acb20 con 0x7fb54c15b340 2024-01-15T11:33:13.330 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.327+0000 7fb55117c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb54c06df40 0x7fb54c0b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:13.331 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.327+0000 7fb55117c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb54c06df40 0x7fb54c0b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34650/0 (socket says 172.21.15.27:34650) 2024-01-15T11:33:13.331 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.327+0000 7fb55117c640 1 -- 172.21.15.27:0/4252623523 learned_addr learned my addr 172.21.15.27:0/4252623523 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:13.331 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.327+0000 7fb54bfff640 1 --1- 172.21.15.27:0/4252623523 >> v1:172.21.15.27:6789/0 conn(0x7fb54c0cbed0 0x7fb54c06d830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:43660/0 (socket says 172.21.15.27:43660) 2024-01-15T11:33:13.331 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.327+0000 7fb55097b640 1 --2- 172.21.15.27:0/4252623523 >> v2:172.21.15.93:3300/0 conn(0x7fb54c15b340 0x7fb54c15f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:13.331 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.327+0000 7fb55117c640 1 -- 172.21.15.27:0/4252623523 >> v2:172.21.15.93:3300/0 conn(0x7fb54c15b340 msgr2=0x7fb54c15f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:13.331 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.327+0000 7fb55117c640 1 --2- 172.21.15.27:0/4252623523 >> v2:172.21.15.93:3300/0 conn(0x7fb54c15b340 0x7fb54c15f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:13.331 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.327+0000 7fb55117c640 1 -- 172.21.15.27:0/4252623523 >> v1:172.21.15.27:6789/0 conn(0x7fb54c0cbed0 legacy=0x7fb54c06d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:13.331 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.327+0000 7fb55117c640 1 -- 172.21.15.27:0/4252623523 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c0b2260 con 0x7fb54c06df40 2024-01-15T11:33:13.331 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.327+0000 7fb54b7fe640 1 -- 172.21.15.27:0/4252623523 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 16066232 0 0) 0x7fb54c15fe70 con 0x7fb54c0cbed0 2024-01-15T11:33:13.333 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.331+0000 7fb55117c640 1 --2- 172.21.15.27:0/4252623523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb54c06df40 0x7fb54c0b3300 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb544009e50 tx=0x7fb54401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebdefcd149d7cb7e server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:13.333 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.331+0000 7fb54b7fe640 1 -- 172.21.15.27:0/4252623523 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5440a5860 con 0x7fb54c06df40 2024-01-15T11:33:13.333 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.331+0000 7fb54b7fe640 1 -- 172.21.15.27:0/4252623523 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5440a59c0 con 0x7fb54c06df40 2024-01-15T11:33:13.333 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.331+0000 7fb54b7fe640 1 -- 172.21.15.27:0/4252623523 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5440a5d50 con 0x7fb54c06df40 2024-01-15T11:33:13.334 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.331+0000 7fb552bdf640 1 -- 172.21.15.27:0/4252623523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb54c06df40 msgr2=0x7fb54c0b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:13.335 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.331+0000 7fb552bdf640 1 --2- 172.21.15.27:0/4252623523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb54c06df40 0x7fb54c0b3300 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb544009e50 tx=0x7fb54401c9a0 comp rx=0 tx=0).stop 2024-01-15T11:33:13.335 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.331+0000 7fb552bdf640 1 -- 172.21.15.27:0/4252623523 shutdown_connections 2024-01-15T11:33:13.335 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.331+0000 7fb552bdf640 1 --2- 172.21.15.27:0/4252623523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb54c06df40 0x7fb54c0b3300 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:13.335 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.331+0000 7fb552bdf640 1 --2- 172.21.15.27:0/4252623523 >> v2:172.21.15.93:3300/0 conn(0x7fb54c15b340 0x7fb54c15f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:13.335 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.331+0000 7fb552bdf640 1 -- 172.21.15.27:0/4252623523 >> 172.21.15.27:0/4252623523 conn(0x7fb54c0b0ec0 msgr2=0x7fb54c0b12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:13.335 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.331+0000 7fb552bdf640 1 -- 172.21.15.27:0/4252623523 shutdown_connections 2024-01-15T11:33:13.335 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.331+0000 7fb552bdf640 1 -- 172.21.15.27:0/4252623523 wait complete. 2024-01-15T11:33:13.336 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.331+0000 7fb552bdf640 1 Processor -- start 2024-01-15T11:33:13.336 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.331+0000 7fb552bdf640 1 -- start start 2024-01-15T11:33:13.339 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.335+0000 7fb552bdf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb54c06df40 0x7fb54c0988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:13.339 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.335+0000 7fb552bdf640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb54c0cbed0 0x7fb54c14d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:13.339 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.335+0000 7fb552bdf640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb54c15b340 0x7fb54c0992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:13.339 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.335+0000 7fb552bdf640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c09b510 con 0x7fb54c06df40 2024-01-15T11:33:13.340 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.335+0000 7fb552bdf640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c09b7f0 con 0x7fb54c0cbed0 2024-01-15T11:33:13.340 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.335+0000 7fb552bdf640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c09bad0 con 0x7fb54c15b340 2024-01-15T11:33:13.340 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.335+0000 7fb55097b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb54c06df40 0x7fb54c0988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:13.340 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.335+0000 7fb55097b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb54c06df40 0x7fb54c0988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34658/0 (socket says 172.21.15.27:34658) 2024-01-15T11:33:13.340 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.335+0000 7fb55097b640 1 -- 172.21.15.27:0/2155593262 learned_addr learned my addr 172.21.15.27:0/2155593262 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:13.340 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.335+0000 7fb54bfff640 1 --2- 172.21.15.27:0/2155593262 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb54c0cbed0 0x7fb54c14d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:13.340 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.335+0000 7fb55117c640 1 --2- 172.21.15.27:0/2155593262 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb54c15b340 0x7fb54c0992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:13.340 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.335+0000 7fb55097b640 1 -- 172.21.15.27:0/2155593262 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb54c15b340 msgr2=0x7fb54c0992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:13.340 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.335+0000 7fb55097b640 1 --2- 172.21.15.27:0/2155593262 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb54c15b340 0x7fb54c0992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:13.340 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.335+0000 7fb55097b640 1 -- 172.21.15.27:0/2155593262 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb54c0cbed0 msgr2=0x7fb54c14d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:13.341 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.335+0000 7fb55097b640 1 --2- 172.21.15.27:0/2155593262 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb54c0cbed0 0x7fb54c14d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:13.341 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.335+0000 7fb55097b640 1 -- 172.21.15.27:0/2155593262 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb544009b30 con 0x7fb54c06df40 2024-01-15T11:33:13.341 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.335+0000 7fb55117c640 1 --2- 172.21.15.27:0/2155593262 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb54c15b340 0x7fb54c0992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:33:13.341 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.335+0000 7fb55097b640 1 --2- 172.21.15.27:0/2155593262 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb54c06df40 0x7fb54c0988e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb54000e870 tx=0x7fb54000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:13.341 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.335+0000 7fb5497fa640 1 -- 172.21.15.27:0/2155593262 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb540009510 con 0x7fb54c06df40 2024-01-15T11:33:13.341 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.335+0000 7fb5497fa640 1 -- 172.21.15.27:0/2155593262 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54000eec0 con 0x7fb54c06df40 2024-01-15T11:33:13.341 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.335+0000 7fb5497fa640 1 -- 172.21.15.27:0/2155593262 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54000cb40 con 0x7fb54c06df40 2024-01-15T11:33:13.341 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.335+0000 7fb552bdf640 1 -- 172.21.15.27:0/2155593262 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54c09bdb0 con 0x7fb54c06df40 2024-01-15T11:33:13.341 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.335+0000 7fb552bdf640 1 -- 172.21.15.27:0/2155593262 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54c098e20 con 0x7fb54c06df40 2024-01-15T11:33:13.341 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.335+0000 7fb552bdf640 1 -- 172.21.15.27:0/2155593262 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb54c04e850 con 0x7fb54c06df40 2024-01-15T11:33:13.342 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.335+0000 7fb5497fa640 1 -- 172.21.15.27:0/2155593262 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fb54000cca0 con 0x7fb54c06df40 2024-01-15T11:33:13.343 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.339+0000 7fb5497fa640 1 --2- 172.21.15.27:0/2155593262 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb5300668f0 0x7fb530068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:13.343 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.339+0000 7fb5497fa640 1 -- 172.21.15.27:0/2155593262 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb540084200 con 0x7fb54c06df40 2024-01-15T11:33:13.343 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.339+0000 7fb54bfff640 1 --2- 172.21.15.27:0/2155593262 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb5300668f0 0x7fb530068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:13.343 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.339+0000 7fb54bfff640 1 --2- 172.21.15.27:0/2155593262 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb5300668f0 0x7fb530068db0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb54c09d450 tx=0x7fb538007ba0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:13.345 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.343+0000 7fb5497fa640 1 -- 172.21.15.27:0/2155593262 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb540051790 con 0x7fb54c06df40 2024-01-15T11:33:13.504 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.499+0000 7fb552bdf640 1 -- 172.21.15.27:0/2155593262 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb54c1660e0 con 0x7fb54c06df40 2024-01-15T11:33:13.505 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.503+0000 7fb5497fa640 1 -- 172.21.15.27:0/2155593262 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12766 (secure 0 0 0) 0x7fb540054db0 con 0x7fb54c06df40 2024-01-15T11:33:13.505 INFO:teuthology.misc.health.smithi027.stdout: 2024-01-15T11:33:13.505 INFO:teuthology.misc.health.smithi027.stdout:{"epoch":18,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:33:10.197649+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:33:13.507 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.503+0000 7fb552bdf640 1 -- 172.21.15.27:0/2155593262 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb5300668f0 msgr2=0x7fb530068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:13.507 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.503+0000 7fb552bdf640 1 --2- 172.21.15.27:0/2155593262 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb5300668f0 0x7fb530068db0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb54c09d450 tx=0x7fb538007ba0 comp rx=0 tx=0).stop 2024-01-15T11:33:13.508 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.503+0000 7fb552bdf640 1 -- 172.21.15.27:0/2155593262 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb54c06df40 msgr2=0x7fb54c0988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:13.508 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.503+0000 7fb552bdf640 1 --2- 172.21.15.27:0/2155593262 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb54c06df40 0x7fb54c0988e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb54000e870 tx=0x7fb54000ec70 comp rx=0 tx=0).stop 2024-01-15T11:33:13.508 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.503+0000 7fb552bdf640 1 -- 172.21.15.27:0/2155593262 shutdown_connections 2024-01-15T11:33:13.508 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.503+0000 7fb552bdf640 1 --2- 172.21.15.27:0/2155593262 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb54c15b340 0x7fb54c0992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:13.508 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.503+0000 7fb552bdf640 1 --2- 172.21.15.27:0/2155593262 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb5300668f0 0x7fb530068db0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:13.508 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.503+0000 7fb552bdf640 1 --2- 172.21.15.27:0/2155593262 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb54c0cbed0 0x7fb54c14d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:13.508 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.503+0000 7fb552bdf640 1 --2- 172.21.15.27:0/2155593262 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb54c06df40 0x7fb54c0988e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:13.508 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.503+0000 7fb552bdf640 1 -- 172.21.15.27:0/2155593262 >> 172.21.15.27:0/2155593262 conn(0x7fb54c0b0ec0 msgr2=0x7fb54c0aecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:13.508 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.503+0000 7fb552bdf640 1 -- 172.21.15.27:0/2155593262 shutdown_connections 2024-01-15T11:33:13.509 INFO:teuthology.misc.health.smithi027.stderr:2024-01-15T11:33:13.503+0000 7fb552bdf640 1 -- 172.21.15.27:0/2155593262 wait complete. 2024-01-15T11:33:13.525 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-01-15T11:33:13.525 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-01-15T11:33:13.525 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-15T11:33:13.526 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-15T11:33:13.530 INFO:tasks.ceph.mds.a:Started 2024-01-15T11:33:13.530 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-15T11:33:13.530 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-15T11:33:13.534 INFO:tasks.ceph.mds.c:Started 2024-01-15T11:33:13.534 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-15T11:33:13.534 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-15T11:33:13.538 INFO:tasks.ceph.mds.b:Started 2024-01-15T11:33:13.538 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-15T11:33:13.539 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-15T11:33:13.543 INFO:tasks.ceph.mds.d:Started 2024-01-15T11:33:13.543 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-01-15T11:33:13.543 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:33:13.628 INFO:tasks.ceph.mds.c.smithi027.stdout:starting mds.c at 2024-01-15T11:33:13.631 INFO:tasks.ceph.mds.a.smithi027.stdout:starting mds.a at 2024-01-15T11:33:13.647 INFO:tasks.ceph.mds.b.smithi093.stdout:starting mds.b at 2024-01-15T11:33:13.648 INFO:tasks.ceph.mds.d.smithi093.stdout:starting mds.d at 2024-01-15T11:33:13.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.691+0000 7f30c5432640 1 Processor -- start 2024-01-15T11:33:13.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.691+0000 7f30c5432640 1 -- start start 2024-01-15T11:33:13.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.691+0000 7f30c5432640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f30c015d640 0x7f30c00d3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:13.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.691+0000 7f30c5432640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c006b3f0 con 0x7f30c00d4090 2024-01-15T11:33:13.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.691+0000 7f30c5432640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c006b6d0 con 0x7f30c00d2110 2024-01-15T11:33:13.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.691+0000 7f30c5432640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c015da20 con 0x7f30c015d640 2024-01-15T11:33:13.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.691+0000 7f30b7fff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f30c00d4090 0x7f30c00d1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:43682/0 (socket says 172.21.15.27:43682) 2024-01-15T11:33:13.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.691+0000 7f30b7fff640 1 -- 172.21.15.27:0/3987229323 learned_addr learned my addr 172.21.15.27:0/3987229323 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:13.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.691+0000 7f30beffd640 1 --2- 172.21.15.27:0/3987229323 >> v2:172.21.15.93:3300/0 conn(0x7f30c015d640 0x7f30c00d3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:13.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.691+0000 7f30be7fc640 1 -- 172.21.15.27:0/3987229323 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 62281304 0 0) 0x7f30c006b3f0 con 0x7f30c00d4090 2024-01-15T11:33:13.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.691+0000 7f30beffd640 1 -- 172.21.15.27:0/3987229323 >> v1:172.21.15.93:6789/0 conn(0x7f30c00d2110 legacy=0x7f30c006bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:13.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.691+0000 7f30beffd640 1 -- 172.21.15.27:0/3987229323 >> v1:172.21.15.27:6789/0 conn(0x7f30c00d4090 legacy=0x7f30c00d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:13.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.691+0000 7f30beffd640 1 -- 172.21.15.27:0/3987229323 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c00d10b0 con 0x7f30c015d640 2024-01-15T11:33:13.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.695+0000 7f30beffd640 1 --2- 172.21.15.27:0/3987229323 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f30c015d640 0x7f30c00d3b50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f30b0009740 tx=0x7f30b001c1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d32acdb4f1a67e6a server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:13.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.695+0000 7f30be7fc640 1 -- 172.21.15.27:0/3987229323 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b00ab600 con 0x7f30c015d640 2024-01-15T11:33:13.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.695+0000 7f30be7fc640 1 -- 172.21.15.27:0/3987229323 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b00a7050 con 0x7f30c015d640 2024-01-15T11:33:13.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.695+0000 7f30be7fc640 1 -- 172.21.15.27:0/3987229323 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b00ab980 con 0x7f30c015d640 2024-01-15T11:33:13.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.695+0000 7f30c5432640 1 -- 172.21.15.27:0/3987229323 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f30c015d640 msgr2=0x7f30c00d3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:13.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.695+0000 7f30c5432640 1 --2- 172.21.15.27:0/3987229323 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f30c015d640 0x7f30c00d3b50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f30b0009740 tx=0x7f30b001c1f0 comp rx=0 tx=0).stop 2024-01-15T11:33:13.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.695+0000 7f30c5432640 1 -- 172.21.15.27:0/3987229323 shutdown_connections 2024-01-15T11:33:13.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.695+0000 7f30c5432640 1 --2- 172.21.15.27:0/3987229323 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f30c015d640 0x7f30c00d3b50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:13.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.695+0000 7f30c5432640 1 -- 172.21.15.27:0/3987229323 >> 172.21.15.27:0/3987229323 conn(0x7f30c008afc0 msgr2=0x7f30c00d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:13.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.695+0000 7f30c5432640 1 -- 172.21.15.27:0/3987229323 shutdown_connections 2024-01-15T11:33:13.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.695+0000 7f30c5432640 1 -- 172.21.15.27:0/3987229323 wait complete. 2024-01-15T11:33:13.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.699+0000 7f30c5432640 1 Processor -- start 2024-01-15T11:33:13.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.699+0000 7f30c5432640 1 -- start start 2024-01-15T11:33:13.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.699+0000 7f30c5432640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30c00d2110 0x7f30c00b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:13.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.699+0000 7f30c5432640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f30c00d4090 0x7f30c0155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:13.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.699+0000 7f30c5432640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f30c015d640 0x7f30c014cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:13.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.699+0000 7f30c5432640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c0153170 con 0x7f30c00d2110 2024-01-15T11:33:13.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.699+0000 7f30c5432640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c00b1570 con 0x7f30c00d4090 2024-01-15T11:33:13.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.699+0000 7f30c5432640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c00b1850 con 0x7f30c015d640 2024-01-15T11:33:13.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.699+0000 7f30beffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30c00d2110 0x7f30c00b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:13.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.699+0000 7f30beffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30c00d2110 0x7f30c00b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34704/0 (socket says 172.21.15.27:34704) 2024-01-15T11:33:13.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.699+0000 7f30beffd640 1 -- 172.21.15.27:0/2632936567 learned_addr learned my addr 172.21.15.27:0/2632936567 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:13.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.699+0000 7f30b7fff640 1 --2- 172.21.15.27:0/2632936567 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f30c00d4090 0x7f30c0155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:13.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.699+0000 7f30bf7fe640 1 --2- 172.21.15.27:0/2632936567 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f30c015d640 0x7f30c014cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:13.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.699+0000 7f30beffd640 1 -- 172.21.15.27:0/2632936567 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f30c015d640 msgr2=0x7f30c014cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:13.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.699+0000 7f30beffd640 1 --2- 172.21.15.27:0/2632936567 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f30c015d640 0x7f30c014cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:13.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.699+0000 7f30beffd640 1 -- 172.21.15.27:0/2632936567 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f30c00d4090 msgr2=0x7f30c0155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:13.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.699+0000 7f30beffd640 1 --2- 172.21.15.27:0/2632936567 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f30c00d4090 0x7f30c0155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:13.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.699+0000 7f30beffd640 1 -- 172.21.15.27:0/2632936567 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b0009420 con 0x7f30c00d2110 2024-01-15T11:33:13.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.699+0000 7f30beffd640 1 --2- 172.21.15.27:0/2632936567 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30c00d2110 0x7f30c00b0cb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f30b00ae040 tx=0x7f30b001aa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:13.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.699+0000 7f30b77fe640 1 -- 172.21.15.27:0/2632936567 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b00b7650 con 0x7f30c00d2110 2024-01-15T11:33:13.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.699+0000 7f30b77fe640 1 -- 172.21.15.27:0/2632936567 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b00b77d0 con 0x7f30c00d2110 2024-01-15T11:33:13.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.699+0000 7f30c5432640 1 -- 172.21.15.27:0/2632936567 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c00b1b30 con 0x7f30c00d2110 2024-01-15T11:33:13.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.699+0000 7f30b77fe640 1 -- 172.21.15.27:0/2632936567 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b00b7b80 con 0x7f30c00d2110 2024-01-15T11:33:13.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.699+0000 7f30c5432640 1 -- 172.21.15.27:0/2632936567 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c00b11f0 con 0x7f30c00d2110 2024-01-15T11:33:13.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.703+0000 7f30c5432640 1 -- 172.21.15.27:0/2632936567 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c004e850 con 0x7f30c00d2110 2024-01-15T11:33:13.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.703+0000 7f30b77fe640 1 -- 172.21.15.27:0/2632936567 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f30b00b7ce0 con 0x7f30c00d2110 2024-01-15T11:33:13.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.703+0000 7f30b77fe640 1 --2- 172.21.15.27:0/2632936567 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f30a0066920 0x7f30a0068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:13.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.703+0000 7f30b77fe640 1 -- 172.21.15.27:0/2632936567 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f30b011e9c0 con 0x7f30c00d2110 2024-01-15T11:33:13.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.703+0000 7f30b7fff640 1 --2- 172.21.15.27:0/2632936567 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f30a0066920 0x7f30a0068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:13.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.703+0000 7f30b7fff640 1 --2- 172.21.15.27:0/2632936567 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f30a0066920 0x7f30a0068de0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f30c01fa750 tx=0x7f30a8007240 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:13.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.707+0000 7f30b77fe640 1 -- 172.21.15.27:0/2632936567 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f30b00ec110 con 0x7f30c00d2110 2024-01-15T11:33:13.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.863+0000 7f30c5432640 1 -- 172.21.15.27:0/2632936567 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30c00b1cc0 con 0x7f30c00d2110 2024-01-15T11:33:13.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.867+0000 7f30b77fe640 1 -- 172.21.15.27:0/2632936567 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12766 (secure 0 0 0) 0x7f30b00b0090 con 0x7f30c00d2110 2024-01-15T11:33:13.869 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:13.869 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":18,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:33:10.197649+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:33:13.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.867+0000 7f30c5432640 1 -- 172.21.15.27:0/2632936567 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f30a0066920 msgr2=0x7f30a0068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:13.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.867+0000 7f30c5432640 1 --2- 172.21.15.27:0/2632936567 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f30a0066920 0x7f30a0068de0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f30c01fa750 tx=0x7f30a8007240 comp rx=0 tx=0).stop 2024-01-15T11:33:13.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.867+0000 7f30c5432640 1 -- 172.21.15.27:0/2632936567 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30c00d2110 msgr2=0x7f30c00b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:13.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.867+0000 7f30c5432640 1 --2- 172.21.15.27:0/2632936567 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30c00d2110 0x7f30c00b0cb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f30b00ae040 tx=0x7f30b001aa30 comp rx=0 tx=0).stop 2024-01-15T11:33:13.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.867+0000 7f30c5432640 1 -- 172.21.15.27:0/2632936567 shutdown_connections 2024-01-15T11:33:13.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.867+0000 7f30c5432640 1 --2- 172.21.15.27:0/2632936567 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f30c015d640 0x7f30c014cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:13.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.867+0000 7f30c5432640 1 --2- 172.21.15.27:0/2632936567 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f30a0066920 0x7f30a0068de0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:13.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.867+0000 7f30c5432640 1 --2- 172.21.15.27:0/2632936567 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f30c00d4090 0x7f30c0155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:13.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.867+0000 7f30c5432640 1 --2- 172.21.15.27:0/2632936567 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f30c00d2110 0x7f30c00b0cb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:13.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.867+0000 7f30c5432640 1 -- 172.21.15.27:0/2632936567 >> 172.21.15.27:0/2632936567 conn(0x7f30c008afc0 msgr2=0x7f30c00d19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:13.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.867+0000 7f30c5432640 1 -- 172.21.15.27:0/2632936567 shutdown_connections 2024-01-15T11:33:13.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:13.867+0000 7f30c5432640 1 -- 172.21.15.27:0/2632936567 wait complete. 2024-01-15T11:33:13.890 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T11:33:08.134662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T11:33:13.891 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T11:33:14.036 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.031+0000 7f3cfa7c1640 1 Processor -- start 2024-01-15T11:33:14.036 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.031+0000 7f3cfa7c1640 1 -- start start 2024-01-15T11:33:14.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.035+0000 7f3cfa7c1640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3cf4159f00 0x7f3cf40ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:14.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.035+0000 7f3cfa7c1640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf4072950 con 0x7f3cf40ae680 2024-01-15T11:33:14.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.035+0000 7f3cfa7c1640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf406e2b0 con 0x7f3cf4070890 2024-01-15T11:33:14.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.035+0000 7f3cfa7c1640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf406c6f0 con 0x7f3cf4159f00 2024-01-15T11:33:14.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.035+0000 7f3cf37fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f3cf40ae680 0x7f3cf40cd3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:43692/0 (socket says 172.21.15.27:43692) 2024-01-15T11:33:14.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.035+0000 7f3cf37fe640 1 -- 172.21.15.27:0/578480044 learned_addr learned my addr 172.21.15.27:0/578480044 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:14.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.035+0000 7f3cf3fff640 1 --2- 172.21.15.27:0/578480044 >> v2:172.21.15.93:3300/0 conn(0x7f3cf4159f00 0x7f3cf40ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:14.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.035+0000 7f3cf2ffd640 1 -- 172.21.15.27:0/578480044 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2110459554 0 0) 0x7f3cf4072950 con 0x7f3cf40ae680 2024-01-15T11:33:14.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.035+0000 7f3cf2ffd640 1 -- 172.21.15.27:0/578480044 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cdc003530 con 0x7f3cf40ae680 2024-01-15T11:33:14.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.035+0000 7f3cf3fff640 1 -- 172.21.15.27:0/578480044 >> v1:172.21.15.93:6789/0 conn(0x7f3cf4070890 legacy=0x7f3cf4070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:14.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.035+0000 7f3cf2ffd640 1 -- 172.21.15.27:0/578480044 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2114419388 0 0) 0x7f3cf406e2b0 con 0x7f3cf4070890 2024-01-15T11:33:14.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.035+0000 7f3cf3fff640 1 -- 172.21.15.27:0/578480044 >> v1:172.21.15.27:6789/0 conn(0x7f3cf40ae680 legacy=0x7f3cf40cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:14.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.035+0000 7f3cf3fff640 1 -- 172.21.15.27:0/578480044 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf406e550 con 0x7f3cf4159f00 2024-01-15T11:33:14.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.039+0000 7f3cf3fff640 1 --2- 172.21.15.27:0/578480044 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cf4159f00 0x7f3cf40ccea0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40097c0 tx=0x7f3ce401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edd329864d4d9a77 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:14.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.039+0000 7f3cf2ffd640 1 -- 172.21.15.27:0/578480044 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce40ac630 con 0x7f3cf4159f00 2024-01-15T11:33:14.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.039+0000 7f3cf2ffd640 1 -- 172.21.15.27:0/578480044 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce40ac790 con 0x7f3cf4159f00 2024-01-15T11:33:14.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.039+0000 7f3cf2ffd640 1 -- 172.21.15.27:0/578480044 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce40acb20 con 0x7f3cf4159f00 2024-01-15T11:33:14.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.039+0000 7f3cfa7c1640 1 -- 172.21.15.27:0/578480044 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cf4159f00 msgr2=0x7f3cf40ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:14.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.039+0000 7f3cfa7c1640 1 --2- 172.21.15.27:0/578480044 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cf4159f00 0x7f3cf40ccea0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40097c0 tx=0x7f3ce401c450 comp rx=0 tx=0).stop 2024-01-15T11:33:14.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.039+0000 7f3cfa7c1640 1 -- 172.21.15.27:0/578480044 shutdown_connections 2024-01-15T11:33:14.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.039+0000 7f3cfa7c1640 1 --2- 172.21.15.27:0/578480044 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cf4159f00 0x7f3cf40ccea0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:14.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.039+0000 7f3cfa7c1640 1 -- 172.21.15.27:0/578480044 >> 172.21.15.27:0/578480044 conn(0x7f3cf40b0cb0 msgr2=0x7f3cf40b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:14.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.039+0000 7f3cfa7c1640 1 -- 172.21.15.27:0/578480044 shutdown_connections 2024-01-15T11:33:14.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.039+0000 7f3cfa7c1640 1 -- 172.21.15.27:0/578480044 wait complete. 2024-01-15T11:33:14.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.039+0000 7f3cfa7c1640 1 Processor -- start 2024-01-15T11:33:14.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.039+0000 7f3cfa7c1640 1 -- start start 2024-01-15T11:33:14.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cfa7c1640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3cf4070890 0x7f3cf4141940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:14.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cfa7c1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cf40ae680 0x7f3cf40b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:14.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cfa7c1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cf4152e20 0x7f3cf40afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:14.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cfa7c1640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf41f6e10 con 0x7f3cf40ae680 2024-01-15T11:33:14.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cfa7c1640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf41f61d0 con 0x7f3cf4152e20 2024-01-15T11:33:14.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cfa7c1640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf41f6470 con 0x7f3cf4070890 2024-01-15T11:33:14.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cf37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cf40ae680 0x7f3cf40b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:14.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cf37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cf40ae680 0x7f3cf40b1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34708/0 (socket says 172.21.15.27:34708) 2024-01-15T11:33:14.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cf37fe640 1 -- 172.21.15.27:0/969680113 learned_addr learned my addr 172.21.15.27:0/969680113 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:14.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cf3fff640 1 --2- 172.21.15.27:0/969680113 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3cf4070890 0x7f3cf4141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:14.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cf8d5e640 1 --2- 172.21.15.27:0/969680113 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cf4152e20 0x7f3cf40afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:14.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cf37fe640 1 -- 172.21.15.27:0/969680113 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3cf4070890 msgr2=0x7f3cf4141940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:14.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cf37fe640 1 --2- 172.21.15.27:0/969680113 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3cf4070890 0x7f3cf4141940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:14.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cf37fe640 1 -- 172.21.15.27:0/969680113 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cf4152e20 msgr2=0x7f3cf40afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:14.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cf37fe640 1 --2- 172.21.15.27:0/969680113 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cf4152e20 0x7f3cf40afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:14.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cf37fe640 1 -- 172.21.15.27:0/969680113 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce4009420 con 0x7f3cf40ae680 2024-01-15T11:33:14.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cf3fff640 1 --2- 172.21.15.27:0/969680113 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3cf4070890 0x7f3cf4141940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:14.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cf8d5e640 1 --2- 172.21.15.27:0/969680113 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cf4152e20 0x7f3cf40afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:14.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cf37fe640 1 --2- 172.21.15.27:0/969680113 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cf40ae680 0x7f3cf40b1e50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3ce800c450 tx=0x7f3ce800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:14.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cf0ff9640 1 -- 172.21.15.27:0/969680113 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8005cf0 con 0x7f3cf40ae680 2024-01-15T11:33:14.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cf0ff9640 1 -- 172.21.15.27:0/969680113 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce8005e50 con 0x7f3cf40ae680 2024-01-15T11:33:14.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cf0ff9640 1 -- 172.21.15.27:0/969680113 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8007290 con 0x7f3cf40ae680 2024-01-15T11:33:14.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cfa7c1640 1 -- 172.21.15.27:0/969680113 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf41f6750 con 0x7f3cf40ae680 2024-01-15T11:33:14.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cfa7c1640 1 -- 172.21.15.27:0/969680113 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf4141e80 con 0x7f3cf40ae680 2024-01-15T11:33:14.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cfa7c1640 1 -- 172.21.15.27:0/969680113 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf40671f0 con 0x7f3cf40ae680 2024-01-15T11:33:14.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.043+0000 7f3cf0ff9640 1 -- 172.21.15.27:0/969680113 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f3ce80073f0 con 0x7f3cf40ae680 2024-01-15T11:33:14.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.047+0000 7f3cf0ff9640 1 --2- 172.21.15.27:0/969680113 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3ce00668f0 0x7f3ce0068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:14.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.047+0000 7f3cf0ff9640 1 -- 172.21.15.27:0/969680113 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3ce80836f0 con 0x7f3cf40ae680 2024-01-15T11:33:14.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.047+0000 7f3cf3fff640 1 --2- 172.21.15.27:0/969680113 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3ce00668f0 0x7f3ce0068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:14.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.047+0000 7f3cf3fff640 1 --2- 172.21.15.27:0/969680113 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3ce00668f0 0x7f3ce0068db0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40ae000 tx=0x7f3ce40a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:14.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.051+0000 7f3cf0ff9640 1 -- 172.21.15.27:0/969680113 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3ce8050be0 con 0x7f3cf40ae680 2024-01-15T11:33:14.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.207+0000 7f3cfa7c1640 1 -- 172.21.15.27:0/969680113 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3cf40b15e0 con 0x7f3cf40ae680 2024-01-15T11:33:14.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.211+0000 7f3cf0ff9640 1 -- 172.21.15.27:0/969680113 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3ce8017020 con 0x7f3cf40ae680 2024-01-15T11:33:14.213 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-15T11:33:14.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.211+0000 7f3cfa7c1640 1 -- 172.21.15.27:0/969680113 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3ce00668f0 msgr2=0x7f3ce0068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:14.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.211+0000 7f3cfa7c1640 1 --2- 172.21.15.27:0/969680113 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3ce00668f0 0x7f3ce0068db0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40ae000 tx=0x7f3ce40a7000 comp rx=0 tx=0).stop 2024-01-15T11:33:14.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.211+0000 7f3cfa7c1640 1 -- 172.21.15.27:0/969680113 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cf40ae680 msgr2=0x7f3cf40b1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:14.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.211+0000 7f3cfa7c1640 1 --2- 172.21.15.27:0/969680113 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cf40ae680 0x7f3cf40b1e50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3ce800c450 tx=0x7f3ce800c910 comp rx=0 tx=0).stop 2024-01-15T11:33:14.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.211+0000 7f3cfa7c1640 1 -- 172.21.15.27:0/969680113 shutdown_connections 2024-01-15T11:33:14.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.211+0000 7f3cfa7c1640 1 --2- 172.21.15.27:0/969680113 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3ce00668f0 0x7f3ce0068db0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:14.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.211+0000 7f3cfa7c1640 1 --2- 172.21.15.27:0/969680113 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cf4152e20 0x7f3cf40afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:14.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.211+0000 7f3cfa7c1640 1 --2- 172.21.15.27:0/969680113 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3cf40ae680 0x7f3cf40b1e50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:14.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.211+0000 7f3cfa7c1640 1 --2- 172.21.15.27:0/969680113 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3cf4070890 0x7f3cf4141940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:14.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.211+0000 7f3cfa7c1640 1 -- 172.21.15.27:0/969680113 >> 172.21.15.27:0/969680113 conn(0x7f3cf40b0cb0 msgr2=0x7f3cf40717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:14.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.211+0000 7f3cfa7c1640 1 -- 172.21.15.27:0/969680113 shutdown_connections 2024-01-15T11:33:14.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.211+0000 7f3cfa7c1640 1 -- 172.21.15.27:0/969680113 wait complete. 2024-01-15T11:33:14.234 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-15T11:33:14.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.375+0000 7f7b4ef2a640 1 Processor -- start 2024-01-15T11:33:14.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.375+0000 7f7b4ef2a640 1 -- start start 2024-01-15T11:33:14.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.375+0000 7f7b4ef2a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b480cb230 0x7f7b48070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:14.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.375+0000 7f7b4ef2a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7b48071430 0x7f7b4806d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:14.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.375+0000 7f7b4ef2a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b480b41a0 con 0x7f7b48159880 2024-01-15T11:33:14.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.375+0000 7f7b4ef2a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b480718c0 con 0x7f7b48071430 2024-01-15T11:33:14.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.375+0000 7f7b4ef2a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b480b3be0 con 0x7f7b480cb230 2024-01-15T11:33:14.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.375+0000 7f7b4d4c7640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7b48071430 0x7f7b4806d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:14.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.375+0000 7f7b4d4c7640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7b48071430 0x7f7b4806d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34722/0 (socket says 172.21.15.27:34722) 2024-01-15T11:33:14.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.375+0000 7f7b4d4c7640 1 -- 172.21.15.27:0/3245224230 learned_addr learned my addr 172.21.15.27:0/3245224230 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:14.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.379+0000 7f7b47fff640 1 --2- 172.21.15.27:0/3245224230 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b480cb230 0x7f7b48070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:14.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.379+0000 7f7b4d4c7640 1 -- 172.21.15.27:0/3245224230 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b480cb230 msgr2=0x7f7b48070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:14.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.379+0000 7f7b4d4c7640 1 --2- 172.21.15.27:0/3245224230 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b480cb230 0x7f7b48070ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:14.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.379+0000 7f7b4d4c7640 1 -- 172.21.15.27:0/3245224230 >> v1:172.21.15.93:6789/0 conn(0x7f7b48159880 legacy=0x7f7b480b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:14.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.379+0000 7f7b4d4c7640 1 -- 172.21.15.27:0/3245224230 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b480b3ec0 con 0x7f7b48071430 2024-01-15T11:33:14.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.379+0000 7f7b477fe640 1 -- 172.21.15.27:0/3245224230 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820458932 0 0) 0x7f7b480b41a0 con 0x7f7b48159880 2024-01-15T11:33:14.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.379+0000 7f7b47fff640 1 --2- 172.21.15.27:0/3245224230 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b480cb230 0x7f7b48070ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:14.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.379+0000 7f7b4d4c7640 1 --2- 172.21.15.27:0/3245224230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b48071430 0x7f7b4806d760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7b40009e50 tx=0x7f7b4001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f8bb704fd22a16 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:14.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.379+0000 7f7b477fe640 1 -- 172.21.15.27:0/3245224230 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b400a56b0 con 0x7f7b48071430 2024-01-15T11:33:14.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.379+0000 7f7b477fe640 1 -- 172.21.15.27:0/3245224230 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b400a5810 con 0x7f7b48071430 2024-01-15T11:33:14.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.379+0000 7f7b477fe640 1 -- 172.21.15.27:0/3245224230 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b400a5ba0 con 0x7f7b48071430 2024-01-15T11:33:14.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.379+0000 7f7b4ef2a640 1 -- 172.21.15.27:0/3245224230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b48071430 msgr2=0x7f7b4806d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:14.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.379+0000 7f7b4ef2a640 1 --2- 172.21.15.27:0/3245224230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b48071430 0x7f7b4806d760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7b40009e50 tx=0x7f7b4001c980 comp rx=0 tx=0).stop 2024-01-15T11:33:14.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.383+0000 7f7b4ef2a640 1 -- 172.21.15.27:0/3245224230 shutdown_connections 2024-01-15T11:33:14.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.383+0000 7f7b4ef2a640 1 --2- 172.21.15.27:0/3245224230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b48071430 0x7f7b4806d760 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:14.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.383+0000 7f7b4ef2a640 1 --2- 172.21.15.27:0/3245224230 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b480cb230 0x7f7b48070ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:14.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.383+0000 7f7b4ef2a640 1 -- 172.21.15.27:0/3245224230 >> 172.21.15.27:0/3245224230 conn(0x7f7b480b0c40 msgr2=0x7f7b480b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:14.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.383+0000 7f7b4ef2a640 1 -- 172.21.15.27:0/3245224230 shutdown_connections 2024-01-15T11:33:14.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.383+0000 7f7b4ef2a640 1 -- 172.21.15.27:0/3245224230 wait complete. 2024-01-15T11:33:14.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.383+0000 7f7b4ef2a640 1 Processor -- start 2024-01-15T11:33:14.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.383+0000 7f7b4ef2a640 1 -- start start 2024-01-15T11:33:14.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.383+0000 7f7b4ef2a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b48071430 0x7f7b481f8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:14.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.383+0000 7f7b4ef2a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b480cb230 0x7f7b480cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:14.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.383+0000 7f7b4ef2a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b48159880 0x7f7b481f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:14.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.383+0000 7f7b4ef2a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b480cd8c0 con 0x7f7b480cb230 2024-01-15T11:33:14.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.383+0000 7f7b4ef2a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b480ccc40 con 0x7f7b48159880 2024-01-15T11:33:14.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.383+0000 7f7b4ef2a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b480ccf20 con 0x7f7b48071430 2024-01-15T11:33:14.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.383+0000 7f7b47fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b480cb230 0x7f7b480cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:14.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.383+0000 7f7b47fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b480cb230 0x7f7b480cc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34724/0 (socket says 172.21.15.27:34724) 2024-01-15T11:33:14.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.383+0000 7f7b47fff640 1 -- 172.21.15.27:0/1893774200 learned_addr learned my addr 172.21.15.27:0/1893774200 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:14.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.383+0000 7f7b4ccc6640 1 --2- 172.21.15.27:0/1893774200 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b48071430 0x7f7b481f8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:14.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.383+0000 7f7b4d4c7640 1 --2- 172.21.15.27:0/1893774200 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b48159880 0x7f7b481f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:14.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.383+0000 7f7b47fff640 1 -- 172.21.15.27:0/1893774200 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b48071430 msgr2=0x7f7b481f8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:14.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.383+0000 7f7b47fff640 1 --2- 172.21.15.27:0/1893774200 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b48071430 0x7f7b481f8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:14.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.383+0000 7f7b47fff640 1 -- 172.21.15.27:0/1893774200 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b48159880 msgr2=0x7f7b481f5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:14.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.383+0000 7f7b47fff640 1 --2- 172.21.15.27:0/1893774200 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b48159880 0x7f7b481f5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:14.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.383+0000 7f7b47fff640 1 -- 172.21.15.27:0/1893774200 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b34009420 con 0x7f7b480cb230 2024-01-15T11:33:14.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.383+0000 7f7b4d4c7640 1 --2- 172.21.15.27:0/1893774200 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b48159880 0x7f7b481f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:33:14.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.387+0000 7f7b47fff640 1 --2- 172.21.15.27:0/1893774200 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b480cb230 0x7f7b480cc2d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400ebe0 tx=0x7f7b3400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:14.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.387+0000 7f7b457fa640 1 -- 172.21.15.27:0/1893774200 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3400eee0 con 0x7f7b480cb230 2024-01-15T11:33:14.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.387+0000 7f7b457fa640 1 -- 172.21.15.27:0/1893774200 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3400cc30 con 0x7f7b480cb230 2024-01-15T11:33:14.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.387+0000 7f7b457fa640 1 -- 172.21.15.27:0/1893774200 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34013470 con 0x7f7b480cb230 2024-01-15T11:33:14.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.387+0000 7f7b4ef2a640 1 -- 172.21.15.27:0/1893774200 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b40009b30 con 0x7f7b480cb230 2024-01-15T11:33:14.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.387+0000 7f7b4ef2a640 1 -- 172.21.15.27:0/1893774200 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b480cd4e0 con 0x7f7b480cb230 2024-01-15T11:33:14.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.387+0000 7f7b4ef2a640 1 -- 172.21.15.27:0/1893774200 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b4804e850 con 0x7f7b480cb230 2024-01-15T11:33:14.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.387+0000 7f7b457fa640 1 -- 172.21.15.27:0/1893774200 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f7b340135d0 con 0x7f7b480cb230 2024-01-15T11:33:14.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.387+0000 7f7b457fa640 1 --2- 172.21.15.27:0/1893774200 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7b2c0668f0 0x7f7b2c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:14.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.387+0000 7f7b457fa640 1 -- 172.21.15.27:0/1893774200 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7b340843c0 con 0x7f7b480cb230 2024-01-15T11:33:14.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.387+0000 7f7b4ccc6640 1 --2- 172.21.15.27:0/1893774200 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7b2c0668f0 0x7f7b2c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:14.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.391+0000 7f7b4ccc6640 1 --2- 172.21.15.27:0/1893774200 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7b2c0668f0 0x7f7b2c068db0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c000f70 tx=0x7f7b3c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:14.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.391+0000 7f7b457fa640 1 -- 172.21.15.27:0/1893774200 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7b34051940 con 0x7f7b480cb230 2024-01-15T11:33:14.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.587+0000 7f7b4ef2a640 1 -- 172.21.15.27:0/1893774200 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b480b2c80 con 0x7f7b480cb230 2024-01-15T11:33:14.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.591+0000 7f7b457fa640 1 -- 172.21.15.27:0/1893774200 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1321 (secure 0 0 0) 0x7f7b34054f60 con 0x7f7b480cb230 2024-01-15T11:33:14.594 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:14.594 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/889491859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":889491859},{"type":"v1","addr":"172.21.15.27:6833","nonce":889491859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-15T11:33:14.594 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 2 2024-01-15T11:33:14.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.591+0000 7f7b4ef2a640 1 -- 172.21.15.27:0/1893774200 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7b2c0668f0 msgr2=0x7f7b2c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:14.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.591+0000 7f7b4ef2a640 1 --2- 172.21.15.27:0/1893774200 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7b2c0668f0 0x7f7b2c068db0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c000f70 tx=0x7f7b3c009040 comp rx=0 tx=0).stop 2024-01-15T11:33:14.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.591+0000 7f7b4ef2a640 1 -- 172.21.15.27:0/1893774200 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b480cb230 msgr2=0x7f7b480cc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:14.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.591+0000 7f7b4ef2a640 1 --2- 172.21.15.27:0/1893774200 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b480cb230 0x7f7b480cc2d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400ebe0 tx=0x7f7b3400c520 comp rx=0 tx=0).stop 2024-01-15T11:33:14.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.591+0000 7f7b4ef2a640 1 -- 172.21.15.27:0/1893774200 shutdown_connections 2024-01-15T11:33:14.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.591+0000 7f7b4ef2a640 1 --2- 172.21.15.27:0/1893774200 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7b2c0668f0 0x7f7b2c068db0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:14.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.591+0000 7f7b4ef2a640 1 --2- 172.21.15.27:0/1893774200 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b48159880 0x7f7b481f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:14.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.591+0000 7f7b4ef2a640 1 --2- 172.21.15.27:0/1893774200 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b480cb230 0x7f7b480cc2d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:14.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.591+0000 7f7b4ef2a640 1 --2- 172.21.15.27:0/1893774200 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b48071430 0x7f7b481f8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:14.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.591+0000 7f7b4ef2a640 1 -- 172.21.15.27:0/1893774200 >> 172.21.15.27:0/1893774200 conn(0x7f7b480b0c40 msgr2=0x7f7b48156f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:14.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.591+0000 7f7b4ef2a640 1 -- 172.21.15.27:0/1893774200 shutdown_connections 2024-01-15T11:33:14.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:14.591+0000 7f7b4ef2a640 1 -- 172.21.15.27:0/1893774200 wait complete. 2024-01-15T11:33:16.616 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-15T11:33:16.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.767+0000 7f3a2c972640 1 Processor -- start 2024-01-15T11:33:16.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.767+0000 7f3a2c972640 1 -- start start 2024-01-15T11:33:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a2c972640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3a280ce5c0 0x7f3a280cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a2c972640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a280b0a70 con 0x7f3a2806a5b0 2024-01-15T11:33:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a2c972640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a280b4100 con 0x7f3a2815d8b0 2024-01-15T11:33:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a2c972640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a280cddb0 con 0x7f3a280ce5c0 2024-01-15T11:33:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a26d9d640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f3a2806a5b0 0x7f3a2806aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:48746/0 (socket says 172.21.15.27:48746) 2024-01-15T11:33:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a26d9d640 1 -- 172.21.15.27:0/3264150933 learned_addr learned my addr 172.21.15.27:0/3264150933 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a25d9b640 1 --2- 172.21.15.27:0/3264150933 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3a280ce5c0 0x7f3a280cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a2559a640 1 -- 172.21.15.27:0/3264150933 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3105082804 0 0) 0x7f3a280b0a70 con 0x7f3a2806a5b0 2024-01-15T11:33:16.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a2559a640 1 -- 172.21.15.27:0/3264150933 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a10003530 con 0x7f3a2806a5b0 2024-01-15T11:33:16.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a2559a640 1 -- 172.21.15.27:0/3264150933 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 732482400 0 0) 0x7f3a10003530 con 0x7f3a2806a5b0 2024-01-15T11:33:16.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a2559a640 1 -- 172.21.15.27:0/3264150933 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3a280ce5c0 msgr2=0x7f3a280cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:16.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a2559a640 1 --2- 172.21.15.27:0/3264150933 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3a280ce5c0 0x7f3a280cea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:16.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a2559a640 1 -- 172.21.15.27:0/3264150933 >> v1:172.21.15.93:6789/0 conn(0x7f3a2815d8b0 legacy=0x7f3a280b4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:16.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a2559a640 1 -- 172.21.15.27:0/3264150933 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a280b43e0 con 0x7f3a2806a5b0 2024-01-15T11:33:16.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a2559a640 1 -- 172.21.15.27:0/3264150933 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1394381265 0 0) 0x7f3a20001a00 con 0x7f3a2806a5b0 2024-01-15T11:33:16.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a2559a640 1 -- 172.21.15.27:0/3264150933 >> v1:172.21.15.27:6789/0 conn(0x7f3a2806a5b0 legacy=0x7f3a2806aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:16.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a2559a640 1 --2- 172.21.15.27:0/3264150933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a100039b0 0x7f3a10003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:16.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a2559a640 1 --2- 172.21.15.27:0/3264150933 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a10004360 0x7f3a10004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:16.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a2559a640 1 --2- 172.21.15.27:0/3264150933 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3a280ce5c0 0x7f3a10005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:16.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a2559a640 1 -- 172.21.15.27:0/3264150933 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a280cddb0 con 0x7f3a100039b0 2024-01-15T11:33:16.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a2559a640 1 -- 172.21.15.27:0/3264150933 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1000b990 con 0x7f3a10004360 2024-01-15T11:33:16.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a2559a640 1 -- 172.21.15.27:0/3264150933 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1000bb50 con 0x7f3a280ce5c0 2024-01-15T11:33:16.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a2659c640 1 --2- 172.21.15.27:0/3264150933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a100039b0 0x7f3a10003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:16.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a26d9d640 1 --2- 172.21.15.27:0/3264150933 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3a280ce5c0 0x7f3a10005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:16.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a25d9b640 1 --2- 172.21.15.27:0/3264150933 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a10004360 0x7f3a10004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:16.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a2659c640 1 -- 172.21.15.27:0/3264150933 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3a280ce5c0 msgr2=0x7f3a10005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:16.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a2659c640 1 --2- 172.21.15.27:0/3264150933 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3a280ce5c0 0x7f3a10005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:16.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a2659c640 1 -- 172.21.15.27:0/3264150933 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a10004360 msgr2=0x7f3a10004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:16.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a2659c640 1 --2- 172.21.15.27:0/3264150933 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a10004360 0x7f3a10004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:16.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.771+0000 7f3a2659c640 1 -- 172.21.15.27:0/3264150933 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a10003530 con 0x7f3a100039b0 2024-01-15T11:33:16.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.775+0000 7f3a2659c640 1 --2- 172.21.15.27:0/3264150933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a100039b0 0x7f3a10003d90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3a18001860 tx=0x7f3a1801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2bea0cc779700e server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:16.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.775+0000 7f3a2559a640 1 -- 172.21.15.27:0/3264150933 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a180a8890 con 0x7f3a100039b0 2024-01-15T11:33:16.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.775+0000 7f3a2559a640 1 -- 172.21.15.27:0/3264150933 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a180a89f0 con 0x7f3a100039b0 2024-01-15T11:33:16.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.775+0000 7f3a2559a640 1 -- 172.21.15.27:0/3264150933 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a180a8da0 con 0x7f3a100039b0 2024-01-15T11:33:16.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.775+0000 7f3a2c972640 1 -- 172.21.15.27:0/3264150933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a100039b0 msgr2=0x7f3a10003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:16.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.775+0000 7f3a2c972640 1 --2- 172.21.15.27:0/3264150933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a100039b0 0x7f3a10003d90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3a18001860 tx=0x7f3a1801ec70 comp rx=0 tx=0).stop 2024-01-15T11:33:16.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.775+0000 7f3a26d9d640 1 -- 172.21.15.27:0/3264150933 reap_dead start 2024-01-15T11:33:16.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.775+0000 7f3a2c972640 1 -- 172.21.15.27:0/3264150933 shutdown_connections 2024-01-15T11:33:16.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.775+0000 7f3a2c972640 1 -- 172.21.15.27:0/3264150933 >> 172.21.15.27:0/3264150933 conn(0x7f3a280b5570 msgr2=0x7f3a280b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:16.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.775+0000 7f3a2c972640 1 -- 172.21.15.27:0/3264150933 shutdown_connections 2024-01-15T11:33:16.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.775+0000 7f3a2c972640 1 -- 172.21.15.27:0/3264150933 wait complete. 2024-01-15T11:33:16.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.779+0000 7f3a2c972640 1 Processor -- start 2024-01-15T11:33:16.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.779+0000 7f3a2c972640 1 -- start start 2024-01-15T11:33:16.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.779+0000 7f3a2c972640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a100039b0 0x7f3a28149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:16.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.779+0000 7f3a2c972640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3a2815bb30 0x7f3a2815bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:16.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.779+0000 7f3a2c972640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a280ad260 0x7f3a280ad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:16.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.779+0000 7f3a2c972640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a280aec50 con 0x7f3a280ad260 2024-01-15T11:33:16.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.779+0000 7f3a2c972640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2815c4f0 con 0x7f3a100039b0 2024-01-15T11:33:16.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.779+0000 7f3a2c972640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a280adfd0 con 0x7f3a2815bb30 2024-01-15T11:33:16.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.779+0000 7f3a2659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a100039b0 0x7f3a28149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:16.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.779+0000 7f3a26d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a280ad260 0x7f3a280ad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:16.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.779+0000 7f3a2659c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a100039b0 0x7f3a28149bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:48300/0 (socket says 172.21.15.27:48300) 2024-01-15T11:33:16.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.779+0000 7f3a2659c640 1 -- 172.21.15.27:0/2337758185 learned_addr learned my addr 172.21.15.27:0/2337758185 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:16.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.779+0000 7f3a25d9b640 1 --2- 172.21.15.27:0/2337758185 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3a2815bb30 0x7f3a2815bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:16.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.779+0000 7f3a26d9d640 1 -- 172.21.15.27:0/2337758185 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3a2815bb30 msgr2=0x7f3a2815bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:16.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.779+0000 7f3a26d9d640 1 --2- 172.21.15.27:0/2337758185 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3a2815bb30 0x7f3a2815bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:16.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.779+0000 7f3a26d9d640 1 -- 172.21.15.27:0/2337758185 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a100039b0 msgr2=0x7f3a28149bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:16.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.779+0000 7f3a26d9d640 1 --2- 172.21.15.27:0/2337758185 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a100039b0 0x7f3a28149bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:16.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.779+0000 7f3a26d9d640 1 -- 172.21.15.27:0/2337758185 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a280ae2b0 con 0x7f3a280ad260 2024-01-15T11:33:16.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.779+0000 7f3a26d9d640 1 --2- 172.21.15.27:0/2337758185 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a280ad260 0x7f3a280ad6e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3a28071360 tx=0x7f3a2000a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:16.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.779+0000 7f3a16ffd640 1 -- 172.21.15.27:0/2337758185 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2000ac80 con 0x7f3a280ad260 2024-01-15T11:33:16.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.779+0000 7f3a16ffd640 1 -- 172.21.15.27:0/2337758185 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2000ae20 con 0x7f3a280ad260 2024-01-15T11:33:16.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.779+0000 7f3a2c972640 1 -- 172.21.15.27:0/2337758185 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a280ae590 con 0x7f3a280ad260 2024-01-15T11:33:16.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.779+0000 7f3a16ffd640 1 -- 172.21.15.27:0/2337758185 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a20013630 con 0x7f3a280ad260 2024-01-15T11:33:16.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.779+0000 7f3a2c972640 1 -- 172.21.15.27:0/2337758185 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2814a100 con 0x7f3a280ad260 2024-01-15T11:33:16.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.779+0000 7f3a2c972640 1 -- 172.21.15.27:0/2337758185 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a280b0650 con 0x7f3a280ad260 2024-01-15T11:33:16.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.783+0000 7f3a16ffd640 1 -- 172.21.15.27:0/2337758185 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f3a20013790 con 0x7f3a280ad260 2024-01-15T11:33:16.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.783+0000 7f3a16ffd640 1 --2- 172.21.15.27:0/2337758185 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3a080668f0 0x7f3a08068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:16.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.783+0000 7f3a16ffd640 1 -- 172.21.15.27:0/2337758185 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3a20084670 con 0x7f3a280ad260 2024-01-15T11:33:16.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.783+0000 7f3a2659c640 1 --2- 172.21.15.27:0/2337758185 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3a080668f0 0x7f3a08068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:16.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.783+0000 7f3a2659c640 1 --2- 172.21.15.27:0/2337758185 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3a080668f0 0x7f3a08068db0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3a18000c10 tx=0x7f3a180aa070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:16.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.787+0000 7f3a16ffd640 1 -- 172.21.15.27:0/2337758185 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3a20051b60 con 0x7f3a280ad260 2024-01-15T11:33:16.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.975+0000 7f3a2c972640 1 -- 172.21.15.27:0/2337758185 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a2804e850 con 0x7f3a280ad260 2024-01-15T11:33:16.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.975+0000 7f3a16ffd640 1 -- 172.21.15.27:0/2337758185 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3691 (secure 0 0 0) 0x7f3a20055180 con 0x7f3a280ad260 2024-01-15T11:33:16.980 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:16.980 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3682867520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3682867520},{"type":"v1","addr":"172.21.15.93:6837","nonce":3682867520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/2849635892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2849635892},{"type":"v1","addr":"172.21.15.93:6836","nonce":2849635892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/889491859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":889491859},{"type":"v1","addr":"172.21.15.27:6833","nonce":889491859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2516765751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2516765751},{"type":"v1","addr":"172.21.15.27:6835","nonce":2516765751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-01-15T11:33:16.980 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 3 2024-01-15T11:33:16.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.979+0000 7f3a2c972640 1 -- 172.21.15.27:0/2337758185 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3a080668f0 msgr2=0x7f3a08068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:16.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.979+0000 7f3a2c972640 1 --2- 172.21.15.27:0/2337758185 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3a080668f0 0x7f3a08068db0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3a18000c10 tx=0x7f3a180aa070 comp rx=0 tx=0).stop 2024-01-15T11:33:16.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.979+0000 7f3a2c972640 1 -- 172.21.15.27:0/2337758185 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a280ad260 msgr2=0x7f3a280ad6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:16.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.979+0000 7f3a2c972640 1 --2- 172.21.15.27:0/2337758185 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a280ad260 0x7f3a280ad6e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3a28071360 tx=0x7f3a2000a6a0 comp rx=0 tx=0).stop 2024-01-15T11:33:16.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.979+0000 7f3a2c972640 1 -- 172.21.15.27:0/2337758185 shutdown_connections 2024-01-15T11:33:16.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.979+0000 7f3a2c972640 1 --2- 172.21.15.27:0/2337758185 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a280ad260 0x7f3a280ad6e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:16.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.979+0000 7f3a2c972640 1 --2- 172.21.15.27:0/2337758185 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3a2815bb30 0x7f3a2815bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:16.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.979+0000 7f3a2c972640 1 --2- 172.21.15.27:0/2337758185 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3a080668f0 0x7f3a08068db0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:16.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.979+0000 7f3a2c972640 1 --2- 172.21.15.27:0/2337758185 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3a100039b0 0x7f3a28149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:16.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.979+0000 7f3a2c972640 1 -- 172.21.15.27:0/2337758185 >> 172.21.15.27:0/2337758185 conn(0x7f3a280b5570 msgr2=0x7f3a280d03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:16.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.979+0000 7f3a2c972640 1 -- 172.21.15.27:0/2337758185 shutdown_connections 2024-01-15T11:33:16.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:16.979+0000 7f3a2c972640 1 -- 172.21.15.27:0/2337758185 wait complete. 2024-01-15T11:33:17.001 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:33:17.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.139+0000 7f764473e640 1 Processor -- start 2024-01-15T11:33:17.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.139+0000 7f764473e640 1 -- start start 2024-01-15T11:33:17.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.143+0000 7f764473e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f763c144c80 0x7f763c0abf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:17.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.143+0000 7f764473e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f763c070df0 0x7f763c06c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:17.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.143+0000 7f764473e640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f763c145060 con 0x7f763c0ac460 2024-01-15T11:33:17.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.143+0000 7f764473e640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f763c071fd0 con 0x7f763c070df0 2024-01-15T11:33:17.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.143+0000 7f764473e640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f763c0ac8c0 con 0x7f763c144c80 2024-01-15T11:33:17.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.143+0000 7f7642cdb640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f763c070df0 0x7f763c06c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:17.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.143+0000 7f7642cdb640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f763c070df0 0x7f763c06c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58072/0 (socket says 172.21.15.27:58072) 2024-01-15T11:33:17.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.143+0000 7f7642cdb640 1 -- 172.21.15.27:0/220222040 learned_addr learned my addr 172.21.15.27:0/220222040 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:17.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.143+0000 7f76424da640 1 --2- 172.21.15.27:0/220222040 >> v2:172.21.15.93:3300/0 conn(0x7f763c144c80 0x7f763c0abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:17.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.143+0000 7f7642cdb640 1 -- 172.21.15.27:0/220222040 >> v2:172.21.15.93:3300/0 conn(0x7f763c144c80 msgr2=0x7f763c0abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:17.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.143+0000 7f7642cdb640 1 --2- 172.21.15.27:0/220222040 >> v2:172.21.15.93:3300/0 conn(0x7f763c144c80 0x7f763c0abf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:17.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.143+0000 7f7642cdb640 1 -- 172.21.15.27:0/220222040 >> v1:172.21.15.93:6789/0 conn(0x7f763c0ac460 legacy=0x7f763c0706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:17.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.143+0000 7f7642cdb640 1 -- 172.21.15.27:0/220222040 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c071450 con 0x7f763c070df0 2024-01-15T11:33:17.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.147+0000 7f7642cdb640 1 --2- 172.21.15.27:0/220222040 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f763c070df0 0x7f763c06c910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f763c06eb80 tx=0x7f763401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0adc38add4d178a server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:17.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.147+0000 7f76414d8640 1 -- 172.21.15.27:0/220222040 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76340a5780 con 0x7f763c070df0 2024-01-15T11:33:17.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.147+0000 7f76414d8640 1 -- 172.21.15.27:0/220222040 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76340a58e0 con 0x7f763c070df0 2024-01-15T11:33:17.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.147+0000 7f76414d8640 1 -- 172.21.15.27:0/220222040 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76340a5c70 con 0x7f763c070df0 2024-01-15T11:33:17.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.147+0000 7f764473e640 1 -- 172.21.15.27:0/220222040 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f763c070df0 msgr2=0x7f763c06c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:17.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.147+0000 7f764473e640 1 --2- 172.21.15.27:0/220222040 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f763c070df0 0x7f763c06c910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f763c06eb80 tx=0x7f763401c9d0 comp rx=0 tx=0).stop 2024-01-15T11:33:17.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.147+0000 7f764473e640 1 -- 172.21.15.27:0/220222040 shutdown_connections 2024-01-15T11:33:17.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.147+0000 7f764473e640 1 --2- 172.21.15.27:0/220222040 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f763c070df0 0x7f763c06c910 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:17.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.147+0000 7f764473e640 1 --2- 172.21.15.27:0/220222040 >> v2:172.21.15.93:3300/0 conn(0x7f763c144c80 0x7f763c0abf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:17.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.147+0000 7f764473e640 1 -- 172.21.15.27:0/220222040 >> 172.21.15.27:0/220222040 conn(0x7f763c0b0c40 msgr2=0x7f763c0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:17.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.147+0000 7f764473e640 1 -- 172.21.15.27:0/220222040 shutdown_connections 2024-01-15T11:33:17.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.147+0000 7f764473e640 1 -- 172.21.15.27:0/220222040 wait complete. 2024-01-15T11:33:17.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.147+0000 7f764473e640 1 Processor -- start 2024-01-15T11:33:17.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.147+0000 7f764473e640 1 -- start start 2024-01-15T11:33:17.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.151+0000 7f764473e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f763c070df0 0x7f763c15a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:17.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.151+0000 7f764473e640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f763c0ac460 0x7f763c0b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:17.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.151+0000 7f764473e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f763c144c80 0x7f763c09a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:17.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.151+0000 7f764473e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c164570 con 0x7f763c070df0 2024-01-15T11:33:17.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.151+0000 7f764473e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c09c010 con 0x7f763c144c80 2024-01-15T11:33:17.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.151+0000 7f764473e640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763c15ad70 con 0x7f763c0ac460 2024-01-15T11:33:17.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.151+0000 7f76424da640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f763c070df0 0x7f763c15a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:17.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.151+0000 7f76424da640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f763c070df0 0x7f763c15a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58076/0 (socket says 172.21.15.27:58076) 2024-01-15T11:33:17.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.151+0000 7f76424da640 1 -- 172.21.15.27:0/3673530383 learned_addr learned my addr 172.21.15.27:0/3673530383 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:17.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.151+0000 7f7641cd9640 1 --2- 172.21.15.27:0/3673530383 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f763c0ac460 0x7f763c0b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:17.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.151+0000 7f7642cdb640 1 --2- 172.21.15.27:0/3673530383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f763c144c80 0x7f763c09a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:17.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.151+0000 7f76424da640 1 -- 172.21.15.27:0/3673530383 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f763c0ac460 msgr2=0x7f763c0b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:17.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.151+0000 7f76424da640 1 --2- 172.21.15.27:0/3673530383 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f763c0ac460 0x7f763c0b3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:17.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.151+0000 7f76424da640 1 -- 172.21.15.27:0/3673530383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f763c144c80 msgr2=0x7f763c09a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:17.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.151+0000 7f76424da640 1 --2- 172.21.15.27:0/3673530383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f763c144c80 0x7f763c09a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:17.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.151+0000 7f76424da640 1 -- 172.21.15.27:0/3673530383 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7634009b30 con 0x7f763c070df0 2024-01-15T11:33:17.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.151+0000 7f76424da640 1 --2- 172.21.15.27:0/3673530383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f763c070df0 0x7f763c15a830 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f763800e870 tx=0x7f763800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:17.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.151+0000 7f7632ffd640 1 -- 172.21.15.27:0/3673530383 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7638009510 con 0x7f763c070df0 2024-01-15T11:33:17.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.151+0000 7f7632ffd640 1 -- 172.21.15.27:0/3673530383 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763800eec0 con 0x7f763c070df0 2024-01-15T11:33:17.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.151+0000 7f764473e640 1 -- 172.21.15.27:0/3673530383 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763c15e660 con 0x7f763c070df0 2024-01-15T11:33:17.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.151+0000 7f7632ffd640 1 -- 172.21.15.27:0/3673530383 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763800cb40 con 0x7f763c070df0 2024-01-15T11:33:17.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.151+0000 7f764473e640 1 -- 172.21.15.27:0/3673530383 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763c15de70 con 0x7f763c070df0 2024-01-15T11:33:17.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.151+0000 7f764473e640 1 -- 172.21.15.27:0/3673530383 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f763c1647e0 con 0x7f763c070df0 2024-01-15T11:33:17.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.151+0000 7f7632ffd640 1 -- 172.21.15.27:0/3673530383 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f763800cca0 con 0x7f763c070df0 2024-01-15T11:33:17.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.155+0000 7f7632ffd640 1 --2- 172.21.15.27:0/3673530383 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f76200668f0 0x7f7620068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:17.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.155+0000 7f7632ffd640 1 -- 172.21.15.27:0/3673530383 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7638084160 con 0x7f763c070df0 2024-01-15T11:33:17.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.155+0000 7f7641cd9640 1 --2- 172.21.15.27:0/3673530383 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f76200668f0 0x7f7620068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:17.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.155+0000 7f7641cd9640 1 --2- 172.21.15.27:0/3673530383 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f76200668f0 0x7f7620068db0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f763c144510 tx=0x7f762c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:17.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.159+0000 7f7632ffd640 1 -- 172.21.15.27:0/3673530383 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7638051790 con 0x7f763c070df0 2024-01-15T11:33:17.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.315+0000 7f764473e640 1 -- 172.21.15.27:0/3673530383 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f763c0b1ba0 con 0x7f763c070df0 2024-01-15T11:33:17.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.319+0000 7f7632ffd640 1 -- 172.21.15.27:0/3673530383 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12766 (secure 0 0 0) 0x7f7638054db0 con 0x7f763c070df0 2024-01-15T11:33:17.321 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:17.321 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":18,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:33:10.197649+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:33:17.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.319+0000 7f764473e640 1 -- 172.21.15.27:0/3673530383 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f76200668f0 msgr2=0x7f7620068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:17.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.319+0000 7f764473e640 1 --2- 172.21.15.27:0/3673530383 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f76200668f0 0x7f7620068db0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f763c144510 tx=0x7f762c009040 comp rx=0 tx=0).stop 2024-01-15T11:33:17.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.319+0000 7f764473e640 1 -- 172.21.15.27:0/3673530383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f763c070df0 msgr2=0x7f763c15a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:17.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.319+0000 7f764473e640 1 --2- 172.21.15.27:0/3673530383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f763c070df0 0x7f763c15a830 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f763800e870 tx=0x7f763800ec70 comp rx=0 tx=0).stop 2024-01-15T11:33:17.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.319+0000 7f764473e640 1 -- 172.21.15.27:0/3673530383 shutdown_connections 2024-01-15T11:33:17.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.319+0000 7f764473e640 1 --2- 172.21.15.27:0/3673530383 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f76200668f0 0x7f7620068db0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:17.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.319+0000 7f764473e640 1 --2- 172.21.15.27:0/3673530383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f763c144c80 0x7f763c09a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:17.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.319+0000 7f764473e640 1 --2- 172.21.15.27:0/3673530383 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f763c0ac460 0x7f763c0b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:17.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.319+0000 7f764473e640 1 --2- 172.21.15.27:0/3673530383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f763c070df0 0x7f763c15a830 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:17.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.319+0000 7f764473e640 1 -- 172.21.15.27:0/3673530383 >> 172.21.15.27:0/3673530383 conn(0x7f763c0b0c40 msgr2=0x7f763c0aee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:17.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.319+0000 7f764473e640 1 -- 172.21.15.27:0/3673530383 shutdown_connections 2024-01-15T11:33:17.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.319+0000 7f764473e640 1 -- 172.21.15.27:0/3673530383 wait complete. 2024-01-15T11:33:17.342 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T11:33:08.134662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T11:33:17.343 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T11:33:17.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.483+0000 7f7b3f52a640 1 Processor -- start 2024-01-15T11:33:17.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.483+0000 7f7b3f52a640 1 -- start start 2024-01-15T11:33:17.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.487+0000 7f7b3f52a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7b380b07a0 0x7f7b381619e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:17.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.487+0000 7f7b3f52a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b38161f20 0x7f7b380b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:17.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.487+0000 7f7b3f52a640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b38161290 con 0x7f7b380b2870 2024-01-15T11:33:17.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.487+0000 7f7b3f52a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b380b0b80 con 0x7f7b380b07a0 2024-01-15T11:33:17.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.487+0000 7f7b3f52a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3815ebc0 con 0x7f7b38161f20 2024-01-15T11:33:17.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.487+0000 7f7b3dac7640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7b380b2870 0x7f7b380cc9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:48754/0 (socket says 172.21.15.27:48754) 2024-01-15T11:33:17.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.487+0000 7f7b3d2c6640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7b380b07a0 0x7f7b381619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:17.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.487+0000 7f7b3dac7640 1 -- 172.21.15.27:0/4134295573 learned_addr learned my addr 172.21.15.27:0/4134295573 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:17.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.487+0000 7f7b3cac5640 1 --2- 172.21.15.27:0/4134295573 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b38161f20 0x7f7b380b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:17.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.487+0000 7f7b3d2c6640 1 -- 172.21.15.27:0/4134295573 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b38161f20 msgr2=0x7f7b380b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:17.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.487+0000 7f7b3d2c6640 1 --2- 172.21.15.27:0/4134295573 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b38161f20 0x7f7b380b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:17.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.487+0000 7f7b3d2c6640 1 -- 172.21.15.27:0/4134295573 >> v1:172.21.15.27:6789/0 conn(0x7f7b380b2870 legacy=0x7f7b380cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:17.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.487+0000 7f7b3d2c6640 1 -- 172.21.15.27:0/4134295573 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b38161550 con 0x7f7b380b07a0 2024-01-15T11:33:17.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.487+0000 7f7b2ffff640 1 -- 172.21.15.27:0/4134295573 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2667562477 0 0) 0x7f7b38161290 con 0x7f7b380b2870 2024-01-15T11:33:17.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.491+0000 7f7b3d2c6640 1 --2- 172.21.15.27:0/4134295573 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b380b07a0 0x7f7b381619e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7b340097f0 tx=0x7f7b3401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd48906e18f97de server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:17.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.491+0000 7f7b2ffff640 1 -- 172.21.15.27:0/4134295573 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b340ab600 con 0x7f7b380b07a0 2024-01-15T11:33:17.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.491+0000 7f7b2ffff640 1 -- 172.21.15.27:0/4134295573 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b340a7050 con 0x7f7b380b07a0 2024-01-15T11:33:17.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.491+0000 7f7b2ffff640 1 -- 172.21.15.27:0/4134295573 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b340ab980 con 0x7f7b380b07a0 2024-01-15T11:33:17.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.491+0000 7f7b3f52a640 1 -- 172.21.15.27:0/4134295573 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b380b07a0 msgr2=0x7f7b381619e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:17.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.491+0000 7f7b3f52a640 1 --2- 172.21.15.27:0/4134295573 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b380b07a0 0x7f7b381619e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7b340097f0 tx=0x7f7b3401c480 comp rx=0 tx=0).stop 2024-01-15T11:33:17.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.491+0000 7f7b3f52a640 1 -- 172.21.15.27:0/4134295573 shutdown_connections 2024-01-15T11:33:17.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.491+0000 7f7b3f52a640 1 --2- 172.21.15.27:0/4134295573 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b38161f20 0x7f7b380b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:17.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.491+0000 7f7b3f52a640 1 --2- 172.21.15.27:0/4134295573 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b380b07a0 0x7f7b381619e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:17.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.491+0000 7f7b3f52a640 1 -- 172.21.15.27:0/4134295573 >> 172.21.15.27:0/4134295573 conn(0x7f7b380b1d50 msgr2=0x7f7b380b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:17.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.491+0000 7f7b3f52a640 1 -- 172.21.15.27:0/4134295573 shutdown_connections 2024-01-15T11:33:17.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.491+0000 7f7b3f52a640 1 -- 172.21.15.27:0/4134295573 wait complete. 2024-01-15T11:33:17.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.491+0000 7f7b3f52a640 1 Processor -- start 2024-01-15T11:33:17.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.491+0000 7f7b3f52a640 1 -- start start 2024-01-15T11:33:17.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.495+0000 7f7b3f52a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b380b07a0 0x7f7b380b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:17.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.495+0000 7f7b3f52a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b380b2870 0x7f7b380b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:17.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.495+0000 7f7b3f52a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b38161f20 0x7f7b38157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:17.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.495+0000 7f7b3f52a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b380b0330 con 0x7f7b38161f20 2024-01-15T11:33:17.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.495+0000 7f7b3f52a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b380b0050 con 0x7f7b380b07a0 2024-01-15T11:33:17.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.495+0000 7f7b3f52a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b380b3880 con 0x7f7b380b2870 2024-01-15T11:33:17.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.495+0000 7f7b3dac7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b38161f20 0x7f7b38157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:17.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.495+0000 7f7b3dac7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b38161f20 0x7f7b38157750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58090/0 (socket says 172.21.15.27:58090) 2024-01-15T11:33:17.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.495+0000 7f7b3dac7640 1 -- 172.21.15.27:0/471047423 learned_addr learned my addr 172.21.15.27:0/471047423 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:17.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.495+0000 7f7b3d2c6640 1 --2- 172.21.15.27:0/471047423 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b380b07a0 0x7f7b380b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:17.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.495+0000 7f7b3cac5640 1 --2- 172.21.15.27:0/471047423 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b380b2870 0x7f7b380b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:17.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.495+0000 7f7b3dac7640 1 -- 172.21.15.27:0/471047423 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b380b2870 msgr2=0x7f7b380b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:17.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.495+0000 7f7b3dac7640 1 --2- 172.21.15.27:0/471047423 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b380b2870 0x7f7b380b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:17.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.495+0000 7f7b3dac7640 1 -- 172.21.15.27:0/471047423 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b380b07a0 msgr2=0x7f7b380b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:17.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.495+0000 7f7b3dac7640 1 --2- 172.21.15.27:0/471047423 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b380b07a0 0x7f7b380b4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:17.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.495+0000 7f7b3dac7640 1 -- 172.21.15.27:0/471047423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b34009420 con 0x7f7b38161f20 2024-01-15T11:33:17.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.495+0000 7f7b3dac7640 1 --2- 172.21.15.27:0/471047423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b38161f20 0x7f7b38157750 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000c7a0 tx=0x7f7b3000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:17.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.495+0000 7f7b2dffb640 1 -- 172.21.15.27:0/471047423 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3000a640 con 0x7f7b38161f20 2024-01-15T11:33:17.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.495+0000 7f7b2dffb640 1 -- 172.21.15.27:0/471047423 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3000a7a0 con 0x7f7b38161f20 2024-01-15T11:33:17.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.495+0000 7f7b2dffb640 1 -- 172.21.15.27:0/471047423 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3000abd0 con 0x7f7b38161f20 2024-01-15T11:33:17.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.495+0000 7f7b3f52a640 1 -- 172.21.15.27:0/471047423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b380b3b60 con 0x7f7b38161f20 2024-01-15T11:33:17.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.495+0000 7f7b3f52a640 1 -- 172.21.15.27:0/471047423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b380afd20 con 0x7f7b38161f20 2024-01-15T11:33:17.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.495+0000 7f7b3f52a640 1 -- 172.21.15.27:0/471047423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b380b4080 con 0x7f7b38161f20 2024-01-15T11:33:17.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.495+0000 7f7b2dffb640 1 -- 172.21.15.27:0/471047423 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f7b3000ad30 con 0x7f7b38161f20 2024-01-15T11:33:17.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.499+0000 7f7b2dffb640 1 --2- 172.21.15.27:0/471047423 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7b1c0668f0 0x7f7b1c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:17.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.499+0000 7f7b2dffb640 1 -- 172.21.15.27:0/471047423 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7b300835a0 con 0x7f7b38161f20 2024-01-15T11:33:17.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.499+0000 7f7b3d2c6640 1 --2- 172.21.15.27:0/471047423 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7b1c0668f0 0x7f7b1c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:17.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.499+0000 7f7b3d2c6640 1 --2- 172.21.15.27:0/471047423 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7b1c0668f0 0x7f7b1c068db0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7b340ad000 tx=0x7f7b34008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:17.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.503+0000 7f7b2dffb640 1 -- 172.21.15.27:0/471047423 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7b380b4080 con 0x7f7b38161f20 2024-01-15T11:33:17.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.663+0000 7f7b3f52a640 1 -- 172.21.15.27:0/471047423 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7b380b4080 con 0x7f7b38161f20 2024-01-15T11:33:17.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.663+0000 7f7b2dffb640 1 -- 172.21.15.27:0/471047423 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7b380b4080 con 0x7f7b38161f20 2024-01-15T11:33:17.666 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-15T11:33:17.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.663+0000 7f7b3f52a640 1 -- 172.21.15.27:0/471047423 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7b1c0668f0 msgr2=0x7f7b1c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:17.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.663+0000 7f7b3f52a640 1 --2- 172.21.15.27:0/471047423 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7b1c0668f0 0x7f7b1c068db0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7b340ad000 tx=0x7f7b34008040 comp rx=0 tx=0).stop 2024-01-15T11:33:17.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.663+0000 7f7b3f52a640 1 -- 172.21.15.27:0/471047423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b38161f20 msgr2=0x7f7b38157750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:17.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.663+0000 7f7b3f52a640 1 --2- 172.21.15.27:0/471047423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b38161f20 0x7f7b38157750 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000c7a0 tx=0x7f7b3000cc60 comp rx=0 tx=0).stop 2024-01-15T11:33:17.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.663+0000 7f7b3f52a640 1 -- 172.21.15.27:0/471047423 shutdown_connections 2024-01-15T11:33:17.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.663+0000 7f7b3f52a640 1 --2- 172.21.15.27:0/471047423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b38161f20 0x7f7b38157750 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:17.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.663+0000 7f7b3f52a640 1 --2- 172.21.15.27:0/471047423 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b380b2870 0x7f7b380b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:17.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.663+0000 7f7b3f52a640 1 --2- 172.21.15.27:0/471047423 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7b1c0668f0 0x7f7b1c068db0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:17.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.663+0000 7f7b3f52a640 1 --2- 172.21.15.27:0/471047423 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b380b07a0 0x7f7b380b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:17.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.663+0000 7f7b3f52a640 1 -- 172.21.15.27:0/471047423 >> 172.21.15.27:0/471047423 conn(0x7f7b380b1d50 msgr2=0x7f7b38160d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:17.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.663+0000 7f7b3f52a640 1 -- 172.21.15.27:0/471047423 shutdown_connections 2024-01-15T11:33:17.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.663+0000 7f7b3f52a640 1 -- 172.21.15.27:0/471047423 wait complete. 2024-01-15T11:33:17.687 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-15T11:33:17.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.827+0000 7f334f079640 1 Processor -- start 2024-01-15T11:33:17.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.827+0000 7f334f079640 1 -- start start 2024-01-15T11:33:17.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.827+0000 7f334f079640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f334806dfd0 0x7f334806e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:17.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.827+0000 7f334f079640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f334806e950 con 0x7f3348143ae0 2024-01-15T11:33:17.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.827+0000 7f334f079640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3348070670 con 0x7f33480adcc0 2024-01-15T11:33:17.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.827+0000 7f334f079640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33480ae820 con 0x7f334806dfd0 2024-01-15T11:33:17.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.827+0000 7f334ce15640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f3348143ae0 0x7f33480b1f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:48766/0 (socket says 172.21.15.27:48766) 2024-01-15T11:33:17.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.827+0000 7f334ce15640 1 -- 172.21.15.27:0/1704895269 learned_addr learned my addr 172.21.15.27:0/1704895269 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:17.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.827+0000 7f3347fff640 1 --2- 172.21.15.27:0/1704895269 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f334806dfd0 0x7f334806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:17.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.827+0000 7f33477fe640 1 -- 172.21.15.27:0/1704895269 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2054769919 0 0) 0x7f334806e950 con 0x7f3348143ae0 2024-01-15T11:33:17.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.827+0000 7f33477fe640 1 -- 172.21.15.27:0/1704895269 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3338003530 con 0x7f3348143ae0 2024-01-15T11:33:17.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.827+0000 7f33477fe640 1 -- 172.21.15.27:0/1704895269 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743421471 0 0) 0x7f3348070670 con 0x7f33480adcc0 2024-01-15T11:33:17.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.827+0000 7f33477fe640 1 -- 172.21.15.27:0/1704895269 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f334806e950 con 0x7f33480adcc0 2024-01-15T11:33:17.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.827+0000 7f3347fff640 1 -- 172.21.15.27:0/1704895269 >> v1:172.21.15.93:6789/0 conn(0x7f33480adcc0 legacy=0x7f33480ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:17.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.827+0000 7f3347fff640 1 -- 172.21.15.27:0/1704895269 >> v1:172.21.15.27:6789/0 conn(0x7f3348143ae0 legacy=0x7f33480b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:17.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.827+0000 7f3347fff640 1 -- 172.21.15.27:0/1704895269 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3348070950 con 0x7f334806dfd0 2024-01-15T11:33:17.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.831+0000 7f3347fff640 1 --2- 172.21.15.27:0/1704895269 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f334806dfd0 0x7f334806e410 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f33340097f0 tx=0x7f333401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20919b846cac24dc server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:17.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.831+0000 7f33477fe640 1 -- 172.21.15.27:0/1704895269 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33340aa5f0 con 0x7f334806dfd0 2024-01-15T11:33:17.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.831+0000 7f33477fe640 1 -- 172.21.15.27:0/1704895269 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33340aa750 con 0x7f334806dfd0 2024-01-15T11:33:17.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.831+0000 7f33477fe640 1 -- 172.21.15.27:0/1704895269 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33340aaae0 con 0x7f334806dfd0 2024-01-15T11:33:17.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.831+0000 7f334f079640 1 -- 172.21.15.27:0/1704895269 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f334806dfd0 msgr2=0x7f334806e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:17.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.831+0000 7f334f079640 1 --2- 172.21.15.27:0/1704895269 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f334806dfd0 0x7f334806e410 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f33340097f0 tx=0x7f333401c490 comp rx=0 tx=0).stop 2024-01-15T11:33:17.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.831+0000 7f334f079640 1 -- 172.21.15.27:0/1704895269 shutdown_connections 2024-01-15T11:33:17.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.831+0000 7f334f079640 1 --2- 172.21.15.27:0/1704895269 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f334806dfd0 0x7f334806e410 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:17.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.831+0000 7f334f079640 1 -- 172.21.15.27:0/1704895269 >> 172.21.15.27:0/1704895269 conn(0x7f33480b0c40 msgr2=0x7f33480b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:17.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.831+0000 7f334f079640 1 -- 172.21.15.27:0/1704895269 shutdown_connections 2024-01-15T11:33:17.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.831+0000 7f334f079640 1 -- 172.21.15.27:0/1704895269 wait complete. 2024-01-15T11:33:17.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.835+0000 7f334f079640 1 Processor -- start 2024-01-15T11:33:17.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.835+0000 7f334f079640 1 -- start start 2024-01-15T11:33:17.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.835+0000 7f334f079640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f334806dfd0 0x7f33480b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:17.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.835+0000 7f334f079640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f33480adcc0 0x7f334809b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:17.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.835+0000 7f334f079640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3348143ae0 0x7f3348158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:17.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.835+0000 7f334f079640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334809ae80 con 0x7f3348143ae0 2024-01-15T11:33:17.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.835+0000 7f334f079640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334813fba0 con 0x7f33480adcc0 2024-01-15T11:33:17.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.835+0000 7f334f079640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f334809a4e0 con 0x7f334806dfd0 2024-01-15T11:33:17.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.835+0000 7f334d616640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3348143ae0 0x7f3348158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:17.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.835+0000 7f334d616640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3348143ae0 0x7f3348158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58094/0 (socket says 172.21.15.27:58094) 2024-01-15T11:33:17.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.835+0000 7f334d616640 1 -- 172.21.15.27:0/614024680 learned_addr learned my addr 172.21.15.27:0/614024680 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:17.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.835+0000 7f3347fff640 1 --2- 172.21.15.27:0/614024680 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f33480adcc0 0x7f334809b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:17.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.835+0000 7f334ce15640 1 --2- 172.21.15.27:0/614024680 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f334806dfd0 0x7f33480b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:17.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.835+0000 7f334d616640 1 -- 172.21.15.27:0/614024680 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f334806dfd0 msgr2=0x7f33480b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:17.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.835+0000 7f334d616640 1 --2- 172.21.15.27:0/614024680 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f334806dfd0 0x7f33480b2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:17.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.835+0000 7f334d616640 1 -- 172.21.15.27:0/614024680 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f33480adcc0 msgr2=0x7f334809b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:17.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.835+0000 7f334d616640 1 --2- 172.21.15.27:0/614024680 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f33480adcc0 0x7f334809b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:17.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.835+0000 7f334d616640 1 -- 172.21.15.27:0/614024680 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3334009420 con 0x7f3348143ae0 2024-01-15T11:33:17.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.835+0000 7f334d616640 1 --2- 172.21.15.27:0/614024680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3348143ae0 0x7f3348158a20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f334000c790 tx=0x7f334000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:17.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.835+0000 7f33457fa640 1 -- 172.21.15.27:0/614024680 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334000cea0 con 0x7f3348143ae0 2024-01-15T11:33:17.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.835+0000 7f33457fa640 1 -- 172.21.15.27:0/614024680 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3340003b80 con 0x7f3348143ae0 2024-01-15T11:33:17.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.835+0000 7f33457fa640 1 -- 172.21.15.27:0/614024680 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334000a850 con 0x7f3348143ae0 2024-01-15T11:33:17.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.835+0000 7f334f079640 1 -- 172.21.15.27:0/614024680 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f334809a7c0 con 0x7f3348143ae0 2024-01-15T11:33:17.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.835+0000 7f334f079640 1 -- 172.21.15.27:0/614024680 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33480b3150 con 0x7f3348143ae0 2024-01-15T11:33:17.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.839+0000 7f334f079640 1 -- 172.21.15.27:0/614024680 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f334809afc0 con 0x7f3348143ae0 2024-01-15T11:33:17.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.839+0000 7f33457fa640 1 -- 172.21.15.27:0/614024680 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f334000a9b0 con 0x7f3348143ae0 2024-01-15T11:33:17.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.839+0000 7f33457fa640 1 --2- 172.21.15.27:0/614024680 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f332c0668f0 0x7f332c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:17.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.839+0000 7f33457fa640 1 -- 172.21.15.27:0/614024680 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3340083e90 con 0x7f3348143ae0 2024-01-15T11:33:17.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.839+0000 7f334ce15640 1 --2- 172.21.15.27:0/614024680 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f332c0668f0 0x7f332c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:17.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.839+0000 7f334ce15640 1 --2- 172.21.15.27:0/614024680 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f332c0668f0 0x7f332c068db0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f333c0011f0 tx=0x7f333c007d40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:17.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:17.843+0000 7f33457fa640 1 -- 172.21.15.27:0/614024680 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f334809afc0 con 0x7f3348143ae0 2024-01-15T11:33:18.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.003+0000 7f334f079640 1 -- 172.21.15.27:0/614024680 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f334809afc0 con 0x7f3348143ae0 2024-01-15T11:33:18.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.003+0000 7f33457fa640 1 -- 172.21.15.27:0/614024680 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7f334809afc0 con 0x7f3348143ae0 2024-01-15T11:33:18.006 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:18.006 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2024-01-15T11:33:18.006 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:33:18.006 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 1, 2024-01-15T11:33:18.006 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": ".mgr" 2024-01-15T11:33:18.006 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:33:18.006 INFO:teuthology.orchestra.run.smithi027.stdout:] 2024-01-15T11:33:18.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.003+0000 7f334f079640 1 -- 172.21.15.27:0/614024680 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f332c0668f0 msgr2=0x7f332c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:18.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.003+0000 7f334f079640 1 --2- 172.21.15.27:0/614024680 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f332c0668f0 0x7f332c068db0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f333c0011f0 tx=0x7f333c007d40 comp rx=0 tx=0).stop 2024-01-15T11:33:18.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.003+0000 7f334f079640 1 -- 172.21.15.27:0/614024680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3348143ae0 msgr2=0x7f3348158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:18.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.003+0000 7f334f079640 1 --2- 172.21.15.27:0/614024680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3348143ae0 0x7f3348158a20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f334000c790 tx=0x7f334000cc50 comp rx=0 tx=0).stop 2024-01-15T11:33:18.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.003+0000 7f334f079640 1 -- 172.21.15.27:0/614024680 shutdown_connections 2024-01-15T11:33:18.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.003+0000 7f334f079640 1 --2- 172.21.15.27:0/614024680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3348143ae0 0x7f3348158a20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:18.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.003+0000 7f334f079640 1 --2- 172.21.15.27:0/614024680 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f332c0668f0 0x7f332c068db0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:18.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.003+0000 7f334f079640 1 --2- 172.21.15.27:0/614024680 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f33480adcc0 0x7f334809b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:18.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.003+0000 7f334f079640 1 --2- 172.21.15.27:0/614024680 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f334806dfd0 0x7f33480b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:18.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.003+0000 7f334f079640 1 -- 172.21.15.27:0/614024680 >> 172.21.15.27:0/614024680 conn(0x7f33480b0c40 msgr2=0x7f33480b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:18.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.003+0000 7f334f079640 1 -- 172.21.15.27:0/614024680 shutdown_connections 2024-01-15T11:33:18.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.003+0000 7f334f079640 1 -- 172.21.15.27:0/614024680 wait complete. 2024-01-15T11:33:18.027 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-15T11:33:18.027 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-15T11:33:18.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.171+0000 7f4730f72640 1 Processor -- start 2024-01-15T11:33:18.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.171+0000 7f4730f72640 1 -- start start 2024-01-15T11:33:18.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.171+0000 7f4730f72640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f472c0d0510 0x7f472c0d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:18.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.171+0000 7f4730f72640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f472c0cdfb0 con 0x7f472c0ced30 2024-01-15T11:33:18.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.171+0000 7f4730f72640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f472c0d4140 con 0x7f472c15d8f0 2024-01-15T11:33:18.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.171+0000 7f4730f72640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f472c0d4420 con 0x7f472c0d0510 2024-01-15T11:33:18.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.171+0000 7f4723fff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f472c0ced30 0x7f472c0cfe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:48776/0 (socket says 172.21.15.27:48776) 2024-01-15T11:33:18.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.171+0000 7f4723fff640 1 -- 172.21.15.27:0/3094860759 learned_addr learned my addr 172.21.15.27:0/3094860759 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:18.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.171+0000 7f472ad9d640 1 --2- 172.21.15.27:0/3094860759 >> v2:172.21.15.93:3300/0 conn(0x7f472c0d0510 0x7f472c0d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:18.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.171+0000 7f4729d9b640 1 -- 172.21.15.27:0/3094860759 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388564672 0 0) 0x7f472c0cdfb0 con 0x7f472c0ced30 2024-01-15T11:33:18.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.171+0000 7f4729d9b640 1 -- 172.21.15.27:0/3094860759 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4718003530 con 0x7f472c0ced30 2024-01-15T11:33:18.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.171+0000 7f4729d9b640 1 -- 172.21.15.27:0/3094860759 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2283449416 0 0) 0x7f4718003530 con 0x7f472c0ced30 2024-01-15T11:33:18.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.171+0000 7f4729d9b640 1 -- 172.21.15.27:0/3094860759 >> v2:172.21.15.93:3300/0 conn(0x7f472c0d0510 msgr2=0x7f472c0d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:18.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.171+0000 7f4729d9b640 1 --2- 172.21.15.27:0/3094860759 >> v2:172.21.15.93:3300/0 conn(0x7f472c0d0510 0x7f472c0d1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:18.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.171+0000 7f4729d9b640 1 -- 172.21.15.27:0/3094860759 >> v1:172.21.15.93:6789/0 conn(0x7f472c15d8f0 legacy=0x7f472c15e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:18.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.171+0000 7f4729d9b640 1 -- 172.21.15.27:0/3094860759 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472c0ce250 con 0x7f472c0ced30 2024-01-15T11:33:18.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.171+0000 7f4729d9b640 1 -- 172.21.15.27:0/3094860759 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1394381265 0 0) 0x7f4714001680 con 0x7f472c0ced30 2024-01-15T11:33:18.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.171+0000 7f4729d9b640 1 -- 172.21.15.27:0/3094860759 >> v1:172.21.15.27:6789/0 conn(0x7f472c0ced30 legacy=0x7f472c0cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:18.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.171+0000 7f4729d9b640 1 --2- 172.21.15.27:0/3094860759 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47180039d0 0x7f4718003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:18.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.171+0000 7f4729d9b640 1 --2- 172.21.15.27:0/3094860759 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47180047d0 0x7f4718004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:18.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.171+0000 7f4729d9b640 1 --2- 172.21.15.27:0/3094860759 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4718005190 0x7f471800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:18.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.171+0000 7f4729d9b640 1 -- 172.21.15.27:0/3094860759 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472c0d4420 con 0x7f47180039d0 2024-01-15T11:33:18.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.171+0000 7f4729d9b640 1 -- 172.21.15.27:0/3094860759 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471800c090 con 0x7f47180047d0 2024-01-15T11:33:18.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.171+0000 7f4729d9b640 1 -- 172.21.15.27:0/3094860759 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471800c250 con 0x7f4718005190 2024-01-15T11:33:18.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.175+0000 7f472a59c640 1 --2- 172.21.15.27:0/3094860759 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47180039d0 0x7f4718003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:18.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.175+0000 7f4723fff640 1 --2- 172.21.15.27:0/3094860759 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47180047d0 0x7f4718004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:18.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.175+0000 7f472ad9d640 1 --2- 172.21.15.27:0/3094860759 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4718005190 0x7f471800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:18.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.175+0000 7f472a59c640 1 -- 172.21.15.27:0/3094860759 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4718005190 msgr2=0x7f471800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:18.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.175+0000 7f472a59c640 1 --2- 172.21.15.27:0/3094860759 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4718005190 0x7f471800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:18.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.175+0000 7f472a59c640 1 -- 172.21.15.27:0/3094860759 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47180047d0 msgr2=0x7f4718004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:18.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.175+0000 7f472a59c640 1 --2- 172.21.15.27:0/3094860759 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47180047d0 0x7f4718004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:18.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.175+0000 7f472a59c640 1 -- 172.21.15.27:0/3094860759 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4718003530 con 0x7f47180039d0 2024-01-15T11:33:18.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.175+0000 7f472ad9d640 1 -- 172.21.15.27:0/3094860759 reap_dead start 2024-01-15T11:33:18.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.175+0000 7f4723fff640 1 --2- 172.21.15.27:0/3094860759 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47180047d0 0x7f4718004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:18.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.175+0000 7f472a59c640 1 --2- 172.21.15.27:0/3094860759 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47180039d0 0x7f4718003df0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f471c001780 tx=0x7f471c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45cad35a76c9b5d9 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:18.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.175+0000 7f4729d9b640 1 -- 172.21.15.27:0/3094860759 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c0052d0 con 0x7f47180039d0 2024-01-15T11:33:18.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.175+0000 7f4729d9b640 1 -- 172.21.15.27:0/3094860759 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c0a7050 con 0x7f47180039d0 2024-01-15T11:33:18.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.175+0000 7f4729d9b640 1 -- 172.21.15.27:0/3094860759 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c003600 con 0x7f47180039d0 2024-01-15T11:33:18.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.179+0000 7f4730f72640 1 -- 172.21.15.27:0/3094860759 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47180039d0 msgr2=0x7f4718003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:18.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.179+0000 7f4730f72640 1 --2- 172.21.15.27:0/3094860759 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47180039d0 0x7f4718003df0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f471c001780 tx=0x7f471c01c3d0 comp rx=0 tx=0).stop 2024-01-15T11:33:18.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.179+0000 7f4730f72640 1 -- 172.21.15.27:0/3094860759 shutdown_connections 2024-01-15T11:33:18.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.179+0000 7f4730f72640 1 --2- 172.21.15.27:0/3094860759 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f47180039d0 0x7f4718003df0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:18.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.179+0000 7f4730f72640 1 -- 172.21.15.27:0/3094860759 >> 172.21.15.27:0/3094860759 conn(0x7f472c09c750 msgr2=0x7f472c0d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:18.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.179+0000 7f4730f72640 1 -- 172.21.15.27:0/3094860759 shutdown_connections 2024-01-15T11:33:18.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.179+0000 7f4730f72640 1 -- 172.21.15.27:0/3094860759 wait complete. 2024-01-15T11:33:18.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.179+0000 7f4730f72640 1 Processor -- start 2024-01-15T11:33:18.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.179+0000 7f4730f72640 1 -- start start 2024-01-15T11:33:18.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.179+0000 7f4730f72640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f47180039d0 0x7f472c154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:18.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.179+0000 7f4730f72640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f472c0c8000 0x7f472c0c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:18.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.179+0000 7f4730f72640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f472c14b3f0 0x7f472c0b8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:18.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.179+0000 7f4730f72640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472c0c7be0 con 0x7f472c14b3f0 2024-01-15T11:33:18.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.179+0000 7f4730f72640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472c0cd1a0 con 0x7f472c0c8000 2024-01-15T11:33:18.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.179+0000 7f4730f72640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472c14b8a0 con 0x7f47180039d0 2024-01-15T11:33:18.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.179+0000 7f472ad9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f472c14b3f0 0x7f472c0b8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:18.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.179+0000 7f472a59c640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f47180039d0 0x7f472c154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:18.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.179+0000 7f4723fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f472c0c8000 0x7f472c0c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:18.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.179+0000 7f472ad9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f472c14b3f0 0x7f472c0b8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58114/0 (socket says 172.21.15.27:58114) 2024-01-15T11:33:18.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.179+0000 7f472ad9d640 1 -- 172.21.15.27:0/948649698 learned_addr learned my addr 172.21.15.27:0/948649698 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:18.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.183+0000 7f472ad9d640 1 -- 172.21.15.27:0/948649698 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f47180039d0 msgr2=0x7f472c154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:18.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.183+0000 7f472ad9d640 1 --2- 172.21.15.27:0/948649698 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f47180039d0 0x7f472c154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:18.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.183+0000 7f472ad9d640 1 -- 172.21.15.27:0/948649698 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f472c0c8000 msgr2=0x7f472c0c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:18.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.183+0000 7f472ad9d640 1 --2- 172.21.15.27:0/948649698 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f472c0c8000 0x7f472c0c68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:18.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.183+0000 7f472ad9d640 1 -- 172.21.15.27:0/948649698 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472c14bdb0 con 0x7f472c14b3f0 2024-01-15T11:33:18.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.183+0000 7f472ad9d640 1 --2- 172.21.15.27:0/948649698 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f472c14b3f0 0x7f472c0b8570 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f472c08c8a0 tx=0x7f47240115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:18.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.183+0000 7f4722ffd640 1 -- 172.21.15.27:0/948649698 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472400e070 con 0x7f472c14b3f0 2024-01-15T11:33:18.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.183+0000 7f4722ffd640 1 -- 172.21.15.27:0/948649698 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4724011db0 con 0x7f472c14b3f0 2024-01-15T11:33:18.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.183+0000 7f4722ffd640 1 -- 172.21.15.27:0/948649698 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47240039a0 con 0x7f472c14b3f0 2024-01-15T11:33:18.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.183+0000 7f4730f72640 1 -- 172.21.15.27:0/948649698 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f472c0c6f60 con 0x7f472c14b3f0 2024-01-15T11:33:18.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.183+0000 7f4730f72640 1 -- 172.21.15.27:0/948649698 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472c0c7520 con 0x7f472c14b3f0 2024-01-15T11:33:18.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.183+0000 7f4730f72640 1 -- 172.21.15.27:0/948649698 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f472c0c7d20 con 0x7f472c14b3f0 2024-01-15T11:33:18.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.183+0000 7f4722ffd640 1 -- 172.21.15.27:0/948649698 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f4724003b00 con 0x7f472c14b3f0 2024-01-15T11:33:18.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.187+0000 7f4722ffd640 1 --2- 172.21.15.27:0/948649698 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f470c066920 0x7f470c068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:18.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.187+0000 7f4722ffd640 1 -- 172.21.15.27:0/948649698 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f47240846e0 con 0x7f472c14b3f0 2024-01-15T11:33:18.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.187+0000 7f472a59c640 1 --2- 172.21.15.27:0/948649698 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f470c066920 0x7f470c068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:18.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.187+0000 7f472a59c640 1 --2- 172.21.15.27:0/948649698 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f470c066920 0x7f470c068de0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f471c001750 tx=0x7f471c0011a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:18.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.191+0000 7f4722ffd640 1 -- 172.21.15.27:0/948649698 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f472c0c7d20 con 0x7f472c14b3f0 2024-01-15T11:33:18.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.347+0000 7f4730f72640 1 -- 172.21.15.27:0/948649698 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f472c0c7d20 con 0x7f472c14b3f0 2024-01-15T11:33:18.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.659+0000 7f4722ffd640 1 -- 172.21.15.27:0/948649698 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f472c0c7d20 con 0x7f472c14b3f0 2024-01-15T11:33:18.662 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' created 2024-01-15T11:33:18.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.659+0000 7f4730f72640 1 -- 172.21.15.27:0/948649698 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f470c066920 msgr2=0x7f470c068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:18.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.659+0000 7f4730f72640 1 --2- 172.21.15.27:0/948649698 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f470c066920 0x7f470c068de0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f471c001750 tx=0x7f471c0011a0 comp rx=0 tx=0).stop 2024-01-15T11:33:18.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.659+0000 7f4730f72640 1 -- 172.21.15.27:0/948649698 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f472c14b3f0 msgr2=0x7f472c0b8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:18.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.659+0000 7f4730f72640 1 --2- 172.21.15.27:0/948649698 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f472c14b3f0 0x7f472c0b8570 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f472c08c8a0 tx=0x7f47240115a0 comp rx=0 tx=0).stop 2024-01-15T11:33:18.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.659+0000 7f4730f72640 1 -- 172.21.15.27:0/948649698 shutdown_connections 2024-01-15T11:33:18.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.659+0000 7f4730f72640 1 --2- 172.21.15.27:0/948649698 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f472c14b3f0 0x7f472c0b8570 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:18.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.659+0000 7f4730f72640 1 --2- 172.21.15.27:0/948649698 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f470c066920 0x7f470c068de0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:18.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.659+0000 7f4730f72640 1 --2- 172.21.15.27:0/948649698 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f472c0c8000 0x7f472c0c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:18.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.659+0000 7f4730f72640 1 --2- 172.21.15.27:0/948649698 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f47180039d0 0x7f472c154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:18.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.659+0000 7f4730f72640 1 -- 172.21.15.27:0/948649698 >> 172.21.15.27:0/948649698 conn(0x7f472c09c750 msgr2=0x7f472c0b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:18.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.659+0000 7f4730f72640 1 -- 172.21.15.27:0/948649698 shutdown_connections 2024-01-15T11:33:18.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.659+0000 7f4730f72640 1 -- 172.21.15.27:0/948649698 wait complete. 2024-01-15T11:33:18.690 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-15T11:33:18.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.835+0000 7efe3497d640 1 Processor -- start 2024-01-15T11:33:18.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.835+0000 7efe3497d640 1 -- start start 2024-01-15T11:33:18.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.839+0000 7efe3497d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7efe3015d2a0 0x7efe300d26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:18.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.839+0000 7efe3497d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efe300b5350 0x7efe300d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:18.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.839+0000 7efe3497d640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe300b6250 con 0x7efe300d2c20 2024-01-15T11:33:18.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.839+0000 7efe3497d640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe300ce8c0 con 0x7efe300b5350 2024-01-15T11:33:18.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.839+0000 7efe3497d640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe30161cf0 con 0x7efe3015d2a0 2024-01-15T11:33:18.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.839+0000 7efe2ffff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7efe300b5350 0x7efe300d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:18.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.839+0000 7efe2effd640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7efe300d2c20 0x7efe300b4c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:48786/0 (socket says 172.21.15.27:48786) 2024-01-15T11:33:18.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.839+0000 7efe2effd640 1 -- 172.21.15.27:0/3614620446 learned_addr learned my addr 172.21.15.27:0/3614620446 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:18.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.839+0000 7efe2f7fe640 1 --2- 172.21.15.27:0/3614620446 >> v2:172.21.15.93:3300/0 conn(0x7efe3015d2a0 0x7efe300d26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:18.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.839+0000 7efe2ffff640 1 -- 172.21.15.27:0/3614620446 >> v2:172.21.15.93:3300/0 conn(0x7efe3015d2a0 msgr2=0x7efe300d26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:18.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.839+0000 7efe2ffff640 1 --2- 172.21.15.27:0/3614620446 >> v2:172.21.15.93:3300/0 conn(0x7efe3015d2a0 0x7efe300d26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:18.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.839+0000 7efe2ffff640 1 -- 172.21.15.27:0/3614620446 >> v1:172.21.15.27:6789/0 conn(0x7efe300d2c20 legacy=0x7efe300b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:18.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.839+0000 7efe2e7fc640 1 -- 172.21.15.27:0/3614620446 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392076839 0 0) 0x7efe300b6250 con 0x7efe300d2c20 2024-01-15T11:33:18.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.839+0000 7efe2ffff640 1 -- 172.21.15.27:0/3614620446 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe30161170 con 0x7efe300b5350 2024-01-15T11:33:18.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.839+0000 7efe2ffff640 1 --2- 172.21.15.27:0/3614620446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe300b5350 0x7efe300d10e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efe300cdb60 tx=0x7efe2801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93e8e21ced3eb28 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:18.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.843+0000 7efe2e7fc640 1 -- 172.21.15.27:0/3614620446 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe280a59a0 con 0x7efe300b5350 2024-01-15T11:33:18.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.843+0000 7efe2e7fc640 1 -- 172.21.15.27:0/3614620446 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe280a5b00 con 0x7efe300b5350 2024-01-15T11:33:18.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.843+0000 7efe2e7fc640 1 -- 172.21.15.27:0/3614620446 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe280a5e90 con 0x7efe300b5350 2024-01-15T11:33:18.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.843+0000 7efe3497d640 1 -- 172.21.15.27:0/3614620446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe300b5350 msgr2=0x7efe300d10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:18.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.843+0000 7efe3497d640 1 --2- 172.21.15.27:0/3614620446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe300b5350 0x7efe300d10e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efe300cdb60 tx=0x7efe2801c8e0 comp rx=0 tx=0).stop 2024-01-15T11:33:18.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.843+0000 7efe3497d640 1 -- 172.21.15.27:0/3614620446 shutdown_connections 2024-01-15T11:33:18.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.843+0000 7efe3497d640 1 --2- 172.21.15.27:0/3614620446 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe300b5350 0x7efe300d10e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:18.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.843+0000 7efe3497d640 1 --2- 172.21.15.27:0/3614620446 >> v2:172.21.15.93:3300/0 conn(0x7efe3015d2a0 0x7efe300d26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:18.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.843+0000 7efe3497d640 1 -- 172.21.15.27:0/3614620446 >> 172.21.15.27:0/3614620446 conn(0x7efe300668a0 msgr2=0x7efe300cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:18.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.843+0000 7efe3497d640 1 -- 172.21.15.27:0/3614620446 shutdown_connections 2024-01-15T11:33:18.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.843+0000 7efe3497d640 1 -- 172.21.15.27:0/3614620446 wait complete. 2024-01-15T11:33:18.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.843+0000 7efe3497d640 1 Processor -- start 2024-01-15T11:33:18.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.843+0000 7efe3497d640 1 -- start start 2024-01-15T11:33:18.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.843+0000 7efe3497d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe300b5350 0x7efe3014cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:18.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.843+0000 7efe3497d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe300d2c20 0x7efe3015bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:18.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.843+0000 7efe3497d640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efe3015d2a0 0x7efe300c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:18.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.843+0000 7efe3497d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe301f5550 con 0x7efe300b5350 2024-01-15T11:33:18.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.843+0000 7efe3497d640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3015a7a0 con 0x7efe300d2c20 2024-01-15T11:33:18.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.843+0000 7efe3497d640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3015aa80 con 0x7efe3015d2a0 2024-01-15T11:33:18.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.843+0000 7efe2f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe300b5350 0x7efe3014cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:18.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.843+0000 7efe2f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe300b5350 0x7efe3014cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58146/0 (socket says 172.21.15.27:58146) 2024-01-15T11:33:18.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.843+0000 7efe2f7fe640 1 -- 172.21.15.27:0/909131725 learned_addr learned my addr 172.21.15.27:0/909131725 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:18.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.843+0000 7efe2ffff640 1 --2- 172.21.15.27:0/909131725 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efe3015d2a0 0x7efe300c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:18.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.847+0000 7efe2effd640 1 --2- 172.21.15.27:0/909131725 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe300d2c20 0x7efe3015bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:18.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.847+0000 7efe2f7fe640 1 -- 172.21.15.27:0/909131725 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efe3015d2a0 msgr2=0x7efe300c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:18.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.847+0000 7efe2f7fe640 1 --2- 172.21.15.27:0/909131725 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efe3015d2a0 0x7efe300c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:18.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.847+0000 7efe2f7fe640 1 -- 172.21.15.27:0/909131725 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe300d2c20 msgr2=0x7efe3015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:18.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.847+0000 7efe2f7fe640 1 --2- 172.21.15.27:0/909131725 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe300d2c20 0x7efe3015bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:18.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.847+0000 7efe2f7fe640 1 -- 172.21.15.27:0/909131725 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe28009a70 con 0x7efe300b5350 2024-01-15T11:33:18.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.847+0000 7efe2ffff640 1 --2- 172.21.15.27:0/909131725 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efe3015d2a0 0x7efe300c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:18.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.847+0000 7efe2f7fe640 1 --2- 172.21.15.27:0/909131725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe300b5350 0x7efe3014cf70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efe2000e870 tx=0x7efe2000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:18.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.847+0000 7efe17fff640 1 -- 172.21.15.27:0/909131725 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe20009510 con 0x7efe300b5350 2024-01-15T11:33:18.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.847+0000 7efe17fff640 1 -- 172.21.15.27:0/909131725 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2000eec0 con 0x7efe300b5350 2024-01-15T11:33:18.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.847+0000 7efe17fff640 1 -- 172.21.15.27:0/909131725 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2000cb40 con 0x7efe300b5350 2024-01-15T11:33:18.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.847+0000 7efe3497d640 1 -- 172.21.15.27:0/909131725 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3015ad60 con 0x7efe300b5350 2024-01-15T11:33:18.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.847+0000 7efe3497d640 1 -- 172.21.15.27:0/909131725 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3014d4b0 con 0x7efe300b5350 2024-01-15T11:33:18.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.847+0000 7efe3497d640 1 -- 172.21.15.27:0/909131725 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe30074990 con 0x7efe300b5350 2024-01-15T11:33:18.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.847+0000 7efe17fff640 1 -- 172.21.15.27:0/909131725 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7efe2000ccc0 con 0x7efe300b5350 2024-01-15T11:33:18.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.847+0000 7efe17fff640 1 --2- 172.21.15.27:0/909131725 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7efe1c0668f0 0x7efe1c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:18.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.851+0000 7efe17fff640 1 -- 172.21.15.27:0/909131725 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7efe20084350 con 0x7efe300b5350 2024-01-15T11:33:18.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.851+0000 7efe2effd640 1 --2- 172.21.15.27:0/909131725 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7efe1c0668f0 0x7efe1c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:18.854 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.851+0000 7efe2effd640 1 --2- 172.21.15.27:0/909131725 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7efe1c0668f0 0x7efe1c068db0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efe30160a90 tx=0x7efe24009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:18.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:18.855+0000 7efe17fff640 1 -- 172.21.15.27:0/909131725 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efe20051770 con 0x7efe300b5350 2024-01-15T11:33:19.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.011+0000 7efe3497d640 1 -- 172.21.15.27:0/909131725 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7efe300d0fd0 con 0x7efe300b5350 2024-01-15T11:33:19.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.663+0000 7efe17fff640 1 -- 172.21.15.27:0/909131725 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7efe20054d90 con 0x7efe300b5350 2024-01-15T11:33:19.666 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' created 2024-01-15T11:33:19.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.663+0000 7efe3497d640 1 -- 172.21.15.27:0/909131725 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7efe1c0668f0 msgr2=0x7efe1c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:19.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.663+0000 7efe3497d640 1 --2- 172.21.15.27:0/909131725 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7efe1c0668f0 0x7efe1c068db0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efe30160a90 tx=0x7efe24009040 comp rx=0 tx=0).stop 2024-01-15T11:33:19.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.663+0000 7efe3497d640 1 -- 172.21.15.27:0/909131725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe300b5350 msgr2=0x7efe3014cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:19.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.663+0000 7efe3497d640 1 --2- 172.21.15.27:0/909131725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe300b5350 0x7efe3014cf70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efe2000e870 tx=0x7efe2000ec70 comp rx=0 tx=0).stop 2024-01-15T11:33:19.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.663+0000 7efe3497d640 1 -- 172.21.15.27:0/909131725 shutdown_connections 2024-01-15T11:33:19.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.663+0000 7efe3497d640 1 --2- 172.21.15.27:0/909131725 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efe3015d2a0 0x7efe300c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:19.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.663+0000 7efe3497d640 1 --2- 172.21.15.27:0/909131725 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7efe1c0668f0 0x7efe1c068db0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:19.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.663+0000 7efe3497d640 1 --2- 172.21.15.27:0/909131725 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe300d2c20 0x7efe3015bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:19.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.663+0000 7efe3497d640 1 --2- 172.21.15.27:0/909131725 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe300b5350 0x7efe3014cf70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:19.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.663+0000 7efe3497d640 1 -- 172.21.15.27:0/909131725 >> 172.21.15.27:0/909131725 conn(0x7efe300668a0 msgr2=0x7efe300c7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:19.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.663+0000 7efe3497d640 1 -- 172.21.15.27:0/909131725 shutdown_connections 2024-01-15T11:33:19.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.663+0000 7efe3497d640 1 -- 172.21.15.27:0/909131725 wait complete. 2024-01-15T11:33:19.709 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-15T11:33:19.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.855+0000 7fa6ebefe640 1 Processor -- start 2024-01-15T11:33:19.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.855+0000 7fa6ebefe640 1 -- start start 2024-01-15T11:33:19.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.855+0000 7fa6ebefe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa6e415d8f0 0x7fa6e415e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:19.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.855+0000 7fa6ebefe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa6e40ced30 0x7fa6e40cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:19.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.855+0000 7fa6ebefe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e415ecc0 con 0x7fa6e40cf1e0 2024-01-15T11:33:19.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.855+0000 7fa6ebefe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6e40d4420 con 0x7fa6e40ced30 2024-01-15T11:33:19.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.855+0000 7fa6ebefe640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6e40cdfb0 con 0x7fa6e415d8f0 2024-01-15T11:33:19.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.859+0000 7fa6e9499640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa6e40ced30 0x7fa6e40cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:19.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.859+0000 7fa6ea49b640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fa6e40cf1e0 0x7fa6e40d1000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:48802/0 (socket says 172.21.15.27:48802) 2024-01-15T11:33:19.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.859+0000 7fa6ea49b640 1 -- 172.21.15.27:0/1172082410 learned_addr learned my addr 172.21.15.27:0/1172082410 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:19.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.859+0000 7fa6e9c9a640 1 --2- 172.21.15.27:0/1172082410 >> v2:172.21.15.93:3300/0 conn(0x7fa6e415d8f0 0x7fa6e415e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:19.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.859+0000 7fa6e9499640 1 -- 172.21.15.27:0/1172082410 >> v2:172.21.15.93:3300/0 conn(0x7fa6e415d8f0 msgr2=0x7fa6e415e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:19.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.859+0000 7fa6e9499640 1 --2- 172.21.15.27:0/1172082410 >> v2:172.21.15.93:3300/0 conn(0x7fa6e415d8f0 0x7fa6e415e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:19.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.859+0000 7fa6e9499640 1 -- 172.21.15.27:0/1172082410 >> v1:172.21.15.27:6789/0 conn(0x7fa6e40cf1e0 legacy=0x7fa6e40d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:19.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.859+0000 7fa6e9499640 1 -- 172.21.15.27:0/1172082410 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e40d4140 con 0x7fa6e40ced30 2024-01-15T11:33:19.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.859+0000 7fa6e9499640 1 --2- 172.21.15.27:0/1172082410 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6e40ced30 0x7fa6e40cfe00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa6d40097c0 tx=0x7fa6d401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3536e1b8778ab95 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:19.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.859+0000 7fa6e8c98640 1 -- 172.21.15.27:0/1172082410 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d40ab610 con 0x7fa6e40ced30 2024-01-15T11:33:19.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.859+0000 7fa6e8c98640 1 -- 172.21.15.27:0/1172082410 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d40ab770 con 0x7fa6e40ced30 2024-01-15T11:33:19.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.859+0000 7fa6e8c98640 1 -- 172.21.15.27:0/1172082410 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d40abb00 con 0x7fa6e40ced30 2024-01-15T11:33:19.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6ebefe640 1 -- 172.21.15.27:0/1172082410 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6e40ced30 msgr2=0x7fa6e40cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:19.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6ebefe640 1 --2- 172.21.15.27:0/1172082410 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6e40ced30 0x7fa6e40cfe00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa6d40097c0 tx=0x7fa6d401c410 comp rx=0 tx=0).stop 2024-01-15T11:33:19.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6ebefe640 1 -- 172.21.15.27:0/1172082410 shutdown_connections 2024-01-15T11:33:19.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6ebefe640 1 --2- 172.21.15.27:0/1172082410 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6e40ced30 0x7fa6e40cfe00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:19.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6ebefe640 1 --2- 172.21.15.27:0/1172082410 >> v2:172.21.15.93:3300/0 conn(0x7fa6e415d8f0 0x7fa6e415e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:19.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6ebefe640 1 -- 172.21.15.27:0/1172082410 >> 172.21.15.27:0/1172082410 conn(0x7fa6e409c750 msgr2=0x7fa6e40d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:19.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6ebefe640 1 -- 172.21.15.27:0/1172082410 shutdown_connections 2024-01-15T11:33:19.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6ebefe640 1 -- 172.21.15.27:0/1172082410 wait complete. 2024-01-15T11:33:19.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6ebefe640 1 Processor -- start 2024-01-15T11:33:19.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6ebefe640 1 -- start start 2024-01-15T11:33:19.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6ebefe640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa6e40ced30 0x7fa6e40c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:19.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6ebefe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6e40cf1e0 0x7fa6e40b7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:19.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6ebefe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6e415d8f0 0x7fa6e40b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:19.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6ebefe640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e415d1e0 con 0x7fa6e40cf1e0 2024-01-15T11:33:19.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6ebefe640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e415ad90 con 0x7fa6e415d8f0 2024-01-15T11:33:19.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6ebefe640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e415c560 con 0x7fa6e40ced30 2024-01-15T11:33:19.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6e9499640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6e40cf1e0 0x7fa6e40b7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:19.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6e9499640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6e40cf1e0 0x7fa6e40b7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58172/0 (socket says 172.21.15.27:58172) 2024-01-15T11:33:19.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6e9499640 1 -- 172.21.15.27:0/2773637733 learned_addr learned my addr 172.21.15.27:0/2773637733 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:19.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6e9c9a640 1 --2- 172.21.15.27:0/2773637733 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa6e40ced30 0x7fa6e40c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:19.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6ea49b640 1 --2- 172.21.15.27:0/2773637733 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6e415d8f0 0x7fa6e40b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:19.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6e9499640 1 -- 172.21.15.27:0/2773637733 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa6e40ced30 msgr2=0x7fa6e40c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:19.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6e9499640 1 --2- 172.21.15.27:0/2773637733 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa6e40ced30 0x7fa6e40c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:19.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6e9499640 1 -- 172.21.15.27:0/2773637733 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6e415d8f0 msgr2=0x7fa6e40b82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:19.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6e9499640 1 --2- 172.21.15.27:0/2773637733 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6e415d8f0 0x7fa6e40b82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:19.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6e9499640 1 -- 172.21.15.27:0/2773637733 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d4009420 con 0x7fa6e40cf1e0 2024-01-15T11:33:19.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.863+0000 7fa6ea49b640 1 --2- 172.21.15.27:0/2773637733 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6e415d8f0 0x7fa6e40b82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:19.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.867+0000 7fa6e9499640 1 --2- 172.21.15.27:0/2773637733 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6e40cf1e0 0x7fa6e40b7d60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa6d401a040 tx=0x7fa6d401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:19.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.867+0000 7fa6da7fc640 1 -- 172.21.15.27:0/2773637733 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d40bf610 con 0x7fa6e40cf1e0 2024-01-15T11:33:19.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.867+0000 7fa6da7fc640 1 -- 172.21.15.27:0/2773637733 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d40bf790 con 0x7fa6e40cf1e0 2024-01-15T11:33:19.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.867+0000 7fa6da7fc640 1 -- 172.21.15.27:0/2773637733 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d40bfb40 con 0x7fa6e40cf1e0 2024-01-15T11:33:19.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.867+0000 7fa6ebefe640 1 -- 172.21.15.27:0/2773637733 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e415c840 con 0x7fa6e40cf1e0 2024-01-15T11:33:19.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.867+0000 7fa6ebefe640 1 -- 172.21.15.27:0/2773637733 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e415ce00 con 0x7fa6e40cf1e0 2024-01-15T11:33:19.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.867+0000 7fa6ebefe640 1 -- 172.21.15.27:0/2773637733 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6e404e850 con 0x7fa6e40cf1e0 2024-01-15T11:33:19.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.867+0000 7fa6da7fc640 1 -- 172.21.15.27:0/2773637733 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fa6d40b5400 con 0x7fa6e40cf1e0 2024-01-15T11:33:19.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.867+0000 7fa6da7fc640 1 --2- 172.21.15.27:0/2773637733 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa6c80668f0 0x7fa6c8068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:19.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.867+0000 7fa6da7fc640 1 -- 172.21.15.27:0/2773637733 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fa6d411ec50 con 0x7fa6e40cf1e0 2024-01-15T11:33:19.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.871+0000 7fa6e9c9a640 1 --2- 172.21.15.27:0/2773637733 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa6c80668f0 0x7fa6c8068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:19.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.871+0000 7fa6e9c9a640 1 --2- 172.21.15.27:0/2773637733 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa6c80668f0 0x7fa6c8068db0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0009b60 tx=0x7fa6e0009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:19.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:19.875+0000 7fa6da7fc640 1 -- 172.21.15.27:0/2773637733 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa6d40ebf00 con 0x7fa6e40cf1e0 2024-01-15T11:33:20.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.063+0000 7fa6ebefe640 1 -- 172.21.15.27:0/2773637733 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa6e40cf9d0 con 0x7fa6e40cf1e0 2024-01-15T11:33:20.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.763+0000 7fa6da7fc640 1 -- 172.21.15.27:0/2773637733 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa6d40ef520 con 0x7fa6e40cf1e0 2024-01-15T11:33:20.766 INFO:teuthology.orchestra.run.smithi027.stderr:new fs with metadata pool 2 and data pool 3 2024-01-15T11:33:20.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.763+0000 7fa6ebefe640 1 -- 172.21.15.27:0/2773637733 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa6c80668f0 msgr2=0x7fa6c8068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:20.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.763+0000 7fa6ebefe640 1 --2- 172.21.15.27:0/2773637733 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa6c80668f0 0x7fa6c8068db0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0009b60 tx=0x7fa6e0009190 comp rx=0 tx=0).stop 2024-01-15T11:33:20.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.763+0000 7fa6ebefe640 1 -- 172.21.15.27:0/2773637733 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6e40cf1e0 msgr2=0x7fa6e40b7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:20.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.763+0000 7fa6ebefe640 1 --2- 172.21.15.27:0/2773637733 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6e40cf1e0 0x7fa6e40b7d60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa6d401a040 tx=0x7fa6d401ac50 comp rx=0 tx=0).stop 2024-01-15T11:33:20.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.763+0000 7fa6ebefe640 1 -- 172.21.15.27:0/2773637733 shutdown_connections 2024-01-15T11:33:20.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.763+0000 7fa6ebefe640 1 --2- 172.21.15.27:0/2773637733 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa6c80668f0 0x7fa6c8068db0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:20.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.763+0000 7fa6ebefe640 1 --2- 172.21.15.27:0/2773637733 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6e415d8f0 0x7fa6e40b82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:20.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.763+0000 7fa6ebefe640 1 --2- 172.21.15.27:0/2773637733 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa6e40cf1e0 0x7fa6e40b7d60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:20.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.763+0000 7fa6ebefe640 1 --2- 172.21.15.27:0/2773637733 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa6e40ced30 0x7fa6e40c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:20.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.763+0000 7fa6ebefe640 1 -- 172.21.15.27:0/2773637733 >> 172.21.15.27:0/2773637733 conn(0x7fa6e409c750 msgr2=0x7fa6e40b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:20.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.763+0000 7fa6ebefe640 1 -- 172.21.15.27:0/2773637733 shutdown_connections 2024-01-15T11:33:20.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.763+0000 7fa6ebefe640 1 -- 172.21.15.27:0/2773637733 wait complete. 2024-01-15T11:33:20.794 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:33:20.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.935+0000 7f8328e5a640 1 Processor -- start 2024-01-15T11:33:20.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.935+0000 7f8328e5a640 1 -- start start 2024-01-15T11:33:20.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.935+0000 7f8328e5a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8324070730 0x7f832406bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:20.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.935+0000 7f8328e5a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8324147040 0x7f832406c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:20.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.935+0000 7f8328e5a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832415dba0 con 0x7f8324146c60 2024-01-15T11:33:20.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.935+0000 7f8328e5a640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832406d100 con 0x7f8324070730 2024-01-15T11:33:20.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.935+0000 7f8328e5a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832406c590 con 0x7f8324147040 2024-01-15T11:33:20.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.935+0000 7f8321d9b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8324070730 0x7f832406bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:20.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.935+0000 7f8322d9d640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8324147040 0x7f832406c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:20.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.935+0000 7f8321d9b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8324070730 0x7f832406bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:48398/0 (socket says 172.21.15.27:48398) 2024-01-15T11:33:20.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.935+0000 7f8321d9b640 1 -- 172.21.15.27:0/1304576814 learned_addr learned my addr 172.21.15.27:0/1304576814 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:20.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.935+0000 7f8321d9b640 1 -- 172.21.15.27:0/1304576814 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8324147040 msgr2=0x7f832406c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:20.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.935+0000 7f8321d9b640 1 --2- 172.21.15.27:0/1304576814 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8324147040 0x7f832406c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:20.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.935+0000 7f8321d9b640 1 -- 172.21.15.27:0/1304576814 >> v1:172.21.15.93:6789/0 conn(0x7f8324146c60 legacy=0x7f8324070020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:20.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.935+0000 7f8321d9b640 1 -- 172.21.15.27:0/1304576814 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832406c860 con 0x7f8324070730 2024-01-15T11:33:20.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.939+0000 7f8321d9b640 1 --2- 172.21.15.27:0/1304576814 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8324070730 0x7f832406bb10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8318009870 tx=0x7f831801c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dee894c773608d4e server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:20.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.939+0000 7f832159a640 1 -- 172.21.15.27:0/1304576814 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83180aa670 con 0x7f8324070730 2024-01-15T11:33:20.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.939+0000 7f832159a640 1 -- 172.21.15.27:0/1304576814 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83180aa7d0 con 0x7f8324070730 2024-01-15T11:33:20.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.939+0000 7f832159a640 1 -- 172.21.15.27:0/1304576814 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83180aab60 con 0x7f8324070730 2024-01-15T11:33:20.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.939+0000 7f8328e5a640 1 -- 172.21.15.27:0/1304576814 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8324070730 msgr2=0x7f832406bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:20.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.939+0000 7f8328e5a640 1 --2- 172.21.15.27:0/1304576814 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8324070730 0x7f832406bb10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8318009870 tx=0x7f831801c510 comp rx=0 tx=0).stop 2024-01-15T11:33:20.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.939+0000 7f8328e5a640 1 -- 172.21.15.27:0/1304576814 shutdown_connections 2024-01-15T11:33:20.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.939+0000 7f8328e5a640 1 --2- 172.21.15.27:0/1304576814 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8324147040 0x7f832406c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:20.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.939+0000 7f8328e5a640 1 --2- 172.21.15.27:0/1304576814 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8324070730 0x7f832406bb10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:20.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.939+0000 7f8328e5a640 1 -- 172.21.15.27:0/1304576814 >> 172.21.15.27:0/1304576814 conn(0x7f83240b2ea0 msgr2=0x7f83240b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:20.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.939+0000 7f8328e5a640 1 -- 172.21.15.27:0/1304576814 shutdown_connections 2024-01-15T11:33:20.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.939+0000 7f8328e5a640 1 -- 172.21.15.27:0/1304576814 wait complete. 2024-01-15T11:33:20.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.943+0000 7f8328e5a640 1 Processor -- start 2024-01-15T11:33:20.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.943+0000 7f8328e5a640 1 -- start start 2024-01-15T11:33:20.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.943+0000 7f8328e5a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8324070730 0x7f8324159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:20.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.943+0000 7f8328e5a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8324146c60 0x7f832413ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:20.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.943+0000 7f8328e5a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8324147040 0x7f832413ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:20.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.943+0000 7f8328e5a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832413c2c0 con 0x7f8324146c60 2024-01-15T11:33:20.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.943+0000 7f8328e5a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832413b390 con 0x7f8324147040 2024-01-15T11:33:20.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.943+0000 7f8328e5a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8324140260 con 0x7f8324070730 2024-01-15T11:33:20.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.943+0000 7f8321d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8324146c60 0x7f832413ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:20.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.943+0000 7f8321d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8324146c60 0x7f832413ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58186/0 (socket says 172.21.15.27:58186) 2024-01-15T11:33:20.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.943+0000 7f8321d9b640 1 -- 172.21.15.27:0/102586905 learned_addr learned my addr 172.21.15.27:0/102586905 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:20.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.943+0000 7f8322d9d640 1 --2- 172.21.15.27:0/102586905 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8324147040 0x7f832413ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:20.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.943+0000 7f832259c640 1 --2- 172.21.15.27:0/102586905 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8324070730 0x7f8324159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:20.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.943+0000 7f8321d9b640 1 -- 172.21.15.27:0/102586905 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8324070730 msgr2=0x7f8324159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:20.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.943+0000 7f8321d9b640 1 --2- 172.21.15.27:0/102586905 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8324070730 0x7f8324159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:20.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.943+0000 7f8321d9b640 1 -- 172.21.15.27:0/102586905 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8324147040 msgr2=0x7f832413ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:20.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.943+0000 7f8321d9b640 1 --2- 172.21.15.27:0/102586905 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8324147040 0x7f832413ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:20.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.943+0000 7f8321d9b640 1 -- 172.21.15.27:0/102586905 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83180094d0 con 0x7f8324146c60 2024-01-15T11:33:20.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.943+0000 7f8321d9b640 1 --2- 172.21.15.27:0/102586905 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8324146c60 0x7f832413ca10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f831801a140 tx=0x7f831801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:20.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.943+0000 7f8312ffd640 1 -- 172.21.15.27:0/102586905 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83180aa670 con 0x7f8324146c60 2024-01-15T11:33:20.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.943+0000 7f8312ffd640 1 -- 172.21.15.27:0/102586905 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83180b3800 con 0x7f8324146c60 2024-01-15T11:33:20.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.943+0000 7f8312ffd640 1 -- 172.21.15.27:0/102586905 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83180b3bb0 con 0x7f8324146c60 2024-01-15T11:33:20.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.943+0000 7f8328e5a640 1 -- 172.21.15.27:0/102586905 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f832413bf20 con 0x7f8324146c60 2024-01-15T11:33:20.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.943+0000 7f8328e5a640 1 -- 172.21.15.27:0/102586905 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8324140790 con 0x7f8324146c60 2024-01-15T11:33:20.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.947+0000 7f8328e5a640 1 -- 172.21.15.27:0/102586905 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832404e850 con 0x7f8324146c60 2024-01-15T11:33:20.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.947+0000 7f8312ffd640 1 -- 172.21.15.27:0/102586905 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f83180b3d10 con 0x7f8324146c60 2024-01-15T11:33:20.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.947+0000 7f8312ffd640 1 --2- 172.21.15.27:0/102586905 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f83040668f0 0x7f8304068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:20.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.947+0000 7f8312ffd640 1 -- 172.21.15.27:0/102586905 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f831811ecc0 con 0x7f8324146c60 2024-01-15T11:33:20.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.947+0000 7f832259c640 1 --2- 172.21.15.27:0/102586905 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f83040668f0 0x7f8304068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:20.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.947+0000 7f832259c640 1 --2- 172.21.15.27:0/102586905 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f83040668f0 0x7f8304068db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8314007fd0 tx=0x7f8314009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:20.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:20.951+0000 7f8312ffd640 1 -- 172.21.15.27:0/102586905 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8318125080 con 0x7f8324146c60 2024-01-15T11:33:21.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.107+0000 7f8328e5a640 1 -- 172.21.15.27:0/102586905 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83240d1f60 con 0x7f8324146c60 2024-01-15T11:33:21.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.111+0000 7f8312ffd640 1 -- 172.21.15.27:0/102586905 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16438 (secure 0 0 0) 0x7f83180c3090 con 0x7f8324146c60 2024-01-15T11:33:21.113 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:21.113 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":21,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:33:20.068188+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T11:33:18.397200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T11:33:19.061383+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:33:21.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.111+0000 7f8328e5a640 1 -- 172.21.15.27:0/102586905 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f83040668f0 msgr2=0x7f8304068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:21.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.111+0000 7f8328e5a640 1 --2- 172.21.15.27:0/102586905 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f83040668f0 0x7f8304068db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8314007fd0 tx=0x7f8314009040 comp rx=0 tx=0).stop 2024-01-15T11:33:21.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.111+0000 7f8328e5a640 1 -- 172.21.15.27:0/102586905 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8324146c60 msgr2=0x7f832413ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:21.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.111+0000 7f8328e5a640 1 --2- 172.21.15.27:0/102586905 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8324146c60 0x7f832413ca10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f831801a140 tx=0x7f831801ad50 comp rx=0 tx=0).stop 2024-01-15T11:33:21.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.111+0000 7f8328e5a640 1 -- 172.21.15.27:0/102586905 shutdown_connections 2024-01-15T11:33:21.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.111+0000 7f8328e5a640 1 --2- 172.21.15.27:0/102586905 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f83040668f0 0x7f8304068db0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:21.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.111+0000 7f8328e5a640 1 --2- 172.21.15.27:0/102586905 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8324147040 0x7f832413ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:21.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.111+0000 7f8328e5a640 1 --2- 172.21.15.27:0/102586905 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8324146c60 0x7f832413ca10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:21.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.111+0000 7f8328e5a640 1 --2- 172.21.15.27:0/102586905 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8324070730 0x7f8324159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:21.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.111+0000 7f8328e5a640 1 -- 172.21.15.27:0/102586905 >> 172.21.15.27:0/102586905 conn(0x7f83240b2ea0 msgr2=0x7f83240b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:21.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.111+0000 7f8328e5a640 1 -- 172.21.15.27:0/102586905 shutdown_connections 2024-01-15T11:33:21.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.111+0000 7f8328e5a640 1 -- 172.21.15.27:0/102586905 wait complete. 2024-01-15T11:33:21.134 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:33:21.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.275+0000 7fc6d7609640 1 Processor -- start 2024-01-15T11:33:21.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.275+0000 7fc6d7609640 1 -- start start 2024-01-15T11:33:21.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.275+0000 7fc6d7609640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc6d006d920 0x7fc6d0070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:21.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.275+0000 7fc6d7609640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d0145060 con 0x7fc6d0144c80 2024-01-15T11:33:21.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.275+0000 7fc6d7609640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d0071fd0 con 0x7fc6d00ac630 2024-01-15T11:33:21.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.275+0000 7fc6d7609640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6d0071450 con 0x7fc6d006d920 2024-01-15T11:33:21.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.275+0000 7fc6d53a5640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc6d0144c80 0x7fc6d00abf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:48816/0 (socket says 172.21.15.27:48816) 2024-01-15T11:33:21.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.275+0000 7fc6d53a5640 1 -- 172.21.15.27:0/1251461055 learned_addr learned my addr 172.21.15.27:0/1251461055 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:21.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.275+0000 7fc6d5ba6640 1 --2- 172.21.15.27:0/1251461055 >> v2:172.21.15.27:3300/0 conn(0x7fc6d006d920 0x7fc6d0070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:21.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.275+0000 7fc6c7fff640 1 -- 172.21.15.27:0/1251461055 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 634635179 0 0) 0x7fc6d0145060 con 0x7fc6d0144c80 2024-01-15T11:33:21.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.275+0000 7fc6c7fff640 1 -- 172.21.15.27:0/1251461055 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6bc003530 con 0x7fc6d0144c80 2024-01-15T11:33:21.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.275+0000 7fc6c7fff640 1 -- 172.21.15.27:0/1251461055 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325333431 0 0) 0x7fc6d0071fd0 con 0x7fc6d00ac630 2024-01-15T11:33:21.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.275+0000 7fc6c7fff640 1 -- 172.21.15.27:0/1251461055 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6d0145060 con 0x7fc6d00ac630 2024-01-15T11:33:21.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.275+0000 7fc6d5ba6640 1 -- 172.21.15.27:0/1251461055 >> v1:172.21.15.93:6789/0 conn(0x7fc6d00ac630 legacy=0x7fc6d00706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:21.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.275+0000 7fc6d5ba6640 1 -- 172.21.15.27:0/1251461055 >> v1:172.21.15.27:6789/0 conn(0x7fc6d0144c80 legacy=0x7fc6d00abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:21.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.275+0000 7fc6d5ba6640 1 -- 172.21.15.27:0/1251461055 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d0071730 con 0x7fc6d006d920 2024-01-15T11:33:21.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.279+0000 7fc6d5ba6640 1 --2- 172.21.15.27:0/1251461055 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6d006d920 0x7fc6d0070df0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8009d90 tx=0x7fc6c801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8fc1d7d7bfa89b7 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:21.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.279+0000 7fc6c7fff640 1 -- 172.21.15.27:0/1251461055 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c80a59e0 con 0x7fc6d006d920 2024-01-15T11:33:21.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.279+0000 7fc6c7fff640 1 -- 172.21.15.27:0/1251461055 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c80a5b40 con 0x7fc6d006d920 2024-01-15T11:33:21.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.279+0000 7fc6c7fff640 1 -- 172.21.15.27:0/1251461055 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c80ad440 con 0x7fc6d006d920 2024-01-15T11:33:21.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.279+0000 7fc6d7609640 1 -- 172.21.15.27:0/1251461055 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6d006d920 msgr2=0x7fc6d0070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:21.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.279+0000 7fc6d7609640 1 --2- 172.21.15.27:0/1251461055 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6d006d920 0x7fc6d0070df0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8009d90 tx=0x7fc6c801c920 comp rx=0 tx=0).stop 2024-01-15T11:33:21.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.279+0000 7fc6d7609640 1 -- 172.21.15.27:0/1251461055 shutdown_connections 2024-01-15T11:33:21.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.279+0000 7fc6d7609640 1 --2- 172.21.15.27:0/1251461055 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6d006d920 0x7fc6d0070df0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:21.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.279+0000 7fc6d7609640 1 -- 172.21.15.27:0/1251461055 >> 172.21.15.27:0/1251461055 conn(0x7fc6d00b0c40 msgr2=0x7fc6d00b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:21.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.279+0000 7fc6d7609640 1 -- 172.21.15.27:0/1251461055 shutdown_connections 2024-01-15T11:33:21.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.279+0000 7fc6d7609640 1 -- 172.21.15.27:0/1251461055 wait complete. 2024-01-15T11:33:21.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.283+0000 7fc6d7609640 1 Processor -- start 2024-01-15T11:33:21.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.283+0000 7fc6d7609640 1 -- start start 2024-01-15T11:33:21.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.283+0000 7fc6d7609640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc6d006d920 0x7fc6d0099cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:21.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.283+0000 7fc6d7609640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6d00ac630 0x7fc6d0157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:21.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.283+0000 7fc6d7609640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc6d0144c80 0x7fc6d015b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:21.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.283+0000 7fc6d7609640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d009a440 con 0x7fc6d00ac630 2024-01-15T11:33:21.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.283+0000 7fc6d7609640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d009a690 con 0x7fc6d006d920 2024-01-15T11:33:21.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.283+0000 7fc6d7609640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d009a970 con 0x7fc6d0144c80 2024-01-15T11:33:21.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.283+0000 7fc6d4ba4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6d00ac630 0x7fc6d0157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:21.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.283+0000 7fc6d4ba4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6d00ac630 0x7fc6d0157b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58198/0 (socket says 172.21.15.27:58198) 2024-01-15T11:33:21.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.283+0000 7fc6d4ba4640 1 -- 172.21.15.27:0/2731380383 learned_addr learned my addr 172.21.15.27:0/2731380383 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:21.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.283+0000 7fc6d5ba6640 1 --2- 172.21.15.27:0/2731380383 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc6d0144c80 0x7fc6d015b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:21.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.283+0000 7fc6d53a5640 1 --2- 172.21.15.27:0/2731380383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc6d006d920 0x7fc6d0099cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:21.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.283+0000 7fc6d4ba4640 1 -- 172.21.15.27:0/2731380383 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc6d0144c80 msgr2=0x7fc6d015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:21.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.283+0000 7fc6d4ba4640 1 --2- 172.21.15.27:0/2731380383 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc6d0144c80 0x7fc6d015b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:21.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.283+0000 7fc6d4ba4640 1 -- 172.21.15.27:0/2731380383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc6d006d920 msgr2=0x7fc6d0099cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:21.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.283+0000 7fc6d4ba4640 1 --2- 172.21.15.27:0/2731380383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc6d006d920 0x7fc6d0099cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:21.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.283+0000 7fc6d4ba4640 1 -- 172.21.15.27:0/2731380383 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c8009a70 con 0x7fc6d00ac630 2024-01-15T11:33:21.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.283+0000 7fc6d53a5640 1 --2- 172.21.15.27:0/2731380383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc6d006d920 0x7fc6d0099cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:21.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.283+0000 7fc6d4ba4640 1 --2- 172.21.15.27:0/2731380383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6d00ac630 0x7fc6d0157b20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000c490 tx=0x7fc6c000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:21.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.283+0000 7fc6c5ffb640 1 -- 172.21.15.27:0/2731380383 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c00052d0 con 0x7fc6d00ac630 2024-01-15T11:33:21.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.283+0000 7fc6c5ffb640 1 -- 172.21.15.27:0/2731380383 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c0005430 con 0x7fc6d00ac630 2024-01-15T11:33:21.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.283+0000 7fc6d7609640 1 -- 172.21.15.27:0/2731380383 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d0159600 con 0x7fc6d00ac630 2024-01-15T11:33:21.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.283+0000 7fc6c5ffb640 1 -- 172.21.15.27:0/2731380383 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0012870 con 0x7fc6d00ac630 2024-01-15T11:33:21.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.283+0000 7fc6d7609640 1 -- 172.21.15.27:0/2731380383 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d0158060 con 0x7fc6d00ac630 2024-01-15T11:33:21.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.287+0000 7fc6d7609640 1 -- 172.21.15.27:0/2731380383 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d00b1ba0 con 0x7fc6d00ac630 2024-01-15T11:33:21.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.287+0000 7fc6c5ffb640 1 -- 172.21.15.27:0/2731380383 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fc6c00129d0 con 0x7fc6d00ac630 2024-01-15T11:33:21.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.287+0000 7fc6c5ffb640 1 --2- 172.21.15.27:0/2731380383 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc6b40668f0 0x7fc6b4068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:21.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.287+0000 7fc6c5ffb640 1 -- 172.21.15.27:0/2731380383 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6c0083f40 con 0x7fc6d00ac630 2024-01-15T11:33:21.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.287+0000 7fc6d53a5640 1 --2- 172.21.15.27:0/2731380383 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc6b40668f0 0x7fc6b4068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:21.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.287+0000 7fc6d53a5640 1 --2- 172.21.15.27:0/2731380383 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc6b40668f0 0x7fc6b4068db0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc0011f0 tx=0x7fc6cc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:21.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.291+0000 7fc6c5ffb640 1 -- 172.21.15.27:0/2731380383 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc6c0054c10 con 0x7fc6d00ac630 2024-01-15T11:33:21.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.447+0000 7fc6d7609640 1 -- 172.21.15.27:0/2731380383 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6d004e850 con 0x7fc6d00ac630 2024-01-15T11:33:21.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.451+0000 7fc6c5ffb640 1 -- 172.21.15.27:0/2731380383 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16438 (secure 0 0 0) 0x7fc6c00547a0 con 0x7fc6d00ac630 2024-01-15T11:33:21.453 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:21.454 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":21,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:33:20.068188+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T11:33:18.397200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T11:33:19.061383+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:33:21.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.451+0000 7fc6d7609640 1 -- 172.21.15.27:0/2731380383 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc6b40668f0 msgr2=0x7fc6b4068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:21.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.451+0000 7fc6d7609640 1 --2- 172.21.15.27:0/2731380383 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc6b40668f0 0x7fc6b4068db0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc0011f0 tx=0x7fc6cc009040 comp rx=0 tx=0).stop 2024-01-15T11:33:21.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.451+0000 7fc6d7609640 1 -- 172.21.15.27:0/2731380383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6d00ac630 msgr2=0x7fc6d0157b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:21.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.451+0000 7fc6d7609640 1 --2- 172.21.15.27:0/2731380383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6d00ac630 0x7fc6d0157b20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000c490 tx=0x7fc6c000c950 comp rx=0 tx=0).stop 2024-01-15T11:33:21.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.451+0000 7fc6d7609640 1 -- 172.21.15.27:0/2731380383 shutdown_connections 2024-01-15T11:33:21.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.451+0000 7fc6d7609640 1 --2- 172.21.15.27:0/2731380383 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc6d0144c80 0x7fc6d015b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:21.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.451+0000 7fc6d7609640 1 --2- 172.21.15.27:0/2731380383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc6d00ac630 0x7fc6d0157b20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:21.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.451+0000 7fc6d7609640 1 --2- 172.21.15.27:0/2731380383 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc6b40668f0 0x7fc6b4068db0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:21.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.451+0000 7fc6d7609640 1 --2- 172.21.15.27:0/2731380383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc6d006d920 0x7fc6d0099cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:21.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.451+0000 7fc6d7609640 1 -- 172.21.15.27:0/2731380383 >> 172.21.15.27:0/2731380383 conn(0x7fc6d00b0c40 msgr2=0x7fc6d00b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:21.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.451+0000 7fc6d7609640 1 -- 172.21.15.27:0/2731380383 shutdown_connections 2024-01-15T11:33:21.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.451+0000 7fc6d7609640 1 -- 172.21.15.27:0/2731380383 wait complete. 2024-01-15T11:33:21.474 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-15T11:33:21.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb9364fe640 1 Processor -- start 2024-01-15T11:33:21.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb9364fe640 1 -- start start 2024-01-15T11:33:21.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb9364fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb93015a710 0x7fb9300abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:21.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb9364fe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9300b2710 con 0x7fb9300cdfb0 2024-01-15T11:33:21.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb9364fe640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9300b29f0 con 0x7fb9300cbd50 2024-01-15T11:33:21.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb9364fe640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9300cca80 con 0x7fb93015a710 2024-01-15T11:33:21.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92ffff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb9300cdfb0 0x7fb9300ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:48828/0 (socket says 172.21.15.27:48828) 2024-01-15T11:33:21.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92ffff640 1 -- 172.21.15.27:0/674314247 learned_addr learned my addr 172.21.15.27:0/674314247 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:21.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92f7fe640 1 --2- 172.21.15.27:0/674314247 >> v2:172.21.15.93:3300/0 conn(0x7fb93015a710 0x7fb9300abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:21.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92effd640 1 -- 172.21.15.27:0/674314247 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3127592213 0 0) 0x7fb9300b2710 con 0x7fb9300cdfb0 2024-01-15T11:33:21.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92effd640 1 -- 172.21.15.27:0/674314247 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb918003530 con 0x7fb9300cdfb0 2024-01-15T11:33:21.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92effd640 1 -- 172.21.15.27:0/674314247 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 760326072 0 0) 0x7fb918003530 con 0x7fb9300cdfb0 2024-01-15T11:33:21.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92effd640 1 -- 172.21.15.27:0/674314247 >> v2:172.21.15.93:3300/0 conn(0x7fb93015a710 msgr2=0x7fb9300abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:21.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92effd640 1 --2- 172.21.15.27:0/674314247 >> v2:172.21.15.93:3300/0 conn(0x7fb93015a710 0x7fb9300abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:21.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92effd640 1 -- 172.21.15.27:0/674314247 >> v1:172.21.15.93:6789/0 conn(0x7fb9300cbd50 legacy=0x7fb9300cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:21.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92effd640 1 -- 172.21.15.27:0/674314247 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9300b2cd0 con 0x7fb9300cdfb0 2024-01-15T11:33:21.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92effd640 1 -- 172.21.15.27:0/674314247 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1394381265 0 0) 0x7fb920001680 con 0x7fb9300cdfb0 2024-01-15T11:33:21.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92effd640 1 -- 172.21.15.27:0/674314247 >> v1:172.21.15.27:6789/0 conn(0x7fb9300cdfb0 legacy=0x7fb9300ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:21.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92effd640 1 --2- 172.21.15.27:0/674314247 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb918003980 0x7fb918003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:21.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92effd640 1 --2- 172.21.15.27:0/674314247 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb918004380 0x7fb918004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:21.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92effd640 1 --2- 172.21.15.27:0/674314247 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb918005050 0x7fb91800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:21.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92effd640 1 -- 172.21.15.27:0/674314247 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9300cca80 con 0x7fb918004380 2024-01-15T11:33:21.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92effd640 1 -- 172.21.15.27:0/674314247 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91800e1c0 con 0x7fb918003980 2024-01-15T11:33:21.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92effd640 1 -- 172.21.15.27:0/674314247 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91800e380 con 0x7fb918005050 2024-01-15T11:33:21.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92f7fe640 1 --2- 172.21.15.27:0/674314247 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb918004380 0x7fb918004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:21.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92ffff640 1 --2- 172.21.15.27:0/674314247 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb918003980 0x7fb918003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:21.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb934a9b640 1 --2- 172.21.15.27:0/674314247 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb918005050 0x7fb91800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:21.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92f7fe640 1 -- 172.21.15.27:0/674314247 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb918005050 msgr2=0x7fb91800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:21.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92f7fe640 1 --2- 172.21.15.27:0/674314247 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb918005050 0x7fb91800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:21.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92f7fe640 1 -- 172.21.15.27:0/674314247 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb918003980 msgr2=0x7fb918003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:21.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92f7fe640 1 --2- 172.21.15.27:0/674314247 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb918003980 0x7fb918003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:21.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92f7fe640 1 -- 172.21.15.27:0/674314247 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb918003530 con 0x7fb918004380 2024-01-15T11:33:21.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb92ffff640 1 --2- 172.21.15.27:0/674314247 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb918003980 0x7fb918003d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:21.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.619+0000 7fb934a9b640 1 -- 172.21.15.27:0/674314247 reap_dead start 2024-01-15T11:33:21.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.623+0000 7fb92f7fe640 1 --2- 172.21.15.27:0/674314247 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb918004380 0x7fb918004850 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb924009ab0 tx=0x7fb92401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aff61173c81d71c server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:21.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.623+0000 7fb92effd640 1 -- 172.21.15.27:0/674314247 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9240a5530 con 0x7fb918004380 2024-01-15T11:33:21.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.623+0000 7fb92effd640 1 -- 172.21.15.27:0/674314247 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9240a5690 con 0x7fb918004380 2024-01-15T11:33:21.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.623+0000 7fb92effd640 1 -- 172.21.15.27:0/674314247 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9240a5a40 con 0x7fb918004380 2024-01-15T11:33:21.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.623+0000 7fb9364fe640 1 -- 172.21.15.27:0/674314247 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb918004380 msgr2=0x7fb918004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:21.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.623+0000 7fb9364fe640 1 --2- 172.21.15.27:0/674314247 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb918004380 0x7fb918004850 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb924009ab0 tx=0x7fb92401ca50 comp rx=0 tx=0).stop 2024-01-15T11:33:21.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.623+0000 7fb9364fe640 1 -- 172.21.15.27:0/674314247 shutdown_connections 2024-01-15T11:33:21.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.623+0000 7fb9364fe640 1 --2- 172.21.15.27:0/674314247 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb918004380 0x7fb918004850 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:21.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.623+0000 7fb9364fe640 1 -- 172.21.15.27:0/674314247 >> 172.21.15.27:0/674314247 conn(0x7fb9300b0cb0 msgr2=0x7fb9300b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:21.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.623+0000 7fb9364fe640 1 -- 172.21.15.27:0/674314247 shutdown_connections 2024-01-15T11:33:21.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.623+0000 7fb9364fe640 1 -- 172.21.15.27:0/674314247 wait complete. 2024-01-15T11:33:21.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.627+0000 7fb9364fe640 1 Processor -- start 2024-01-15T11:33:21.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.627+0000 7fb9364fe640 1 -- start start 2024-01-15T11:33:21.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.627+0000 7fb9364fe640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb918004380 0x7fb93015b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:21.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.627+0000 7fb9364fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb93009cc60 0x7fb930152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:21.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.627+0000 7fb9364fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb93015cf20 0x7fb93015d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:21.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.627+0000 7fb9364fe640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb930153340 con 0x7fb93015cf20 2024-01-15T11:33:21.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.627+0000 7fb9364fe640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93009c880 con 0x7fb93009cc60 2024-01-15T11:33:21.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.627+0000 7fb9364fe640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93015bac0 con 0x7fb918004380 2024-01-15T11:33:21.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.627+0000 7fb934a9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb93015cf20 0x7fb93015d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:21.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.627+0000 7fb934a9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb93015cf20 0x7fb93015d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58216/0 (socket says 172.21.15.27:58216) 2024-01-15T11:33:21.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.627+0000 7fb934a9b640 1 -- 172.21.15.27:0/663750688 learned_addr learned my addr 172.21.15.27:0/663750688 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:21.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.627+0000 7fb92ffff640 1 --2- 172.21.15.27:0/663750688 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb918004380 0x7fb93015b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:21.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.627+0000 7fb92f7fe640 1 --2- 172.21.15.27:0/663750688 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb93009cc60 0x7fb930152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:21.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.627+0000 7fb934a9b640 1 -- 172.21.15.27:0/663750688 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb918004380 msgr2=0x7fb93015b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:21.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.627+0000 7fb934a9b640 1 --2- 172.21.15.27:0/663750688 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb918004380 0x7fb93015b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:21.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.627+0000 7fb934a9b640 1 -- 172.21.15.27:0/663750688 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb93009cc60 msgr2=0x7fb930152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:21.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.627+0000 7fb934a9b640 1 --2- 172.21.15.27:0/663750688 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb93009cc60 0x7fb930152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:21.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.627+0000 7fb934a9b640 1 -- 172.21.15.27:0/663750688 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb930070830 con 0x7fb93015cf20 2024-01-15T11:33:21.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.627+0000 7fb934a9b640 1 --2- 172.21.15.27:0/663750688 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb93015cf20 0x7fb93015d3a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb9280059b0 tx=0x7fb928012e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:21.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.627+0000 7fb92cff9640 1 -- 172.21.15.27:0/663750688 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb928010b80 con 0x7fb93015cf20 2024-01-15T11:33:21.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.627+0000 7fb92cff9640 1 -- 172.21.15.27:0/663750688 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb928010d00 con 0x7fb93015cf20 2024-01-15T11:33:21.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.627+0000 7fb92cff9640 1 -- 172.21.15.27:0/663750688 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9280166c0 con 0x7fb93015cf20 2024-01-15T11:33:21.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.627+0000 7fb9364fe640 1 -- 172.21.15.27:0/663750688 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb930070b10 con 0x7fb93015cf20 2024-01-15T11:33:21.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.627+0000 7fb9364fe640 1 -- 172.21.15.27:0/663750688 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9300710d0 con 0x7fb93015cf20 2024-01-15T11:33:21.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.631+0000 7fb9364fe640 1 -- 172.21.15.27:0/663750688 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9300671f0 con 0x7fb93015cf20 2024-01-15T11:33:21.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.631+0000 7fb92cff9640 1 -- 172.21.15.27:0/663750688 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fb928016820 con 0x7fb93015cf20 2024-01-15T11:33:21.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.631+0000 7fb92cff9640 1 --2- 172.21.15.27:0/663750688 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb91c0668f0 0x7fb91c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:21.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.631+0000 7fb92cff9640 1 -- 172.21.15.27:0/663750688 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb928087b20 con 0x7fb93015cf20 2024-01-15T11:33:21.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.631+0000 7fb92ffff640 1 --2- 172.21.15.27:0/663750688 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb91c0668f0 0x7fb91c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:21.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.631+0000 7fb92ffff640 1 --2- 172.21.15.27:0/663750688 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb91c0668f0 0x7fb91c068db0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb920001c40 tx=0x7fb920007040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:21.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.635+0000 7fb92cff9640 1 -- 172.21.15.27:0/663750688 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb928054d70 con 0x7fb93015cf20 2024-01-15T11:33:21.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:21.831+0000 7fb9364fe640 1 -- 172.21.15.27:0/663750688 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb93006b460 con 0x7fb93015cf20 2024-01-15T11:33:22.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.775+0000 7fb92cff9640 1 -- 172.21.15.27:0/663750688 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb928058390 con 0x7fb93015cf20 2024-01-15T11:33:22.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.779+0000 7fb9364fe640 1 -- 172.21.15.27:0/663750688 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb91c0668f0 msgr2=0x7fb91c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:22.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.779+0000 7fb9364fe640 1 --2- 172.21.15.27:0/663750688 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb91c0668f0 0x7fb91c068db0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb920001c40 tx=0x7fb920007040 comp rx=0 tx=0).stop 2024-01-15T11:33:22.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.779+0000 7fb9364fe640 1 -- 172.21.15.27:0/663750688 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb93015cf20 msgr2=0x7fb93015d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:22.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.779+0000 7fb9364fe640 1 --2- 172.21.15.27:0/663750688 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb93015cf20 0x7fb93015d3a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb9280059b0 tx=0x7fb928012e60 comp rx=0 tx=0).stop 2024-01-15T11:33:22.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.779+0000 7fb9364fe640 1 -- 172.21.15.27:0/663750688 shutdown_connections 2024-01-15T11:33:22.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.779+0000 7fb9364fe640 1 --2- 172.21.15.27:0/663750688 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb93015cf20 0x7fb93015d3a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:22.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.779+0000 7fb9364fe640 1 --2- 172.21.15.27:0/663750688 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb91c0668f0 0x7fb91c068db0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:22.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.779+0000 7fb9364fe640 1 --2- 172.21.15.27:0/663750688 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb93009cc60 0x7fb930152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:22.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.779+0000 7fb9364fe640 1 --2- 172.21.15.27:0/663750688 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb918004380 0x7fb93015b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:22.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.779+0000 7fb9364fe640 1 -- 172.21.15.27:0/663750688 >> 172.21.15.27:0/663750688 conn(0x7fb9300b0cb0 msgr2=0x7fb9300ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:22.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.779+0000 7fb9364fe640 1 -- 172.21.15.27:0/663750688 shutdown_connections 2024-01-15T11:33:22.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.779+0000 7fb9364fe640 1 -- 172.21.15.27:0/663750688 wait complete. 2024-01-15T11:33:22.804 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-15T11:33:22.804 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-15T11:33:22.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.955+0000 7f4c2472a640 1 Processor -- start 2024-01-15T11:33:22.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.955+0000 7f4c2472a640 1 -- start start 2024-01-15T11:33:22.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.955+0000 7f4c2472a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c1c0ae680 0x7f4c1c0cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:22.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.955+0000 7f4c2472a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4c1c070890 0x7f4c1c070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:22.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.955+0000 7f4c2472a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1c072950 con 0x7f4c1c159f00 2024-01-15T11:33:22.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.955+0000 7f4c2472a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1c06e2b0 con 0x7f4c1c070890 2024-01-15T11:33:22.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.955+0000 7f4c2472a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c06c6f0 con 0x7f4c1c0ae680 2024-01-15T11:33:22.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.955+0000 7f4c22cc7640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4c1c070890 0x7f4c1c070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:22.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.955+0000 7f4c22cc7640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4c1c070890 0x7f4c1c070cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58224/0 (socket says 172.21.15.27:58224) 2024-01-15T11:33:22.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.955+0000 7f4c22cc7640 1 -- 172.21.15.27:0/712305554 learned_addr learned my addr 172.21.15.27:0/712305554 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:22.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.955+0000 7f4c21cc5640 1 --2- 172.21.15.27:0/712305554 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c1c0ae680 0x7f4c1c0cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:22.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.955+0000 7f4c22cc7640 1 -- 172.21.15.27:0/712305554 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c1c0ae680 msgr2=0x7f4c1c0cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:22.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.955+0000 7f4c22cc7640 1 --2- 172.21.15.27:0/712305554 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c1c0ae680 0x7f4c1c0cd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:22.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.955+0000 7f4c22cc7640 1 -- 172.21.15.27:0/712305554 >> v1:172.21.15.93:6789/0 conn(0x7f4c1c159f00 legacy=0x7f4c1c0ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:22.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.955+0000 7f4c22cc7640 1 -- 172.21.15.27:0/712305554 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c06e550 con 0x7f4c1c070890 2024-01-15T11:33:22.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.959+0000 7f4c22cc7640 1 --2- 172.21.15.27:0/712305554 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c1c070890 0x7f4c1c070cf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4c1400d150 tx=0x7f4c1401ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ac4b128e3be892 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:22.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.959+0000 7f4c214c4640 1 -- 172.21.15.27:0/712305554 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c140a7c30 con 0x7f4c1c070890 2024-01-15T11:33:22.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.959+0000 7f4c214c4640 1 -- 172.21.15.27:0/712305554 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c140ab070 con 0x7f4c1c070890 2024-01-15T11:33:22.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.959+0000 7f4c214c4640 1 -- 172.21.15.27:0/712305554 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c140b1400 con 0x7f4c1c070890 2024-01-15T11:33:22.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.959+0000 7f4c2472a640 1 -- 172.21.15.27:0/712305554 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c1c070890 msgr2=0x7f4c1c070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:22.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.959+0000 7f4c2472a640 1 --2- 172.21.15.27:0/712305554 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c1c070890 0x7f4c1c070cf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4c1400d150 tx=0x7f4c1401ebe0 comp rx=0 tx=0).stop 2024-01-15T11:33:22.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.959+0000 7f4c2472a640 1 -- 172.21.15.27:0/712305554 shutdown_connections 2024-01-15T11:33:22.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.959+0000 7f4c2472a640 1 --2- 172.21.15.27:0/712305554 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c1c070890 0x7f4c1c070cf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:22.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.959+0000 7f4c2472a640 1 --2- 172.21.15.27:0/712305554 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c1c0ae680 0x7f4c1c0cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:22.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.959+0000 7f4c2472a640 1 -- 172.21.15.27:0/712305554 >> 172.21.15.27:0/712305554 conn(0x7f4c1c0b0cb0 msgr2=0x7f4c1c0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:22.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.959+0000 7f4c2472a640 1 -- 172.21.15.27:0/712305554 shutdown_connections 2024-01-15T11:33:22.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.959+0000 7f4c2472a640 1 -- 172.21.15.27:0/712305554 wait complete. 2024-01-15T11:33:22.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.963+0000 7f4c2472a640 1 Processor -- start 2024-01-15T11:33:22.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.963+0000 7f4c2472a640 1 -- start start 2024-01-15T11:33:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.963+0000 7f4c2472a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c1c070890 0x7f4c1c146d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.963+0000 7f4c2472a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c1c0ae680 0x7f4c1c158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.963+0000 7f4c2472a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c1c158bc0 0x7f4c1c0c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.963+0000 7f4c2472a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c159070 con 0x7f4c1c070890 2024-01-15T11:33:22.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.963+0000 7f4c2472a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c147280 con 0x7f4c1c158bc0 2024-01-15T11:33:22.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.963+0000 7f4c2472a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0c9300 con 0x7f4c1c0ae680 2024-01-15T11:33:22.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.963+0000 7f4c224c6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c1c070890 0x7f4c1c146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:22.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.963+0000 7f4c224c6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c1c070890 0x7f4c1c146d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58226/0 (socket says 172.21.15.27:58226) 2024-01-15T11:33:22.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.963+0000 7f4c224c6640 1 -- 172.21.15.27:0/2405763655 learned_addr learned my addr 172.21.15.27:0/2405763655 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:22.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.963+0000 7f4c22cc7640 1 --2- 172.21.15.27:0/2405763655 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c1c158bc0 0x7f4c1c0c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:22.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.963+0000 7f4c21cc5640 1 --2- 172.21.15.27:0/2405763655 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c1c0ae680 0x7f4c1c158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:22.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.963+0000 7f4c224c6640 1 -- 172.21.15.27:0/2405763655 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c1c0ae680 msgr2=0x7f4c1c158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:22.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.963+0000 7f4c224c6640 1 --2- 172.21.15.27:0/2405763655 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c1c0ae680 0x7f4c1c158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:22.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.963+0000 7f4c224c6640 1 -- 172.21.15.27:0/2405763655 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c1c158bc0 msgr2=0x7f4c1c0c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:22.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.963+0000 7f4c224c6640 1 --2- 172.21.15.27:0/2405763655 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c1c158bc0 0x7f4c1c0c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:22.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.963+0000 7f4c224c6640 1 -- 172.21.15.27:0/2405763655 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1400bd40 con 0x7f4c1c070890 2024-01-15T11:33:22.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.963+0000 7f4c224c6640 1 --2- 172.21.15.27:0/2405763655 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c1c070890 0x7f4c1c146d40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4c1800c3c0 tx=0x7f4c1800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:22.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.963+0000 7f4c12ffd640 1 -- 172.21.15.27:0/2405763655 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c180052d0 con 0x7f4c1c070890 2024-01-15T11:33:22.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.963+0000 7f4c12ffd640 1 -- 172.21.15.27:0/2405763655 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c18005430 con 0x7f4c1c070890 2024-01-15T11:33:22.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.963+0000 7f4c2472a640 1 -- 172.21.15.27:0/2405763655 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1c0c95e0 con 0x7f4c1c070890 2024-01-15T11:33:22.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.963+0000 7f4c12ffd640 1 -- 172.21.15.27:0/2405763655 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c18003840 con 0x7f4c1c070890 2024-01-15T11:33:22.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.963+0000 7f4c2472a640 1 -- 172.21.15.27:0/2405763655 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1c0c9ba0 con 0x7f4c1c070890 2024-01-15T11:33:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.963+0000 7f4c2472a640 1 -- 172.21.15.27:0/2405763655 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1c0671f0 con 0x7f4c1c070890 2024-01-15T11:33:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.967+0000 7f4c12ffd640 1 -- 172.21.15.27:0/2405763655 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f4c180039a0 con 0x7f4c1c070890 2024-01-15T11:33:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.967+0000 7f4c12ffd640 1 --2- 172.21.15.27:0/2405763655 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4c000668f0 0x7f4c00068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.967+0000 7f4c12ffd640 1 -- 172.21.15.27:0/2405763655 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c18083950 con 0x7f4c1c070890 2024-01-15T11:33:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.967+0000 7f4c21cc5640 1 --2- 172.21.15.27:0/2405763655 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4c000668f0 0x7f4c00068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:22.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.967+0000 7f4c21cc5640 1 --2- 172.21.15.27:0/2405763655 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4c000668f0 0x7f4c00068db0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c15cbe0 tx=0x7f4c0c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:22.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:22.971+0000 7f4c12ffd640 1 -- 172.21.15.27:0/2405763655 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4c18050ba0 con 0x7f4c1c070890 2024-01-15T11:33:23.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.163+0000 7f4c2472a640 1 -- 172.21.15.27:0/2405763655 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4c1c06b460 con 0x7f4c1c070890 2024-01-15T11:33:23.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.779+0000 7f4c12ffd640 1 -- 172.21.15.27:0/2405763655 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4c180170c0 con 0x7f4c1c070890 2024-01-15T11:33:23.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.779+0000 7f4c2472a640 1 -- 172.21.15.27:0/2405763655 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4c000668f0 msgr2=0x7f4c00068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:23.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.779+0000 7f4c2472a640 1 --2- 172.21.15.27:0/2405763655 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4c000668f0 0x7f4c00068db0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c15cbe0 tx=0x7f4c0c008040 comp rx=0 tx=0).stop 2024-01-15T11:33:23.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.779+0000 7f4c2472a640 1 -- 172.21.15.27:0/2405763655 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c1c070890 msgr2=0x7f4c1c146d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:23.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.779+0000 7f4c2472a640 1 --2- 172.21.15.27:0/2405763655 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c1c070890 0x7f4c1c146d40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4c1800c3c0 tx=0x7f4c1800c880 comp rx=0 tx=0).stop 2024-01-15T11:33:23.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.779+0000 7f4c2472a640 1 -- 172.21.15.27:0/2405763655 shutdown_connections 2024-01-15T11:33:23.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.779+0000 7f4c2472a640 1 --2- 172.21.15.27:0/2405763655 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4c000668f0 0x7f4c00068db0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:23.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.779+0000 7f4c2472a640 1 --2- 172.21.15.27:0/2405763655 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c1c158bc0 0x7f4c1c0c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:23.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.779+0000 7f4c2472a640 1 --2- 172.21.15.27:0/2405763655 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c1c0ae680 0x7f4c1c158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:23.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.779+0000 7f4c2472a640 1 --2- 172.21.15.27:0/2405763655 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c1c070890 0x7f4c1c146d40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:23.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.779+0000 7f4c2472a640 1 -- 172.21.15.27:0/2405763655 >> 172.21.15.27:0/2405763655 conn(0x7f4c1c0b0cb0 msgr2=0x7f4c1c0af7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:23.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.779+0000 7f4c2472a640 1 -- 172.21.15.27:0/2405763655 shutdown_connections 2024-01-15T11:33:23.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.779+0000 7f4c2472a640 1 -- 172.21.15.27:0/2405763655 wait complete. 2024-01-15T11:33:23.806 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-15T11:33:23.806 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-15T11:33:23.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.951+0000 7f528226b640 1 Processor -- start 2024-01-15T11:33:23.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.951+0000 7f528226b640 1 -- start start 2024-01-15T11:33:23.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.951+0000 7f528226b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f527c144cf0 0x7f527c070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:23.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.951+0000 7f528226b640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f527c0b44b0 0x7f527c0cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:23.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.951+0000 7f528226b640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f527c0b4c70 con 0x7f527c0ce160 2024-01-15T11:33:23.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.951+0000 7f528226b640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f527c0b5d10 con 0x7f527c144cf0 2024-01-15T11:33:23.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.951+0000 7f528226b640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527c0ce5f0 con 0x7f527c0b44b0 2024-01-15T11:33:23.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.951+0000 7f5280808640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f527c0ce160 0x7f527c15eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:48842/0 (socket says 172.21.15.27:48842) 2024-01-15T11:33:23.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.951+0000 7f5280808640 1 -- 172.21.15.27:0/1365347636 learned_addr learned my addr 172.21.15.27:0/1365347636 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:23.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.951+0000 7f527bfff640 1 --2- 172.21.15.27:0/1365347636 >> v2:172.21.15.93:3300/0 conn(0x7f527c144cf0 0x7f527c070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:23.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.951+0000 7f527b7fe640 1 --2- 172.21.15.27:0/1365347636 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f527c0b44b0 0x7f527c0cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:23.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.951+0000 7f527affd640 1 -- 172.21.15.27:0/1365347636 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617778583 0 0) 0x7f527c0b4c70 con 0x7f527c0ce160 2024-01-15T11:33:23.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.951+0000 7f527affd640 1 -- 172.21.15.27:0/1365347636 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5264003530 con 0x7f527c0ce160 2024-01-15T11:33:23.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.951+0000 7f527bfff640 1 -- 172.21.15.27:0/1365347636 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f527c0b44b0 msgr2=0x7f527c0cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:23.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.951+0000 7f527bfff640 1 --2- 172.21.15.27:0/1365347636 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f527c0b44b0 0x7f527c0cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:23.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.951+0000 7f527bfff640 1 -- 172.21.15.27:0/1365347636 >> v1:172.21.15.27:6789/0 conn(0x7f527c0ce160 legacy=0x7f527c15eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:23.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.951+0000 7f527bfff640 1 -- 172.21.15.27:0/1365347636 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527c0b4f50 con 0x7f527c144cf0 2024-01-15T11:33:23.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.955+0000 7f527bfff640 1 --2- 172.21.15.27:0/1365347636 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f527c144cf0 0x7f527c070ae0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f526c0097c0 tx=0x7f526c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e04ccc0f22a2618c server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:23.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.955+0000 7f527affd640 1 -- 172.21.15.27:0/1365347636 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0ab650 con 0x7f527c144cf0 2024-01-15T11:33:23.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.955+0000 7f527affd640 1 -- 172.21.15.27:0/1365347636 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526c0ab7b0 con 0x7f527c144cf0 2024-01-15T11:33:23.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.955+0000 7f527affd640 1 -- 172.21.15.27:0/1365347636 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0abb40 con 0x7f527c144cf0 2024-01-15T11:33:23.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.955+0000 7f528226b640 1 -- 172.21.15.27:0/1365347636 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f527c144cf0 msgr2=0x7f527c070ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:23.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.955+0000 7f528226b640 1 --2- 172.21.15.27:0/1365347636 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f527c144cf0 0x7f527c070ae0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f526c0097c0 tx=0x7f526c01c450 comp rx=0 tx=0).stop 2024-01-15T11:33:23.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.955+0000 7f528226b640 1 -- 172.21.15.27:0/1365347636 shutdown_connections 2024-01-15T11:33:23.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.955+0000 7f528226b640 1 --2- 172.21.15.27:0/1365347636 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f527c0b44b0 0x7f527c0cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:23.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.955+0000 7f528226b640 1 --2- 172.21.15.27:0/1365347636 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f527c144cf0 0x7f527c070ae0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:23.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.955+0000 7f528226b640 1 -- 172.21.15.27:0/1365347636 >> 172.21.15.27:0/1365347636 conn(0x7f527c0b2ea0 msgr2=0x7f527c0b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:23.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.955+0000 7f528226b640 1 -- 172.21.15.27:0/1365347636 shutdown_connections 2024-01-15T11:33:23.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.955+0000 7f528226b640 1 -- 172.21.15.27:0/1365347636 wait complete. 2024-01-15T11:33:23.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.959+0000 7f528226b640 1 Processor -- start 2024-01-15T11:33:23.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.959+0000 7f528226b640 1 -- start start 2024-01-15T11:33:23.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.959+0000 7f528226b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f527c0b44b0 0x7f527c153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:23.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.959+0000 7f528226b640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f527c0ce160 0x7f527c143f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:23.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.959+0000 7f528226b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f527c144cf0 0x7f527c13caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:23.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.959+0000 7f528226b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c1548b0 con 0x7f527c0b44b0 2024-01-15T11:33:23.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.959+0000 7f528226b640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c1444d0 con 0x7f527c144cf0 2024-01-15T11:33:23.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.959+0000 7f528226b640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527c153c30 con 0x7f527c0ce160 2024-01-15T11:33:23.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.959+0000 7f527bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f527c0b44b0 0x7f527c153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:23.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.959+0000 7f527bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f527c0b44b0 0x7f527c153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58234/0 (socket says 172.21.15.27:58234) 2024-01-15T11:33:23.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.959+0000 7f527bfff640 1 -- 172.21.15.27:0/1877706048 learned_addr learned my addr 172.21.15.27:0/1877706048 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:23.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.959+0000 7f527b7fe640 1 --2- 172.21.15.27:0/1877706048 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f527c0ce160 0x7f527c143f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:23.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.959+0000 7f5280808640 1 --2- 172.21.15.27:0/1877706048 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f527c144cf0 0x7f527c13caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:23.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.959+0000 7f527bfff640 1 -- 172.21.15.27:0/1877706048 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f527c0ce160 msgr2=0x7f527c143f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:23.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.959+0000 7f527bfff640 1 --2- 172.21.15.27:0/1877706048 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f527c0ce160 0x7f527c143f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:23.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.959+0000 7f527bfff640 1 -- 172.21.15.27:0/1877706048 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f527c144cf0 msgr2=0x7f527c13caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:23.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.959+0000 7f527bfff640 1 --2- 172.21.15.27:0/1877706048 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f527c144cf0 0x7f527c13caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:23.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.959+0000 7f527bfff640 1 -- 172.21.15.27:0/1877706048 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526c009420 con 0x7f527c0b44b0 2024-01-15T11:33:23.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.959+0000 7f527b7fe640 1 --2- 172.21.15.27:0/1877706048 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f527c0ce160 0x7f527c143f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:23.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.959+0000 7f527bfff640 1 --2- 172.21.15.27:0/1877706048 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f527c0b44b0 0x7f527c153650 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f526c0ad040 tx=0x7f526c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:23.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.959+0000 7f5278ff9640 1 -- 172.21.15.27:0/1877706048 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0bf610 con 0x7f527c0b44b0 2024-01-15T11:33:23.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.959+0000 7f5278ff9640 1 -- 172.21.15.27:0/1877706048 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526c0bf790 con 0x7f527c0b44b0 2024-01-15T11:33:23.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.959+0000 7f5278ff9640 1 -- 172.21.15.27:0/1877706048 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0bfb40 con 0x7f527c0b44b0 2024-01-15T11:33:23.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.959+0000 7f528226b640 1 -- 172.21.15.27:0/1877706048 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f527c153f10 con 0x7f527c0b44b0 2024-01-15T11:33:23.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.959+0000 7f528226b640 1 -- 172.21.15.27:0/1877706048 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527c1544d0 con 0x7f527c0b44b0 2024-01-15T11:33:23.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.963+0000 7f528226b640 1 -- 172.21.15.27:0/1877706048 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f527c1549f0 con 0x7f527c0b44b0 2024-01-15T11:33:23.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.963+0000 7f5278ff9640 1 -- 172.21.15.27:0/1877706048 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f526c0b5400 con 0x7f527c0b44b0 2024-01-15T11:33:23.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.963+0000 7f5278ff9640 1 --2- 172.21.15.27:0/1877706048 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f52680668f0 0x7f5268068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:23.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.963+0000 7f5278ff9640 1 -- 172.21.15.27:0/1877706048 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f526c11ee40 con 0x7f527c0b44b0 2024-01-15T11:33:23.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.963+0000 7f527b7fe640 1 --2- 172.21.15.27:0/1877706048 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f52680668f0 0x7f5268068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:23.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.963+0000 7f527b7fe640 1 --2- 172.21.15.27:0/1877706048 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f52680668f0 0x7f5268068db0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f527c067a20 tx=0x7f5270008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:23.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:23.967+0000 7f5278ff9640 1 -- 172.21.15.27:0/1877706048 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f526c0ebff0 con 0x7f527c0b44b0 2024-01-15T11:33:24.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.159+0000 7f528226b640 1 -- 172.21.15.27:0/1877706048 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f527c04e850 con 0x7f527c0b44b0 2024-01-15T11:33:24.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.159+0000 7f5278ff9640 1 -- 172.21.15.27:0/1877706048 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f526c0ef610 con 0x7f527c0b44b0 2024-01-15T11:33:24.163 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:24.163 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3682867520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3682867520},{"type":"v1","addr":"172.21.15.93:6837","nonce":3682867520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/2849635892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2849635892},{"type":"v1","addr":"172.21.15.93:6836","nonce":2849635892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/889491859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":889491859},{"type":"v1","addr":"172.21.15.27:6833","nonce":889491859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-15T11:33:20.068559+0000","modified":"2024-01-15T11:33:23.168516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/2516765751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2516765751},{"type":"v1","addr":"172.21.15.27:6835","nonce":2516765751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-15T11:33:24.163 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 8 2024-01-15T11:33:24.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.163+0000 7f528226b640 1 -- 172.21.15.27:0/1877706048 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f52680668f0 msgr2=0x7f5268068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:24.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.163+0000 7f528226b640 1 --2- 172.21.15.27:0/1877706048 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f52680668f0 0x7f5268068db0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f527c067a20 tx=0x7f5270008040 comp rx=0 tx=0).stop 2024-01-15T11:33:24.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.163+0000 7f528226b640 1 -- 172.21.15.27:0/1877706048 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f527c0b44b0 msgr2=0x7f527c153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:24.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.163+0000 7f528226b640 1 --2- 172.21.15.27:0/1877706048 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f527c0b44b0 0x7f527c153650 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f526c0ad040 tx=0x7f526c01ac90 comp rx=0 tx=0).stop 2024-01-15T11:33:24.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.163+0000 7f528226b640 1 -- 172.21.15.27:0/1877706048 shutdown_connections 2024-01-15T11:33:24.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.163+0000 7f528226b640 1 --2- 172.21.15.27:0/1877706048 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f52680668f0 0x7f5268068db0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:24.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.163+0000 7f528226b640 1 --2- 172.21.15.27:0/1877706048 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f527c144cf0 0x7f527c13caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:24.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.163+0000 7f528226b640 1 --2- 172.21.15.27:0/1877706048 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f527c0ce160 0x7f527c143f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:24.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.163+0000 7f528226b640 1 --2- 172.21.15.27:0/1877706048 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f527c0b44b0 0x7f527c153650 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:24.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.163+0000 7f528226b640 1 -- 172.21.15.27:0/1877706048 >> 172.21.15.27:0/1877706048 conn(0x7f527c0b2ea0 msgr2=0x7f527c0b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:24.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.163+0000 7f528226b640 1 -- 172.21.15.27:0/1877706048 shutdown_connections 2024-01-15T11:33:24.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.163+0000 7f528226b640 1 -- 172.21.15.27:0/1877706048 wait complete. 2024-01-15T11:33:24.185 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:33:24.328 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.323+0000 7f46c17f5640 1 Processor -- start 2024-01-15T11:33:24.328 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.323+0000 7f46c17f5640 1 -- start start 2024-01-15T11:33:24.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.327+0000 7f46c17f5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f46bc0ac630 0x7f46bc0706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:24.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.327+0000 7f46c17f5640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f46bc070c20 0x7f46bc06c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:24.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.327+0000 7f46c17f5640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46bc145060 con 0x7f46bc144c80 2024-01-15T11:33:24.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.327+0000 7f46c17f5640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46bc071fd0 con 0x7f46bc0ac630 2024-01-15T11:33:24.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.327+0000 7f46c17f5640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc071450 con 0x7f46bc070c20 2024-01-15T11:33:24.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.327+0000 7f46b3fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f46bc0ac630 0x7f46bc0706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:24.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.327+0000 7f46bb7fe640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f46bc070c20 0x7f46bc06c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:24.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.327+0000 7f46b3fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f46bc0ac630 0x7f46bc0706e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:48470/0 (socket says 172.21.15.27:48470) 2024-01-15T11:33:24.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.327+0000 7f46baffd640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f46bc144c80 0x7f46bc0abf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.27:42126/0 (socket says 172.21.15.27:42126) 2024-01-15T11:33:24.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.327+0000 7f46b3fff640 1 -- 172.21.15.27:0/1604460146 learned_addr learned my addr 172.21.15.27:0/1604460146 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:24.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.327+0000 7f46b3fff640 1 -- 172.21.15.27:0/1604460146 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f46bc070c20 msgr2=0x7f46bc06c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:24.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.327+0000 7f46b3fff640 1 --2- 172.21.15.27:0/1604460146 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f46bc070c20 0x7f46bc06c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:24.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.327+0000 7f46b3fff640 1 -- 172.21.15.27:0/1604460146 >> v1:172.21.15.93:6789/0 conn(0x7f46bc144c80 legacy=0x7f46bc0abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:24.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.327+0000 7f46b3fff640 1 -- 172.21.15.27:0/1604460146 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc071730 con 0x7f46bc0ac630 2024-01-15T11:33:24.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.331+0000 7f46b3fff640 1 --2- 172.21.15.27:0/1604460146 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46bc0ac630 0x7f46bc0706e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009870 tx=0x7f46a401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39b9955b2713bd76 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:24.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.331+0000 7f46ba7fc640 1 -- 172.21.15.27:0/1604460146 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a40aa670 con 0x7f46bc0ac630 2024-01-15T11:33:24.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.331+0000 7f46ba7fc640 1 -- 172.21.15.27:0/1604460146 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a40aa7d0 con 0x7f46bc0ac630 2024-01-15T11:33:24.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.331+0000 7f46ba7fc640 1 -- 172.21.15.27:0/1604460146 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a40aab60 con 0x7f46bc0ac630 2024-01-15T11:33:24.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.331+0000 7f46c17f5640 1 -- 172.21.15.27:0/1604460146 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46bc0ac630 msgr2=0x7f46bc0706e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:24.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.331+0000 7f46c17f5640 1 --2- 172.21.15.27:0/1604460146 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46bc0ac630 0x7f46bc0706e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009870 tx=0x7f46a401c510 comp rx=0 tx=0).stop 2024-01-15T11:33:24.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.331+0000 7f46c17f5640 1 -- 172.21.15.27:0/1604460146 shutdown_connections 2024-01-15T11:33:24.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.331+0000 7f46c17f5640 1 --2- 172.21.15.27:0/1604460146 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f46bc070c20 0x7f46bc06c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:24.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.331+0000 7f46c17f5640 1 --2- 172.21.15.27:0/1604460146 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46bc0ac630 0x7f46bc0706e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:24.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.331+0000 7f46c17f5640 1 -- 172.21.15.27:0/1604460146 >> 172.21.15.27:0/1604460146 conn(0x7f46bc0b0c40 msgr2=0x7f46bc0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:24.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.331+0000 7f46c17f5640 1 -- 172.21.15.27:0/1604460146 shutdown_connections 2024-01-15T11:33:24.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.331+0000 7f46c17f5640 1 -- 172.21.15.27:0/1604460146 wait complete. 2024-01-15T11:33:24.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.331+0000 7f46c17f5640 1 Processor -- start 2024-01-15T11:33:24.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.335+0000 7f46c17f5640 1 -- start start 2024-01-15T11:33:24.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.335+0000 7f46c17f5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46bc070c20 0x7f46bc165c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:24.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.335+0000 7f46c17f5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46bc0ac630 0x7f46bc15ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:24.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.335+0000 7f46c17f5640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f46bc144c80 0x7f46bc15ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:24.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.335+0000 7f46c17f5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc15f380 con 0x7f46bc0ac630 2024-01-15T11:33:24.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.335+0000 7f46c17f5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc15b3c0 con 0x7f46bc070c20 2024-01-15T11:33:24.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.335+0000 7f46c17f5640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc15dda0 con 0x7f46bc144c80 2024-01-15T11:33:24.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.335+0000 7f46b3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46bc0ac630 0x7f46bc15ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:24.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.335+0000 7f46b3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46bc0ac630 0x7f46bc15ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58248/0 (socket says 172.21.15.27:58248) 2024-01-15T11:33:24.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.335+0000 7f46b3fff640 1 -- 172.21.15.27:0/3128478268 learned_addr learned my addr 172.21.15.27:0/3128478268 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:24.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.335+0000 7f46baffd640 1 --2- 172.21.15.27:0/3128478268 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46bc070c20 0x7f46bc165c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:24.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.335+0000 7f46bb7fe640 1 --2- 172.21.15.27:0/3128478268 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f46bc144c80 0x7f46bc15ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:24.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.335+0000 7f46b3fff640 1 -- 172.21.15.27:0/3128478268 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f46bc144c80 msgr2=0x7f46bc15ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:24.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.335+0000 7f46b3fff640 1 --2- 172.21.15.27:0/3128478268 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f46bc144c80 0x7f46bc15ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:24.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.335+0000 7f46b3fff640 1 -- 172.21.15.27:0/3128478268 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46bc070c20 msgr2=0x7f46bc165c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:24.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.335+0000 7f46b3fff640 1 --2- 172.21.15.27:0/3128478268 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46bc070c20 0x7f46bc165c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:24.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.335+0000 7f46b3fff640 1 -- 172.21.15.27:0/3128478268 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a40094d0 con 0x7f46bc0ac630 2024-01-15T11:33:24.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.335+0000 7f46bb7fe640 1 --2- 172.21.15.27:0/3128478268 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f46bc144c80 0x7f46bc15ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:33:24.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.335+0000 7f46b3fff640 1 --2- 172.21.15.27:0/3128478268 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46bc0ac630 0x7f46bc15ee40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f46a401a140 tx=0x7f46a401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:24.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.335+0000 7f46b37fe640 1 -- 172.21.15.27:0/3128478268 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a40aa670 con 0x7f46bc0ac630 2024-01-15T11:33:24.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.335+0000 7f46b37fe640 1 -- 172.21.15.27:0/3128478268 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a40b3800 con 0x7f46bc0ac630 2024-01-15T11:33:24.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.335+0000 7f46b37fe640 1 -- 172.21.15.27:0/3128478268 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a40b3bb0 con 0x7f46bc0ac630 2024-01-15T11:33:24.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.335+0000 7f46c17f5640 1 -- 172.21.15.27:0/3128478268 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46bc15e080 con 0x7f46bc0ac630 2024-01-15T11:33:24.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.335+0000 7f46c17f5640 1 -- 172.21.15.27:0/3128478268 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46bc15e640 con 0x7f46bc0ac630 2024-01-15T11:33:24.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.335+0000 7f46c17f5640 1 -- 172.21.15.27:0/3128478268 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46bc0b1ba0 con 0x7f46bc0ac630 2024-01-15T11:33:24.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.339+0000 7f46b37fe640 1 -- 172.21.15.27:0/3128478268 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f46a40b3d10 con 0x7f46bc0ac630 2024-01-15T11:33:24.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.339+0000 7f46b37fe640 1 --2- 172.21.15.27:0/3128478268 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f469c0668f0 0x7f469c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:24.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.339+0000 7f46b37fe640 1 -- 172.21.15.27:0/3128478268 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46a411eb60 con 0x7f46bc0ac630 2024-01-15T11:33:24.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.339+0000 7f46baffd640 1 --2- 172.21.15.27:0/3128478268 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f469c0668f0 0x7f469c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:24.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.339+0000 7f46baffd640 1 --2- 172.21.15.27:0/3128478268 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f469c0668f0 0x7f469c068db0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f46ac000f70 tx=0x7f46ac007c90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:24.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.343+0000 7f46b37fe640 1 -- 172.21.15.27:0/3128478268 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f46a40ebe30 con 0x7f46bc0ac630 2024-01-15T11:33:24.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.499+0000 7f46c17f5640 1 -- 172.21.15.27:0/3128478268 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46bc04e850 con 0x7f46bc0ac630 2024-01-15T11:33:24.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.499+0000 7f46b37fe640 1 -- 172.21.15.27:0/3128478268 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16425 (secure 0 0 0) 0x7f46a40c3090 con 0x7f46bc0ac630 2024-01-15T11:33:24.504 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:24.504 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:33:21.682894+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T11:33:18.397200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T11:33:19.061383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:33:24.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.503+0000 7f46c17f5640 1 -- 172.21.15.27:0/3128478268 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f469c0668f0 msgr2=0x7f469c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:24.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.503+0000 7f46c17f5640 1 --2- 172.21.15.27:0/3128478268 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f469c0668f0 0x7f469c068db0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f46ac000f70 tx=0x7f46ac007c90 comp rx=0 tx=0).stop 2024-01-15T11:33:24.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.503+0000 7f46c17f5640 1 -- 172.21.15.27:0/3128478268 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46bc0ac630 msgr2=0x7f46bc15ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:24.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.503+0000 7f46c17f5640 1 --2- 172.21.15.27:0/3128478268 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46bc0ac630 0x7f46bc15ee40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f46a401a140 tx=0x7f46a401ad50 comp rx=0 tx=0).stop 2024-01-15T11:33:24.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.503+0000 7f46c17f5640 1 -- 172.21.15.27:0/3128478268 shutdown_connections 2024-01-15T11:33:24.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.503+0000 7f46c17f5640 1 --2- 172.21.15.27:0/3128478268 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f46bc144c80 0x7f46bc15ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:24.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.503+0000 7f46c17f5640 1 --2- 172.21.15.27:0/3128478268 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46bc0ac630 0x7f46bc15ee40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:24.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.503+0000 7f46c17f5640 1 --2- 172.21.15.27:0/3128478268 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f469c0668f0 0x7f469c068db0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:24.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.503+0000 7f46c17f5640 1 --2- 172.21.15.27:0/3128478268 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46bc070c20 0x7f46bc165c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:24.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.503+0000 7f46c17f5640 1 -- 172.21.15.27:0/3128478268 >> 172.21.15.27:0/3128478268 conn(0x7f46bc0b0c40 msgr2=0x7f46bc0abf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:24.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.503+0000 7f46c17f5640 1 -- 172.21.15.27:0/3128478268 shutdown_connections 2024-01-15T11:33:24.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.503+0000 7f46c17f5640 1 -- 172.21.15.27:0/3128478268 wait complete. 2024-01-15T11:33:24.525 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-15T11:33:24.525 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-15T11:33:24.655 INFO:tasks.ceph.mds.a.smithi027.stderr:2024-01-15T11:33:24.651+0000 7f1765809640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-15T11:33:24.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.663+0000 7fc0a2faa640 1 Processor -- start 2024-01-15T11:33:24.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.663+0000 7fc0a2faa640 1 -- start start 2024-01-15T11:33:24.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.667+0000 7fc0a2faa640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc09c0b39c0 0x7fc09c06c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:24.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.667+0000 7fc0a2faa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc09c06cb70 0x7fc09c070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:24.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.667+0000 7fc0a2faa640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09c06cfc0 con 0x7fc09c15f540 2024-01-15T11:33:24.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.667+0000 7fc0a2faa640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc09c0b2650 con 0x7fc09c06cb70 2024-01-15T11:33:24.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.667+0000 7fc0a2faa640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c0b2920 con 0x7fc09c0b39c0 2024-01-15T11:33:24.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.667+0000 7fc0a1547640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc09c06cb70 0x7fc09c070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:24.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.667+0000 7fc09bfff640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc09c0b39c0 0x7fc09c06c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:24.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.667+0000 7fc09bfff640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc09c0b39c0 0x7fc09c06c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:58482/0 (socket says 172.21.15.27:58482) 2024-01-15T11:33:24.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.667+0000 7fc0a1547640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc09c06cb70 0x7fc09c070880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:48488/0 (socket says 172.21.15.27:48488) 2024-01-15T11:33:24.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.667+0000 7fc09bfff640 1 -- 172.21.15.27:0/1911884185 learned_addr learned my addr 172.21.15.27:0/1911884185 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:24.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.667+0000 7fc09bfff640 1 -- 172.21.15.27:0/1911884185 >> v2:172.21.15.93:3300/0 conn(0x7fc09c06cb70 msgr2=0x7fc09c070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:24.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.667+0000 7fc09bfff640 1 --2- 172.21.15.27:0/1911884185 >> v2:172.21.15.93:3300/0 conn(0x7fc09c06cb70 0x7fc09c070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:24.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.667+0000 7fc09b7fe640 1 -- 172.21.15.27:0/1911884185 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 822454905 0 0) 0x7fc090001120 con 0x7fc09c15f540 2024-01-15T11:33:24.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.667+0000 7fc09bfff640 1 -- 172.21.15.27:0/1911884185 >> v1:172.21.15.93:6789/0 conn(0x7fc09c15f540 legacy=0x7fc09c0b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:24.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.667+0000 7fc09bfff640 1 -- 172.21.15.27:0/1911884185 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c0b2c00 con 0x7fc09c0b39c0 2024-01-15T11:33:24.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.667+0000 7fc0a1547640 1 --2- 172.21.15.27:0/1911884185 >> v2:172.21.15.93:3300/0 conn(0x7fc09c06cb70 0x7fc09c070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:24.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.671+0000 7fc09bfff640 1 --2- 172.21.15.27:0/1911884185 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc09c0b39c0 0x7fc09c06c630 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc088009870 tx=0x7fc08801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cdeecc48b9ab638 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:24.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.671+0000 7fc09b7fe640 1 -- 172.21.15.27:0/1911884185 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0880aa670 con 0x7fc09c0b39c0 2024-01-15T11:33:24.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.671+0000 7fc09b7fe640 1 -- 172.21.15.27:0/1911884185 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0880aa7d0 con 0x7fc09c0b39c0 2024-01-15T11:33:24.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.671+0000 7fc09b7fe640 1 -- 172.21.15.27:0/1911884185 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0880aab60 con 0x7fc09c0b39c0 2024-01-15T11:33:24.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.671+0000 7fc0a2faa640 1 -- 172.21.15.27:0/1911884185 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc09c0b39c0 msgr2=0x7fc09c06c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:24.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.671+0000 7fc0a2faa640 1 --2- 172.21.15.27:0/1911884185 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc09c0b39c0 0x7fc09c06c630 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc088009870 tx=0x7fc08801c510 comp rx=0 tx=0).stop 2024-01-15T11:33:24.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.671+0000 7fc0a2faa640 1 -- 172.21.15.27:0/1911884185 shutdown_connections 2024-01-15T11:33:24.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.671+0000 7fc0a2faa640 1 --2- 172.21.15.27:0/1911884185 >> v2:172.21.15.93:3300/0 conn(0x7fc09c06cb70 0x7fc09c070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:24.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.671+0000 7fc0a2faa640 1 --2- 172.21.15.27:0/1911884185 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc09c0b39c0 0x7fc09c06c630 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:24.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.671+0000 7fc0a2faa640 1 -- 172.21.15.27:0/1911884185 >> 172.21.15.27:0/1911884185 conn(0x7fc09c0b0c40 msgr2=0x7fc09c0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:24.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.671+0000 7fc0a2faa640 1 -- 172.21.15.27:0/1911884185 shutdown_connections 2024-01-15T11:33:24.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.671+0000 7fc0a2faa640 1 -- 172.21.15.27:0/1911884185 wait complete. 2024-01-15T11:33:24.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.671+0000 7fc0a2faa640 1 Processor -- start 2024-01-15T11:33:24.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.671+0000 7fc0a2faa640 1 -- start start 2024-01-15T11:33:24.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.675+0000 7fc0a2faa640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc09c06cb70 0x7fc09c1404e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:24.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.675+0000 7fc0a2faa640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc09c0b39c0 0x7fc09c15c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:24.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.675+0000 7fc0a2faa640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc09c15f540 0x7fc09c152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:24.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.675+0000 7fc0a2faa640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c15ac30 con 0x7fc09c0b39c0 2024-01-15T11:33:24.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.675+0000 7fc0a2faa640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c140a20 con 0x7fc09c15f540 2024-01-15T11:33:24.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.675+0000 7fc0a2faa640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c1522f0 con 0x7fc09c06cb70 2024-01-15T11:33:24.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.675+0000 7fc09bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc09c0b39c0 0x7fc09c15c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:24.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.675+0000 7fc09bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc09c0b39c0 0x7fc09c15c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58264/0 (socket says 172.21.15.27:58264) 2024-01-15T11:33:24.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.675+0000 7fc09bfff640 1 -- 172.21.15.27:0/108362651 learned_addr learned my addr 172.21.15.27:0/108362651 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:24.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.675+0000 7fc0a1547640 1 --2- 172.21.15.27:0/108362651 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc09c15f540 0x7fc09c152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:24.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.675+0000 7fc0a0d46640 1 --2- 172.21.15.27:0/108362651 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc09c06cb70 0x7fc09c1404e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:24.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.675+0000 7fc09bfff640 1 -- 172.21.15.27:0/108362651 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc09c06cb70 msgr2=0x7fc09c1404e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:24.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.675+0000 7fc09bfff640 1 --2- 172.21.15.27:0/108362651 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc09c06cb70 0x7fc09c1404e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:24.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.675+0000 7fc09bfff640 1 -- 172.21.15.27:0/108362651 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc09c15f540 msgr2=0x7fc09c152780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:24.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.675+0000 7fc09bfff640 1 --2- 172.21.15.27:0/108362651 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc09c15f540 0x7fc09c152780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:24.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.675+0000 7fc09bfff640 1 -- 172.21.15.27:0/108362651 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc094009a70 con 0x7fc09c0b39c0 2024-01-15T11:33:24.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.675+0000 7fc0a1547640 1 --2- 172.21.15.27:0/108362651 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc09c15f540 0x7fc09c152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:24.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.675+0000 7fc09bfff640 1 --2- 172.21.15.27:0/108362651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc09c0b39c0 0x7fc09c15c250 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc0880ac040 tx=0x7fc08801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:24.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.675+0000 7fc0997fa640 1 -- 172.21.15.27:0/108362651 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0880aad50 con 0x7fc09c0b39c0 2024-01-15T11:33:24.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.675+0000 7fc0997fa640 1 -- 172.21.15.27:0/108362651 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0880b7070 con 0x7fc09c0b39c0 2024-01-15T11:33:24.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.675+0000 7fc0997fa640 1 -- 172.21.15.27:0/108362651 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc088004220 con 0x7fc09c0b39c0 2024-01-15T11:33:24.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.675+0000 7fc0a2faa640 1 -- 172.21.15.27:0/108362651 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0880094d0 con 0x7fc09c0b39c0 2024-01-15T11:33:24.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.675+0000 7fc0a2faa640 1 -- 172.21.15.27:0/108362651 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09c151ca0 con 0x7fc09c0b39c0 2024-01-15T11:33:24.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.675+0000 7fc0a2faa640 1 -- 172.21.15.27:0/108362651 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc09c151b00 con 0x7fc09c0b39c0 2024-01-15T11:33:24.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.675+0000 7fc0997fa640 1 -- 172.21.15.27:0/108362651 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fc088004380 con 0x7fc09c0b39c0 2024-01-15T11:33:24.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.679+0000 7fc0997fa640 1 --2- 172.21.15.27:0/108362651 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc0800668f0 0x7fc080068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:24.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.679+0000 7fc0997fa640 1 -- 172.21.15.27:0/108362651 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc08811e650 con 0x7fc09c0b39c0 2024-01-15T11:33:24.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.679+0000 7fc0a0d46640 1 --2- 172.21.15.27:0/108362651 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc0800668f0 0x7fc080068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:24.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.679+0000 7fc0a0d46640 1 --2- 172.21.15.27:0/108362651 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc0800668f0 0x7fc080068db0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc090000f70 tx=0x7fc090009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:24.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.683+0000 7fc0997fa640 1 -- 172.21.15.27:0/108362651 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc09c151b00 con 0x7fc09c0b39c0 2024-01-15T11:33:24.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.839+0000 7fc0a2faa640 1 -- 172.21.15.27:0/108362651 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc09c16e420 con 0x7fc0800668f0 2024-01-15T11:33:24.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.851+0000 7fc0997fa640 1 -- 172.21.15.27:0/108362651 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264616 (secure 0 0 0) 0x7fc090001c50 con 0x7fc0800668f0 2024-01-15T11:33:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:24.858 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-01-15T11:33:24.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.851+0000 7fc0a2faa640 1 -- 172.21.15.27:0/108362651 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc0800668f0 msgr2=0x7fc080068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:24.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.851+0000 7fc0a2faa640 1 --2- 172.21.15.27:0/108362651 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc0800668f0 0x7fc080068db0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc090000f70 tx=0x7fc090009040 comp rx=0 tx=0).stop 2024-01-15T11:33:24.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.851+0000 7fc0a2faa640 1 -- 172.21.15.27:0/108362651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc09c0b39c0 msgr2=0x7fc09c15c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:24.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.851+0000 7fc0a2faa640 1 --2- 172.21.15.27:0/108362651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc09c0b39c0 0x7fc09c15c250 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc0880ac040 tx=0x7fc08801ad50 comp rx=0 tx=0).stop 2024-01-15T11:33:24.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.855+0000 7fc0a2faa640 1 -- 172.21.15.27:0/108362651 shutdown_connections 2024-01-15T11:33:24.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.855+0000 7fc0a2faa640 1 --2- 172.21.15.27:0/108362651 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc0800668f0 0x7fc080068db0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:24.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.855+0000 7fc0a2faa640 1 --2- 172.21.15.27:0/108362651 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc09c15f540 0x7fc09c152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:24.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.855+0000 7fc0a2faa640 1 --2- 172.21.15.27:0/108362651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc09c0b39c0 0x7fc09c15c250 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:24.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.855+0000 7fc0a2faa640 1 --2- 172.21.15.27:0/108362651 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc09c06cb70 0x7fc09c1404e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:24.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.855+0000 7fc0a2faa640 1 -- 172.21.15.27:0/108362651 >> 172.21.15.27:0/108362651 conn(0x7fc09c0b0c40 msgr2=0x7fc09c159bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:24.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.855+0000 7fc0a2faa640 1 -- 172.21.15.27:0/108362651 shutdown_connections 2024-01-15T11:33:24.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:24.855+0000 7fc0a2faa640 1 -- 172.21.15.27:0/108362651 wait complete. 2024-01-15T11:33:24.876 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-01-15T11:33:24.065695+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":105,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219016,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755704,"statfs":{"total":773094113280,"available":772869840896,"internally_reserved":0,"allocated":2924544,"data_stored":1745172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.403845"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049923+0000","last_change":"2024-01-15T11:33:20.716411+0000","last_active":"2024-01-15T11:33:22.049923+0000","last_peered":"2024-01-15T11:33:22.049923+0000","last_clean":"2024-01-15T11:33:22.049923+0000","last_became_active":"2024-01-15T11:33:20.716169+0000","last_became_peered":"2024-01-15T11:33:20.716169+0000","last_unstale":"2024-01-15T11:33:22.049923+0000","last_undegraded":"2024-01-15T11:33:22.049923+0000","last_fullsized":"2024-01-15T11:33:22.049923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:43:30.219449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.718688+0000","last_change":"2024-01-15T11:33:20.713459+0000","last_active":"2024-01-15T11:33:20.718688+0000","last_peered":"2024-01-15T11:33:20.718688+0000","last_clean":"2024-01-15T11:33:20.718688+0000","last_became_active":"2024-01-15T11:33:20.713141+0000","last_became_peered":"2024-01-15T11:33:20.713141+0000","last_unstale":"2024-01-15T11:33:20.718688+0000","last_undegraded":"2024-01-15T11:33:20.718688+0000","last_fullsized":"2024-01-15T11:33:20.718688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:25:27.920141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.719755+0000","last_change":"2024-01-15T11:33:20.715526+0000","last_active":"2024-01-15T11:33:20.719755+0000","last_peered":"2024-01-15T11:33:20.719755+0000","last_clean":"2024-01-15T11:33:20.719755+0000","last_became_active":"2024-01-15T11:33:20.715226+0000","last_became_peered":"2024-01-15T11:33:20.715226+0000","last_unstale":"2024-01-15T11:33:20.719755+0000","last_undegraded":"2024-01-15T11:33:20.719755+0000","last_fullsized":"2024-01-15T11:33:20.719755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:22:29.656689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.703187+0000","last_change":"2024-01-15T11:33:20.699790+0000","last_active":"2024-01-15T11:33:20.703187+0000","last_peered":"2024-01-15T11:33:20.703187+0000","last_clean":"2024-01-15T11:33:20.703187+0000","last_became_active":"2024-01-15T11:33:20.699497+0000","last_became_peered":"2024-01-15T11:33:20.699497+0000","last_unstale":"2024-01-15T11:33:20.703187+0000","last_undegraded":"2024-01-15T11:33:20.703187+0000","last_fullsized":"2024-01-15T11:33:20.703187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:23:47.978250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049813+0000","last_change":"2024-01-15T11:33:20.714669+0000","last_active":"2024-01-15T11:33:22.049813+0000","last_peered":"2024-01-15T11:33:22.049813+0000","last_clean":"2024-01-15T11:33:22.049813+0000","last_became_active":"2024-01-15T11:33:20.714267+0000","last_became_peered":"2024-01-15T11:33:20.714267+0000","last_unstale":"2024-01-15T11:33:22.049813+0000","last_undegraded":"2024-01-15T11:33:22.049813+0000","last_fullsized":"2024-01-15T11:33:22.049813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T11:40:03.906758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.703172+0000","last_change":"2024-01-15T11:33:20.700208+0000","last_active":"2024-01-15T11:33:20.703172+0000","last_peered":"2024-01-15T11:33:20.703172+0000","last_clean":"2024-01-15T11:33:20.703172+0000","last_became_active":"2024-01-15T11:33:20.698271+0000","last_became_peered":"2024-01-15T11:33:20.698271+0000","last_unstale":"2024-01-15T11:33:20.703172+0000","last_undegraded":"2024-01-15T11:33:20.703172+0000","last_fullsized":"2024-01-15T11:33:20.703172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:56:28.155106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049558+0000","last_change":"2024-01-15T11:33:20.709080+0000","last_active":"2024-01-15T11:33:22.049558+0000","last_peered":"2024-01-15T11:33:22.049558+0000","last_clean":"2024-01-15T11:33:22.049558+0000","last_became_active":"2024-01-15T11:33:20.707734+0000","last_became_peered":"2024-01-15T11:33:20.707734+0000","last_unstale":"2024-01-15T11:33:22.049558+0000","last_undegraded":"2024-01-15T11:33:22.049558+0000","last_fullsized":"2024-01-15T11:33:22.049558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:30:57.472645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.724152+0000","last_change":"2024-01-15T11:33:20.721012+0000","last_active":"2024-01-15T11:33:20.724152+0000","last_peered":"2024-01-15T11:33:20.724152+0000","last_clean":"2024-01-15T11:33:20.724152+0000","last_became_active":"2024-01-15T11:33:20.720749+0000","last_became_peered":"2024-01-15T11:33:20.720749+0000","last_unstale":"2024-01-15T11:33:20.724152+0000","last_undegraded":"2024-01-15T11:33:20.724152+0000","last_fullsized":"2024-01-15T11:33:20.724152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:55:28.642409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.718281+0000","last_change":"2024-01-15T11:33:20.712100+0000","last_active":"2024-01-15T11:33:20.718281+0000","last_peered":"2024-01-15T11:33:20.718281+0000","last_clean":"2024-01-15T11:33:20.718281+0000","last_became_active":"2024-01-15T11:33:20.711811+0000","last_became_peered":"2024-01-15T11:33:20.711811+0000","last_unstale":"2024-01-15T11:33:20.718281+0000","last_undegraded":"2024-01-15T11:33:20.718281+0000","last_fullsized":"2024-01-15T11:33:20.718281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:43:20.038655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049776+0000","last_change":"2024-01-15T11:33:20.707038+0000","last_active":"2024-01-15T11:33:22.049776+0000","last_peered":"2024-01-15T11:33:22.049776+0000","last_clean":"2024-01-15T11:33:22.049776+0000","last_became_active":"2024-01-15T11:33:20.706364+0000","last_became_peered":"2024-01-15T11:33:20.706364+0000","last_unstale":"2024-01-15T11:33:22.049776+0000","last_undegraded":"2024-01-15T11:33:22.049776+0000","last_fullsized":"2024-01-15T11:33:22.049776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:06:51.078552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049883+0000","last_change":"2024-01-15T11:33:20.716954+0000","last_active":"2024-01-15T11:33:22.049883+0000","last_peered":"2024-01-15T11:33:22.049883+0000","last_clean":"2024-01-15T11:33:22.049883+0000","last_became_active":"2024-01-15T11:33:20.716582+0000","last_became_peered":"2024-01-15T11:33:20.716582+0000","last_unstale":"2024-01-15T11:33:22.049883+0000","last_undegraded":"2024-01-15T11:33:22.049883+0000","last_fullsized":"2024-01-15T11:33:22.049883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:37:58.693069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049767+0000","last_change":"2024-01-15T11:33:20.717724+0000","last_active":"2024-01-15T11:33:22.049767+0000","last_peered":"2024-01-15T11:33:22.049767+0000","last_clean":"2024-01-15T11:33:22.049767+0000","last_became_active":"2024-01-15T11:33:20.717228+0000","last_became_peered":"2024-01-15T11:33:20.717228+0000","last_unstale":"2024-01-15T11:33:22.049767+0000","last_undegraded":"2024-01-15T11:33:22.049767+0000","last_fullsized":"2024-01-15T11:33:22.049767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:25:16.576586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.719082+0000","last_change":"2024-01-15T11:33:20.715589+0000","last_active":"2024-01-15T11:33:20.719082+0000","last_peered":"2024-01-15T11:33:20.719082+0000","last_clean":"2024-01-15T11:33:20.719082+0000","last_became_active":"2024-01-15T11:33:20.714841+0000","last_became_peered":"2024-01-15T11:33:20.714841+0000","last_unstale":"2024-01-15T11:33:20.719082+0000","last_undegraded":"2024-01-15T11:33:20.719082+0000","last_fullsized":"2024-01-15T11:33:20.719082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:10:17.455765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.709859+0000","last_change":"2024-01-15T11:33:20.703953+0000","last_active":"2024-01-15T11:33:20.709859+0000","last_peered":"2024-01-15T11:33:20.709859+0000","last_clean":"2024-01-15T11:33:20.709859+0000","last_became_active":"2024-01-15T11:33:20.703653+0000","last_became_peered":"2024-01-15T11:33:20.703653+0000","last_unstale":"2024-01-15T11:33:20.709859+0000","last_undegraded":"2024-01-15T11:33:20.709859+0000","last_fullsized":"2024-01-15T11:33:20.709859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:23:47.978250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.721727+0000","last_change":"2024-01-15T11:33:20.719103+0000","last_active":"2024-01-15T11:33:20.721727+0000","last_peered":"2024-01-15T11:33:20.721727+0000","last_clean":"2024-01-15T11:33:20.721727+0000","last_became_active":"2024-01-15T11:33:20.718591+0000","last_became_peered":"2024-01-15T11:33:20.718591+0000","last_unstale":"2024-01-15T11:33:20.721727+0000","last_undegraded":"2024-01-15T11:33:20.721727+0000","last_fullsized":"2024-01-15T11:33:20.721727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:17:33.638563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694295+0000","last_change":"2024-01-15T11:33:20.701415+0000","last_active":"2024-01-15T11:33:21.694295+0000","last_peered":"2024-01-15T11:33:21.694295+0000","last_clean":"2024-01-15T11:33:21.694295+0000","last_became_active":"2024-01-15T11:33:20.701093+0000","last_became_peered":"2024-01-15T11:33:20.701093+0000","last_unstale":"2024-01-15T11:33:21.694295+0000","last_undegraded":"2024-01-15T11:33:21.694295+0000","last_fullsized":"2024-01-15T11:33:21.694295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:43:30.219449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694973+0000","last_change":"2024-01-15T11:33:20.718200+0000","last_active":"2024-01-15T11:33:21.694973+0000","last_peered":"2024-01-15T11:33:21.694973+0000","last_clean":"2024-01-15T11:33:21.694973+0000","last_became_active":"2024-01-15T11:33:20.717333+0000","last_became_peered":"2024-01-15T11:33:20.717333+0000","last_unstale":"2024-01-15T11:33:21.694973+0000","last_undegraded":"2024-01-15T11:33:21.694973+0000","last_fullsized":"2024-01-15T11:33:21.694973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:01:50.198012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.693034+0000","last_change":"2024-01-15T11:33:20.701000+0000","last_active":"2024-01-15T11:33:21.693034+0000","last_peered":"2024-01-15T11:33:21.693034+0000","last_clean":"2024-01-15T11:33:21.693034+0000","last_became_active":"2024-01-15T11:33:20.700312+0000","last_became_peered":"2024-01-15T11:33:20.700312+0000","last_unstale":"2024-01-15T11:33:21.693034+0000","last_undegraded":"2024-01-15T11:33:21.693034+0000","last_fullsized":"2024-01-15T11:33:21.693034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:30:25.661172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694717+0000","last_change":"2024-01-15T11:33:20.703054+0000","last_active":"2024-01-15T11:33:21.694717+0000","last_peered":"2024-01-15T11:33:21.694717+0000","last_clean":"2024-01-15T11:33:21.694717+0000","last_became_active":"2024-01-15T11:33:20.702256+0000","last_became_peered":"2024-01-15T11:33:20.702256+0000","last_unstale":"2024-01-15T11:33:21.694717+0000","last_undegraded":"2024-01-15T11:33:21.694717+0000","last_fullsized":"2024-01-15T11:33:21.694717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:27:46.642600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049810+0000","last_change":"2024-01-15T11:33:20.717634+0000","last_active":"2024-01-15T11:33:22.049810+0000","last_peered":"2024-01-15T11:33:22.049810+0000","last_clean":"2024-01-15T11:33:22.049810+0000","last_became_active":"2024-01-15T11:33:20.716991+0000","last_became_peered":"2024-01-15T11:33:20.716991+0000","last_unstale":"2024-01-15T11:33:22.049810+0000","last_undegraded":"2024-01-15T11:33:22.049810+0000","last_fullsized":"2024-01-15T11:33:22.049810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:29:53.572044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692042+0000","last_change":"2024-01-15T11:33:20.706694+0000","last_active":"2024-01-15T11:33:21.692042+0000","last_peered":"2024-01-15T11:33:21.692042+0000","last_clean":"2024-01-15T11:33:21.692042+0000","last_became_active":"2024-01-15T11:33:20.706408+0000","last_became_peered":"2024-01-15T11:33:20.706408+0000","last_unstale":"2024-01-15T11:33:21.692042+0000","last_undegraded":"2024-01-15T11:33:21.692042+0000","last_fullsized":"2024-01-15T11:33:21.692042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:38:46.122065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.723132+0000","last_change":"2024-01-15T11:33:20.720066+0000","last_active":"2024-01-15T11:33:20.723132+0000","last_peered":"2024-01-15T11:33:20.723132+0000","last_clean":"2024-01-15T11:33:20.723132+0000","last_became_active":"2024-01-15T11:33:20.719629+0000","last_became_peered":"2024-01-15T11:33:20.719629+0000","last_unstale":"2024-01-15T11:33:20.723132+0000","last_undegraded":"2024-01-15T11:33:20.723132+0000","last_fullsized":"2024-01-15T11:33:20.723132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:20:20.127357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.719238+0000","last_change":"2024-01-15T11:33:20.713988+0000","last_active":"2024-01-15T11:33:20.719238+0000","last_peered":"2024-01-15T11:33:20.719238+0000","last_clean":"2024-01-15T11:33:20.719238+0000","last_became_active":"2024-01-15T11:33:20.713701+0000","last_became_peered":"2024-01-15T11:33:20.713701+0000","last_unstale":"2024-01-15T11:33:20.719238+0000","last_undegraded":"2024-01-15T11:33:20.719238+0000","last_fullsized":"2024-01-15T11:33:20.719238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:34:15.750417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694293+0000","last_change":"2024-01-15T11:33:20.716478+0000","last_active":"2024-01-15T11:33:21.694293+0000","last_peered":"2024-01-15T11:33:21.694293+0000","last_clean":"2024-01-15T11:33:21.694293+0000","last_became_active":"2024-01-15T11:33:20.716205+0000","last_became_peered":"2024-01-15T11:33:20.716205+0000","last_unstale":"2024-01-15T11:33:21.694293+0000","last_undegraded":"2024-01-15T11:33:21.694293+0000","last_fullsized":"2024-01-15T11:33:21.694293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:37:58.693069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.719827+0000","last_change":"2024-01-15T11:33:20.716995+0000","last_active":"2024-01-15T11:33:20.719827+0000","last_peered":"2024-01-15T11:33:20.719827+0000","last_clean":"2024-01-15T11:33:20.719827+0000","last_became_active":"2024-01-15T11:33:20.716752+0000","last_became_peered":"2024-01-15T11:33:20.716752+0000","last_unstale":"2024-01-15T11:33:20.719827+0000","last_undegraded":"2024-01-15T11:33:20.719827+0000","last_fullsized":"2024-01-15T11:33:20.719827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:59:25.779673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.707007+0000","last_change":"2024-01-15T11:33:20.701779+0000","last_active":"2024-01-15T11:33:20.707007+0000","last_peered":"2024-01-15T11:33:20.707007+0000","last_clean":"2024-01-15T11:33:20.707007+0000","last_became_active":"2024-01-15T11:33:20.701423+0000","last_became_peered":"2024-01-15T11:33:20.701423+0000","last_unstale":"2024-01-15T11:33:20.707007+0000","last_undegraded":"2024-01-15T11:33:20.707007+0000","last_fullsized":"2024-01-15T11:33:20.707007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:20:20.127357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.709938+0000","last_change":"2024-01-15T11:33:20.703490+0000","last_active":"2024-01-15T11:33:20.709938+0000","last_peered":"2024-01-15T11:33:20.709938+0000","last_clean":"2024-01-15T11:33:20.709938+0000","last_became_active":"2024-01-15T11:33:20.703217+0000","last_became_peered":"2024-01-15T11:33:20.703217+0000","last_unstale":"2024-01-15T11:33:20.709938+0000","last_undegraded":"2024-01-15T11:33:20.709938+0000","last_fullsized":"2024-01-15T11:33:20.709938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:21:39.120264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.724107+0000","last_change":"2024-01-15T11:33:20.721606+0000","last_active":"2024-01-15T11:33:20.724107+0000","last_peered":"2024-01-15T11:33:20.724107+0000","last_clean":"2024-01-15T11:33:20.724107+0000","last_became_active":"2024-01-15T11:33:20.721213+0000","last_became_peered":"2024-01-15T11:33:20.721213+0000","last_unstale":"2024-01-15T11:33:20.724107+0000","last_undegraded":"2024-01-15T11:33:20.724107+0000","last_fullsized":"2024-01-15T11:33:20.724107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:43:20.038655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.713146+0000","last_change":"2024-01-15T11:33:20.709187+0000","last_active":"2024-01-15T11:33:20.713146+0000","last_peered":"2024-01-15T11:33:20.713146+0000","last_clean":"2024-01-15T11:33:20.713146+0000","last_became_active":"2024-01-15T11:33:20.708936+0000","last_became_peered":"2024-01-15T11:33:20.708936+0000","last_unstale":"2024-01-15T11:33:20.713146+0000","last_undegraded":"2024-01-15T11:33:20.713146+0000","last_fullsized":"2024-01-15T11:33:20.713146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:10:59.020362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694339+0000","last_change":"2024-01-15T11:33:20.713513+0000","last_active":"2024-01-15T11:33:21.694339+0000","last_peered":"2024-01-15T11:33:21.694339+0000","last_clean":"2024-01-15T11:33:21.694339+0000","last_became_active":"2024-01-15T11:33:20.713242+0000","last_became_peered":"2024-01-15T11:33:20.713242+0000","last_unstale":"2024-01-15T11:33:21.694339+0000","last_undegraded":"2024-01-15T11:33:21.694339+0000","last_fullsized":"2024-01-15T11:33:21.694339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:16:29.898998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692439+0000","last_change":"2024-01-15T11:33:20.708040+0000","last_active":"2024-01-15T11:33:21.692439+0000","last_peered":"2024-01-15T11:33:21.692439+0000","last_clean":"2024-01-15T11:33:21.692439+0000","last_became_active":"2024-01-15T11:33:20.707700+0000","last_became_peered":"2024-01-15T11:33:20.707700+0000","last_unstale":"2024-01-15T11:33:21.692439+0000","last_undegraded":"2024-01-15T11:33:21.692439+0000","last_fullsized":"2024-01-15T11:33:21.692439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:21:39.120264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.711513+0000","last_change":"2024-01-15T11:33:20.708725+0000","last_active":"2024-01-15T11:33:20.711513+0000","last_peered":"2024-01-15T11:33:20.711513+0000","last_clean":"2024-01-15T11:33:20.711513+0000","last_became_active":"2024-01-15T11:33:20.707260+0000","last_became_peered":"2024-01-15T11:33:20.707260+0000","last_unstale":"2024-01-15T11:33:20.711513+0000","last_undegraded":"2024-01-15T11:33:20.711513+0000","last_fullsized":"2024-01-15T11:33:20.711513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:30:00.041187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.723046+0000","last_change":"2024-01-15T11:33:20.719952+0000","last_active":"2024-01-15T11:33:20.723046+0000","last_peered":"2024-01-15T11:33:20.723046+0000","last_clean":"2024-01-15T11:33:20.723046+0000","last_became_active":"2024-01-15T11:33:20.719219+0000","last_became_peered":"2024-01-15T11:33:20.719219+0000","last_unstale":"2024-01-15T11:33:20.723046+0000","last_undegraded":"2024-01-15T11:33:20.723046+0000","last_fullsized":"2024-01-15T11:33:20.723046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:56:28.155106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.777115+0000","last_change":"2024-01-15T11:33:19.694356+0000","last_active":"2024-01-15T11:33:20.777115+0000","last_peered":"2024-01-15T11:33:20.777115+0000","last_clean":"2024-01-15T11:33:20.777115+0000","last_became_active":"2024-01-15T11:33:19.693392+0000","last_became_peered":"2024-01-15T11:33:19.693392+0000","last_unstale":"2024-01-15T11:33:20.777115+0000","last_undegraded":"2024-01-15T11:33:20.777115+0000","last_fullsized":"2024-01-15T11:33:20.777115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:00:25.349679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692151+0000","last_change":"2024-01-15T11:33:20.715147+0000","last_active":"2024-01-15T11:33:21.692151+0000","last_peered":"2024-01-15T11:33:21.692151+0000","last_clean":"2024-01-15T11:33:21.692151+0000","last_became_active":"2024-01-15T11:33:20.714851+0000","last_became_peered":"2024-01-15T11:33:20.714851+0000","last_unstale":"2024-01-15T11:33:21.692151+0000","last_undegraded":"2024-01-15T11:33:21.692151+0000","last_fullsized":"2024-01-15T11:33:21.692151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:19:46.455034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694644+0000","last_change":"2024-01-15T11:33:19.695468+0000","last_active":"2024-01-15T11:33:21.694644+0000","last_peered":"2024-01-15T11:33:21.694644+0000","last_clean":"2024-01-15T11:33:21.694644+0000","last_became_active":"2024-01-15T11:33:19.694811+0000","last_became_peered":"2024-01-15T11:33:19.694811+0000","last_unstale":"2024-01-15T11:33:21.694644+0000","last_undegraded":"2024-01-15T11:33:21.694644+0000","last_fullsized":"2024-01-15T11:33:21.694644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:59:05.422692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.695882+0000","last_change":"2024-01-15T11:33:19.703161+0000","last_active":"2024-01-15T11:33:20.695882+0000","last_peered":"2024-01-15T11:33:20.695882+0000","last_clean":"2024-01-15T11:33:20.695882+0000","last_became_active":"2024-01-15T11:33:19.702777+0000","last_became_peered":"2024-01-15T11:33:19.702777+0000","last_unstale":"2024-01-15T11:33:20.695882+0000","last_undegraded":"2024-01-15T11:33:20.695882+0000","last_fullsized":"2024-01-15T11:33:20.695882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:55:14.164103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.718560+0000","last_change":"2024-01-15T11:33:20.713246+0000","last_active":"2024-01-15T11:33:20.718560+0000","last_peered":"2024-01-15T11:33:20.718560+0000","last_clean":"2024-01-15T11:33:20.718560+0000","last_became_active":"2024-01-15T11:33:20.712606+0000","last_became_peered":"2024-01-15T11:33:20.712606+0000","last_unstale":"2024-01-15T11:33:20.718560+0000","last_undegraded":"2024-01-15T11:33:20.718560+0000","last_fullsized":"2024-01-15T11:33:20.718560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:26:56.290650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694396+0000","last_change":"2024-01-15T11:33:19.688561+0000","last_active":"2024-01-15T11:33:21.694396+0000","last_peered":"2024-01-15T11:33:21.694396+0000","last_clean":"2024-01-15T11:33:21.694396+0000","last_became_active":"2024-01-15T11:33:19.688262+0000","last_became_peered":"2024-01-15T11:33:19.688262+0000","last_unstale":"2024-01-15T11:33:21.694396+0000","last_undegraded":"2024-01-15T11:33:21.694396+0000","last_fullsized":"2024-01-15T11:33:21.694396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:10:11.542737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692151+0000","last_change":"2024-01-15T11:33:20.707012+0000","last_active":"2024-01-15T11:33:21.692151+0000","last_peered":"2024-01-15T11:33:21.692151+0000","last_clean":"2024-01-15T11:33:21.692151+0000","last_became_active":"2024-01-15T11:33:20.706739+0000","last_became_peered":"2024-01-15T11:33:20.706739+0000","last_unstale":"2024-01-15T11:33:21.692151+0000","last_undegraded":"2024-01-15T11:33:21.692151+0000","last_fullsized":"2024-01-15T11:33:21.692151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:56:03.543465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.706928+0000","last_change":"2024-01-15T11:33:19.681692+0000","last_active":"2024-01-15T11:33:20.706928+0000","last_peered":"2024-01-15T11:33:20.706928+0000","last_clean":"2024-01-15T11:33:20.706928+0000","last_became_active":"2024-01-15T11:33:19.681438+0000","last_became_peered":"2024-01-15T11:33:19.681438+0000","last_unstale":"2024-01-15T11:33:20.706928+0000","last_undegraded":"2024-01-15T11:33:20.706928+0000","last_fullsized":"2024-01-15T11:33:20.706928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:29:59.035408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.707028+0000","last_change":"2024-01-15T11:33:20.703299+0000","last_active":"2024-01-15T11:33:20.707028+0000","last_peered":"2024-01-15T11:33:20.707028+0000","last_clean":"2024-01-15T11:33:20.707028+0000","last_became_active":"2024-01-15T11:33:20.702790+0000","last_became_peered":"2024-01-15T11:33:20.702790+0000","last_unstale":"2024-01-15T11:33:20.707028+0000","last_undegraded":"2024-01-15T11:33:20.707028+0000","last_fullsized":"2024-01-15T11:33:20.707028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:10:17.455765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049957+0000","last_change":"2024-01-15T11:33:19.705105+0000","last_active":"2024-01-15T11:33:22.049957+0000","last_peered":"2024-01-15T11:33:22.049957+0000","last_clean":"2024-01-15T11:33:22.049957+0000","last_became_active":"2024-01-15T11:33:19.704838+0000","last_became_peered":"2024-01-15T11:33:19.704838+0000","last_unstale":"2024-01-15T11:33:22.049957+0000","last_undegraded":"2024-01-15T11:33:22.049957+0000","last_fullsized":"2024-01-15T11:33:22.049957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:10:11.542737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.718859+0000","last_change":"2024-01-15T11:33:20.714206+0000","last_active":"2024-01-15T11:33:20.718859+0000","last_peered":"2024-01-15T11:33:20.718859+0000","last_clean":"2024-01-15T11:33:20.718859+0000","last_became_active":"2024-01-15T11:33:20.713849+0000","last_became_peered":"2024-01-15T11:33:20.713849+0000","last_unstale":"2024-01-15T11:33:20.718859+0000","last_undegraded":"2024-01-15T11:33:20.718859+0000","last_fullsized":"2024-01-15T11:33:20.718859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:31:22.460007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692762+0000","last_change":"2024-01-15T11:33:19.693447+0000","last_active":"2024-01-15T11:33:21.692762+0000","last_peered":"2024-01-15T11:33:21.692762+0000","last_clean":"2024-01-15T11:33:21.692762+0000","last_became_active":"2024-01-15T11:33:19.692828+0000","last_became_peered":"2024-01-15T11:33:19.692828+0000","last_unstale":"2024-01-15T11:33:21.692762+0000","last_undegraded":"2024-01-15T11:33:21.692762+0000","last_fullsized":"2024-01-15T11:33:21.692762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:43:19.032876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694795+0000","last_change":"2024-01-15T11:33:20.708034+0000","last_active":"2024-01-15T11:33:21.694795+0000","last_peered":"2024-01-15T11:33:21.694795+0000","last_clean":"2024-01-15T11:33:21.694795+0000","last_became_active":"2024-01-15T11:33:20.707770+0000","last_became_peered":"2024-01-15T11:33:20.707770+0000","last_unstale":"2024-01-15T11:33:21.694795+0000","last_undegraded":"2024-01-15T11:33:21.694795+0000","last_fullsized":"2024-01-15T11:33:21.694795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:05:32.012901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.783701+0000","last_change":"2024-01-15T11:33:19.689357+0000","last_active":"2024-01-15T11:33:20.783701+0000","last_peered":"2024-01-15T11:33:20.783701+0000","last_clean":"2024-01-15T11:33:20.783701+0000","last_became_active":"2024-01-15T11:33:19.685961+0000","last_became_peered":"2024-01-15T11:33:19.685961+0000","last_unstale":"2024-01-15T11:33:20.783701+0000","last_undegraded":"2024-01-15T11:33:20.783701+0000","last_fullsized":"2024-01-15T11:33:20.783701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:10:41.101806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.050023+0000","last_change":"2024-01-15T11:33:20.717161+0000","last_active":"2024-01-15T11:33:22.050023+0000","last_peered":"2024-01-15T11:33:22.050023+0000","last_clean":"2024-01-15T11:33:22.050023+0000","last_became_active":"2024-01-15T11:33:20.716866+0000","last_became_peered":"2024-01-15T11:33:20.716866+0000","last_unstale":"2024-01-15T11:33:22.050023+0000","last_undegraded":"2024-01-15T11:33:22.050023+0000","last_fullsized":"2024-01-15T11:33:22.050023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:40:37.948024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.693226+0000","last_change":"2024-01-15T11:33:19.698607+0000","last_active":"2024-01-15T11:33:21.693226+0000","last_peered":"2024-01-15T11:33:21.693226+0000","last_clean":"2024-01-15T11:33:21.693226+0000","last_became_active":"2024-01-15T11:33:19.698300+0000","last_became_peered":"2024-01-15T11:33:19.698300+0000","last_unstale":"2024-01-15T11:33:21.693226+0000","last_undegraded":"2024-01-15T11:33:21.693226+0000","last_fullsized":"2024-01-15T11:33:21.693226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:10:16.449986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.709880+0000","last_change":"2024-01-15T11:33:20.704242+0000","last_active":"2024-01-15T11:33:20.709880+0000","last_peered":"2024-01-15T11:33:20.709880+0000","last_clean":"2024-01-15T11:33:20.709880+0000","last_became_active":"2024-01-15T11:33:20.703938+0000","last_became_peered":"2024-01-15T11:33:20.703938+0000","last_unstale":"2024-01-15T11:33:20.709880+0000","last_undegraded":"2024-01-15T11:33:20.709880+0000","last_fullsized":"2024-01-15T11:33:20.709880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:56:28.155106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694704+0000","last_change":"2024-01-15T11:33:19.695692+0000","last_active":"2024-01-15T11:33:21.694704+0000","last_peered":"2024-01-15T11:33:21.694704+0000","last_clean":"2024-01-15T11:33:21.694704+0000","last_became_active":"2024-01-15T11:33:19.695189+0000","last_became_peered":"2024-01-15T11:33:19.695189+0000","last_unstale":"2024-01-15T11:33:21.694704+0000","last_undegraded":"2024-01-15T11:33:21.694704+0000","last_fullsized":"2024-01-15T11:33:21.694704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:30:56.466865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694542+0000","last_change":"2024-01-15T11:33:20.718461+0000","last_active":"2024-01-15T11:33:21.694542+0000","last_peered":"2024-01-15T11:33:21.694542+0000","last_clean":"2024-01-15T11:33:21.694542+0000","last_became_active":"2024-01-15T11:33:20.718129+0000","last_became_peered":"2024-01-15T11:33:20.718129+0000","last_unstale":"2024-01-15T11:33:21.694542+0000","last_undegraded":"2024-01-15T11:33:21.694542+0000","last_fullsized":"2024-01-15T11:33:21.694542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:31:06.263833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049542+0000","last_change":"2024-01-15T11:33:19.704099+0000","last_active":"2024-01-15T11:33:22.049542+0000","last_peered":"2024-01-15T11:33:22.049542+0000","last_clean":"2024-01-15T11:33:22.049542+0000","last_became_active":"2024-01-15T11:33:19.699225+0000","last_became_peered":"2024-01-15T11:33:19.699225+0000","last_unstale":"2024-01-15T11:33:22.049542+0000","last_undegraded":"2024-01-15T11:33:22.049542+0000","last_fullsized":"2024-01-15T11:33:22.049542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:38:45.116285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.723081+0000","last_change":"2024-01-15T11:33:20.719867+0000","last_active":"2024-01-15T11:33:20.723081+0000","last_peered":"2024-01-15T11:33:20.723081+0000","last_clean":"2024-01-15T11:33:20.723081+0000","last_became_active":"2024-01-15T11:33:20.719528+0000","last_became_peered":"2024-01-15T11:33:20.719528+0000","last_unstale":"2024-01-15T11:33:20.723081+0000","last_undegraded":"2024-01-15T11:33:20.723081+0000","last_fullsized":"2024-01-15T11:33:20.723081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:23:47.978250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692059+0000","last_change":"2024-01-15T11:33:19.688957+0000","last_active":"2024-01-15T11:33:21.692059+0000","last_peered":"2024-01-15T11:33:21.692059+0000","last_clean":"2024-01-15T11:33:21.692059+0000","last_became_active":"2024-01-15T11:33:19.688682+0000","last_became_peered":"2024-01-15T11:33:19.688682+0000","last_unstale":"2024-01-15T11:33:21.692059+0000","last_undegraded":"2024-01-15T11:33:21.692059+0000","last_fullsized":"2024-01-15T11:33:21.692059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:24:37.824206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694356+0000","last_change":"2024-01-15T11:33:20.703451+0000","last_active":"2024-01-15T11:33:21.694356+0000","last_peered":"2024-01-15T11:33:21.694356+0000","last_clean":"2024-01-15T11:33:21.694356+0000","last_became_active":"2024-01-15T11:33:20.703004+0000","last_became_peered":"2024-01-15T11:33:20.703004+0000","last_unstale":"2024-01-15T11:33:21.694356+0000","last_undegraded":"2024-01-15T11:33:21.694356+0000","last_fullsized":"2024-01-15T11:33:21.694356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:40:37.948024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.050081+0000","last_change":"2024-01-15T11:33:19.700886+0000","last_active":"2024-01-15T11:33:22.050081+0000","last_peered":"2024-01-15T11:33:22.050081+0000","last_clean":"2024-01-15T11:33:22.050081+0000","last_became_active":"2024-01-15T11:33:19.700536+0000","last_became_peered":"2024-01-15T11:33:19.700536+0000","last_unstale":"2024-01-15T11:33:22.050081+0000","last_undegraded":"2024-01-15T11:33:22.050081+0000","last_fullsized":"2024-01-15T11:33:22.050081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:10:23.063991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.703106+0000","last_change":"2024-01-15T11:33:20.698576+0000","last_active":"2024-01-15T11:33:20.703106+0000","last_peered":"2024-01-15T11:33:20.703106+0000","last_clean":"2024-01-15T11:33:20.703106+0000","last_became_active":"2024-01-15T11:33:20.698281+0000","last_became_peered":"2024-01-15T11:33:20.698281+0000","last_unstale":"2024-01-15T11:33:20.703106+0000","last_undegraded":"2024-01-15T11:33:20.703106+0000","last_fullsized":"2024-01-15T11:33:20.703106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:43:20.038655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692467+0000","last_change":"2024-01-15T11:33:19.686942+0000","last_active":"2024-01-15T11:33:21.692467+0000","last_peered":"2024-01-15T11:33:21.692467+0000","last_clean":"2024-01-15T11:33:21.692467+0000","last_became_active":"2024-01-15T11:33:19.686670+0000","last_became_peered":"2024-01-15T11:33:19.686670+0000","last_unstale":"2024-01-15T11:33:21.692467+0000","last_undegraded":"2024-01-15T11:33:21.692467+0000","last_fullsized":"2024-01-15T11:33:21.692467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:54:19.815477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.050080+0000","last_change":"2024-01-15T11:33:20.717627+0000","last_active":"2024-01-15T11:33:22.050080+0000","last_peered":"2024-01-15T11:33:22.050080+0000","last_clean":"2024-01-15T11:33:22.050080+0000","last_became_active":"2024-01-15T11:33:20.717314+0000","last_became_peered":"2024-01-15T11:33:20.717314+0000","last_unstale":"2024-01-15T11:33:22.050080+0000","last_undegraded":"2024-01-15T11:33:22.050080+0000","last_fullsized":"2024-01-15T11:33:22.050080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:06:38.712115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.776823+0000","last_change":"2024-01-15T11:33:19.686445+0000","last_active":"2024-01-15T11:33:20.776823+0000","last_peered":"2024-01-15T11:33:20.776823+0000","last_clean":"2024-01-15T11:33:20.776823+0000","last_became_active":"2024-01-15T11:33:19.686095+0000","last_became_peered":"2024-01-15T11:33:19.686095+0000","last_unstale":"2024-01-15T11:33:20.776823+0000","last_undegraded":"2024-01-15T11:33:20.776823+0000","last_fullsized":"2024-01-15T11:33:20.776823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:40:08.252519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049946+0000","last_change":"2024-01-15T11:33:20.717522+0000","last_active":"2024-01-15T11:33:22.049946+0000","last_peered":"2024-01-15T11:33:22.049946+0000","last_clean":"2024-01-15T11:33:22.049946+0000","last_became_active":"2024-01-15T11:33:20.716509+0000","last_became_peered":"2024-01-15T11:33:20.716509+0000","last_unstale":"2024-01-15T11:33:22.049946+0000","last_undegraded":"2024-01-15T11:33:22.049946+0000","last_fullsized":"2024-01-15T11:33:22.049946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:16:29.898998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.696539+0000","last_change":"2024-01-15T11:33:19.704598+0000","last_active":"2024-01-15T11:33:20.696539+0000","last_peered":"2024-01-15T11:33:20.696539+0000","last_clean":"2024-01-15T11:33:20.696539+0000","last_became_active":"2024-01-15T11:33:19.704325+0000","last_became_peered":"2024-01-15T11:33:19.704325+0000","last_unstale":"2024-01-15T11:33:20.696539+0000","last_undegraded":"2024-01-15T11:33:20.696539+0000","last_fullsized":"2024-01-15T11:33:20.696539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:30:24.655392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694647+0000","last_change":"2024-01-15T11:33:20.713073+0000","last_active":"2024-01-15T11:33:21.694647+0000","last_peered":"2024-01-15T11:33:21.694647+0000","last_clean":"2024-01-15T11:33:21.694647+0000","last_became_active":"2024-01-15T11:33:20.712445+0000","last_became_peered":"2024-01-15T11:33:20.712445+0000","last_unstale":"2024-01-15T11:33:21.694647+0000","last_undegraded":"2024-01-15T11:33:21.694647+0000","last_fullsized":"2024-01-15T11:33:21.694647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:43:36.505459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T11:33:19.673001+0000","last_change":"2024-01-15T11:33:09.200536+0000","last_active":"2024-01-15T11:33:19.673001+0000","last_peered":"2024-01-15T11:33:19.673001+0000","last_clean":"2024-01-15T11:33:19.673001+0000","last_became_active":"2024-01-15T11:33:09.199051+0000","last_became_peered":"2024-01-15T11:33:09.199051+0000","last_unstale":"2024-01-15T11:33:19.673001+0000","last_undegraded":"2024-01-15T11:33:19.673001+0000","last_fullsized":"2024-01-15T11:33:19.673001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:08.185347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:08.185347+0000","last_clean_scrub_stamp":"2024-01-15T11:33:08.185347+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:04:15.799885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694629+0000","last_change":"2024-01-15T11:33:19.696884+0000","last_active":"2024-01-15T11:33:21.694629+0000","last_peered":"2024-01-15T11:33:21.694629+0000","last_clean":"2024-01-15T11:33:21.694629+0000","last_became_active":"2024-01-15T11:33:19.696613+0000","last_became_peered":"2024-01-15T11:33:19.696613+0000","last_unstale":"2024-01-15T11:33:21.694629+0000","last_undegraded":"2024-01-15T11:33:21.694629+0000","last_fullsized":"2024-01-15T11:33:21.694629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:39:06.448053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692244+0000","last_change":"2024-01-15T11:33:20.699247+0000","last_active":"2024-01-15T11:33:21.692244+0000","last_peered":"2024-01-15T11:33:21.692244+0000","last_clean":"2024-01-15T11:33:21.692244+0000","last_became_active":"2024-01-15T11:33:20.698918+0000","last_became_peered":"2024-01-15T11:33:20.698918+0000","last_unstale":"2024-01-15T11:33:21.692244+0000","last_undegraded":"2024-01-15T11:33:21.692244+0000","last_fullsized":"2024-01-15T11:33:21.692244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:10:12.548516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694391+0000","last_change":"2024-01-15T11:33:19.697464+0000","last_active":"2024-01-15T11:33:21.694391+0000","last_peered":"2024-01-15T11:33:21.694391+0000","last_clean":"2024-01-15T11:33:21.694391+0000","last_became_active":"2024-01-15T11:33:19.697216+0000","last_became_peered":"2024-01-15T11:33:19.697216+0000","last_unstale":"2024-01-15T11:33:21.694391+0000","last_undegraded":"2024-01-15T11:33:21.694391+0000","last_fullsized":"2024-01-15T11:33:21.694391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:10:23.063991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.711416+0000","last_change":"2024-01-15T11:33:20.705721+0000","last_active":"2024-01-15T11:33:20.711416+0000","last_peered":"2024-01-15T11:33:20.711416+0000","last_clean":"2024-01-15T11:33:20.711416+0000","last_became_active":"2024-01-15T11:33:20.705377+0000","last_became_peered":"2024-01-15T11:33:20.705377+0000","last_unstale":"2024-01-15T11:33:20.711416+0000","last_undegraded":"2024-01-15T11:33:20.711416+0000","last_fullsized":"2024-01-15T11:33:20.711416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:20:20.127357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692543+0000","last_change":"2024-01-15T11:33:19.695074+0000","last_active":"2024-01-15T11:33:21.692543+0000","last_peered":"2024-01-15T11:33:21.692543+0000","last_clean":"2024-01-15T11:33:21.692543+0000","last_became_active":"2024-01-15T11:33:19.694782+0000","last_became_peered":"2024-01-15T11:33:19.694782+0000","last_unstale":"2024-01-15T11:33:21.692543+0000","last_undegraded":"2024-01-15T11:33:21.692543+0000","last_fullsized":"2024-01-15T11:33:21.692543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:23:46.972470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.715823+0000","last_change":"2024-01-15T11:33:20.710903+0000","last_active":"2024-01-15T11:33:20.715823+0000","last_peered":"2024-01-15T11:33:20.715823+0000","last_clean":"2024-01-15T11:33:20.715823+0000","last_became_active":"2024-01-15T11:33:20.710654+0000","last_became_peered":"2024-01-15T11:33:20.710654+0000","last_unstale":"2024-01-15T11:33:20.715823+0000","last_undegraded":"2024-01-15T11:33:20.715823+0000","last_fullsized":"2024-01-15T11:33:20.715823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:28:05.330745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694751+0000","last_change":"2024-01-15T11:33:19.695513+0000","last_active":"2024-01-15T11:33:21.694751+0000","last_peered":"2024-01-15T11:33:21.694751+0000","last_clean":"2024-01-15T11:33:21.694751+0000","last_became_active":"2024-01-15T11:33:19.694979+0000","last_became_peered":"2024-01-15T11:33:19.694979+0000","last_unstale":"2024-01-15T11:33:21.694751+0000","last_undegraded":"2024-01-15T11:33:21.694751+0000","last_fullsized":"2024-01-15T11:33:21.694751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T11:40:02.900978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049811+0000","last_change":"2024-01-15T11:33:20.714405+0000","last_active":"2024-01-15T11:33:22.049811+0000","last_peered":"2024-01-15T11:33:22.049811+0000","last_clean":"2024-01-15T11:33:22.049811+0000","last_became_active":"2024-01-15T11:33:20.714117+0000","last_became_peered":"2024-01-15T11:33:20.714117+0000","last_unstale":"2024-01-15T11:33:22.049811+0000","last_undegraded":"2024-01-15T11:33:22.049811+0000","last_fullsized":"2024-01-15T11:33:22.049811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:39:07.453832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.701349+0000","last_change":"2024-01-15T11:33:19.687389+0000","last_active":"2024-01-15T11:33:20.701349+0000","last_peered":"2024-01-15T11:33:20.701349+0000","last_clean":"2024-01-15T11:33:20.701349+0000","last_became_active":"2024-01-15T11:33:19.687007+0000","last_became_peered":"2024-01-15T11:33:19.687007+0000","last_unstale":"2024-01-15T11:33:20.701349+0000","last_undegraded":"2024-01-15T11:33:20.701349+0000","last_fullsized":"2024-01-15T11:33:20.701349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:48:31.960351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.711187+0000","last_change":"2024-01-15T11:33:20.707549+0000","last_active":"2024-01-15T11:33:20.711187+0000","last_peered":"2024-01-15T11:33:20.711187+0000","last_clean":"2024-01-15T11:33:20.711187+0000","last_became_active":"2024-01-15T11:33:20.707209+0000","last_became_peered":"2024-01-15T11:33:20.707209+0000","last_unstale":"2024-01-15T11:33:20.711187+0000","last_undegraded":"2024-01-15T11:33:20.711187+0000","last_fullsized":"2024-01-15T11:33:20.711187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:35:58.917376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694720+0000","last_change":"2024-01-15T11:33:19.694270+0000","last_active":"2024-01-15T11:33:21.694720+0000","last_peered":"2024-01-15T11:33:21.694720+0000","last_clean":"2024-01-15T11:33:21.694720+0000","last_became_active":"2024-01-15T11:33:19.693994+0000","last_became_peered":"2024-01-15T11:33:19.693994+0000","last_unstale":"2024-01-15T11:33:21.694720+0000","last_undegraded":"2024-01-15T11:33:21.694720+0000","last_fullsized":"2024-01-15T11:33:21.694720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:06:50.072772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.717717+0000","last_change":"2024-01-15T11:33:20.710508+0000","last_active":"2024-01-15T11:33:20.717717+0000","last_peered":"2024-01-15T11:33:20.717717+0000","last_clean":"2024-01-15T11:33:20.717717+0000","last_became_active":"2024-01-15T11:33:20.710227+0000","last_became_peered":"2024-01-15T11:33:20.710227+0000","last_unstale":"2024-01-15T11:33:20.717717+0000","last_undegraded":"2024-01-15T11:33:20.717717+0000","last_fullsized":"2024-01-15T11:33:20.717717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:30:00.041187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692521+0000","last_change":"2024-01-15T11:33:19.695648+0000","last_active":"2024-01-15T11:33:21.692521+0000","last_peered":"2024-01-15T11:33:21.692521+0000","last_clean":"2024-01-15T11:33:21.692521+0000","last_became_active":"2024-01-15T11:33:19.695275+0000","last_became_peered":"2024-01-15T11:33:19.695275+0000","last_unstale":"2024-01-15T11:33:21.692521+0000","last_undegraded":"2024-01-15T11:33:21.692521+0000","last_fullsized":"2024-01-15T11:33:21.692521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:35:14.710253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692522+0000","last_change":"2024-01-15T11:33:20.702612+0000","last_active":"2024-01-15T11:33:21.692522+0000","last_peered":"2024-01-15T11:33:21.692522+0000","last_clean":"2024-01-15T11:33:21.692522+0000","last_became_active":"2024-01-15T11:33:20.702237+0000","last_became_peered":"2024-01-15T11:33:20.702237+0000","last_unstale":"2024-01-15T11:33:21.692522+0000","last_undegraded":"2024-01-15T11:33:21.692522+0000","last_fullsized":"2024-01-15T11:33:21.692522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:59:06.428472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694987+0000","last_change":"2024-01-15T11:33:19.703609+0000","last_active":"2024-01-15T11:33:21.694987+0000","last_peered":"2024-01-15T11:33:21.694987+0000","last_clean":"2024-01-15T11:33:21.694987+0000","last_became_active":"2024-01-15T11:33:19.703303+0000","last_became_peered":"2024-01-15T11:33:19.703303+0000","last_unstale":"2024-01-15T11:33:21.694987+0000","last_undegraded":"2024-01-15T11:33:21.694987+0000","last_fullsized":"2024-01-15T11:33:21.694987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:25:15.570806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692384+0000","last_change":"2024-01-15T11:33:20.698701+0000","last_active":"2024-01-15T11:33:21.692384+0000","last_peered":"2024-01-15T11:33:21.692384+0000","last_clean":"2024-01-15T11:33:21.692384+0000","last_became_active":"2024-01-15T11:33:20.698404+0000","last_became_peered":"2024-01-15T11:33:20.698404+0000","last_unstale":"2024-01-15T11:33:21.692384+0000","last_undegraded":"2024-01-15T11:33:21.692384+0000","last_fullsized":"2024-01-15T11:33:21.692384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:10:24.069771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049423+0000","last_change":"2024-01-15T11:33:19.692573+0000","last_active":"2024-01-15T11:33:22.049423+0000","last_peered":"2024-01-15T11:33:22.049423+0000","last_clean":"2024-01-15T11:33:22.049423+0000","last_became_active":"2024-01-15T11:33:19.692258+0000","last_became_peered":"2024-01-15T11:33:19.692258+0000","last_unstale":"2024-01-15T11:33:22.049423+0000","last_undegraded":"2024-01-15T11:33:22.049423+0000","last_fullsized":"2024-01-15T11:33:22.049423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:24:55.482541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694384+0000","last_change":"2024-01-15T11:33:20.702022+0000","last_active":"2024-01-15T11:33:21.694384+0000","last_peered":"2024-01-15T11:33:21.694384+0000","last_clean":"2024-01-15T11:33:21.694384+0000","last_became_active":"2024-01-15T11:33:20.701623+0000","last_became_peered":"2024-01-15T11:33:20.701623+0000","last_unstale":"2024-01-15T11:33:21.694384+0000","last_undegraded":"2024-01-15T11:33:21.694384+0000","last_fullsized":"2024-01-15T11:33:21.694384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:06:38.712115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692157+0000","last_change":"2024-01-15T11:33:19.695563+0000","last_active":"2024-01-15T11:33:21.692157+0000","last_peered":"2024-01-15T11:33:21.692157+0000","last_clean":"2024-01-15T11:33:21.692157+0000","last_became_active":"2024-01-15T11:33:19.695286+0000","last_became_peered":"2024-01-15T11:33:19.695286+0000","last_unstale":"2024-01-15T11:33:21.692157+0000","last_undegraded":"2024-01-15T11:33:21.692157+0000","last_fullsized":"2024-01-15T11:33:21.692157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:47:33.225390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.691971+0000","last_change":"2024-01-15T11:33:20.698692+0000","last_active":"2024-01-15T11:33:21.691971+0000","last_peered":"2024-01-15T11:33:21.691971+0000","last_clean":"2024-01-15T11:33:21.691971+0000","last_became_active":"2024-01-15T11:33:20.698341+0000","last_became_peered":"2024-01-15T11:33:20.698341+0000","last_unstale":"2024-01-15T11:33:21.691971+0000","last_undegraded":"2024-01-15T11:33:21.691971+0000","last_fullsized":"2024-01-15T11:33:21.691971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:24:56.488321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.696554+0000","last_change":"2024-01-15T11:33:19.697600+0000","last_active":"2024-01-15T11:33:20.696554+0000","last_peered":"2024-01-15T11:33:20.696554+0000","last_clean":"2024-01-15T11:33:20.696554+0000","last_became_active":"2024-01-15T11:33:19.697340+0000","last_became_peered":"2024-01-15T11:33:19.697340+0000","last_unstale":"2024-01-15T11:33:20.696554+0000","last_undegraded":"2024-01-15T11:33:20.696554+0000","last_fullsized":"2024-01-15T11:33:20.696554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:24:37.824206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.693173+0000","last_change":"2024-01-15T11:33:20.699235+0000","last_active":"2024-01-15T11:33:21.693173+0000","last_peered":"2024-01-15T11:33:21.693173+0000","last_clean":"2024-01-15T11:33:21.693173+0000","last_became_active":"2024-01-15T11:33:20.698686+0000","last_became_peered":"2024-01-15T11:33:20.698686+0000","last_unstale":"2024-01-15T11:33:21.693173+0000","last_undegraded":"2024-01-15T11:33:21.693173+0000","last_fullsized":"2024-01-15T11:33:21.693173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:24:38.829986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694531+0000","last_change":"2024-01-15T11:33:19.701728+0000","last_active":"2024-01-15T11:33:21.694531+0000","last_peered":"2024-01-15T11:33:21.694531+0000","last_clean":"2024-01-15T11:33:21.694531+0000","last_became_active":"2024-01-15T11:33:19.701429+0000","last_became_peered":"2024-01-15T11:33:19.701429+0000","last_unstale":"2024-01-15T11:33:21.694531+0000","last_undegraded":"2024-01-15T11:33:21.694531+0000","last_fullsized":"2024-01-15T11:33:21.694531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:29:52.566265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694539+0000","last_change":"2024-01-15T11:33:20.710518+0000","last_active":"2024-01-15T11:33:21.694539+0000","last_peered":"2024-01-15T11:33:21.694539+0000","last_clean":"2024-01-15T11:33:21.694539+0000","last_became_active":"2024-01-15T11:33:20.709615+0000","last_became_peered":"2024-01-15T11:33:20.709615+0000","last_unstale":"2024-01-15T11:33:21.694539+0000","last_undegraded":"2024-01-15T11:33:21.694539+0000","last_fullsized":"2024-01-15T11:33:21.694539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:03:30.363934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694665+0000","last_change":"2024-01-15T11:33:20.718816+0000","last_active":"2024-01-15T11:33:21.694665+0000","last_peered":"2024-01-15T11:33:21.694665+0000","last_clean":"2024-01-15T11:33:21.694665+0000","last_became_active":"2024-01-15T11:33:20.716841+0000","last_became_peered":"2024-01-15T11:33:20.716841+0000","last_unstale":"2024-01-15T11:33:21.694665+0000","last_undegraded":"2024-01-15T11:33:21.694665+0000","last_fullsized":"2024-01-15T11:33:21.694665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:13:30.740169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049911+0000","last_change":"2024-01-15T11:33:19.706026+0000","last_active":"2024-01-15T11:33:22.049911+0000","last_peered":"2024-01-15T11:33:22.049911+0000","last_clean":"2024-01-15T11:33:22.049911+0000","last_became_active":"2024-01-15T11:33:19.705650+0000","last_became_peered":"2024-01-15T11:33:19.705650+0000","last_unstale":"2024-01-15T11:33:22.049911+0000","last_undegraded":"2024-01-15T11:33:22.049911+0000","last_fullsized":"2024-01-15T11:33:22.049911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:19:45.449255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.725680+0000","last_change":"2024-01-15T11:33:20.723707+0000","last_active":"2024-01-15T11:33:20.725680+0000","last_peered":"2024-01-15T11:33:20.725680+0000","last_clean":"2024-01-15T11:33:20.725680+0000","last_became_active":"2024-01-15T11:33:20.723420+0000","last_became_peered":"2024-01-15T11:33:20.723420+0000","last_unstale":"2024-01-15T11:33:20.725680+0000","last_undegraded":"2024-01-15T11:33:20.725680+0000","last_fullsized":"2024-01-15T11:33:20.725680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:10:17.455765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.050061+0000","last_change":"2024-01-15T11:33:19.707453+0000","last_active":"2024-01-15T11:33:22.050061+0000","last_peered":"2024-01-15T11:33:22.050061+0000","last_clean":"2024-01-15T11:33:22.050061+0000","last_became_active":"2024-01-15T11:33:19.707108+0000","last_became_peered":"2024-01-15T11:33:19.707108+0000","last_unstale":"2024-01-15T11:33:22.050061+0000","last_undegraded":"2024-01-15T11:33:22.050061+0000","last_fullsized":"2024-01-15T11:33:22.050061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:56:02.537685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.719779+0000","last_change":"2024-01-15T11:33:20.716694+0000","last_active":"2024-01-15T11:33:20.719779+0000","last_peered":"2024-01-15T11:33:20.719779+0000","last_clean":"2024-01-15T11:33:20.719779+0000","last_became_active":"2024-01-15T11:33:20.716405+0000","last_became_peered":"2024-01-15T11:33:20.716405+0000","last_unstale":"2024-01-15T11:33:20.719779+0000","last_undegraded":"2024-01-15T11:33:20.719779+0000","last_fullsized":"2024-01-15T11:33:20.719779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:59:58.594182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.778022+0000","last_change":"2024-01-15T11:33:19.690015+0000","last_active":"2024-01-15T11:33:20.778022+0000","last_peered":"2024-01-15T11:33:20.778022+0000","last_clean":"2024-01-15T11:33:20.778022+0000","last_became_active":"2024-01-15T11:33:19.688306+0000","last_became_peered":"2024-01-15T11:33:19.688306+0000","last_unstale":"2024-01-15T11:33:20.778022+0000","last_undegraded":"2024-01-15T11:33:20.778022+0000","last_fullsized":"2024-01-15T11:33:20.778022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:41:03.219134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.718709+0000","last_change":"2024-01-15T11:33:20.713812+0000","last_active":"2024-01-15T11:33:20.718709+0000","last_peered":"2024-01-15T11:33:20.718709+0000","last_clean":"2024-01-15T11:33:20.718709+0000","last_became_active":"2024-01-15T11:33:20.713505+0000","last_became_peered":"2024-01-15T11:33:20.713505+0000","last_unstale":"2024-01-15T11:33:20.718709+0000","last_undegraded":"2024-01-15T11:33:20.718709+0000","last_fullsized":"2024-01-15T11:33:20.718709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:04:03.414689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692650+0000","last_change":"2024-01-15T11:33:19.691915+0000","last_active":"2024-01-15T11:33:21.692650+0000","last_peered":"2024-01-15T11:33:21.692650+0000","last_clean":"2024-01-15T11:33:21.692650+0000","last_became_active":"2024-01-15T11:33:19.691570+0000","last_became_peered":"2024-01-15T11:33:19.691570+0000","last_unstale":"2024-01-15T11:33:21.692650+0000","last_undegraded":"2024-01-15T11:33:21.692650+0000","last_fullsized":"2024-01-15T11:33:21.692650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:28:16.778157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":69952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":72236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":70534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":71564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":660390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":660412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-15T11:33:24.880 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-15T11:33:25.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.059+0000 7fb781d56640 1 Processor -- start 2024-01-15T11:33:25.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.059+0000 7fb781d56640 1 -- start start 2024-01-15T11:33:25.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.063+0000 7fb781d56640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb77c15d880 0x7fb77c0b6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:25.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.063+0000 7fb781d56640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb77c0b6c70 0x7fb77c0d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:25.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.063+0000 7fb781d56640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb77c0d3ca0 0x7fb77c0cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:25.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.063+0000 7fb781d56640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77c0d4110 con 0x7fb77c0b6c70 2024-01-15T11:33:25.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.063+0000 7fb781d56640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77c0d15f0 con 0x7fb77c15d880 2024-01-15T11:33:25.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.063+0000 7fb781d56640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c0ce000 con 0x7fb77c0d3ca0 2024-01-15T11:33:25.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.063+0000 7fb77bfff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb77c0b6c70 0x7fb77c0d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:25.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.063+0000 7fb77bfff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb77c0b6c70 0x7fb77c0d3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55244/0 (socket says 172.21.15.27:55244) 2024-01-15T11:33:25.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.063+0000 7fb77bfff640 1 -- 172.21.15.27:0/1468020478 learned_addr learned my addr 172.21.15.27:0/1468020478 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:25.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.063+0000 7fb780d54640 1 --2- 172.21.15.27:0/1468020478 >> v2:172.21.15.93:3300/0 conn(0x7fb77c15d880 0x7fb77c0b6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:25.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.063+0000 7fb781555640 1 --2- 172.21.15.27:0/1468020478 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb77c0d3ca0 0x7fb77c0cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:25.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.063+0000 7fb77bfff640 1 -- 172.21.15.27:0/1468020478 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb77c0d3ca0 msgr2=0x7fb77c0cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:25.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.063+0000 7fb77bfff640 1 --2- 172.21.15.27:0/1468020478 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb77c0d3ca0 0x7fb77c0cfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:25.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.063+0000 7fb77bfff640 1 -- 172.21.15.27:0/1468020478 >> v2:172.21.15.93:3300/0 conn(0x7fb77c15d880 msgr2=0x7fb77c0b6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:25.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.063+0000 7fb77bfff640 1 --2- 172.21.15.27:0/1468020478 >> v2:172.21.15.93:3300/0 conn(0x7fb77c15d880 0x7fb77c0b6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:25.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.063+0000 7fb77bfff640 1 -- 172.21.15.27:0/1468020478 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c0d0630 con 0x7fb77c0b6c70 2024-01-15T11:33:25.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.063+0000 7fb780d54640 1 --2- 172.21.15.27:0/1468020478 >> v2:172.21.15.93:3300/0 conn(0x7fb77c15d880 0x7fb77c0b6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:25.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.067+0000 7fb77bfff640 1 --2- 172.21.15.27:0/1468020478 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb77c0b6c70 0x7fb77c0d3760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb77c08c420 tx=0x7fb76801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea3a78dda0ff061 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:25.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.067+0000 7fb77b7fe640 1 -- 172.21.15.27:0/1468020478 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7680aa640 con 0x7fb77c0b6c70 2024-01-15T11:33:25.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.067+0000 7fb77b7fe640 1 -- 172.21.15.27:0/1468020478 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7680aa7a0 con 0x7fb77c0b6c70 2024-01-15T11:33:25.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.067+0000 7fb77b7fe640 1 -- 172.21.15.27:0/1468020478 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7680aab30 con 0x7fb77c0b6c70 2024-01-15T11:33:25.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.067+0000 7fb781d56640 1 -- 172.21.15.27:0/1468020478 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb77c0b6c70 msgr2=0x7fb77c0d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:25.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.067+0000 7fb781d56640 1 --2- 172.21.15.27:0/1468020478 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb77c0b6c70 0x7fb77c0d3760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb77c08c420 tx=0x7fb76801c500 comp rx=0 tx=0).stop 2024-01-15T11:33:25.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.067+0000 7fb781d56640 1 -- 172.21.15.27:0/1468020478 shutdown_connections 2024-01-15T11:33:25.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.067+0000 7fb781d56640 1 --2- 172.21.15.27:0/1468020478 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb77c0d3ca0 0x7fb77c0cfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:25.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.067+0000 7fb781d56640 1 --2- 172.21.15.27:0/1468020478 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb77c0b6c70 0x7fb77c0d3760 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:25.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.067+0000 7fb781d56640 1 --2- 172.21.15.27:0/1468020478 >> v2:172.21.15.93:3300/0 conn(0x7fb77c15d880 0x7fb77c0b6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:25.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.067+0000 7fb781d56640 1 -- 172.21.15.27:0/1468020478 >> 172.21.15.27:0/1468020478 conn(0x7fb77c06b9f0 msgr2=0x7fb77c06be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:25.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.067+0000 7fb781d56640 1 -- 172.21.15.27:0/1468020478 shutdown_connections 2024-01-15T11:33:25.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.067+0000 7fb781d56640 1 -- 172.21.15.27:0/1468020478 wait complete. 2024-01-15T11:33:25.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.067+0000 7fb781d56640 1 Processor -- start 2024-01-15T11:33:25.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.067+0000 7fb781d56640 1 -- start start 2024-01-15T11:33:25.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.067+0000 7fb781d56640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb77c0b6c70 0x7fb77c156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:25.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.067+0000 7fb781d56640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb77c0d3ca0 0x7fb77c157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:25.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.067+0000 7fb781d56640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb77c15d880 0x7fb77c157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:25.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.067+0000 7fb781d56640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c0b3c60 con 0x7fb77c0b6c70 2024-01-15T11:33:25.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.067+0000 7fb781d56640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c0b56c0 con 0x7fb77c0d3ca0 2024-01-15T11:33:25.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.067+0000 7fb781d56640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c0b3330 con 0x7fb77c15d880 2024-01-15T11:33:25.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.071+0000 7fb780d54640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb77c0b6c70 0x7fb77c156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:25.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.071+0000 7fb780d54640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb77c0b6c70 0x7fb77c156fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55246/0 (socket says 172.21.15.27:55246) 2024-01-15T11:33:25.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.071+0000 7fb780d54640 1 -- 172.21.15.27:0/1503772797 learned_addr learned my addr 172.21.15.27:0/1503772797 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:25.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.071+0000 7fb781555640 1 --2- 172.21.15.27:0/1503772797 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb77c15d880 0x7fb77c157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:25.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.071+0000 7fb77bfff640 1 --2- 172.21.15.27:0/1503772797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb77c0d3ca0 0x7fb77c157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:25.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.071+0000 7fb780d54640 1 -- 172.21.15.27:0/1503772797 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb77c15d880 msgr2=0x7fb77c157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:25.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.071+0000 7fb780d54640 1 --2- 172.21.15.27:0/1503772797 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb77c15d880 0x7fb77c157e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:25.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.071+0000 7fb780d54640 1 -- 172.21.15.27:0/1503772797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb77c0d3ca0 msgr2=0x7fb77c157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:25.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.071+0000 7fb780d54640 1 --2- 172.21.15.27:0/1503772797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb77c0d3ca0 0x7fb77c157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:25.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.071+0000 7fb780d54640 1 -- 172.21.15.27:0/1503772797 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7680094d0 con 0x7fb77c0b6c70 2024-01-15T11:33:25.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.071+0000 7fb780d54640 1 --2- 172.21.15.27:0/1503772797 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb77c0b6c70 0x7fb77c156fb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb77000d800 tx=0x7fb77000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:25.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.071+0000 7fb7797fa640 1 -- 172.21.15.27:0/1503772797 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7700096c0 con 0x7fb77c0b6c70 2024-01-15T11:33:25.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.071+0000 7fb7797fa640 1 -- 172.21.15.27:0/1503772797 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb770009820 con 0x7fb77c0b6c70 2024-01-15T11:33:25.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.071+0000 7fb7797fa640 1 -- 172.21.15.27:0/1503772797 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb770009bd0 con 0x7fb77c0b6c70 2024-01-15T11:33:25.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.071+0000 7fb781d56640 1 -- 172.21.15.27:0/1503772797 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77c0b3610 con 0x7fb77c0b6c70 2024-01-15T11:33:25.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.071+0000 7fb781d56640 1 -- 172.21.15.27:0/1503772797 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77c0b40f0 con 0x7fb77c0b6c70 2024-01-15T11:33:25.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.071+0000 7fb781d56640 1 -- 172.21.15.27:0/1503772797 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77c074a00 con 0x7fb77c0b6c70 2024-01-15T11:33:25.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.071+0000 7fb7797fa640 1 -- 172.21.15.27:0/1503772797 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fb770009d30 con 0x7fb77c0b6c70 2024-01-15T11:33:25.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.075+0000 7fb7797fa640 1 --2- 172.21.15.27:0/1503772797 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb760066920 0x7fb760068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:25.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.075+0000 7fb7797fa640 1 -- 172.21.15.27:0/1503772797 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb770084bc0 con 0x7fb77c0b6c70 2024-01-15T11:33:25.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.075+0000 7fb77bfff640 1 --2- 172.21.15.27:0/1503772797 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb760066920 0x7fb760068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:25.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.075+0000 7fb77bfff640 1 --2- 172.21.15.27:0/1503772797 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb760066920 0x7fb760068de0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb7680ae000 tx=0x7fb7680a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:25.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.079+0000 7fb7797fa640 1 -- 172.21.15.27:0/1503772797 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb770051e00 con 0x7fb77c0b6c70 2024-01-15T11:33:25.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.231+0000 7fb781d56640 1 -- 172.21.15.27:0/1503772797 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb77c0d1b20 con 0x7fb760066920 2024-01-15T11:33:25.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.239+0000 7fb7797fa640 1 -- 172.21.15.27:0/1503772797 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264616 (secure 0 0 0) 0x7fb7680aa910 con 0x7fb760066920 2024-01-15T11:33:25.246 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:25.247 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-01-15T11:33:25.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.243+0000 7fb781d56640 1 -- 172.21.15.27:0/1503772797 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb760066920 msgr2=0x7fb760068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:25.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.243+0000 7fb781d56640 1 --2- 172.21.15.27:0/1503772797 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb760066920 0x7fb760068de0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb7680ae000 tx=0x7fb7680a7000 comp rx=0 tx=0).stop 2024-01-15T11:33:25.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.243+0000 7fb781d56640 1 -- 172.21.15.27:0/1503772797 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb77c0b6c70 msgr2=0x7fb77c156fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:25.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.243+0000 7fb781d56640 1 --2- 172.21.15.27:0/1503772797 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb77c0b6c70 0x7fb77c156fb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb77000d800 tx=0x7fb77000dcc0 comp rx=0 tx=0).stop 2024-01-15T11:33:25.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.243+0000 7fb781d56640 1 -- 172.21.15.27:0/1503772797 shutdown_connections 2024-01-15T11:33:25.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.243+0000 7fb781d56640 1 --2- 172.21.15.27:0/1503772797 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb77c15d880 0x7fb77c157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:25.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.243+0000 7fb781d56640 1 --2- 172.21.15.27:0/1503772797 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb760066920 0x7fb760068de0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:25.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.243+0000 7fb781d56640 1 --2- 172.21.15.27:0/1503772797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb77c0d3ca0 0x7fb77c157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:25.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.243+0000 7fb781d56640 1 --2- 172.21.15.27:0/1503772797 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb77c0b6c70 0x7fb77c156fb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:25.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.243+0000 7fb781d56640 1 -- 172.21.15.27:0/1503772797 >> 172.21.15.27:0/1503772797 conn(0x7fb77c06b9f0 msgr2=0x7fb77c160430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:25.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.243+0000 7fb781d56640 1 -- 172.21.15.27:0/1503772797 shutdown_connections 2024-01-15T11:33:25.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.243+0000 7fb781d56640 1 -- 172.21.15.27:0/1503772797 wait complete. 2024-01-15T11:33:25.266 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-01-15T11:33:24.065695+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":105,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219016,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755704,"statfs":{"total":773094113280,"available":772869840896,"internally_reserved":0,"allocated":2924544,"data_stored":1745172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.403845"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049923+0000","last_change":"2024-01-15T11:33:20.716411+0000","last_active":"2024-01-15T11:33:22.049923+0000","last_peered":"2024-01-15T11:33:22.049923+0000","last_clean":"2024-01-15T11:33:22.049923+0000","last_became_active":"2024-01-15T11:33:20.716169+0000","last_became_peered":"2024-01-15T11:33:20.716169+0000","last_unstale":"2024-01-15T11:33:22.049923+0000","last_undegraded":"2024-01-15T11:33:22.049923+0000","last_fullsized":"2024-01-15T11:33:22.049923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:43:30.219449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.718688+0000","last_change":"2024-01-15T11:33:20.713459+0000","last_active":"2024-01-15T11:33:20.718688+0000","last_peered":"2024-01-15T11:33:20.718688+0000","last_clean":"2024-01-15T11:33:20.718688+0000","last_became_active":"2024-01-15T11:33:20.713141+0000","last_became_peered":"2024-01-15T11:33:20.713141+0000","last_unstale":"2024-01-15T11:33:20.718688+0000","last_undegraded":"2024-01-15T11:33:20.718688+0000","last_fullsized":"2024-01-15T11:33:20.718688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:25:27.920141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.719755+0000","last_change":"2024-01-15T11:33:20.715526+0000","last_active":"2024-01-15T11:33:20.719755+0000","last_peered":"2024-01-15T11:33:20.719755+0000","last_clean":"2024-01-15T11:33:20.719755+0000","last_became_active":"2024-01-15T11:33:20.715226+0000","last_became_peered":"2024-01-15T11:33:20.715226+0000","last_unstale":"2024-01-15T11:33:20.719755+0000","last_undegraded":"2024-01-15T11:33:20.719755+0000","last_fullsized":"2024-01-15T11:33:20.719755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:22:29.656689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.703187+0000","last_change":"2024-01-15T11:33:20.699790+0000","last_active":"2024-01-15T11:33:20.703187+0000","last_peered":"2024-01-15T11:33:20.703187+0000","last_clean":"2024-01-15T11:33:20.703187+0000","last_became_active":"2024-01-15T11:33:20.699497+0000","last_became_peered":"2024-01-15T11:33:20.699497+0000","last_unstale":"2024-01-15T11:33:20.703187+0000","last_undegraded":"2024-01-15T11:33:20.703187+0000","last_fullsized":"2024-01-15T11:33:20.703187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:23:47.978250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049813+0000","last_change":"2024-01-15T11:33:20.714669+0000","last_active":"2024-01-15T11:33:22.049813+0000","last_peered":"2024-01-15T11:33:22.049813+0000","last_clean":"2024-01-15T11:33:22.049813+0000","last_became_active":"2024-01-15T11:33:20.714267+0000","last_became_peered":"2024-01-15T11:33:20.714267+0000","last_unstale":"2024-01-15T11:33:22.049813+0000","last_undegraded":"2024-01-15T11:33:22.049813+0000","last_fullsized":"2024-01-15T11:33:22.049813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T11:40:03.906758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.703172+0000","last_change":"2024-01-15T11:33:20.700208+0000","last_active":"2024-01-15T11:33:20.703172+0000","last_peered":"2024-01-15T11:33:20.703172+0000","last_clean":"2024-01-15T11:33:20.703172+0000","last_became_active":"2024-01-15T11:33:20.698271+0000","last_became_peered":"2024-01-15T11:33:20.698271+0000","last_unstale":"2024-01-15T11:33:20.703172+0000","last_undegraded":"2024-01-15T11:33:20.703172+0000","last_fullsized":"2024-01-15T11:33:20.703172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:56:28.155106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049558+0000","last_change":"2024-01-15T11:33:20.709080+0000","last_active":"2024-01-15T11:33:22.049558+0000","last_peered":"2024-01-15T11:33:22.049558+0000","last_clean":"2024-01-15T11:33:22.049558+0000","last_became_active":"2024-01-15T11:33:20.707734+0000","last_became_peered":"2024-01-15T11:33:20.707734+0000","last_unstale":"2024-01-15T11:33:22.049558+0000","last_undegraded":"2024-01-15T11:33:22.049558+0000","last_fullsized":"2024-01-15T11:33:22.049558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:30:57.472645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.724152+0000","last_change":"2024-01-15T11:33:20.721012+0000","last_active":"2024-01-15T11:33:20.724152+0000","last_peered":"2024-01-15T11:33:20.724152+0000","last_clean":"2024-01-15T11:33:20.724152+0000","last_became_active":"2024-01-15T11:33:20.720749+0000","last_became_peered":"2024-01-15T11:33:20.720749+0000","last_unstale":"2024-01-15T11:33:20.724152+0000","last_undegraded":"2024-01-15T11:33:20.724152+0000","last_fullsized":"2024-01-15T11:33:20.724152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:55:28.642409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.718281+0000","last_change":"2024-01-15T11:33:20.712100+0000","last_active":"2024-01-15T11:33:20.718281+0000","last_peered":"2024-01-15T11:33:20.718281+0000","last_clean":"2024-01-15T11:33:20.718281+0000","last_became_active":"2024-01-15T11:33:20.711811+0000","last_became_peered":"2024-01-15T11:33:20.711811+0000","last_unstale":"2024-01-15T11:33:20.718281+0000","last_undegraded":"2024-01-15T11:33:20.718281+0000","last_fullsized":"2024-01-15T11:33:20.718281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:43:20.038655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049776+0000","last_change":"2024-01-15T11:33:20.707038+0000","last_active":"2024-01-15T11:33:22.049776+0000","last_peered":"2024-01-15T11:33:22.049776+0000","last_clean":"2024-01-15T11:33:22.049776+0000","last_became_active":"2024-01-15T11:33:20.706364+0000","last_became_peered":"2024-01-15T11:33:20.706364+0000","last_unstale":"2024-01-15T11:33:22.049776+0000","last_undegraded":"2024-01-15T11:33:22.049776+0000","last_fullsized":"2024-01-15T11:33:22.049776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:06:51.078552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049883+0000","last_change":"2024-01-15T11:33:20.716954+0000","last_active":"2024-01-15T11:33:22.049883+0000","last_peered":"2024-01-15T11:33:22.049883+0000","last_clean":"2024-01-15T11:33:22.049883+0000","last_became_active":"2024-01-15T11:33:20.716582+0000","last_became_peered":"2024-01-15T11:33:20.716582+0000","last_unstale":"2024-01-15T11:33:22.049883+0000","last_undegraded":"2024-01-15T11:33:22.049883+0000","last_fullsized":"2024-01-15T11:33:22.049883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:37:58.693069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049767+0000","last_change":"2024-01-15T11:33:20.717724+0000","last_active":"2024-01-15T11:33:22.049767+0000","last_peered":"2024-01-15T11:33:22.049767+0000","last_clean":"2024-01-15T11:33:22.049767+0000","last_became_active":"2024-01-15T11:33:20.717228+0000","last_became_peered":"2024-01-15T11:33:20.717228+0000","last_unstale":"2024-01-15T11:33:22.049767+0000","last_undegraded":"2024-01-15T11:33:22.049767+0000","last_fullsized":"2024-01-15T11:33:22.049767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:25:16.576586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.719082+0000","last_change":"2024-01-15T11:33:20.715589+0000","last_active":"2024-01-15T11:33:20.719082+0000","last_peered":"2024-01-15T11:33:20.719082+0000","last_clean":"2024-01-15T11:33:20.719082+0000","last_became_active":"2024-01-15T11:33:20.714841+0000","last_became_peered":"2024-01-15T11:33:20.714841+0000","last_unstale":"2024-01-15T11:33:20.719082+0000","last_undegraded":"2024-01-15T11:33:20.719082+0000","last_fullsized":"2024-01-15T11:33:20.719082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:10:17.455765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.709859+0000","last_change":"2024-01-15T11:33:20.703953+0000","last_active":"2024-01-15T11:33:20.709859+0000","last_peered":"2024-01-15T11:33:20.709859+0000","last_clean":"2024-01-15T11:33:20.709859+0000","last_became_active":"2024-01-15T11:33:20.703653+0000","last_became_peered":"2024-01-15T11:33:20.703653+0000","last_unstale":"2024-01-15T11:33:20.709859+0000","last_undegraded":"2024-01-15T11:33:20.709859+0000","last_fullsized":"2024-01-15T11:33:20.709859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:23:47.978250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.721727+0000","last_change":"2024-01-15T11:33:20.719103+0000","last_active":"2024-01-15T11:33:20.721727+0000","last_peered":"2024-01-15T11:33:20.721727+0000","last_clean":"2024-01-15T11:33:20.721727+0000","last_became_active":"2024-01-15T11:33:20.718591+0000","last_became_peered":"2024-01-15T11:33:20.718591+0000","last_unstale":"2024-01-15T11:33:20.721727+0000","last_undegraded":"2024-01-15T11:33:20.721727+0000","last_fullsized":"2024-01-15T11:33:20.721727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:17:33.638563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694295+0000","last_change":"2024-01-15T11:33:20.701415+0000","last_active":"2024-01-15T11:33:21.694295+0000","last_peered":"2024-01-15T11:33:21.694295+0000","last_clean":"2024-01-15T11:33:21.694295+0000","last_became_active":"2024-01-15T11:33:20.701093+0000","last_became_peered":"2024-01-15T11:33:20.701093+0000","last_unstale":"2024-01-15T11:33:21.694295+0000","last_undegraded":"2024-01-15T11:33:21.694295+0000","last_fullsized":"2024-01-15T11:33:21.694295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:43:30.219449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694973+0000","last_change":"2024-01-15T11:33:20.718200+0000","last_active":"2024-01-15T11:33:21.694973+0000","last_peered":"2024-01-15T11:33:21.694973+0000","last_clean":"2024-01-15T11:33:21.694973+0000","last_became_active":"2024-01-15T11:33:20.717333+0000","last_became_peered":"2024-01-15T11:33:20.717333+0000","last_unstale":"2024-01-15T11:33:21.694973+0000","last_undegraded":"2024-01-15T11:33:21.694973+0000","last_fullsized":"2024-01-15T11:33:21.694973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:01:50.198012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.693034+0000","last_change":"2024-01-15T11:33:20.701000+0000","last_active":"2024-01-15T11:33:21.693034+0000","last_peered":"2024-01-15T11:33:21.693034+0000","last_clean":"2024-01-15T11:33:21.693034+0000","last_became_active":"2024-01-15T11:33:20.700312+0000","last_became_peered":"2024-01-15T11:33:20.700312+0000","last_unstale":"2024-01-15T11:33:21.693034+0000","last_undegraded":"2024-01-15T11:33:21.693034+0000","last_fullsized":"2024-01-15T11:33:21.693034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:30:25.661172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694717+0000","last_change":"2024-01-15T11:33:20.703054+0000","last_active":"2024-01-15T11:33:21.694717+0000","last_peered":"2024-01-15T11:33:21.694717+0000","last_clean":"2024-01-15T11:33:21.694717+0000","last_became_active":"2024-01-15T11:33:20.702256+0000","last_became_peered":"2024-01-15T11:33:20.702256+0000","last_unstale":"2024-01-15T11:33:21.694717+0000","last_undegraded":"2024-01-15T11:33:21.694717+0000","last_fullsized":"2024-01-15T11:33:21.694717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:27:46.642600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049810+0000","last_change":"2024-01-15T11:33:20.717634+0000","last_active":"2024-01-15T11:33:22.049810+0000","last_peered":"2024-01-15T11:33:22.049810+0000","last_clean":"2024-01-15T11:33:22.049810+0000","last_became_active":"2024-01-15T11:33:20.716991+0000","last_became_peered":"2024-01-15T11:33:20.716991+0000","last_unstale":"2024-01-15T11:33:22.049810+0000","last_undegraded":"2024-01-15T11:33:22.049810+0000","last_fullsized":"2024-01-15T11:33:22.049810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:29:53.572044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692042+0000","last_change":"2024-01-15T11:33:20.706694+0000","last_active":"2024-01-15T11:33:21.692042+0000","last_peered":"2024-01-15T11:33:21.692042+0000","last_clean":"2024-01-15T11:33:21.692042+0000","last_became_active":"2024-01-15T11:33:20.706408+0000","last_became_peered":"2024-01-15T11:33:20.706408+0000","last_unstale":"2024-01-15T11:33:21.692042+0000","last_undegraded":"2024-01-15T11:33:21.692042+0000","last_fullsized":"2024-01-15T11:33:21.692042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:38:46.122065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.723132+0000","last_change":"2024-01-15T11:33:20.720066+0000","last_active":"2024-01-15T11:33:20.723132+0000","last_peered":"2024-01-15T11:33:20.723132+0000","last_clean":"2024-01-15T11:33:20.723132+0000","last_became_active":"2024-01-15T11:33:20.719629+0000","last_became_peered":"2024-01-15T11:33:20.719629+0000","last_unstale":"2024-01-15T11:33:20.723132+0000","last_undegraded":"2024-01-15T11:33:20.723132+0000","last_fullsized":"2024-01-15T11:33:20.723132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:20:20.127357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.719238+0000","last_change":"2024-01-15T11:33:20.713988+0000","last_active":"2024-01-15T11:33:20.719238+0000","last_peered":"2024-01-15T11:33:20.719238+0000","last_clean":"2024-01-15T11:33:20.719238+0000","last_became_active":"2024-01-15T11:33:20.713701+0000","last_became_peered":"2024-01-15T11:33:20.713701+0000","last_unstale":"2024-01-15T11:33:20.719238+0000","last_undegraded":"2024-01-15T11:33:20.719238+0000","last_fullsized":"2024-01-15T11:33:20.719238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:34:15.750417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694293+0000","last_change":"2024-01-15T11:33:20.716478+0000","last_active":"2024-01-15T11:33:21.694293+0000","last_peered":"2024-01-15T11:33:21.694293+0000","last_clean":"2024-01-15T11:33:21.694293+0000","last_became_active":"2024-01-15T11:33:20.716205+0000","last_became_peered":"2024-01-15T11:33:20.716205+0000","last_unstale":"2024-01-15T11:33:21.694293+0000","last_undegraded":"2024-01-15T11:33:21.694293+0000","last_fullsized":"2024-01-15T11:33:21.694293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:37:58.693069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.719827+0000","last_change":"2024-01-15T11:33:20.716995+0000","last_active":"2024-01-15T11:33:20.719827+0000","last_peered":"2024-01-15T11:33:20.719827+0000","last_clean":"2024-01-15T11:33:20.719827+0000","last_became_active":"2024-01-15T11:33:20.716752+0000","last_became_peered":"2024-01-15T11:33:20.716752+0000","last_unstale":"2024-01-15T11:33:20.719827+0000","last_undegraded":"2024-01-15T11:33:20.719827+0000","last_fullsized":"2024-01-15T11:33:20.719827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:59:25.779673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.707007+0000","last_change":"2024-01-15T11:33:20.701779+0000","last_active":"2024-01-15T11:33:20.707007+0000","last_peered":"2024-01-15T11:33:20.707007+0000","last_clean":"2024-01-15T11:33:20.707007+0000","last_became_active":"2024-01-15T11:33:20.701423+0000","last_became_peered":"2024-01-15T11:33:20.701423+0000","last_unstale":"2024-01-15T11:33:20.707007+0000","last_undegraded":"2024-01-15T11:33:20.707007+0000","last_fullsized":"2024-01-15T11:33:20.707007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:20:20.127357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.709938+0000","last_change":"2024-01-15T11:33:20.703490+0000","last_active":"2024-01-15T11:33:20.709938+0000","last_peered":"2024-01-15T11:33:20.709938+0000","last_clean":"2024-01-15T11:33:20.709938+0000","last_became_active":"2024-01-15T11:33:20.703217+0000","last_became_peered":"2024-01-15T11:33:20.703217+0000","last_unstale":"2024-01-15T11:33:20.709938+0000","last_undegraded":"2024-01-15T11:33:20.709938+0000","last_fullsized":"2024-01-15T11:33:20.709938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:21:39.120264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.724107+0000","last_change":"2024-01-15T11:33:20.721606+0000","last_active":"2024-01-15T11:33:20.724107+0000","last_peered":"2024-01-15T11:33:20.724107+0000","last_clean":"2024-01-15T11:33:20.724107+0000","last_became_active":"2024-01-15T11:33:20.721213+0000","last_became_peered":"2024-01-15T11:33:20.721213+0000","last_unstale":"2024-01-15T11:33:20.724107+0000","last_undegraded":"2024-01-15T11:33:20.724107+0000","last_fullsized":"2024-01-15T11:33:20.724107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:43:20.038655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.713146+0000","last_change":"2024-01-15T11:33:20.709187+0000","last_active":"2024-01-15T11:33:20.713146+0000","last_peered":"2024-01-15T11:33:20.713146+0000","last_clean":"2024-01-15T11:33:20.713146+0000","last_became_active":"2024-01-15T11:33:20.708936+0000","last_became_peered":"2024-01-15T11:33:20.708936+0000","last_unstale":"2024-01-15T11:33:20.713146+0000","last_undegraded":"2024-01-15T11:33:20.713146+0000","last_fullsized":"2024-01-15T11:33:20.713146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:10:59.020362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694339+0000","last_change":"2024-01-15T11:33:20.713513+0000","last_active":"2024-01-15T11:33:21.694339+0000","last_peered":"2024-01-15T11:33:21.694339+0000","last_clean":"2024-01-15T11:33:21.694339+0000","last_became_active":"2024-01-15T11:33:20.713242+0000","last_became_peered":"2024-01-15T11:33:20.713242+0000","last_unstale":"2024-01-15T11:33:21.694339+0000","last_undegraded":"2024-01-15T11:33:21.694339+0000","last_fullsized":"2024-01-15T11:33:21.694339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:16:29.898998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692439+0000","last_change":"2024-01-15T11:33:20.708040+0000","last_active":"2024-01-15T11:33:21.692439+0000","last_peered":"2024-01-15T11:33:21.692439+0000","last_clean":"2024-01-15T11:33:21.692439+0000","last_became_active":"2024-01-15T11:33:20.707700+0000","last_became_peered":"2024-01-15T11:33:20.707700+0000","last_unstale":"2024-01-15T11:33:21.692439+0000","last_undegraded":"2024-01-15T11:33:21.692439+0000","last_fullsized":"2024-01-15T11:33:21.692439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:21:39.120264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.711513+0000","last_change":"2024-01-15T11:33:20.708725+0000","last_active":"2024-01-15T11:33:20.711513+0000","last_peered":"2024-01-15T11:33:20.711513+0000","last_clean":"2024-01-15T11:33:20.711513+0000","last_became_active":"2024-01-15T11:33:20.707260+0000","last_became_peered":"2024-01-15T11:33:20.707260+0000","last_unstale":"2024-01-15T11:33:20.711513+0000","last_undegraded":"2024-01-15T11:33:20.711513+0000","last_fullsized":"2024-01-15T11:33:20.711513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:30:00.041187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.723046+0000","last_change":"2024-01-15T11:33:20.719952+0000","last_active":"2024-01-15T11:33:20.723046+0000","last_peered":"2024-01-15T11:33:20.723046+0000","last_clean":"2024-01-15T11:33:20.723046+0000","last_became_active":"2024-01-15T11:33:20.719219+0000","last_became_peered":"2024-01-15T11:33:20.719219+0000","last_unstale":"2024-01-15T11:33:20.723046+0000","last_undegraded":"2024-01-15T11:33:20.723046+0000","last_fullsized":"2024-01-15T11:33:20.723046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:56:28.155106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.777115+0000","last_change":"2024-01-15T11:33:19.694356+0000","last_active":"2024-01-15T11:33:20.777115+0000","last_peered":"2024-01-15T11:33:20.777115+0000","last_clean":"2024-01-15T11:33:20.777115+0000","last_became_active":"2024-01-15T11:33:19.693392+0000","last_became_peered":"2024-01-15T11:33:19.693392+0000","last_unstale":"2024-01-15T11:33:20.777115+0000","last_undegraded":"2024-01-15T11:33:20.777115+0000","last_fullsized":"2024-01-15T11:33:20.777115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:00:25.349679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692151+0000","last_change":"2024-01-15T11:33:20.715147+0000","last_active":"2024-01-15T11:33:21.692151+0000","last_peered":"2024-01-15T11:33:21.692151+0000","last_clean":"2024-01-15T11:33:21.692151+0000","last_became_active":"2024-01-15T11:33:20.714851+0000","last_became_peered":"2024-01-15T11:33:20.714851+0000","last_unstale":"2024-01-15T11:33:21.692151+0000","last_undegraded":"2024-01-15T11:33:21.692151+0000","last_fullsized":"2024-01-15T11:33:21.692151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:19:46.455034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694644+0000","last_change":"2024-01-15T11:33:19.695468+0000","last_active":"2024-01-15T11:33:21.694644+0000","last_peered":"2024-01-15T11:33:21.694644+0000","last_clean":"2024-01-15T11:33:21.694644+0000","last_became_active":"2024-01-15T11:33:19.694811+0000","last_became_peered":"2024-01-15T11:33:19.694811+0000","last_unstale":"2024-01-15T11:33:21.694644+0000","last_undegraded":"2024-01-15T11:33:21.694644+0000","last_fullsized":"2024-01-15T11:33:21.694644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:59:05.422692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.695882+0000","last_change":"2024-01-15T11:33:19.703161+0000","last_active":"2024-01-15T11:33:20.695882+0000","last_peered":"2024-01-15T11:33:20.695882+0000","last_clean":"2024-01-15T11:33:20.695882+0000","last_became_active":"2024-01-15T11:33:19.702777+0000","last_became_peered":"2024-01-15T11:33:19.702777+0000","last_unstale":"2024-01-15T11:33:20.695882+0000","last_undegraded":"2024-01-15T11:33:20.695882+0000","last_fullsized":"2024-01-15T11:33:20.695882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:55:14.164103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.718560+0000","last_change":"2024-01-15T11:33:20.713246+0000","last_active":"2024-01-15T11:33:20.718560+0000","last_peered":"2024-01-15T11:33:20.718560+0000","last_clean":"2024-01-15T11:33:20.718560+0000","last_became_active":"2024-01-15T11:33:20.712606+0000","last_became_peered":"2024-01-15T11:33:20.712606+0000","last_unstale":"2024-01-15T11:33:20.718560+0000","last_undegraded":"2024-01-15T11:33:20.718560+0000","last_fullsized":"2024-01-15T11:33:20.718560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:26:56.290650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694396+0000","last_change":"2024-01-15T11:33:19.688561+0000","last_active":"2024-01-15T11:33:21.694396+0000","last_peered":"2024-01-15T11:33:21.694396+0000","last_clean":"2024-01-15T11:33:21.694396+0000","last_became_active":"2024-01-15T11:33:19.688262+0000","last_became_peered":"2024-01-15T11:33:19.688262+0000","last_unstale":"2024-01-15T11:33:21.694396+0000","last_undegraded":"2024-01-15T11:33:21.694396+0000","last_fullsized":"2024-01-15T11:33:21.694396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:10:11.542737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692151+0000","last_change":"2024-01-15T11:33:20.707012+0000","last_active":"2024-01-15T11:33:21.692151+0000","last_peered":"2024-01-15T11:33:21.692151+0000","last_clean":"2024-01-15T11:33:21.692151+0000","last_became_active":"2024-01-15T11:33:20.706739+0000","last_became_peered":"2024-01-15T11:33:20.706739+0000","last_unstale":"2024-01-15T11:33:21.692151+0000","last_undegraded":"2024-01-15T11:33:21.692151+0000","last_fullsized":"2024-01-15T11:33:21.692151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:56:03.543465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.706928+0000","last_change":"2024-01-15T11:33:19.681692+0000","last_active":"2024-01-15T11:33:20.706928+0000","last_peered":"2024-01-15T11:33:20.706928+0000","last_clean":"2024-01-15T11:33:20.706928+0000","last_became_active":"2024-01-15T11:33:19.681438+0000","last_became_peered":"2024-01-15T11:33:19.681438+0000","last_unstale":"2024-01-15T11:33:20.706928+0000","last_undegraded":"2024-01-15T11:33:20.706928+0000","last_fullsized":"2024-01-15T11:33:20.706928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:29:59.035408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.707028+0000","last_change":"2024-01-15T11:33:20.703299+0000","last_active":"2024-01-15T11:33:20.707028+0000","last_peered":"2024-01-15T11:33:20.707028+0000","last_clean":"2024-01-15T11:33:20.707028+0000","last_became_active":"2024-01-15T11:33:20.702790+0000","last_became_peered":"2024-01-15T11:33:20.702790+0000","last_unstale":"2024-01-15T11:33:20.707028+0000","last_undegraded":"2024-01-15T11:33:20.707028+0000","last_fullsized":"2024-01-15T11:33:20.707028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:10:17.455765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049957+0000","last_change":"2024-01-15T11:33:19.705105+0000","last_active":"2024-01-15T11:33:22.049957+0000","last_peered":"2024-01-15T11:33:22.049957+0000","last_clean":"2024-01-15T11:33:22.049957+0000","last_became_active":"2024-01-15T11:33:19.704838+0000","last_became_peered":"2024-01-15T11:33:19.704838+0000","last_unstale":"2024-01-15T11:33:22.049957+0000","last_undegraded":"2024-01-15T11:33:22.049957+0000","last_fullsized":"2024-01-15T11:33:22.049957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:10:11.542737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.718859+0000","last_change":"2024-01-15T11:33:20.714206+0000","last_active":"2024-01-15T11:33:20.718859+0000","last_peered":"2024-01-15T11:33:20.718859+0000","last_clean":"2024-01-15T11:33:20.718859+0000","last_became_active":"2024-01-15T11:33:20.713849+0000","last_became_peered":"2024-01-15T11:33:20.713849+0000","last_unstale":"2024-01-15T11:33:20.718859+0000","last_undegraded":"2024-01-15T11:33:20.718859+0000","last_fullsized":"2024-01-15T11:33:20.718859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:31:22.460007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692762+0000","last_change":"2024-01-15T11:33:19.693447+0000","last_active":"2024-01-15T11:33:21.692762+0000","last_peered":"2024-01-15T11:33:21.692762+0000","last_clean":"2024-01-15T11:33:21.692762+0000","last_became_active":"2024-01-15T11:33:19.692828+0000","last_became_peered":"2024-01-15T11:33:19.692828+0000","last_unstale":"2024-01-15T11:33:21.692762+0000","last_undegraded":"2024-01-15T11:33:21.692762+0000","last_fullsized":"2024-01-15T11:33:21.692762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:43:19.032876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694795+0000","last_change":"2024-01-15T11:33:20.708034+0000","last_active":"2024-01-15T11:33:21.694795+0000","last_peered":"2024-01-15T11:33:21.694795+0000","last_clean":"2024-01-15T11:33:21.694795+0000","last_became_active":"2024-01-15T11:33:20.707770+0000","last_became_peered":"2024-01-15T11:33:20.707770+0000","last_unstale":"2024-01-15T11:33:21.694795+0000","last_undegraded":"2024-01-15T11:33:21.694795+0000","last_fullsized":"2024-01-15T11:33:21.694795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:05:32.012901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.783701+0000","last_change":"2024-01-15T11:33:19.689357+0000","last_active":"2024-01-15T11:33:20.783701+0000","last_peered":"2024-01-15T11:33:20.783701+0000","last_clean":"2024-01-15T11:33:20.783701+0000","last_became_active":"2024-01-15T11:33:19.685961+0000","last_became_peered":"2024-01-15T11:33:19.685961+0000","last_unstale":"2024-01-15T11:33:20.783701+0000","last_undegraded":"2024-01-15T11:33:20.783701+0000","last_fullsized":"2024-01-15T11:33:20.783701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:10:41.101806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.050023+0000","last_change":"2024-01-15T11:33:20.717161+0000","last_active":"2024-01-15T11:33:22.050023+0000","last_peered":"2024-01-15T11:33:22.050023+0000","last_clean":"2024-01-15T11:33:22.050023+0000","last_became_active":"2024-01-15T11:33:20.716866+0000","last_became_peered":"2024-01-15T11:33:20.716866+0000","last_unstale":"2024-01-15T11:33:22.050023+0000","last_undegraded":"2024-01-15T11:33:22.050023+0000","last_fullsized":"2024-01-15T11:33:22.050023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:40:37.948024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.693226+0000","last_change":"2024-01-15T11:33:19.698607+0000","last_active":"2024-01-15T11:33:21.693226+0000","last_peered":"2024-01-15T11:33:21.693226+0000","last_clean":"2024-01-15T11:33:21.693226+0000","last_became_active":"2024-01-15T11:33:19.698300+0000","last_became_peered":"2024-01-15T11:33:19.698300+0000","last_unstale":"2024-01-15T11:33:21.693226+0000","last_undegraded":"2024-01-15T11:33:21.693226+0000","last_fullsized":"2024-01-15T11:33:21.693226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:10:16.449986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.709880+0000","last_change":"2024-01-15T11:33:20.704242+0000","last_active":"2024-01-15T11:33:20.709880+0000","last_peered":"2024-01-15T11:33:20.709880+0000","last_clean":"2024-01-15T11:33:20.709880+0000","last_became_active":"2024-01-15T11:33:20.703938+0000","last_became_peered":"2024-01-15T11:33:20.703938+0000","last_unstale":"2024-01-15T11:33:20.709880+0000","last_undegraded":"2024-01-15T11:33:20.709880+0000","last_fullsized":"2024-01-15T11:33:20.709880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:56:28.155106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694704+0000","last_change":"2024-01-15T11:33:19.695692+0000","last_active":"2024-01-15T11:33:21.694704+0000","last_peered":"2024-01-15T11:33:21.694704+0000","last_clean":"2024-01-15T11:33:21.694704+0000","last_became_active":"2024-01-15T11:33:19.695189+0000","last_became_peered":"2024-01-15T11:33:19.695189+0000","last_unstale":"2024-01-15T11:33:21.694704+0000","last_undegraded":"2024-01-15T11:33:21.694704+0000","last_fullsized":"2024-01-15T11:33:21.694704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:30:56.466865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694542+0000","last_change":"2024-01-15T11:33:20.718461+0000","last_active":"2024-01-15T11:33:21.694542+0000","last_peered":"2024-01-15T11:33:21.694542+0000","last_clean":"2024-01-15T11:33:21.694542+0000","last_became_active":"2024-01-15T11:33:20.718129+0000","last_became_peered":"2024-01-15T11:33:20.718129+0000","last_unstale":"2024-01-15T11:33:21.694542+0000","last_undegraded":"2024-01-15T11:33:21.694542+0000","last_fullsized":"2024-01-15T11:33:21.694542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:31:06.263833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049542+0000","last_change":"2024-01-15T11:33:19.704099+0000","last_active":"2024-01-15T11:33:22.049542+0000","last_peered":"2024-01-15T11:33:22.049542+0000","last_clean":"2024-01-15T11:33:22.049542+0000","last_became_active":"2024-01-15T11:33:19.699225+0000","last_became_peered":"2024-01-15T11:33:19.699225+0000","last_unstale":"2024-01-15T11:33:22.049542+0000","last_undegraded":"2024-01-15T11:33:22.049542+0000","last_fullsized":"2024-01-15T11:33:22.049542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:38:45.116285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.723081+0000","last_change":"2024-01-15T11:33:20.719867+0000","last_active":"2024-01-15T11:33:20.723081+0000","last_peered":"2024-01-15T11:33:20.723081+0000","last_clean":"2024-01-15T11:33:20.723081+0000","last_became_active":"2024-01-15T11:33:20.719528+0000","last_became_peered":"2024-01-15T11:33:20.719528+0000","last_unstale":"2024-01-15T11:33:20.723081+0000","last_undegraded":"2024-01-15T11:33:20.723081+0000","last_fullsized":"2024-01-15T11:33:20.723081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:23:47.978250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692059+0000","last_change":"2024-01-15T11:33:19.688957+0000","last_active":"2024-01-15T11:33:21.692059+0000","last_peered":"2024-01-15T11:33:21.692059+0000","last_clean":"2024-01-15T11:33:21.692059+0000","last_became_active":"2024-01-15T11:33:19.688682+0000","last_became_peered":"2024-01-15T11:33:19.688682+0000","last_unstale":"2024-01-15T11:33:21.692059+0000","last_undegraded":"2024-01-15T11:33:21.692059+0000","last_fullsized":"2024-01-15T11:33:21.692059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:24:37.824206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694356+0000","last_change":"2024-01-15T11:33:20.703451+0000","last_active":"2024-01-15T11:33:21.694356+0000","last_peered":"2024-01-15T11:33:21.694356+0000","last_clean":"2024-01-15T11:33:21.694356+0000","last_became_active":"2024-01-15T11:33:20.703004+0000","last_became_peered":"2024-01-15T11:33:20.703004+0000","last_unstale":"2024-01-15T11:33:21.694356+0000","last_undegraded":"2024-01-15T11:33:21.694356+0000","last_fullsized":"2024-01-15T11:33:21.694356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:40:37.948024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.050081+0000","last_change":"2024-01-15T11:33:19.700886+0000","last_active":"2024-01-15T11:33:22.050081+0000","last_peered":"2024-01-15T11:33:22.050081+0000","last_clean":"2024-01-15T11:33:22.050081+0000","last_became_active":"2024-01-15T11:33:19.700536+0000","last_became_peered":"2024-01-15T11:33:19.700536+0000","last_unstale":"2024-01-15T11:33:22.050081+0000","last_undegraded":"2024-01-15T11:33:22.050081+0000","last_fullsized":"2024-01-15T11:33:22.050081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:10:23.063991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.703106+0000","last_change":"2024-01-15T11:33:20.698576+0000","last_active":"2024-01-15T11:33:20.703106+0000","last_peered":"2024-01-15T11:33:20.703106+0000","last_clean":"2024-01-15T11:33:20.703106+0000","last_became_active":"2024-01-15T11:33:20.698281+0000","last_became_peered":"2024-01-15T11:33:20.698281+0000","last_unstale":"2024-01-15T11:33:20.703106+0000","last_undegraded":"2024-01-15T11:33:20.703106+0000","last_fullsized":"2024-01-15T11:33:20.703106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:43:20.038655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692467+0000","last_change":"2024-01-15T11:33:19.686942+0000","last_active":"2024-01-15T11:33:21.692467+0000","last_peered":"2024-01-15T11:33:21.692467+0000","last_clean":"2024-01-15T11:33:21.692467+0000","last_became_active":"2024-01-15T11:33:19.686670+0000","last_became_peered":"2024-01-15T11:33:19.686670+0000","last_unstale":"2024-01-15T11:33:21.692467+0000","last_undegraded":"2024-01-15T11:33:21.692467+0000","last_fullsized":"2024-01-15T11:33:21.692467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:54:19.815477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.050080+0000","last_change":"2024-01-15T11:33:20.717627+0000","last_active":"2024-01-15T11:33:22.050080+0000","last_peered":"2024-01-15T11:33:22.050080+0000","last_clean":"2024-01-15T11:33:22.050080+0000","last_became_active":"2024-01-15T11:33:20.717314+0000","last_became_peered":"2024-01-15T11:33:20.717314+0000","last_unstale":"2024-01-15T11:33:22.050080+0000","last_undegraded":"2024-01-15T11:33:22.050080+0000","last_fullsized":"2024-01-15T11:33:22.050080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:06:38.712115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.776823+0000","last_change":"2024-01-15T11:33:19.686445+0000","last_active":"2024-01-15T11:33:20.776823+0000","last_peered":"2024-01-15T11:33:20.776823+0000","last_clean":"2024-01-15T11:33:20.776823+0000","last_became_active":"2024-01-15T11:33:19.686095+0000","last_became_peered":"2024-01-15T11:33:19.686095+0000","last_unstale":"2024-01-15T11:33:20.776823+0000","last_undegraded":"2024-01-15T11:33:20.776823+0000","last_fullsized":"2024-01-15T11:33:20.776823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:40:08.252519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049946+0000","last_change":"2024-01-15T11:33:20.717522+0000","last_active":"2024-01-15T11:33:22.049946+0000","last_peered":"2024-01-15T11:33:22.049946+0000","last_clean":"2024-01-15T11:33:22.049946+0000","last_became_active":"2024-01-15T11:33:20.716509+0000","last_became_peered":"2024-01-15T11:33:20.716509+0000","last_unstale":"2024-01-15T11:33:22.049946+0000","last_undegraded":"2024-01-15T11:33:22.049946+0000","last_fullsized":"2024-01-15T11:33:22.049946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:16:29.898998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.696539+0000","last_change":"2024-01-15T11:33:19.704598+0000","last_active":"2024-01-15T11:33:20.696539+0000","last_peered":"2024-01-15T11:33:20.696539+0000","last_clean":"2024-01-15T11:33:20.696539+0000","last_became_active":"2024-01-15T11:33:19.704325+0000","last_became_peered":"2024-01-15T11:33:19.704325+0000","last_unstale":"2024-01-15T11:33:20.696539+0000","last_undegraded":"2024-01-15T11:33:20.696539+0000","last_fullsized":"2024-01-15T11:33:20.696539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:30:24.655392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694647+0000","last_change":"2024-01-15T11:33:20.713073+0000","last_active":"2024-01-15T11:33:21.694647+0000","last_peered":"2024-01-15T11:33:21.694647+0000","last_clean":"2024-01-15T11:33:21.694647+0000","last_became_active":"2024-01-15T11:33:20.712445+0000","last_became_peered":"2024-01-15T11:33:20.712445+0000","last_unstale":"2024-01-15T11:33:21.694647+0000","last_undegraded":"2024-01-15T11:33:21.694647+0000","last_fullsized":"2024-01-15T11:33:21.694647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:43:36.505459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-01-15T11:33:19.673001+0000","last_change":"2024-01-15T11:33:09.200536+0000","last_active":"2024-01-15T11:33:19.673001+0000","last_peered":"2024-01-15T11:33:19.673001+0000","last_clean":"2024-01-15T11:33:19.673001+0000","last_became_active":"2024-01-15T11:33:09.199051+0000","last_became_peered":"2024-01-15T11:33:09.199051+0000","last_unstale":"2024-01-15T11:33:19.673001+0000","last_undegraded":"2024-01-15T11:33:19.673001+0000","last_fullsized":"2024-01-15T11:33:19.673001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:08.185347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:08.185347+0000","last_clean_scrub_stamp":"2024-01-15T11:33:08.185347+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:04:15.799885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694629+0000","last_change":"2024-01-15T11:33:19.696884+0000","last_active":"2024-01-15T11:33:21.694629+0000","last_peered":"2024-01-15T11:33:21.694629+0000","last_clean":"2024-01-15T11:33:21.694629+0000","last_became_active":"2024-01-15T11:33:19.696613+0000","last_became_peered":"2024-01-15T11:33:19.696613+0000","last_unstale":"2024-01-15T11:33:21.694629+0000","last_undegraded":"2024-01-15T11:33:21.694629+0000","last_fullsized":"2024-01-15T11:33:21.694629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:39:06.448053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692244+0000","last_change":"2024-01-15T11:33:20.699247+0000","last_active":"2024-01-15T11:33:21.692244+0000","last_peered":"2024-01-15T11:33:21.692244+0000","last_clean":"2024-01-15T11:33:21.692244+0000","last_became_active":"2024-01-15T11:33:20.698918+0000","last_became_peered":"2024-01-15T11:33:20.698918+0000","last_unstale":"2024-01-15T11:33:21.692244+0000","last_undegraded":"2024-01-15T11:33:21.692244+0000","last_fullsized":"2024-01-15T11:33:21.692244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:10:12.548516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694391+0000","last_change":"2024-01-15T11:33:19.697464+0000","last_active":"2024-01-15T11:33:21.694391+0000","last_peered":"2024-01-15T11:33:21.694391+0000","last_clean":"2024-01-15T11:33:21.694391+0000","last_became_active":"2024-01-15T11:33:19.697216+0000","last_became_peered":"2024-01-15T11:33:19.697216+0000","last_unstale":"2024-01-15T11:33:21.694391+0000","last_undegraded":"2024-01-15T11:33:21.694391+0000","last_fullsized":"2024-01-15T11:33:21.694391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:10:23.063991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.711416+0000","last_change":"2024-01-15T11:33:20.705721+0000","last_active":"2024-01-15T11:33:20.711416+0000","last_peered":"2024-01-15T11:33:20.711416+0000","last_clean":"2024-01-15T11:33:20.711416+0000","last_became_active":"2024-01-15T11:33:20.705377+0000","last_became_peered":"2024-01-15T11:33:20.705377+0000","last_unstale":"2024-01-15T11:33:20.711416+0000","last_undegraded":"2024-01-15T11:33:20.711416+0000","last_fullsized":"2024-01-15T11:33:20.711416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:20:20.127357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692543+0000","last_change":"2024-01-15T11:33:19.695074+0000","last_active":"2024-01-15T11:33:21.692543+0000","last_peered":"2024-01-15T11:33:21.692543+0000","last_clean":"2024-01-15T11:33:21.692543+0000","last_became_active":"2024-01-15T11:33:19.694782+0000","last_became_peered":"2024-01-15T11:33:19.694782+0000","last_unstale":"2024-01-15T11:33:21.692543+0000","last_undegraded":"2024-01-15T11:33:21.692543+0000","last_fullsized":"2024-01-15T11:33:21.692543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:23:46.972470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.715823+0000","last_change":"2024-01-15T11:33:20.710903+0000","last_active":"2024-01-15T11:33:20.715823+0000","last_peered":"2024-01-15T11:33:20.715823+0000","last_clean":"2024-01-15T11:33:20.715823+0000","last_became_active":"2024-01-15T11:33:20.710654+0000","last_became_peered":"2024-01-15T11:33:20.710654+0000","last_unstale":"2024-01-15T11:33:20.715823+0000","last_undegraded":"2024-01-15T11:33:20.715823+0000","last_fullsized":"2024-01-15T11:33:20.715823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:28:05.330745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694751+0000","last_change":"2024-01-15T11:33:19.695513+0000","last_active":"2024-01-15T11:33:21.694751+0000","last_peered":"2024-01-15T11:33:21.694751+0000","last_clean":"2024-01-15T11:33:21.694751+0000","last_became_active":"2024-01-15T11:33:19.694979+0000","last_became_peered":"2024-01-15T11:33:19.694979+0000","last_unstale":"2024-01-15T11:33:21.694751+0000","last_undegraded":"2024-01-15T11:33:21.694751+0000","last_fullsized":"2024-01-15T11:33:21.694751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T11:40:02.900978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049811+0000","last_change":"2024-01-15T11:33:20.714405+0000","last_active":"2024-01-15T11:33:22.049811+0000","last_peered":"2024-01-15T11:33:22.049811+0000","last_clean":"2024-01-15T11:33:22.049811+0000","last_became_active":"2024-01-15T11:33:20.714117+0000","last_became_peered":"2024-01-15T11:33:20.714117+0000","last_unstale":"2024-01-15T11:33:22.049811+0000","last_undegraded":"2024-01-15T11:33:22.049811+0000","last_fullsized":"2024-01-15T11:33:22.049811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:39:07.453832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.701349+0000","last_change":"2024-01-15T11:33:19.687389+0000","last_active":"2024-01-15T11:33:20.701349+0000","last_peered":"2024-01-15T11:33:20.701349+0000","last_clean":"2024-01-15T11:33:20.701349+0000","last_became_active":"2024-01-15T11:33:19.687007+0000","last_became_peered":"2024-01-15T11:33:19.687007+0000","last_unstale":"2024-01-15T11:33:20.701349+0000","last_undegraded":"2024-01-15T11:33:20.701349+0000","last_fullsized":"2024-01-15T11:33:20.701349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:48:31.960351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.711187+0000","last_change":"2024-01-15T11:33:20.707549+0000","last_active":"2024-01-15T11:33:20.711187+0000","last_peered":"2024-01-15T11:33:20.711187+0000","last_clean":"2024-01-15T11:33:20.711187+0000","last_became_active":"2024-01-15T11:33:20.707209+0000","last_became_peered":"2024-01-15T11:33:20.707209+0000","last_unstale":"2024-01-15T11:33:20.711187+0000","last_undegraded":"2024-01-15T11:33:20.711187+0000","last_fullsized":"2024-01-15T11:33:20.711187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:35:58.917376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694720+0000","last_change":"2024-01-15T11:33:19.694270+0000","last_active":"2024-01-15T11:33:21.694720+0000","last_peered":"2024-01-15T11:33:21.694720+0000","last_clean":"2024-01-15T11:33:21.694720+0000","last_became_active":"2024-01-15T11:33:19.693994+0000","last_became_peered":"2024-01-15T11:33:19.693994+0000","last_unstale":"2024-01-15T11:33:21.694720+0000","last_undegraded":"2024-01-15T11:33:21.694720+0000","last_fullsized":"2024-01-15T11:33:21.694720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:06:50.072772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.717717+0000","last_change":"2024-01-15T11:33:20.710508+0000","last_active":"2024-01-15T11:33:20.717717+0000","last_peered":"2024-01-15T11:33:20.717717+0000","last_clean":"2024-01-15T11:33:20.717717+0000","last_became_active":"2024-01-15T11:33:20.710227+0000","last_became_peered":"2024-01-15T11:33:20.710227+0000","last_unstale":"2024-01-15T11:33:20.717717+0000","last_undegraded":"2024-01-15T11:33:20.717717+0000","last_fullsized":"2024-01-15T11:33:20.717717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:30:00.041187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692521+0000","last_change":"2024-01-15T11:33:19.695648+0000","last_active":"2024-01-15T11:33:21.692521+0000","last_peered":"2024-01-15T11:33:21.692521+0000","last_clean":"2024-01-15T11:33:21.692521+0000","last_became_active":"2024-01-15T11:33:19.695275+0000","last_became_peered":"2024-01-15T11:33:19.695275+0000","last_unstale":"2024-01-15T11:33:21.692521+0000","last_undegraded":"2024-01-15T11:33:21.692521+0000","last_fullsized":"2024-01-15T11:33:21.692521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:35:14.710253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692522+0000","last_change":"2024-01-15T11:33:20.702612+0000","last_active":"2024-01-15T11:33:21.692522+0000","last_peered":"2024-01-15T11:33:21.692522+0000","last_clean":"2024-01-15T11:33:21.692522+0000","last_became_active":"2024-01-15T11:33:20.702237+0000","last_became_peered":"2024-01-15T11:33:20.702237+0000","last_unstale":"2024-01-15T11:33:21.692522+0000","last_undegraded":"2024-01-15T11:33:21.692522+0000","last_fullsized":"2024-01-15T11:33:21.692522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:59:06.428472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694987+0000","last_change":"2024-01-15T11:33:19.703609+0000","last_active":"2024-01-15T11:33:21.694987+0000","last_peered":"2024-01-15T11:33:21.694987+0000","last_clean":"2024-01-15T11:33:21.694987+0000","last_became_active":"2024-01-15T11:33:19.703303+0000","last_became_peered":"2024-01-15T11:33:19.703303+0000","last_unstale":"2024-01-15T11:33:21.694987+0000","last_undegraded":"2024-01-15T11:33:21.694987+0000","last_fullsized":"2024-01-15T11:33:21.694987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:25:15.570806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692384+0000","last_change":"2024-01-15T11:33:20.698701+0000","last_active":"2024-01-15T11:33:21.692384+0000","last_peered":"2024-01-15T11:33:21.692384+0000","last_clean":"2024-01-15T11:33:21.692384+0000","last_became_active":"2024-01-15T11:33:20.698404+0000","last_became_peered":"2024-01-15T11:33:20.698404+0000","last_unstale":"2024-01-15T11:33:21.692384+0000","last_undegraded":"2024-01-15T11:33:21.692384+0000","last_fullsized":"2024-01-15T11:33:21.692384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:10:24.069771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049423+0000","last_change":"2024-01-15T11:33:19.692573+0000","last_active":"2024-01-15T11:33:22.049423+0000","last_peered":"2024-01-15T11:33:22.049423+0000","last_clean":"2024-01-15T11:33:22.049423+0000","last_became_active":"2024-01-15T11:33:19.692258+0000","last_became_peered":"2024-01-15T11:33:19.692258+0000","last_unstale":"2024-01-15T11:33:22.049423+0000","last_undegraded":"2024-01-15T11:33:22.049423+0000","last_fullsized":"2024-01-15T11:33:22.049423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:24:55.482541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694384+0000","last_change":"2024-01-15T11:33:20.702022+0000","last_active":"2024-01-15T11:33:21.694384+0000","last_peered":"2024-01-15T11:33:21.694384+0000","last_clean":"2024-01-15T11:33:21.694384+0000","last_became_active":"2024-01-15T11:33:20.701623+0000","last_became_peered":"2024-01-15T11:33:20.701623+0000","last_unstale":"2024-01-15T11:33:21.694384+0000","last_undegraded":"2024-01-15T11:33:21.694384+0000","last_fullsized":"2024-01-15T11:33:21.694384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:06:38.712115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692157+0000","last_change":"2024-01-15T11:33:19.695563+0000","last_active":"2024-01-15T11:33:21.692157+0000","last_peered":"2024-01-15T11:33:21.692157+0000","last_clean":"2024-01-15T11:33:21.692157+0000","last_became_active":"2024-01-15T11:33:19.695286+0000","last_became_peered":"2024-01-15T11:33:19.695286+0000","last_unstale":"2024-01-15T11:33:21.692157+0000","last_undegraded":"2024-01-15T11:33:21.692157+0000","last_fullsized":"2024-01-15T11:33:21.692157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:47:33.225390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.691971+0000","last_change":"2024-01-15T11:33:20.698692+0000","last_active":"2024-01-15T11:33:21.691971+0000","last_peered":"2024-01-15T11:33:21.691971+0000","last_clean":"2024-01-15T11:33:21.691971+0000","last_became_active":"2024-01-15T11:33:20.698341+0000","last_became_peered":"2024-01-15T11:33:20.698341+0000","last_unstale":"2024-01-15T11:33:21.691971+0000","last_undegraded":"2024-01-15T11:33:21.691971+0000","last_fullsized":"2024-01-15T11:33:21.691971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:24:56.488321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.696554+0000","last_change":"2024-01-15T11:33:19.697600+0000","last_active":"2024-01-15T11:33:20.696554+0000","last_peered":"2024-01-15T11:33:20.696554+0000","last_clean":"2024-01-15T11:33:20.696554+0000","last_became_active":"2024-01-15T11:33:19.697340+0000","last_became_peered":"2024-01-15T11:33:19.697340+0000","last_unstale":"2024-01-15T11:33:20.696554+0000","last_undegraded":"2024-01-15T11:33:20.696554+0000","last_fullsized":"2024-01-15T11:33:20.696554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:24:37.824206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.693173+0000","last_change":"2024-01-15T11:33:20.699235+0000","last_active":"2024-01-15T11:33:21.693173+0000","last_peered":"2024-01-15T11:33:21.693173+0000","last_clean":"2024-01-15T11:33:21.693173+0000","last_became_active":"2024-01-15T11:33:20.698686+0000","last_became_peered":"2024-01-15T11:33:20.698686+0000","last_unstale":"2024-01-15T11:33:21.693173+0000","last_undegraded":"2024-01-15T11:33:21.693173+0000","last_fullsized":"2024-01-15T11:33:21.693173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:24:38.829986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694531+0000","last_change":"2024-01-15T11:33:19.701728+0000","last_active":"2024-01-15T11:33:21.694531+0000","last_peered":"2024-01-15T11:33:21.694531+0000","last_clean":"2024-01-15T11:33:21.694531+0000","last_became_active":"2024-01-15T11:33:19.701429+0000","last_became_peered":"2024-01-15T11:33:19.701429+0000","last_unstale":"2024-01-15T11:33:21.694531+0000","last_undegraded":"2024-01-15T11:33:21.694531+0000","last_fullsized":"2024-01-15T11:33:21.694531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:29:52.566265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694539+0000","last_change":"2024-01-15T11:33:20.710518+0000","last_active":"2024-01-15T11:33:21.694539+0000","last_peered":"2024-01-15T11:33:21.694539+0000","last_clean":"2024-01-15T11:33:21.694539+0000","last_became_active":"2024-01-15T11:33:20.709615+0000","last_became_peered":"2024-01-15T11:33:20.709615+0000","last_unstale":"2024-01-15T11:33:21.694539+0000","last_undegraded":"2024-01-15T11:33:21.694539+0000","last_fullsized":"2024-01-15T11:33:21.694539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:03:30.363934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694665+0000","last_change":"2024-01-15T11:33:20.718816+0000","last_active":"2024-01-15T11:33:21.694665+0000","last_peered":"2024-01-15T11:33:21.694665+0000","last_clean":"2024-01-15T11:33:21.694665+0000","last_became_active":"2024-01-15T11:33:20.716841+0000","last_became_peered":"2024-01-15T11:33:20.716841+0000","last_unstale":"2024-01-15T11:33:21.694665+0000","last_undegraded":"2024-01-15T11:33:21.694665+0000","last_fullsized":"2024-01-15T11:33:21.694665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:13:30.740169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049911+0000","last_change":"2024-01-15T11:33:19.706026+0000","last_active":"2024-01-15T11:33:22.049911+0000","last_peered":"2024-01-15T11:33:22.049911+0000","last_clean":"2024-01-15T11:33:22.049911+0000","last_became_active":"2024-01-15T11:33:19.705650+0000","last_became_peered":"2024-01-15T11:33:19.705650+0000","last_unstale":"2024-01-15T11:33:22.049911+0000","last_undegraded":"2024-01-15T11:33:22.049911+0000","last_fullsized":"2024-01-15T11:33:22.049911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:19:45.449255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.725680+0000","last_change":"2024-01-15T11:33:20.723707+0000","last_active":"2024-01-15T11:33:20.725680+0000","last_peered":"2024-01-15T11:33:20.725680+0000","last_clean":"2024-01-15T11:33:20.725680+0000","last_became_active":"2024-01-15T11:33:20.723420+0000","last_became_peered":"2024-01-15T11:33:20.723420+0000","last_unstale":"2024-01-15T11:33:20.725680+0000","last_undegraded":"2024-01-15T11:33:20.725680+0000","last_fullsized":"2024-01-15T11:33:20.725680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:10:17.455765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.050061+0000","last_change":"2024-01-15T11:33:19.707453+0000","last_active":"2024-01-15T11:33:22.050061+0000","last_peered":"2024-01-15T11:33:22.050061+0000","last_clean":"2024-01-15T11:33:22.050061+0000","last_became_active":"2024-01-15T11:33:19.707108+0000","last_became_peered":"2024-01-15T11:33:19.707108+0000","last_unstale":"2024-01-15T11:33:22.050061+0000","last_undegraded":"2024-01-15T11:33:22.050061+0000","last_fullsized":"2024-01-15T11:33:22.050061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:56:02.537685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.719779+0000","last_change":"2024-01-15T11:33:20.716694+0000","last_active":"2024-01-15T11:33:20.719779+0000","last_peered":"2024-01-15T11:33:20.719779+0000","last_clean":"2024-01-15T11:33:20.719779+0000","last_became_active":"2024-01-15T11:33:20.716405+0000","last_became_peered":"2024-01-15T11:33:20.716405+0000","last_unstale":"2024-01-15T11:33:20.719779+0000","last_undegraded":"2024-01-15T11:33:20.719779+0000","last_fullsized":"2024-01-15T11:33:20.719779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:59:58.594182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.778022+0000","last_change":"2024-01-15T11:33:19.690015+0000","last_active":"2024-01-15T11:33:20.778022+0000","last_peered":"2024-01-15T11:33:20.778022+0000","last_clean":"2024-01-15T11:33:20.778022+0000","last_became_active":"2024-01-15T11:33:19.688306+0000","last_became_peered":"2024-01-15T11:33:19.688306+0000","last_unstale":"2024-01-15T11:33:20.778022+0000","last_undegraded":"2024-01-15T11:33:20.778022+0000","last_fullsized":"2024-01-15T11:33:20.778022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:41:03.219134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.718709+0000","last_change":"2024-01-15T11:33:20.713812+0000","last_active":"2024-01-15T11:33:20.718709+0000","last_peered":"2024-01-15T11:33:20.718709+0000","last_clean":"2024-01-15T11:33:20.718709+0000","last_became_active":"2024-01-15T11:33:20.713505+0000","last_became_peered":"2024-01-15T11:33:20.713505+0000","last_unstale":"2024-01-15T11:33:20.718709+0000","last_undegraded":"2024-01-15T11:33:20.718709+0000","last_fullsized":"2024-01-15T11:33:20.718709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:04:03.414689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692650+0000","last_change":"2024-01-15T11:33:19.691915+0000","last_active":"2024-01-15T11:33:21.692650+0000","last_peered":"2024-01-15T11:33:21.692650+0000","last_clean":"2024-01-15T11:33:21.692650+0000","last_became_active":"2024-01-15T11:33:19.691570+0000","last_became_peered":"2024-01-15T11:33:19.691570+0000","last_unstale":"2024-01-15T11:33:21.692650+0000","last_undegraded":"2024-01-15T11:33:21.692650+0000","last_fullsized":"2024-01-15T11:33:21.692650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:28:16.778157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":69952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":72236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":70534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":71564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":660390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":660412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-15T11:33:25.269 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-15T11:33:25.270 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-15T11:33:25.270 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-01-15T11:33:25.270 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-01-15T11:33:25.270 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-01-15T11:33:25.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.447+0000 7f10ecb0f640 1 Processor -- start 2024-01-15T11:33:25.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.447+0000 7f10ecb0f640 1 -- start start 2024-01-15T11:33:25.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.447+0000 7f10ecb0f640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f10e80d1da0 0x7f10e80d3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:25.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.447+0000 7f10ecb0f640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e80ce1f0 con 0x7f10e81613a0 2024-01-15T11:33:25.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.447+0000 7f10ecb0f640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e80cea70 con 0x7f10e8160d00 2024-01-15T11:33:25.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.447+0000 7f10ecb0f640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e80cf610 con 0x7f10e80d1da0 2024-01-15T11:33:25.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.447+0000 7f10dffff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f10e80d1da0 0x7f10e80d3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:25.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.447+0000 7f10e6d9d640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f10e81613a0 0x7f10e81617c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:43928/0 (socket says 172.21.15.27:43928) 2024-01-15T11:33:25.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.447+0000 7f10e6d9d640 1 -- 172.21.15.27:0/3484542669 learned_addr learned my addr 172.21.15.27:0/3484542669 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:25.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.447+0000 7f10dffff640 1 -- 172.21.15.27:0/3484542669 >> v1:172.21.15.93:6789/0 conn(0x7f10e8160d00 legacy=0x7f10e80cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:25.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.447+0000 7f10dffff640 1 -- 172.21.15.27:0/3484542669 >> v1:172.21.15.27:6789/0 conn(0x7f10e81613a0 legacy=0x7f10e81617c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:25.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.447+0000 7f10e5d9b640 1 -- 172.21.15.27:0/3484542669 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68975428 0 0) 0x7f10e80ce1f0 con 0x7f10e81613a0 2024-01-15T11:33:25.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.447+0000 7f10dffff640 1 -- 172.21.15.27:0/3484542669 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e80d4380 con 0x7f10e80d1da0 2024-01-15T11:33:25.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.451+0000 7f10dffff640 1 --2- 172.21.15.27:0/3484542669 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10e80d1da0 0x7f10e80d3e40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f10d00097c0 tx=0x7f10d001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2f63745999ba91 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:25.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.451+0000 7f10e5d9b640 1 -- 172.21.15.27:0/3484542669 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d00a8970 con 0x7f10e80d1da0 2024-01-15T11:33:25.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.451+0000 7f10e5d9b640 1 -- 172.21.15.27:0/3484542669 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d00a8ad0 con 0x7f10e80d1da0 2024-01-15T11:33:25.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.451+0000 7f10e5d9b640 1 -- 172.21.15.27:0/3484542669 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d00a8e60 con 0x7f10e80d1da0 2024-01-15T11:33:25.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.451+0000 7f10ecb0f640 1 -- 172.21.15.27:0/3484542669 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10e80d1da0 msgr2=0x7f10e80d3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:25.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.451+0000 7f10ecb0f640 1 --2- 172.21.15.27:0/3484542669 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10e80d1da0 0x7f10e80d3e40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f10d00097c0 tx=0x7f10d001ec70 comp rx=0 tx=0).stop 2024-01-15T11:33:25.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.451+0000 7f10ecb0f640 1 -- 172.21.15.27:0/3484542669 shutdown_connections 2024-01-15T11:33:25.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.451+0000 7f10ecb0f640 1 --2- 172.21.15.27:0/3484542669 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10e80d1da0 0x7f10e80d3e40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:25.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.451+0000 7f10ecb0f640 1 -- 172.21.15.27:0/3484542669 >> 172.21.15.27:0/3484542669 conn(0x7f10e808afc0 msgr2=0x7f10e80d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:25.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.451+0000 7f10ecb0f640 1 -- 172.21.15.27:0/3484542669 shutdown_connections 2024-01-15T11:33:25.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.451+0000 7f10ecb0f640 1 -- 172.21.15.27:0/3484542669 wait complete. 2024-01-15T11:33:25.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.455+0000 7f10ecb0f640 1 Processor -- start 2024-01-15T11:33:25.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.455+0000 7f10ecb0f640 1 -- start start 2024-01-15T11:33:25.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.455+0000 7f10ecb0f640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f10e80d1da0 0x7f10e80ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:25.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.455+0000 7f10ecb0f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10e8160d00 0x7f10e81599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:25.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.455+0000 7f10ecb0f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10e81613a0 0x7f10e80b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:25.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.455+0000 7f10ecb0f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e8159f10 con 0x7f10e8160d00 2024-01-15T11:33:25.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.455+0000 7f10ecb0f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e80b52b0 con 0x7f10e81613a0 2024-01-15T11:33:25.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.455+0000 7f10ecb0f640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e80b46a0 con 0x7f10e80d1da0 2024-01-15T11:33:25.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.455+0000 7f10dffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10e8160d00 0x7f10e81599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:25.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.455+0000 7f10dffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10e8160d00 0x7f10e81599d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55256/0 (socket says 172.21.15.27:55256) 2024-01-15T11:33:25.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.455+0000 7f10dffff640 1 -- 172.21.15.27:0/3866388570 learned_addr learned my addr 172.21.15.27:0/3866388570 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:25.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.455+0000 7f10e659c640 1 --2- 172.21.15.27:0/3866388570 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f10e80d1da0 0x7f10e80ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:25.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.455+0000 7f10e6d9d640 1 --2- 172.21.15.27:0/3866388570 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10e81613a0 0x7f10e80b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:25.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.455+0000 7f10dffff640 1 -- 172.21.15.27:0/3866388570 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f10e80d1da0 msgr2=0x7f10e80ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:25.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.455+0000 7f10dffff640 1 --2- 172.21.15.27:0/3866388570 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f10e80d1da0 0x7f10e80ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:25.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.455+0000 7f10dffff640 1 -- 172.21.15.27:0/3866388570 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10e81613a0 msgr2=0x7f10e80b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:25.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.455+0000 7f10dffff640 1 --2- 172.21.15.27:0/3866388570 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10e81613a0 0x7f10e80b3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:25.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.455+0000 7f10dffff640 1 -- 172.21.15.27:0/3866388570 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d0009420 con 0x7f10e8160d00 2024-01-15T11:33:25.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.455+0000 7f10dffff640 1 --2- 172.21.15.27:0/3866388570 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10e8160d00 0x7f10e81599d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f10d00097c0 tx=0x7f10d001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:25.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.455+0000 7f10deffd640 1 -- 172.21.15.27:0/3866388570 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d00b9630 con 0x7f10e8160d00 2024-01-15T11:33:25.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.455+0000 7f10deffd640 1 -- 172.21.15.27:0/3866388570 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d00b97b0 con 0x7f10e8160d00 2024-01-15T11:33:25.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.455+0000 7f10deffd640 1 -- 172.21.15.27:0/3866388570 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d00b9b60 con 0x7f10e8160d00 2024-01-15T11:33:25.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.455+0000 7f10ecb0f640 1 -- 172.21.15.27:0/3866388570 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e80b4980 con 0x7f10e8160d00 2024-01-15T11:33:25.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.455+0000 7f10ecb0f640 1 -- 172.21.15.27:0/3866388570 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e80b4f40 con 0x7f10e8160d00 2024-01-15T11:33:25.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.459+0000 7f10ecb0f640 1 -- 172.21.15.27:0/3866388570 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e80b5460 con 0x7f10e8160d00 2024-01-15T11:33:25.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.459+0000 7f10deffd640 1 -- 172.21.15.27:0/3866388570 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f10d00b7040 con 0x7f10e8160d00 2024-01-15T11:33:25.462 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.459+0000 7f10deffd640 1 --2- 172.21.15.27:0/3866388570 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f10c80668f0 0x7f10c8068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:25.462 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.459+0000 7f10deffd640 1 -- 172.21.15.27:0/3866388570 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10d0122360 con 0x7f10e8160d00 2024-01-15T11:33:25.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.459+0000 7f10e659c640 1 --2- 172.21.15.27:0/3866388570 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f10c80668f0 0x7f10c8068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:25.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.459+0000 7f10e659c640 1 --2- 172.21.15.27:0/3866388570 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f10c80668f0 0x7f10c8068db0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f10d8007fd0 tx=0x7f10d8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:25.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.463+0000 7f10deffd640 1 -- 172.21.15.27:0/3866388570 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f10e80b5460 con 0x7f10e8160d00 2024-01-15T11:33:25.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.659+0000 7f10ecb0f640 1 -- 172.21.15.27:0/3866388570 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f10e80b5460 con 0x7f10e8160d00 2024-01-15T11:33:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.659+0000 7f10deffd640 1 -- 172.21.15.27:0/3866388570 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164947 (secure 0 0 0) 0x7f10e80b5460 con 0x7f10e8160d00 2024-01-15T11:33:25.665 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:25.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.663+0000 7f10ecb0f640 1 -- 172.21.15.27:0/3866388570 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f10c80668f0 msgr2=0x7f10c8068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:25.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.663+0000 7f10ecb0f640 1 --2- 172.21.15.27:0/3866388570 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f10c80668f0 0x7f10c8068db0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f10d8007fd0 tx=0x7f10d8009040 comp rx=0 tx=0).stop 2024-01-15T11:33:25.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.663+0000 7f10ecb0f640 1 -- 172.21.15.27:0/3866388570 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10e8160d00 msgr2=0x7f10e81599d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:25.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.663+0000 7f10ecb0f640 1 --2- 172.21.15.27:0/3866388570 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10e8160d00 0x7f10e81599d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f10d00097c0 tx=0x7f10d001ba10 comp rx=0 tx=0).stop 2024-01-15T11:33:25.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.663+0000 7f10ecb0f640 1 -- 172.21.15.27:0/3866388570 shutdown_connections 2024-01-15T11:33:25.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.663+0000 7f10ecb0f640 1 --2- 172.21.15.27:0/3866388570 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f10c80668f0 0x7f10c8068db0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:25.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.663+0000 7f10ecb0f640 1 --2- 172.21.15.27:0/3866388570 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10e81613a0 0x7f10e80b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:25.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.663+0000 7f10ecb0f640 1 --2- 172.21.15.27:0/3866388570 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10e8160d00 0x7f10e81599d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:25.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.663+0000 7f10ecb0f640 1 --2- 172.21.15.27:0/3866388570 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f10e80d1da0 0x7f10e80ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:25.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.663+0000 7f10ecb0f640 1 -- 172.21.15.27:0/3866388570 >> 172.21.15.27:0/3866388570 conn(0x7f10e808afc0 msgr2=0x7f10e815ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:25.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.663+0000 7f10ecb0f640 1 -- 172.21.15.27:0/3866388570 shutdown_connections 2024-01-15T11:33:25.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.663+0000 7f10ecb0f640 1 -- 172.21.15.27:0/3866388570 wait complete. 2024-01-15T11:33:25.686 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":5,"active_gid":4111,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":5213615},{"type":"v1","addr":"172.21.15.93:6833","nonce":5213615}]},"active_addr":"172.21.15.93:6833/5213615","active_change":"2024-01-15T11:33:00.052930+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"clone_delay_every_regfile":{"name":"clone_delay_every_regfile","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Sleep for specified seconds after copying a regfile","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"clone_delay_every_regfile":{"name":"clone_delay_every_regfile","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Sleep for specified seconds after copying a regfile","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.93:0","nonce":2213575474}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.93:0","nonce":345858623}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.93:0","nonce":665332444}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.93:0","nonce":2773543741}]}]} 2024-01-15T11:33:25.688 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-01-15T11:33:25.689 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-01-15T11:33:25.689 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:33:25.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.827+0000 7f63ac372640 1 Processor -- start 2024-01-15T11:33:25.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.827+0000 7f63ac372640 1 -- start start 2024-01-15T11:33:25.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.831+0000 7f63ac372640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f63a4143ae0 0x7f63a40b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:25.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.831+0000 7f63ac372640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f63a40adcc0 0x7f63a40ae110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:25.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.831+0000 7f63ac372640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a40b2480 con 0x7f63a406dfd0 2024-01-15T11:33:25.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.831+0000 7f63ac372640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a4070670 con 0x7f63a40adcc0 2024-01-15T11:33:25.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.831+0000 7f63ac372640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a4070950 con 0x7f63a4143ae0 2024-01-15T11:33:25.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.831+0000 7f63aa90f640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f63a40adcc0 0x7f63a40ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:25.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.831+0000 7f63a990d640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f63a406dfd0 0x7f63a406e410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:43940/0 (socket says 172.21.15.27:43940) 2024-01-15T11:33:25.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.831+0000 7f63a990d640 1 -- 172.21.15.27:0/3227463886 learned_addr learned my addr 172.21.15.27:0/3227463886 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:25.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.831+0000 7f63aa10e640 1 --2- 172.21.15.27:0/3227463886 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f63a4143ae0 0x7f63a40b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:25.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.831+0000 7f63aa90f640 1 -- 172.21.15.27:0/3227463886 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f63a4143ae0 msgr2=0x7f63a40b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:25.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.831+0000 7f63aa90f640 1 --2- 172.21.15.27:0/3227463886 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f63a4143ae0 0x7f63a40b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:25.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.831+0000 7f63aa90f640 1 -- 172.21.15.27:0/3227463886 >> v1:172.21.15.27:6789/0 conn(0x7f63a406dfd0 legacy=0x7f63a406e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:25.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.831+0000 7f63aa90f640 1 -- 172.21.15.27:0/3227463886 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a4070c30 con 0x7f63a40adcc0 2024-01-15T11:33:25.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.831+0000 7f63a910c640 1 -- 172.21.15.27:0/3227463886 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136187832 0 0) 0x7f63a40b2480 con 0x7f63a406dfd0 2024-01-15T11:33:25.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.835+0000 7f63aa90f640 1 --2- 172.21.15.27:0/3227463886 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63a40adcc0 0x7f63a40ae110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f639c009d90 tx=0x7f639c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1290bce3ee7f9a9a server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:25.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.835+0000 7f63a910c640 1 -- 172.21.15.27:0/3227463886 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c0a59e0 con 0x7f63a40adcc0 2024-01-15T11:33:25.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.835+0000 7f63a910c640 1 -- 172.21.15.27:0/3227463886 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639c0a5b40 con 0x7f63a40adcc0 2024-01-15T11:33:25.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.835+0000 7f63a910c640 1 -- 172.21.15.27:0/3227463886 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c0ad440 con 0x7f63a40adcc0 2024-01-15T11:33:25.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.835+0000 7f63ac372640 1 -- 172.21.15.27:0/3227463886 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63a40adcc0 msgr2=0x7f63a40ae110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:25.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.835+0000 7f63ac372640 1 --2- 172.21.15.27:0/3227463886 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63a40adcc0 0x7f63a40ae110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f639c009d90 tx=0x7f639c01c920 comp rx=0 tx=0).stop 2024-01-15T11:33:25.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.835+0000 7f63ac372640 1 -- 172.21.15.27:0/3227463886 shutdown_connections 2024-01-15T11:33:25.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.835+0000 7f63ac372640 1 --2- 172.21.15.27:0/3227463886 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63a40adcc0 0x7f63a40ae110 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:25.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.835+0000 7f63ac372640 1 --2- 172.21.15.27:0/3227463886 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f63a4143ae0 0x7f63a40b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:25.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.835+0000 7f63ac372640 1 -- 172.21.15.27:0/3227463886 >> 172.21.15.27:0/3227463886 conn(0x7f63a40b0c40 msgr2=0x7f63a40b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:25.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.835+0000 7f63ac372640 1 -- 172.21.15.27:0/3227463886 shutdown_connections 2024-01-15T11:33:25.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.835+0000 7f63ac372640 1 -- 172.21.15.27:0/3227463886 wait complete. 2024-01-15T11:33:25.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.835+0000 7f63ac372640 1 Processor -- start 2024-01-15T11:33:25.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.835+0000 7f63ac372640 1 -- start start 2024-01-15T11:33:25.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.839+0000 7f63ac372640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63a406dfd0 0x7f63a4161460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:25.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.839+0000 7f63ac372640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f63a40adcc0 0x7f63a4159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:25.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.839+0000 7f63ac372640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63a4143ae0 0x7f63a41599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:25.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.839+0000 7f63ac372640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a4159ee0 con 0x7f63a4143ae0 2024-01-15T11:33:25.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.839+0000 7f63ac372640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a413e620 con 0x7f63a406dfd0 2024-01-15T11:33:25.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.839+0000 7f63ac372640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a409b800 con 0x7f63a40adcc0 2024-01-15T11:33:25.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.839+0000 7f63aa90f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63a4143ae0 0x7f63a41599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:25.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.839+0000 7f63aa90f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63a4143ae0 0x7f63a41599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55262/0 (socket says 172.21.15.27:55262) 2024-01-15T11:33:25.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.839+0000 7f63aa90f640 1 -- 172.21.15.27:0/2977701099 learned_addr learned my addr 172.21.15.27:0/2977701099 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:25.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.839+0000 7f63aa10e640 1 --2- 172.21.15.27:0/2977701099 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63a406dfd0 0x7f63a4161460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:25.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.839+0000 7f63a990d640 1 --2- 172.21.15.27:0/2977701099 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f63a40adcc0 0x7f63a4159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:25.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.839+0000 7f63aa90f640 1 -- 172.21.15.27:0/2977701099 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f63a40adcc0 msgr2=0x7f63a4159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:25.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.839+0000 7f63aa90f640 1 --2- 172.21.15.27:0/2977701099 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f63a40adcc0 0x7f63a4159460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:25.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.839+0000 7f63aa90f640 1 -- 172.21.15.27:0/2977701099 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63a406dfd0 msgr2=0x7f63a4161460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:25.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.839+0000 7f63aa90f640 1 --2- 172.21.15.27:0/2977701099 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63a406dfd0 0x7f63a4161460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:25.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.839+0000 7f63aa90f640 1 -- 172.21.15.27:0/2977701099 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639c009a70 con 0x7f63a4143ae0 2024-01-15T11:33:25.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.839+0000 7f63aa10e640 1 --2- 172.21.15.27:0/2977701099 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63a406dfd0 0x7f63a4161460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:25.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.839+0000 7f63aa90f640 1 --2- 172.21.15.27:0/2977701099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63a4143ae0 0x7f63a41599a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f639c01afd0 tx=0x7f639c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:25.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.839+0000 7f639affd640 1 -- 172.21.15.27:0/2977701099 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c0add90 con 0x7f63a4143ae0 2024-01-15T11:33:25.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.839+0000 7f639affd640 1 -- 172.21.15.27:0/2977701099 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639c009450 con 0x7f63a4143ae0 2024-01-15T11:33:25.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.839+0000 7f639affd640 1 -- 172.21.15.27:0/2977701099 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c0b9670 con 0x7f63a4143ae0 2024-01-15T11:33:25.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.839+0000 7f63ac372640 1 -- 172.21.15.27:0/2977701099 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a409bae0 con 0x7f63a4143ae0 2024-01-15T11:33:25.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.839+0000 7f63ac372640 1 -- 172.21.15.27:0/2977701099 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a409c0a0 con 0x7f63a4143ae0 2024-01-15T11:33:25.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.839+0000 7f63ac372640 1 -- 172.21.15.27:0/2977701099 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a404e850 con 0x7f63a4143ae0 2024-01-15T11:33:25.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.839+0000 7f639affd640 1 -- 172.21.15.27:0/2977701099 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f639c0b97d0 con 0x7f63a4143ae0 2024-01-15T11:33:25.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.843+0000 7f639affd640 1 --2- 172.21.15.27:0/2977701099 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f63880668f0 0x7f6388068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:25.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.843+0000 7f639affd640 1 -- 172.21.15.27:0/2977701099 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f639c11fc90 con 0x7f63a4143ae0 2024-01-15T11:33:25.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.843+0000 7f63aa10e640 1 --2- 172.21.15.27:0/2977701099 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f63880668f0 0x7f6388068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:25.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.843+0000 7f63aa10e640 1 --2- 172.21.15.27:0/2977701099 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f63880668f0 0x7f6388068db0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f63a40b39e0 tx=0x7f63a0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:25.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:25.847+0000 7f639affd640 1 -- 172.21.15.27:0/2977701099 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f639c0ece30 con 0x7f63a4143ae0 2024-01-15T11:33:26.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.003+0000 7f63ac372640 1 -- 172.21.15.27:0/2977701099 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63a406cc40 con 0x7f63a4143ae0 2024-01-15T11:33:26.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.007+0000 7f639affd640 1 -- 172.21.15.27:0/2977701099 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16425 (secure 0 0 0) 0x7f639c0b2090 con 0x7f63a4143ae0 2024-01-15T11:33:26.009 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:26.009 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:33:21.682894+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T11:33:18.397200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T11:33:19.061383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:33:26.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.007+0000 7f63ac372640 1 -- 172.21.15.27:0/2977701099 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f63880668f0 msgr2=0x7f6388068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.007+0000 7f63ac372640 1 --2- 172.21.15.27:0/2977701099 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f63880668f0 0x7f6388068db0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f63a40b39e0 tx=0x7f63a0008040 comp rx=0 tx=0).stop 2024-01-15T11:33:26.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.007+0000 7f63ac372640 1 -- 172.21.15.27:0/2977701099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63a4143ae0 msgr2=0x7f63a41599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.007+0000 7f63ac372640 1 --2- 172.21.15.27:0/2977701099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63a4143ae0 0x7f63a41599a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f639c01afd0 tx=0x7f639c0196c0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.007+0000 7f63ac372640 1 -- 172.21.15.27:0/2977701099 shutdown_connections 2024-01-15T11:33:26.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.007+0000 7f63ac372640 1 --2- 172.21.15.27:0/2977701099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f63a4143ae0 0x7f63a41599a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.007+0000 7f63ac372640 1 --2- 172.21.15.27:0/2977701099 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f63a40adcc0 0x7f63a4159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.007+0000 7f63ac372640 1 --2- 172.21.15.27:0/2977701099 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f63880668f0 0x7f6388068db0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.007+0000 7f63ac372640 1 --2- 172.21.15.27:0/2977701099 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63a406dfd0 0x7f63a4161460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.007+0000 7f63ac372640 1 -- 172.21.15.27:0/2977701099 >> 172.21.15.27:0/2977701099 conn(0x7f63a40b0c40 msgr2=0x7f63a4141410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:26.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.007+0000 7f63ac372640 1 -- 172.21.15.27:0/2977701099 shutdown_connections 2024-01-15T11:33:26.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.007+0000 7f63ac372640 1 -- 172.21.15.27:0/2977701099 wait complete. 2024-01-15T11:33:26.029 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-01-15T11:33:26.029 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:33:26.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.167+0000 7f5bb9ee3640 1 Processor -- start 2024-01-15T11:33:26.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.171+0000 7f5bb9ee3640 1 -- start start 2024-01-15T11:33:26.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.171+0000 7f5bb9ee3640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5bb4143ae0 0x7f5bb40b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.171+0000 7f5bb9ee3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5bb406dfd0 0x7f5bb406e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.171+0000 7f5bb9ee3640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb406e980 con 0x7f5bb40adcc0 2024-01-15T11:33:26.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.171+0000 7f5bb9ee3640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb40ae7f0 con 0x7f5bb4143ae0 2024-01-15T11:33:26.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.171+0000 7f5bb9ee3640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb40b2480 con 0x7f5bb406dfd0 2024-01-15T11:33:26.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.171+0000 7f5bb37fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5bb4143ae0 0x7f5bb40b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.171+0000 7f5bb3fff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f5bb40adcc0 0x7f5bb40ae0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:43948/0 (socket says 172.21.15.27:43948) 2024-01-15T11:33:26.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.171+0000 7f5bb3fff640 1 -- 172.21.15.27:0/2691802520 learned_addr learned my addr 172.21.15.27:0/2691802520 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:26.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.171+0000 7f5bb2ffd640 1 --2- 172.21.15.27:0/2691802520 >> v2:172.21.15.93:3300/0 conn(0x7f5bb406dfd0 0x7f5bb406e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.171+0000 7f5bb27fc640 1 -- 172.21.15.27:0/2691802520 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 602934321 0 0) 0x7f5bb406e980 con 0x7f5bb40adcc0 2024-01-15T11:33:26.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.171+0000 7f5bb37fe640 1 -- 172.21.15.27:0/2691802520 >> v2:172.21.15.93:3300/0 conn(0x7f5bb406dfd0 msgr2=0x7f5bb406e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:26.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.171+0000 7f5bb37fe640 1 --2- 172.21.15.27:0/2691802520 >> v2:172.21.15.93:3300/0 conn(0x7f5bb406dfd0 0x7f5bb406e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.171+0000 7f5bb37fe640 1 -- 172.21.15.27:0/2691802520 >> v1:172.21.15.27:6789/0 conn(0x7f5bb40adcc0 legacy=0x7f5bb40ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.171+0000 7f5bb37fe640 1 -- 172.21.15.27:0/2691802520 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb4070670 con 0x7f5bb4143ae0 2024-01-15T11:33:26.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.175+0000 7f5bb37fe640 1 --2- 172.21.15.27:0/2691802520 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bb4143ae0 0x7f5bb40b1f40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5bb406cbe0 tx=0x7f5ba401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b85fa4ea3d23cba server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.175+0000 7f5bb27fc640 1 -- 172.21.15.27:0/2691802520 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba40a7070 con 0x7f5bb4143ae0 2024-01-15T11:33:26.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.175+0000 7f5bb27fc640 1 -- 172.21.15.27:0/2691802520 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba40ab430 con 0x7f5bb4143ae0 2024-01-15T11:33:26.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.175+0000 7f5bb27fc640 1 -- 172.21.15.27:0/2691802520 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba40ab7c0 con 0x7f5bb4143ae0 2024-01-15T11:33:26.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.175+0000 7f5bb9ee3640 1 -- 172.21.15.27:0/2691802520 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bb4143ae0 msgr2=0x7f5bb40b1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.175+0000 7f5bb9ee3640 1 --2- 172.21.15.27:0/2691802520 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bb4143ae0 0x7f5bb40b1f40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5bb406cbe0 tx=0x7f5ba401c430 comp rx=0 tx=0).stop 2024-01-15T11:33:26.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.175+0000 7f5bb9ee3640 1 -- 172.21.15.27:0/2691802520 shutdown_connections 2024-01-15T11:33:26.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.175+0000 7f5bb9ee3640 1 --2- 172.21.15.27:0/2691802520 >> v2:172.21.15.93:3300/0 conn(0x7f5bb406dfd0 0x7f5bb406e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.175+0000 7f5bb9ee3640 1 --2- 172.21.15.27:0/2691802520 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bb4143ae0 0x7f5bb40b1f40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.175+0000 7f5bb9ee3640 1 -- 172.21.15.27:0/2691802520 >> 172.21.15.27:0/2691802520 conn(0x7f5bb40b0c40 msgr2=0x7f5bb40b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:26.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.175+0000 7f5bb9ee3640 1 -- 172.21.15.27:0/2691802520 shutdown_connections 2024-01-15T11:33:26.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.175+0000 7f5bb9ee3640 1 -- 172.21.15.27:0/2691802520 wait complete. 2024-01-15T11:33:26.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.175+0000 7f5bb9ee3640 1 Processor -- start 2024-01-15T11:33:26.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.175+0000 7f5bb9ee3640 1 -- start start 2024-01-15T11:33:26.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5bb9ee3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bb406dfd0 0x7f5bb414bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5bb9ee3640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5bb40adcc0 0x7f5bb413c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5bb9ee3640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5bb4143ae0 0x7f5bb415ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5bb9ee3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb413d960 con 0x7f5bb406dfd0 2024-01-15T11:33:26.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5bb9ee3640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb413cd50 con 0x7f5bb4143ae0 2024-01-15T11:33:26.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5bb9ee3640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb413d030 con 0x7f5bb40adcc0 2024-01-15T11:33:26.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5bb37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bb406dfd0 0x7f5bb414bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5bb37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bb406dfd0 0x7f5bb414bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55268/0 (socket says 172.21.15.27:55268) 2024-01-15T11:33:26.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5bb37fe640 1 -- 172.21.15.27:0/2358675417 learned_addr learned my addr 172.21.15.27:0/2358675417 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:26.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5bb2ffd640 1 --2- 172.21.15.27:0/2358675417 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5bb40adcc0 0x7f5bb413c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5bb3fff640 1 --2- 172.21.15.27:0/2358675417 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5bb4143ae0 0x7f5bb415ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5bb37fe640 1 -- 172.21.15.27:0/2358675417 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5bb40adcc0 msgr2=0x7f5bb413c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5bb37fe640 1 --2- 172.21.15.27:0/2358675417 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5bb40adcc0 0x7f5bb413c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5bb37fe640 1 -- 172.21.15.27:0/2358675417 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5bb4143ae0 msgr2=0x7f5bb415ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5bb37fe640 1 --2- 172.21.15.27:0/2358675417 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5bb4143ae0 0x7f5bb415ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5bb37fe640 1 -- 172.21.15.27:0/2358675417 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba4009420 con 0x7f5bb406dfd0 2024-01-15T11:33:26.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5bb2ffd640 1 --2- 172.21.15.27:0/2358675417 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5bb40adcc0 0x7f5bb413c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:26.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5bb3fff640 1 --2- 172.21.15.27:0/2358675417 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5bb4143ae0 0x7f5bb415ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:26.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5bb37fe640 1 --2- 172.21.15.27:0/2358675417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bb406dfd0 0x7f5bb414bc00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5ba40ad040 tx=0x7f5ba401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5b9bfff640 1 -- 172.21.15.27:0/2358675417 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba40bf610 con 0x7f5bb406dfd0 2024-01-15T11:33:26.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5b9bfff640 1 -- 172.21.15.27:0/2358675417 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba40bf790 con 0x7f5bb406dfd0 2024-01-15T11:33:26.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5bb9ee3640 1 -- 172.21.15.27:0/2358675417 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb413d310 con 0x7f5bb406dfd0 2024-01-15T11:33:26.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5b9bfff640 1 -- 172.21.15.27:0/2358675417 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba40bfb40 con 0x7f5bb406dfd0 2024-01-15T11:33:26.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5bb9ee3640 1 -- 172.21.15.27:0/2358675417 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb414c140 con 0x7f5bb406dfd0 2024-01-15T11:33:26.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5bb9ee3640 1 -- 172.21.15.27:0/2358675417 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb404e850 con 0x7f5bb406dfd0 2024-01-15T11:33:26.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.179+0000 7f5b9bfff640 1 -- 172.21.15.27:0/2358675417 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f5ba40bfca0 con 0x7f5bb406dfd0 2024-01-15T11:33:26.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.183+0000 7f5b9bfff640 1 --2- 172.21.15.27:0/2358675417 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5ba0066920 0x7f5ba0068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.183+0000 7f5b9bfff640 1 -- 172.21.15.27:0/2358675417 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ba411eed0 con 0x7f5bb406dfd0 2024-01-15T11:33:26.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.183+0000 7f5bb2ffd640 1 --2- 172.21.15.27:0/2358675417 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5ba0066920 0x7f5ba0068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.183+0000 7f5bb2ffd640 1 --2- 172.21.15.27:0/2358675417 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5ba0066920 0x7f5ba0068de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5bb41f79f0 tx=0x7f5ba8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.187+0000 7f5b9bfff640 1 -- 172.21.15.27:0/2358675417 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5ba40ec070 con 0x7f5bb406dfd0 2024-01-15T11:33:26.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.347+0000 7f5bb9ee3640 1 -- 172.21.15.27:0/2358675417 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5bb406cc40 con 0x7f5bb406dfd0 2024-01-15T11:33:26.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.347+0000 7f5b9bfff640 1 -- 172.21.15.27:0/2358675417 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16425 (secure 0 0 0) 0x7f5ba40ef690 con 0x7f5bb406dfd0 2024-01-15T11:33:26.350 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:26.350 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:33:21.682894+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T11:33:18.397200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T11:33:19.061383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:33:26.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.347+0000 7f5bb9ee3640 1 -- 172.21.15.27:0/2358675417 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5ba0066920 msgr2=0x7f5ba0068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.347+0000 7f5bb9ee3640 1 --2- 172.21.15.27:0/2358675417 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5ba0066920 0x7f5ba0068de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5bb41f79f0 tx=0x7f5ba8008040 comp rx=0 tx=0).stop 2024-01-15T11:33:26.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.347+0000 7f5bb9ee3640 1 -- 172.21.15.27:0/2358675417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bb406dfd0 msgr2=0x7f5bb414bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.347+0000 7f5bb9ee3640 1 --2- 172.21.15.27:0/2358675417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bb406dfd0 0x7f5bb414bc00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5ba40ad040 tx=0x7f5ba401ac70 comp rx=0 tx=0).stop 2024-01-15T11:33:26.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.347+0000 7f5bb9ee3640 1 -- 172.21.15.27:0/2358675417 shutdown_connections 2024-01-15T11:33:26.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.347+0000 7f5bb9ee3640 1 --2- 172.21.15.27:0/2358675417 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5ba0066920 0x7f5ba0068de0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.347+0000 7f5bb9ee3640 1 --2- 172.21.15.27:0/2358675417 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5bb4143ae0 0x7f5bb415ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.347+0000 7f5bb9ee3640 1 --2- 172.21.15.27:0/2358675417 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5bb40adcc0 0x7f5bb413c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.347+0000 7f5bb9ee3640 1 --2- 172.21.15.27:0/2358675417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5bb406dfd0 0x7f5bb414bc00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.347+0000 7f5bb9ee3640 1 -- 172.21.15.27:0/2358675417 >> 172.21.15.27:0/2358675417 conn(0x7f5bb40b0c40 msgr2=0x7f5bb40ae0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:26.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.347+0000 7f5bb9ee3640 1 -- 172.21.15.27:0/2358675417 shutdown_connections 2024-01-15T11:33:26.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.347+0000 7f5bb9ee3640 1 -- 172.21.15.27:0/2358675417 wait complete. 2024-01-15T11:33:26.371 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-01-15T11:33:26.372 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-01-15T11:33:26.372 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-01-15T11:33:26.372 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-01-15T11:33:26.373 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-01-15T11:33:26.373 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-01-15T11:33:26.374 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-01-15T11:33:26.374 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-01-15T11:33:26.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.615+0000 7f17b2301640 1 Processor -- start 2024-01-15T11:33:26.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.615+0000 7fe2dec9c640 1 Processor -- start 2024-01-15T11:33:26.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.615+0000 7f17b2301640 1 -- start start 2024-01-15T11:33:26.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.615+0000 7fe2dec9c640 1 -- start start 2024-01-15T11:33:26.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.619+0000 7fe2dec9c640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe2d0055790 0x7fe2d0053e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.619+0000 7fe2dec9c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe2d00076a0 0x7fe2d00e2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.619+0000 7fe2dec9c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d0007210 con 0x7fe2d0006090 2024-01-15T11:33:26.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.619+0000 7fe2dec9c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d0037be0 con 0x7fe2d00076a0 2024-01-15T11:33:26.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.619+0000 7fe2dec9c640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d00068e0 con 0x7fe2d0055790 2024-01-15T11:33:26.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.619+0000 7f17b2301640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f17ac1595a0 0x7f17ac070470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.619+0000 7f17b2301640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ac0cd860 con 0x7f17ac159160 2024-01-15T11:33:26.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.619+0000 7f17b2301640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ac0ccc90 con 0x7f17ac06e920 2024-01-15T11:33:26.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.619+0000 7f17b2301640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac0ccf30 con 0x7f17ac1595a0 2024-01-15T11:33:26.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.619+0000 7f17b089e640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f17ac1595a0 0x7f17ac070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.619+0000 7f17b089e640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f17ac1595a0 0x7f17ac070470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:39904/0 (socket says 172.21.15.27:39904) 2024-01-15T11:33:26.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.619+0000 7f17b089e640 1 -- 172.21.15.27:0/3700422586 learned_addr learned my addr 172.21.15.27:0/3700422586 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:26.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.619+0000 7fe2dda3a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe2d00076a0 0x7fe2d00e2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.619+0000 7fe2dda3a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe2d00076a0 0x7fe2d00e2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:51886/0 (socket says 172.21.15.27:51886) 2024-01-15T11:33:26.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.619+0000 7fe2dda3a640 1 -- 172.21.15.27:0/1877809246 learned_addr learned my addr 172.21.15.27:0/1877809246 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:26.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.619+0000 7f17b089e640 1 -- 172.21.15.27:0/3700422586 >> v1:172.21.15.93:6789/0 conn(0x7f17ac06e920 legacy=0x7f17ac0b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:26.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.619+0000 7f17b089e640 1 -- 172.21.15.27:0/3700422586 >> v1:172.21.15.27:6789/0 conn(0x7f17ac159160 legacy=0x7f17ac0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:26.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.619+0000 7fe2dda3a640 1 -- 172.21.15.27:0/1877809246 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe2d0055790 msgr2=0x7fe2d0053e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:26.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.619+0000 7fe2dca38640 1 --2- 172.21.15.27:0/1877809246 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe2d0055790 0x7fe2d0053e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.619+0000 7f17b089e640 1 -- 172.21.15.27:0/3700422586 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ac0cd210 con 0x7f17ac1595a0 2024-01-15T11:33:26.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.619+0000 7fe2dda3a640 1 --2- 172.21.15.27:0/1877809246 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe2d0055790 0x7fe2d0053e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.619+0000 7fe2dda3a640 1 -- 172.21.15.27:0/1877809246 >> v1:172.21.15.93:6789/0 conn(0x7fe2d0006090 legacy=0x7fe2d00e2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.619+0000 7fe2dda3a640 1 -- 172.21.15.27:0/1877809246 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d0006bc0 con 0x7fe2d00076a0 2024-01-15T11:33:26.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.623+0000 7f17b089e640 1 --2- 172.21.15.27:0/3700422586 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f17ac1595a0 0x7f17ac070470 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009e80 tx=0x7f17a401f1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=175b891b179ecc6a server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.623+0000 7fe2dca38640 1 --2- 172.21.15.27:0/1877809246 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe2d0055790 0x7fe2d0053e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:33:26.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.623+0000 7f17aaffd640 1 -- 172.21.15.27:0/3700422586 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a40af400 con 0x7f17ac1595a0 2024-01-15T11:33:26.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.623+0000 7f17aaffd640 1 -- 172.21.15.27:0/3700422586 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a40ab050 con 0x7f17ac1595a0 2024-01-15T11:33:26.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.623+0000 7f17aaffd640 1 -- 172.21.15.27:0/3700422586 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a40af780 con 0x7f17ac1595a0 2024-01-15T11:33:26.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.627+0000 7fe2dda3a640 1 --2- 172.21.15.27:0/1877809246 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2d00076a0 0x7fe2d00e2da0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009870 tx=0x7fe2cc01ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ec1dbd337883dd8 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.627+0000 7f17b2301640 1 -- 172.21.15.27:0/3700422586 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f17ac1595a0 msgr2=0x7f17ac070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.627+0000 7f17b2301640 1 --2- 172.21.15.27:0/3700422586 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f17ac1595a0 0x7f17ac070470 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009e80 tx=0x7f17a401f1a0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.627+0000 7fbdd6832640 1 Processor -- start 2024-01-15T11:33:26.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.627+0000 7fe2d77fe640 1 -- 172.21.15.27:0/1877809246 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc0a8a70 con 0x7fe2d00076a0 2024-01-15T11:33:26.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.627+0000 7fe2d77fe640 1 -- 172.21.15.27:0/1877809246 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc0a8bd0 con 0x7fe2d00076a0 2024-01-15T11:33:26.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.627+0000 7fe2d77fe640 1 -- 172.21.15.27:0/1877809246 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc0b0440 con 0x7fe2d00076a0 2024-01-15T11:33:26.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.627+0000 7f17b2301640 1 -- 172.21.15.27:0/3700422586 shutdown_connections 2024-01-15T11:33:26.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.627+0000 7f17b2301640 1 --2- 172.21.15.27:0/3700422586 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f17ac1595a0 0x7f17ac070470 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.627+0000 7f17b2301640 1 -- 172.21.15.27:0/3700422586 >> 172.21.15.27:0/3700422586 conn(0x7f17ac06c340 msgr2=0x7f17ac06c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:26.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.627+0000 7f17b2301640 1 -- 172.21.15.27:0/3700422586 shutdown_connections 2024-01-15T11:33:26.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.627+0000 7f17b2301640 1 -- 172.21.15.27:0/3700422586 wait complete. 2024-01-15T11:33:26.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.627+0000 7fe2dec9c640 1 -- 172.21.15.27:0/1877809246 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2d00076a0 msgr2=0x7fe2d00e2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.627+0000 7fe2dec9c640 1 --2- 172.21.15.27:0/1877809246 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2d00076a0 0x7fe2d00e2da0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009870 tx=0x7fe2cc01ed70 comp rx=0 tx=0).stop 2024-01-15T11:33:26.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.627+0000 7fe2dec9c640 1 -- 172.21.15.27:0/1877809246 shutdown_connections 2024-01-15T11:33:26.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.627+0000 7fe2dec9c640 1 --2- 172.21.15.27:0/1877809246 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2d00076a0 0x7fe2d00e2da0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.627+0000 7fe2dec9c640 1 --2- 172.21.15.27:0/1877809246 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe2d0055790 0x7fe2d0053e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.627+0000 7fe2dec9c640 1 -- 172.21.15.27:0/1877809246 >> 172.21.15.27:0/1877809246 conn(0x7fe2d0054c70 msgr2=0x7fe2d0055080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:26.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.627+0000 7fe2dec9c640 1 -- 172.21.15.27:0/1877809246 shutdown_connections 2024-01-15T11:33:26.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.627+0000 7fe2dec9c640 1 -- 172.21.15.27:0/1877809246 wait complete. 2024-01-15T11:33:26.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.627+0000 7fbdd6832640 1 -- start start 2024-01-15T11:33:26.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.627+0000 7f17b2301640 1 Processor -- start 2024-01-15T11:33:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.627+0000 7fbdd6832640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbdd015d8f0 0x7fbdd015e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.627+0000 7fbdd6832640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbdd00ced30 0x7fbdd00cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7f17b2301640 1 -- start start 2024-01-15T11:33:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7fbdcffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbdd015d8f0 0x7fbdd015e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7fbdcffff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbdd015d8f0 0x7fbdd015e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:51892/0 (socket says 172.21.15.27:51892) 2024-01-15T11:33:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7fbdcffff640 1 -- 172.21.15.27:0/1324141833 learned_addr learned my addr 172.21.15.27:0/1324141833 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:26.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7fbdd6832640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd015ecc0 con 0x7fbdd00cf1e0 2024-01-15T11:33:26.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7fbdd6832640 1 -- 172.21.15.27:0/1324141833 --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd00d4420 con 0x7fbdd00ced30 2024-01-15T11:33:26.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7fbdd6832640 1 -- 172.21.15.27:0/1324141833 --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd00cdfb0 con 0x7fbdd015d8f0 2024-01-15T11:33:26.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7f90473a3640 1 Processor -- start 2024-01-15T11:33:26.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7fbdc7fff640 1 --2- 172.21.15.27:0/1324141833 >> v2:172.21.15.27:3300/0 conn(0x7fbdd00ced30 0x7fbdd00cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7fe2dec9c640 1 Processor -- start 2024-01-15T11:33:26.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7fe2dec9c640 1 -- start start 2024-01-15T11:33:26.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7fbdcffff640 1 -- 172.21.15.27:0/1324141833 >> v2:172.21.15.27:3300/0 conn(0x7fbdd00ced30 msgr2=0x7fbdd00cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:26.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7f17b2301640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17ac06e920 0x7f17ac168cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7f17b2301640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17ac159160 0x7f17ac15a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7f17b2301640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f17ac1595a0 0x7f17ac147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7f17b2301640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac16aee0 con 0x7f17ac159160 2024-01-15T11:33:26.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7fbdcffff640 1 --2- 172.21.15.27:0/1324141833 >> v2:172.21.15.27:3300/0 conn(0x7fbdd00ced30 0x7fbdd00cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7f17b2301640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac16b1c0 con 0x7f17ac06e920 2024-01-15T11:33:26.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7f17b2301640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac16b4a0 con 0x7f17ac1595a0 2024-01-15T11:33:26.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7f17abfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17ac06e920 0x7f17ac168cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7f17abfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17ac06e920 0x7f17ac168cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:51908/0 (socket says 172.21.15.27:51908) 2024-01-15T11:33:26.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7f17abfff640 1 -- 172.21.15.27:0/2331076504 learned_addr learned my addr 172.21.15.27:0/2331076504 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:26.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7fbdcffff640 1 -- 172.21.15.27:0/1324141833 >> v1:172.21.15.27:6789/0 conn(0x7fbdd00cf1e0 legacy=0x7fbdd00d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7f17abfff640 1 -- 172.21.15.27:0/2331076504 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f17ac1595a0 msgr2=0x7f17ac147e00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-15T11:33:26.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7f17abfff640 1 --2- 172.21.15.27:0/2331076504 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f17ac1595a0 0x7f17ac147e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7f17abfff640 1 -- 172.21.15.27:0/2331076504 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17ac159160 msgr2=0x7f17ac15a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7f17abfff640 1 --2- 172.21.15.27:0/2331076504 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f17ac159160 0x7f17ac15a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7f17abfff640 1 -- 172.21.15.27:0/2331076504 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a4009b30 con 0x7f17ac06e920 2024-01-15T11:33:26.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7fbdcffff640 1 -- 172.21.15.27:0/1324141833 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd00d4140 con 0x7fbdd015d8f0 2024-01-15T11:33:26.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7f17abfff640 1 --2- 172.21.15.27:0/2331076504 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17ac06e920 0x7f17ac168cd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f17a000c490 tx=0x7f17a0001e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7f17a8ff9640 1 -- 172.21.15.27:0/2331076504 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a0003600 con 0x7f17ac06e920 2024-01-15T11:33:26.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7f17a8ff9640 1 -- 172.21.15.27:0/2331076504 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a0003780 con 0x7f17ac06e920 2024-01-15T11:33:26.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7f17a8ff9640 1 -- 172.21.15.27:0/2331076504 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a0003b70 con 0x7f17ac06e920 2024-01-15T11:33:26.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7fbdc7fff640 1 --2- 172.21.15.27:0/1324141833 >> v2:172.21.15.27:3300/0 conn(0x7fbdd00ced30 0x7fbdd00cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:26.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7f17b2301640 1 -- 172.21.15.27:0/2331076504 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17ac16b780 con 0x7f17ac06e920 2024-01-15T11:33:26.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7f17b2301640 1 -- 172.21.15.27:0/2331076504 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17ac16a590 con 0x7f17ac06e920 2024-01-15T11:33:26.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.631+0000 7f90473a3640 1 -- start start 2024-01-15T11:33:26.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7f90473a3640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9040153800 0x7f9040071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7f90473a3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f90400b3cd0 0x7f904015a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7f90473a3640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f904006d8a0 0x7f904006dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7f90473a3640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9040072760 con 0x7f904006d8a0 2024-01-15T11:33:26.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7f90473a3640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f904006e200 con 0x7f90400b3cd0 2024-01-15T11:33:26.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7f90473a3640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90400ae970 con 0x7f9040153800 2024-01-15T11:33:26.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7fe2dec9c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2d0006090 0x7fe2d00cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7f9045ba0640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f90400b3cd0 0x7f904015a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7f9045ba0640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f90400b3cd0 0x7f904015a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:51910/0 (socket says 172.21.15.27:51910) 2024-01-15T11:33:26.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7f9045ba0640 1 -- 172.21.15.27:0/2174251710 learned_addr learned my addr 172.21.15.27:0/2174251710 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:26.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7f9046ba2640 1 --2- 172.21.15.27:0/2174251710 >> v2:172.21.15.27:3300/0 conn(0x7f904006d8a0 0x7f904006dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7f9046ba2640 1 -- 172.21.15.27:0/2174251710 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9040153800 msgr2=0x7f9040071b50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-15T11:33:26.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7f9046ba2640 1 --2- 172.21.15.27:0/2174251710 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9040153800 0x7f9040071b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7f9046ba2640 1 -- 172.21.15.27:0/2174251710 >> v2:172.21.15.93:3300/0 conn(0x7f90400b3cd0 msgr2=0x7f904015a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:26.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7f9046ba2640 1 --2- 172.21.15.27:0/2174251710 >> v2:172.21.15.93:3300/0 conn(0x7f90400b3cd0 0x7f904015a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7f9046ba2640 1 -- 172.21.15.27:0/2174251710 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90400721a0 con 0x7f904006d8a0 2024-01-15T11:33:26.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7fe2dec9c640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe2d00076a0 0x7fe2d002c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7fe2dec9c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2d0055790 0x7fe2d00cf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7fe2dec9c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d002d160 con 0x7fe2d0006090 2024-01-15T11:33:26.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7fe2dec9c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d00d1c50 con 0x7fe2d0055790 2024-01-15T11:33:26.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7fe2dec9c640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d002c8c0 con 0x7fe2d00076a0 2024-01-15T11:33:26.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7fe2d7fff640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe2d00076a0 0x7fe2d002c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7fe2d7fff640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe2d00076a0 0x7fe2d002c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:39928/0 (socket says 172.21.15.27:39928) 2024-01-15T11:33:26.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7fe2d7fff640 1 -- 172.21.15.27:0/2493120536 learned_addr learned my addr 172.21.15.27:0/2493120536 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:26.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7fe2dda3a640 1 --2- 172.21.15.27:0/2493120536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2d0055790 0x7fe2d00cf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7fe2dca38640 1 --2- 172.21.15.27:0/2493120536 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2d0006090 0x7fe2d00cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7f3d285e7640 1 Processor -- start 2024-01-15T11:33:26.643 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7fbdcffff640 1 --2- 172.21.15.27:0/1324141833 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbdd015d8f0 0x7fbdd015e780 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8009870 tx=0x7fbdb801c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfebcc066393c38e server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.643 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7f3d285e7640 1 -- start start 2024-01-15T11:33:26.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7fe2d7fff640 1 -- 172.21.15.27:0/2493120536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2d0055790 msgr2=0x7fe2d00cf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7fe2d7fff640 1 --2- 172.21.15.27:0/2493120536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2d0055790 0x7fe2d00cf380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7fe2d7fff640 1 -- 172.21.15.27:0/2493120536 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2d0006090 msgr2=0x7fe2d00cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7fe2d7fff640 1 --2- 172.21.15.27:0/2493120536 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe2d0006090 0x7fe2d00cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7fe2d7fff640 1 -- 172.21.15.27:0/2493120536 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc0094d0 con 0x7fe2d00076a0 2024-01-15T11:33:26.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7fe2dda3a640 1 --2- 172.21.15.27:0/2493120536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2d0055790 0x7fe2d00cf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:26.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7fe2d7fff640 1 --2- 172.21.15.27:0/2493120536 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe2d00076a0 0x7fe2d002c030 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400c500 tx=0x7fe2c400c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7fe2d57fa640 1 -- 172.21.15.27:0/2493120536 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c40052d0 con 0x7fe2d00076a0 2024-01-15T11:33:26.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7fe2d57fa640 1 -- 172.21.15.27:0/2493120536 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c4005450 con 0x7fe2d00076a0 2024-01-15T11:33:26.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7fe2d57fa640 1 -- 172.21.15.27:0/2493120536 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4012870 con 0x7fe2d00076a0 2024-01-15T11:33:26.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7fe2dec9c640 1 -- 172.21.15.27:0/2493120536 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d002cba0 con 0x7fe2d00076a0 2024-01-15T11:33:26.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7fe2dec9c640 1 -- 172.21.15.27:0/2493120536 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d00d1e60 con 0x7fe2d00076a0 2024-01-15T11:33:26.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7f17a8ff9640 1 -- 172.21.15.27:0/2331076504 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f17a0003cd0 con 0x7f17ac06e920 2024-01-15T11:33:26.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.635+0000 7f17b2301640 1 -- 172.21.15.27:0/2331076504 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f178c000fd0 con 0x7f17ac06e920 2024-01-15T11:33:26.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7f17a8ff9640 1 --2- 172.21.15.27:0/2331076504 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1798066940 0x7f1798068e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7f17a8ff9640 1 -- 172.21.15.27:0/2331076504 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17a00838c0 con 0x7f17ac06e920 2024-01-15T11:33:26.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7f4d6fae3640 1 Processor -- start 2024-01-15T11:33:26.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7fe2c2ffd640 1 -- 172.21.15.27:0/2493120536 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe2b0000fd0 con 0x7fe2d00076a0 2024-01-15T11:33:26.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7f17ab7fe640 1 --2- 172.21.15.27:0/2331076504 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1798066940 0x7f1798068e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7f17a8ff9640 1 --2- 172.21.15.27:0/2331076504 >> [v2:172.21.15.27:6808/4242255864,v1:172.21.15.27:6809/4242255864] conn(0x7f179806eae0 0x7f1798070f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7f17a8ff9640 1 -- 172.21.15.27:0/2331076504 --> [v2:172.21.15.27:6808/4242255864,v1:172.21.15.27:6809/4242255864] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f17980715b0 con 0x7f179806eae0 2024-01-15T11:33:26.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7f17ab7fe640 1 --2- 172.21.15.27:0/2331076504 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1798066940 0x7f1798068e00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f179c007fd0 tx=0x7f179c0079a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7f17a8ff9640 1 -- 172.21.15.27:0/2331076504 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17a0050c70 con 0x7f17ac06e920 2024-01-15T11:33:26.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7fbdcf7fe640 1 -- 172.21.15.27:0/1324141833 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb80aa430 con 0x7fbdd015d8f0 2024-01-15T11:33:26.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7fbdcf7fe640 1 -- 172.21.15.27:0/1324141833 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb80aa590 con 0x7fbdd015d8f0 2024-01-15T11:33:26.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7fbdcf7fe640 1 -- 172.21.15.27:0/1324141833 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb80aa920 con 0x7fbdd015d8f0 2024-01-15T11:33:26.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7f3d285e7640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3d20072630 0x7f3d200cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7fbdd6832640 1 -- 172.21.15.27:0/1324141833 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbdd015d8f0 msgr2=0x7fbdd015e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7fbdd6832640 1 --2- 172.21.15.27:0/1324141833 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbdd015d8f0 0x7fbdd015e780 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8009870 tx=0x7fbdb801c4d0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7f3d285e7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3d200b3e80 0x7f3d20070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7f4d6fae3640 1 -- start start 2024-01-15T11:33:26.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7f4d6fae3640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4d6815eee0 0x7f4d6815f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7f4d6fae3640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d6815f880 con 0x7f4d680d0950 2024-01-15T11:33:26.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7f4d6fae3640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d6815fcb0 con 0x7f4d68144d50 2024-01-15T11:33:26.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7f4d6fae3640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d680b5790 con 0x7f4d6815eee0 2024-01-15T11:33:26.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7fbdd6832640 1 -- 172.21.15.27:0/1324141833 shutdown_connections 2024-01-15T11:33:26.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7fbdd6832640 1 --2- 172.21.15.27:0/1324141833 >> v2:172.21.15.27:3300/0 conn(0x7fbdd00ced30 0x7fbdd00cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7fbdd6832640 1 --2- 172.21.15.27:0/1324141833 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbdd015d8f0 0x7fbdd015e780 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8009870 tx=0x7fbdb801c4d0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7fbdd6832640 1 -- 172.21.15.27:0/1324141833 >> 172.21.15.27:0/1324141833 conn(0x7fbdd009c750 msgr2=0x7fbdd00d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:26.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7f3d285e7640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d200cc2a0 con 0x7f3d200cbe60 2024-01-15T11:33:26.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7fe2d57fa640 1 -- 172.21.15.27:0/2493120536 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fe2c40129d0 con 0x7fe2d00076a0 2024-01-15T11:33:26.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7f3d285e7640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d200ccea0 con 0x7f3d200b3e80 2024-01-15T11:33:26.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7f3d285e7640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d200cd180 con 0x7f3d20072630 2024-01-15T11:33:26.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f3d26383640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3d20072630 0x7f3d200cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f3d26383640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3d20072630 0x7f3d200cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:39938/0 (socket says 172.21.15.27:39938) 2024-01-15T11:33:26.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7fbdd6832640 1 -- 172.21.15.27:0/1324141833 shutdown_connections 2024-01-15T11:33:26.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7fbdd6832640 1 -- 172.21.15.27:0/1324141833 wait complete. 2024-01-15T11:33:26.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f3d26383640 1 -- 172.21.15.27:0/662039416 learned_addr learned my addr 172.21.15.27:0/662039416 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:26.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.639+0000 7f4d6d87f640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f4d68144d50 0x7f4d680b4c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.27:37358/0 (socket says 172.21.15.27:37358) 2024-01-15T11:33:26.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f4d6d87f640 1 -- 172.21.15.27:0/835160611 learned_addr learned my addr 172.21.15.27:0/835160611 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:26.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f4d6d07e640 1 --2- 172.21.15.27:0/835160611 >> v2:172.21.15.27:3300/0 conn(0x7f4d6815eee0 0x7f4d6815f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f3d25b82640 1 --1- 172.21.15.27:0/662039416 >> v1:172.21.15.93:6789/0 conn(0x7f3d200cbe60 0x7f3d200b3770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.27:37370/0 (socket says 172.21.15.27:37370) 2024-01-15T11:33:26.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f4d6c87d640 1 -- 172.21.15.27:0/835160611 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113247826 0 0) 0x7f4d6815fcb0 con 0x7f4d68144d50 2024-01-15T11:33:26.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f17b089e640 1 --2- 172.21.15.27:0/2331076504 >> [v2:172.21.15.27:6808/4242255864,v1:172.21.15.27:6809/4242255864] conn(0x7f179806eae0 0x7f1798070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f3d25381640 1 -- 172.21.15.27:0/662039416 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540036509 0 0) 0x7f3d200cc2a0 con 0x7f3d200cbe60 2024-01-15T11:33:26.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f3d26b84640 1 --2- 172.21.15.27:0/662039416 >> v2:172.21.15.93:3300/0 conn(0x7f3d200b3e80 0x7f3d20070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f3d25381640 1 -- 172.21.15.27:0/662039416 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d0c003530 con 0x7f3d200cbe60 2024-01-15T11:33:26.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7fe2d57fa640 1 --2- 172.21.15.27:0/2493120536 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fe2bc066940 0x7fe2bc068e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f9046ba2640 1 --2- 172.21.15.27:0/2174251710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f904006d8a0 0x7f904006dcc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f90400b1c40 tx=0x7f9038020c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1abdfbe9f2d3ecb9 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f4d6c87d640 1 -- 172.21.15.27:0/835160611 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d54003530 con 0x7f4d68144d50 2024-01-15T11:33:26.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7fbcf8b5f640 1 Processor -- start 2024-01-15T11:33:26.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f4d6c87d640 1 -- 172.21.15.27:0/835160611 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1596364215 0 0) 0x7f4d6815f880 con 0x7f4d680d0950 2024-01-15T11:33:26.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7fe2dca38640 1 --2- 172.21.15.27:0/2493120536 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fe2bc066940 0x7fe2bc068e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f17b089e640 1 --2- 172.21.15.27:0/2331076504 >> [v2:172.21.15.27:6808/4242255864,v1:172.21.15.27:6809/4242255864] conn(0x7f179806eae0 0x7f1798070f00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f904539f640 1 -- 172.21.15.27:0/2174251710 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90380a9d00 con 0x7f904006d8a0 2024-01-15T11:33:26.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f4d6c87d640 1 -- 172.21.15.27:0/835160611 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d6815fcb0 con 0x7f4d680d0950 2024-01-15T11:33:26.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f4d6d07e640 1 -- 172.21.15.27:0/835160611 >> v1:172.21.15.93:6789/0 conn(0x7f4d68144d50 legacy=0x7f4d680b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f4d6d07e640 1 -- 172.21.15.27:0/835160611 >> v1:172.21.15.27:6789/0 conn(0x7f4d680d0950 legacy=0x7f4d680d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f4d6d07e640 1 -- 172.21.15.27:0/835160611 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d680b5a70 con 0x7f4d6815eee0 2024-01-15T11:33:26.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7fe2d57fa640 1 -- 172.21.15.27:0/2493120536 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2c4083d90 con 0x7fe2d00076a0 2024-01-15T11:33:26.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f904539f640 1 -- 172.21.15.27:0/2174251710 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90380a9e60 con 0x7f904006d8a0 2024-01-15T11:33:26.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f904539f640 1 -- 172.21.15.27:0/2174251710 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90380a9d00 con 0x7f904006d8a0 2024-01-15T11:33:26.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f3d26383640 1 -- 172.21.15.27:0/662039416 >> v2:172.21.15.93:3300/0 conn(0x7f3d200b3e80 msgr2=0x7f3d20070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:26.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f3d26383640 1 --2- 172.21.15.27:0/662039416 >> v2:172.21.15.93:3300/0 conn(0x7f3d200b3e80 0x7f3d20070690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f3d26383640 1 -- 172.21.15.27:0/662039416 >> v1:172.21.15.93:6789/0 conn(0x7f3d200cbe60 legacy=0x7f3d200b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f3d26383640 1 -- 172.21.15.27:0/662039416 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d200cd460 con 0x7f3d20072630 2024-01-15T11:33:26.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f008689a640 1 Processor -- start 2024-01-15T11:33:26.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7fbdd6832640 1 Processor -- start 2024-01-15T11:33:26.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7fe2dca38640 1 --2- 172.21.15.27:0/2493120536 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fe2bc066940 0x7fe2bc068e00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8064230 tx=0x7fe2d806d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7fbdd6832640 1 -- start start 2024-01-15T11:33:26.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7fe2d57fa640 1 --2- 172.21.15.27:0/2493120536 >> [v2:172.21.15.27:6800/35041065,v1:172.21.15.27:6801/35041065] conn(0x7fe2bc06eb60 0x7fe2bc070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7fe2d57fa640 1 -- 172.21.15.27:0/2493120536 --> [v2:172.21.15.27:6800/35041065,v1:172.21.15.27:6801/35041065] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe2bc071630 con 0x7fe2bc06eb60 2024-01-15T11:33:26.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7fbcf8b5f640 1 -- start start 2024-01-15T11:33:26.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7fe2d57fa640 1 -- 172.21.15.27:0/2493120536 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2c4086450 con 0x7fe2d00076a0 2024-01-15T11:33:26.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f90473a3640 1 -- 172.21.15.27:0/2174251710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f904006d8a0 msgr2=0x7f904006dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f90473a3640 1 --2- 172.21.15.27:0/2174251710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f904006d8a0 0x7f904006dcc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f90400b1c40 tx=0x7f9038020c90 comp rx=0 tx=0).stop 2024-01-15T11:33:26.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7f008689a640 1 -- start start 2024-01-15T11:33:26.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.643+0000 7fe2dda3a640 1 --2- 172.21.15.27:0/2493120536 >> [v2:172.21.15.27:6800/35041065,v1:172.21.15.27:6801/35041065] conn(0x7fe2bc06eb60 0x7fe2bc070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbcf8b5f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbcf414b090 0x7fbcf4165ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7f90473a3640 1 -- 172.21.15.27:0/2174251710 shutdown_connections 2024-01-15T11:33:26.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7f90473a3640 1 --2- 172.21.15.27:0/2174251710 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f904006d8a0 0x7f904006dcc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7f90473a3640 1 --2- 172.21.15.27:0/2174251710 >> v2:172.21.15.93:3300/0 conn(0x7f90400b3cd0 0x7f904015a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7f90473a3640 1 --2- 172.21.15.27:0/2174251710 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9040153800 0x7f9040071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7f90473a3640 1 -- 172.21.15.27:0/2174251710 >> 172.21.15.27:0/2174251710 conn(0x7f90400b0c20 msgr2=0x7f90400b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:26.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7f008689a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f00800b1fb0 0x7f00800b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbdd6832640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbdd00ced30 0x7fbdd00cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7f008689a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0080072280 0x7f00800b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7f008689a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00800cbd20 con 0x7f008015cc80 2024-01-15T11:33:26.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7f008689a640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00800b4260 con 0x7f0080072280 2024-01-15T11:33:26.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7f008689a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00800cc810 con 0x7f00800b1fb0 2024-01-15T11:33:26.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fe2dda3a640 1 --2- 172.21.15.27:0/2493120536 >> [v2:172.21.15.27:6800/35041065,v1:172.21.15.27:6801/35041065] conn(0x7fe2bc06eb60 0x7fe2bc070f80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7f90473a3640 1 -- 172.21.15.27:0/2174251710 shutdown_connections 2024-01-15T11:33:26.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbcf8b5f640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbcf4070b10 0x7fbcf406c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbcf8b5f640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf414b470 con 0x7fbcf406c250 2024-01-15T11:33:26.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbcf8b5f640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf406cc10 con 0x7fbcf414b090 2024-01-15T11:33:26.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbcf8b5f640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf4165a10 con 0x7fbcf4070b10 2024-01-15T11:33:26.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7f0084e37640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0080072280 0x7f00800b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7f007ffff640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f008015cc80 0x7f008006df60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.27:37380/0 (socket says 172.21.15.27:37380) 2024-01-15T11:33:26.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7f007ffff640 1 -- 172.21.15.27:0/293476865 learned_addr learned my addr 172.21.15.27:0/293476865 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:26.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7f007f7fe640 1 --2- 172.21.15.27:0/293476865 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f00800b1fb0 0x7f00800b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbcf3fff640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbcf4070b10 0x7fbcf406c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbcf3fff640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbcf4070b10 0x7fbcf406c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:39946/0 (socket says 172.21.15.27:39946) 2024-01-15T11:33:26.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbcf3fff640 1 -- 172.21.15.27:0/4292971182 learned_addr learned my addr 172.21.15.27:0/4292971182 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:26.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbcf37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbcf414b090 0x7fbcf4165ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbdd6832640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbdd00cf1e0 0x7fbdd00c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbdd6832640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbdd015a900 0x7fbdd0155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbdd6832640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd01577e0 con 0x7fbdd00ced30 2024-01-15T11:33:26.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbdd6832640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd00b42c0 con 0x7fbdd00cf1e0 2024-01-15T11:33:26.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbdd6832640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd00cb150 con 0x7fbdd015a900 2024-01-15T11:33:26.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7f90473a3640 1 -- 172.21.15.27:0/2174251710 wait complete. 2024-01-15T11:33:26.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fe2d57fa640 1 -- 172.21.15.27:0/2493120536 <== osd.0 v2:172.21.15.27:6800/35041065 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe2bc071630 con 0x7fe2bc06eb60 2024-01-15T11:33:26.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbdc7fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbdd00cf1e0 0x7fbdd00c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbdc7fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbdd00cf1e0 0x7fbdd00c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:51952/0 (socket says 172.21.15.27:51952) 2024-01-15T11:33:26.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbdc7fff640 1 -- 172.21.15.27:0/2290612635 learned_addr learned my addr 172.21.15.27:0/2290612635 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:26.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbdcffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbdd00ced30 0x7fbdd00cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7f007effd640 1 -- 172.21.15.27:0/293476865 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2645514358 0 0) 0x7f00800cbd20 con 0x7f008015cc80 2024-01-15T11:33:26.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7f007effd640 1 -- 172.21.15.27:0/293476865 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0068003530 con 0x7f008015cc80 2024-01-15T11:33:26.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7f0084e37640 1 -- 172.21.15.27:0/293476865 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f00800b1fb0 msgr2=0x7f00800b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:26.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7f0084e37640 1 --2- 172.21.15.27:0/293476865 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f00800b1fb0 0x7f00800b37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7f0084e37640 1 -- 172.21.15.27:0/293476865 >> v1:172.21.15.93:6789/0 conn(0x7f008015cc80 legacy=0x7f008006df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbdd4dcf640 1 --2- 172.21.15.27:0/2290612635 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbdd015a900 0x7fbdd0155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7f17a8ff9640 1 -- 172.21.15.27:0/2331076504 <== osd.1 v2:172.21.15.27:6808/4242255864 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f17980715b0 con 0x7f179806eae0 2024-01-15T11:33:26.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7f0084e37640 1 -- 172.21.15.27:0/293476865 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0080072960 con 0x7f0080072280 2024-01-15T11:33:26.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbdc7fff640 1 -- 172.21.15.27:0/2290612635 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbdd015a900 msgr2=0x7fbdd0155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbdc7fff640 1 --2- 172.21.15.27:0/2290612635 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbdd015a900 0x7fbdd0155d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbdc7fff640 1 -- 172.21.15.27:0/2290612635 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbdd00ced30 msgr2=0x7fbdd00cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbcf3fff640 1 -- 172.21.15.27:0/4292971182 >> v2:172.21.15.93:3300/0 conn(0x7fbcf414b090 msgr2=0x7fbcf4165ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:26.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbcf3fff640 1 --2- 172.21.15.27:0/4292971182 >> v2:172.21.15.93:3300/0 conn(0x7fbcf414b090 0x7fbcf4165ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbcf3fff640 1 -- 172.21.15.27:0/4292971182 >> v1:172.21.15.27:6789/0 conn(0x7fbcf406c250 legacy=0x7fbcf4070400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:26.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbcf3fff640 1 -- 172.21.15.27:0/4292971182 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf4071a70 con 0x7fbcf4070b10 2024-01-15T11:33:26.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbcf37fe640 1 --2- 172.21.15.27:0/4292971182 >> v2:172.21.15.93:3300/0 conn(0x7fbcf414b090 0x7fbcf4165ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:26.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbdc7fff640 1 --2- 172.21.15.27:0/2290612635 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbdd00ced30 0x7fbdd00cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbdc7fff640 1 -- 172.21.15.27:0/2290612635 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc0009420 con 0x7fbdd00cf1e0 2024-01-15T11:33:26.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.647+0000 7fbdd4dcf640 1 --2- 172.21.15.27:0/2290612635 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbdd015a900 0x7fbdd0155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:26.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7fbdcffff640 1 --2- 172.21.15.27:0/2290612635 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbdd00ced30 0x7fbdd00cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:26.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f4d6d07e640 1 --2- 172.21.15.27:0/835160611 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d6815eee0 0x7f4d6815f340 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4d580097c0 tx=0x7f4d58020820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7bcc1f993d577de server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f3d26383640 1 --2- 172.21.15.27:0/662039416 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3d20072630 0x7f3d200cb920 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3d10008870 tx=0x7f3d1001e9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e34a0ec2991f7b0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7fbdc7fff640 1 --2- 172.21.15.27:0/2290612635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbdd00cf1e0 0x7fbdd00c8b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbdc000e980 tx=0x7fbdc000ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f4d6c87d640 1 -- 172.21.15.27:0/835160611 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d680d1cc0 con 0x7f4d6815eee0 2024-01-15T11:33:26.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f4d6c87d640 1 -- 172.21.15.27:0/835160611 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d580a95e0 con 0x7f4d6815eee0 2024-01-15T11:33:26.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f4d6c87d640 1 -- 172.21.15.27:0/835160611 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d580a9970 con 0x7f4d6815eee0 2024-01-15T11:33:26.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f90473a3640 1 Processor -- start 2024-01-15T11:33:26.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f90473a3640 1 -- start start 2024-01-15T11:33:26.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f4d6fae3640 1 -- 172.21.15.27:0/835160611 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d6815eee0 msgr2=0x7f4d6815f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f4d6fae3640 1 --2- 172.21.15.27:0/835160611 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d6815eee0 0x7f4d6815f340 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4d580097c0 tx=0x7f4d58020820 comp rx=0 tx=0).stop 2024-01-15T11:33:26.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7fbdcd7fa640 1 -- 172.21.15.27:0/2290612635 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc000ca00 con 0x7fbdd00cf1e0 2024-01-15T11:33:26.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7fbdcd7fa640 1 -- 172.21.15.27:0/2290612635 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc000cb60 con 0x7fbdd00cf1e0 2024-01-15T11:33:26.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7fbdcd7fa640 1 -- 172.21.15.27:0/2290612635 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0013470 con 0x7fbdd00cf1e0 2024-01-15T11:33:26.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7fbdd6832640 1 -- 172.21.15.27:0/2290612635 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb80094d0 con 0x7fbdd00cf1e0 2024-01-15T11:33:26.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f4d6fae3640 1 -- 172.21.15.27:0/835160611 shutdown_connections 2024-01-15T11:33:26.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f4d6fae3640 1 --2- 172.21.15.27:0/835160611 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d6815eee0 0x7f4d6815f340 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f4d6fae3640 1 -- 172.21.15.27:0/835160611 >> 172.21.15.27:0/835160611 conn(0x7f4d680b2f10 msgr2=0x7f4d680b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:26.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7fbdd6832640 1 -- 172.21.15.27:0/2290612635 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd0157cf0 con 0x7fbdd00cf1e0 2024-01-15T11:33:26.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f90473a3640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f904006d8a0 0x7f9040143e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f3d25381640 1 -- 172.21.15.27:0/662039416 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d100a7a90 con 0x7f3d20072630 2024-01-15T11:33:26.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f3d25381640 1 -- 172.21.15.27:0/662039416 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d100ab070 con 0x7f3d20072630 2024-01-15T11:33:26.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f3d25381640 1 -- 172.21.15.27:0/662039416 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d100a7e10 con 0x7f3d20072630 2024-01-15T11:33:26.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f90473a3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90400b3cd0 0x7f904014d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f90473a3640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9040153800 0x7f904014bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f90463a1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f904006d8a0 0x7f9040143e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f90463a1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f904006d8a0 0x7f9040143e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:51954/0 (socket says 172.21.15.27:51954) 2024-01-15T11:33:26.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f9045ba0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90400b3cd0 0x7f904014d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f90463a1640 1 -- 172.21.15.27:0/2816636831 learned_addr learned my addr 172.21.15.27:0/2816636831 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:26.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f90473a3640 1 -- 172.21.15.27:0/2816636831 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904014ee50 con 0x7f90400b3cd0 2024-01-15T11:33:26.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f90473a3640 1 -- 172.21.15.27:0/2816636831 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904014e240 con 0x7f904006d8a0 2024-01-15T11:33:26.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f90473a3640 1 -- 172.21.15.27:0/2816636831 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904014e520 con 0x7f9040153800 2024-01-15T11:33:26.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f4d6fae3640 1 -- 172.21.15.27:0/835160611 shutdown_connections 2024-01-15T11:33:26.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7fbdd6832640 1 -- 172.21.15.27:0/2290612635 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbdd00b29b0 con 0x7fbdd00cf1e0 2024-01-15T11:33:26.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f3d285e7640 1 -- 172.21.15.27:0/662039416 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3d20072630 msgr2=0x7f3d200cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f3d285e7640 1 --2- 172.21.15.27:0/662039416 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3d20072630 0x7f3d200cb920 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3d10008870 tx=0x7f3d1001e9e0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f9046ba2640 1 --2- 172.21.15.27:0/2816636831 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9040153800 0x7f904014bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f3d285e7640 1 -- 172.21.15.27:0/662039416 shutdown_connections 2024-01-15T11:33:26.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f90463a1640 1 -- 172.21.15.27:0/2816636831 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9040153800 msgr2=0x7f904014bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f90463a1640 1 --2- 172.21.15.27:0/2816636831 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9040153800 0x7f904014bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f90463a1640 1 -- 172.21.15.27:0/2816636831 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90400b3cd0 msgr2=0x7f904014d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f90463a1640 1 --2- 172.21.15.27:0/2816636831 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90400b3cd0 0x7f904014d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f90463a1640 1 -- 172.21.15.27:0/2816636831 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903800f050 con 0x7f904006d8a0 2024-01-15T11:33:26.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f3d285e7640 1 --2- 172.21.15.27:0/662039416 >> v2:172.21.15.93:3300/0 conn(0x7f3d200b3e80 0x7f3d20070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f3d285e7640 1 --2- 172.21.15.27:0/662039416 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3d20072630 0x7f3d200cb920 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f3d285e7640 1 -- 172.21.15.27:0/662039416 >> 172.21.15.27:0/662039416 conn(0x7f3d200b0cb0 msgr2=0x7f3d200b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:26.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f4d6fae3640 1 -- 172.21.15.27:0/835160611 wait complete. 2024-01-15T11:33:26.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7f90463a1640 1 --2- 172.21.15.27:0/2816636831 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f904006d8a0 0x7f9040143e90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f903c00b3e0 tx=0x7f903c00b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f3d285e7640 1 -- 172.21.15.27:0/662039416 shutdown_connections 2024-01-15T11:33:26.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.651+0000 7f3d285e7640 1 -- 172.21.15.27:0/662039416 wait complete. 2024-01-15T11:33:26.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7f9036ffd640 1 -- 172.21.15.27:0/2816636831 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c011830 con 0x7f904006d8a0 2024-01-15T11:33:26.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7f9036ffd640 1 -- 172.21.15.27:0/2816636831 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c0119b0 con 0x7f904006d8a0 2024-01-15T11:33:26.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7f4d6fae3640 1 Processor -- start 2024-01-15T11:33:26.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7f0084e37640 1 --2- 172.21.15.27:0/293476865 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0080072280 0x7f00800b3d20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f007800bfa0 tx=0x7f007801eac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1cb41de6778a961 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7f9036ffd640 1 -- 172.21.15.27:0/2816636831 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c011d60 con 0x7f904006d8a0 2024-01-15T11:33:26.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7f90473a3640 1 -- 172.21.15.27:0/2816636831 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f904014e800 con 0x7f904006d8a0 2024-01-15T11:33:26.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7f90473a3640 1 -- 172.21.15.27:0/2816636831 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f904014f2e0 con 0x7f904006d8a0 2024-01-15T11:33:26.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7fbcf3fff640 1 --2- 172.21.15.27:0/4292971182 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbcf4070b10 0x7fbcf406c6d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbcec009e50 tx=0x7fbcec01c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb580a7f34d61b4f server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7fbdcd7fa640 1 -- 172.21.15.27:0/2290612635 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fbdc00135d0 con 0x7fbdd00cf1e0 2024-01-15T11:33:26.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7fbdcd7fa640 1 --2- 172.21.15.27:0/2290612635 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbdb00669c0 0x7fbdb0068e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7fbdcd7fa640 1 -- 172.21.15.27:0/2290612635 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbdc0084e90 con 0x7fbdd00cf1e0 2024-01-15T11:33:26.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7fbdcd7fa640 1 --2- 172.21.15.27:0/2290612635 >> [v2:172.21.15.27:6816/746325995,v1:172.21.15.27:6817/746325995] conn(0x7fbdb006ebe0 0x7fbdb0071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7fbdcd7fa640 1 -- 172.21.15.27:0/2290612635 --> [v2:172.21.15.27:6816/746325995,v1:172.21.15.27:6817/746325995] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbdb00716b0 con 0x7fbdb006ebe0 2024-01-15T11:33:26.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7fbdcd7fa640 1 -- 172.21.15.27:0/2290612635 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdc0085240 con 0x7fbdd00cf1e0 2024-01-15T11:33:26.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7f4d6fae3640 1 -- start start 2024-01-15T11:33:26.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7f007effd640 1 -- 172.21.15.27:0/293476865 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007800b2d0 con 0x7f0080072280 2024-01-15T11:33:26.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7f007effd640 1 -- 172.21.15.27:0/293476865 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00780a7880 con 0x7f0080072280 2024-01-15T11:33:26.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7f007effd640 1 -- 172.21.15.27:0/293476865 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00780a7c10 con 0x7f0080072280 2024-01-15T11:33:26.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7f90473a3640 1 -- 172.21.15.27:0/2816636831 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9040153be0 con 0x7f904006d8a0 2024-01-15T11:33:26.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7f3d285e7640 1 Processor -- start 2024-01-15T11:33:26.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7fbdcffff640 1 --2- 172.21.15.27:0/2290612635 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbdb00669c0 0x7fbdb0068e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7f3d285e7640 1 -- start start 2024-01-15T11:33:26.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7f008689a640 1 -- 172.21.15.27:0/293476865 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0080072280 msgr2=0x7f00800b3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7f008689a640 1 --2- 172.21.15.27:0/293476865 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0080072280 0x7f00800b3d20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f007800bfa0 tx=0x7f007801eac0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7fbdd4dcf640 1 --2- 172.21.15.27:0/2290612635 >> [v2:172.21.15.27:6816/746325995,v1:172.21.15.27:6817/746325995] conn(0x7fbdb006ebe0 0x7fbdb0071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7fbdcffff640 1 --2- 172.21.15.27:0/2290612635 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbdb00669c0 0x7fbdb0068e80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80ae000 tx=0x7fbdb80a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f9036ffd640 1 -- 172.21.15.27:0/2816636831 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f903c01a400 con 0x7f904006d8a0 2024-01-15T11:33:26.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7fbcf27fc640 1 -- 172.21.15.27:0/4292971182 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec0a5620 con 0x7fbcf4070b10 2024-01-15T11:33:26.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7fbcf27fc640 1 -- 172.21.15.27:0/4292971182 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcec0a5780 con 0x7fbcf4070b10 2024-01-15T11:33:26.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7f008689a640 1 -- 172.21.15.27:0/293476865 shutdown_connections 2024-01-15T11:33:26.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7fbcf27fc640 1 -- 172.21.15.27:0/4292971182 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec0a5b10 con 0x7fbcf4070b10 2024-01-15T11:33:26.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f4d6fae3640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d680d0950 0x7f4d68130a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f4d6fae3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d68144d50 0x7f4d681434d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f4d6fae3640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d6815eee0 0x7f4d68143a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f4d6fae3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6813b040 con 0x7f4d68144d50 2024-01-15T11:33:26.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f4d6fae3640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d68130fa0 con 0x7f4d6815eee0 2024-01-15T11:33:26.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f4d6fae3640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d68154060 con 0x7f4d680d0950 2024-01-15T11:33:26.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7f008689a640 1 --2- 172.21.15.27:0/293476865 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0080072280 0x7f00800b3d20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7f008689a640 1 --2- 172.21.15.27:0/293476865 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f00800b1fb0 0x7f00800b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.655+0000 7f008689a640 1 -- 172.21.15.27:0/293476865 >> 172.21.15.27:0/293476865 conn(0x7f00800b0cb0 msgr2=0x7f00800b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:26.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f008689a640 1 -- 172.21.15.27:0/293476865 shutdown_connections 2024-01-15T11:33:26.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f008689a640 1 -- 172.21.15.27:0/293476865 wait complete. 2024-01-15T11:33:26.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f3d285e7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d20072630 0x7f3d20143f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f3d285e7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d200b3e80 0x7f3d200ce700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f3d285e7640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3d200cbe60 0x7f3d200cec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f3d285e7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2009c8a0 con 0x7f3d20072630 2024-01-15T11:33:26.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f3d285e7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d20099d50 con 0x7f3d200b3e80 2024-01-15T11:33:26.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f3d285e7640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2009bd20 con 0x7f3d200cbe60 2024-01-15T11:33:26.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f4d6e080640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d6815eee0 0x7f4d68143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f4d6e080640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d6815eee0 0x7f4d68143a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:51966/0 (socket says 172.21.15.27:51966) 2024-01-15T11:33:26.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f4d6e080640 1 -- 172.21.15.27:0/55026869 learned_addr learned my addr 172.21.15.27:0/55026869 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:26.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f4d6d87f640 1 --2- 172.21.15.27:0/55026869 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d680d0950 0x7f4d68130a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7fbcf8b5f640 1 -- 172.21.15.27:0/4292971182 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbcf4070b10 msgr2=0x7fbcf406c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7fbcf8b5f640 1 --2- 172.21.15.27:0/4292971182 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbcf4070b10 0x7fbcf406c6d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbcec009e50 tx=0x7fbcec01c8d0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f3d26b84640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3d200cbe60 0x7f3d200cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f3d26383640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d20072630 0x7f3d20143f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f9036ffd640 1 --2- 172.21.15.27:0/2816636831 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9024066940 0x7f9024068e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f9036ffd640 1 -- 172.21.15.27:0/2816636831 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f903c084460 con 0x7f904006d8a0 2024-01-15T11:33:26.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f9045ba0640 1 --2- 172.21.15.27:0/2816636831 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9024066940 0x7f9024068e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f9036ffd640 1 --2- 172.21.15.27:0/2816636831 >> [v2:172.21.15.27:6824/1557364309,v1:172.21.15.27:6825/1557364309] conn(0x7f902406eb60 0x7f9024070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7fbcf8b5f640 1 -- 172.21.15.27:0/4292971182 shutdown_connections 2024-01-15T11:33:26.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7fbcf8b5f640 1 --2- 172.21.15.27:0/4292971182 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbcf4070b10 0x7fbcf406c6d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7fbcf8b5f640 1 --2- 172.21.15.27:0/4292971182 >> v2:172.21.15.93:3300/0 conn(0x7fbcf414b090 0x7fbcf4165ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7fbcf8b5f640 1 -- 172.21.15.27:0/4292971182 >> 172.21.15.27:0/4292971182 conn(0x7fbcf406df30 msgr2=0x7fbcf406a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:26.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7fbcf8b5f640 1 -- 172.21.15.27:0/4292971182 shutdown_connections 2024-01-15T11:33:26.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7fbcf8b5f640 1 -- 172.21.15.27:0/4292971182 wait complete. 2024-01-15T11:33:26.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f3d25b82640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d200b3e80 0x7f3d200ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f3d25b82640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d200b3e80 0x7f3d200ce700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:51976/0 (socket says 172.21.15.27:51976) 2024-01-15T11:33:26.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f3d25b82640 1 -- 172.21.15.27:0/3708901287 learned_addr learned my addr 172.21.15.27:0/3708901287 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:26.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f3d26b84640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3d200cbe60 0x7f3d200cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:39972/0 (socket says 172.21.15.27:39972) 2024-01-15T11:33:26.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f4d6e080640 1 -- 172.21.15.27:0/55026869 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d680d0950 msgr2=0x7f4d68130a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f4d6e080640 1 --2- 172.21.15.27:0/55026869 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d680d0950 0x7f4d68130a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f4d6e080640 1 -- 172.21.15.27:0/55026869 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d68144d50 msgr2=0x7f4d681434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f4d6e080640 1 --2- 172.21.15.27:0/55026869 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4d68144d50 0x7f4d681434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f4d6e080640 1 -- 172.21.15.27:0/55026869 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d58009420 con 0x7f4d6815eee0 2024-01-15T11:33:26.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f008689a640 1 Processor -- start 2024-01-15T11:33:26.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f9036ffd640 1 -- 172.21.15.27:0/2816636831 --> [v2:172.21.15.27:6824/1557364309,v1:172.21.15.27:6825/1557364309] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9024071630 con 0x7f902406eb60 2024-01-15T11:33:26.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f9036ffd640 1 -- 172.21.15.27:0/2816636831 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f903c086a40 con 0x7f904006d8a0 2024-01-15T11:33:26.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f3d25b82640 1 -- 172.21.15.27:0/3708901287 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3d200cbe60 msgr2=0x7f3d200cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f3d25b82640 1 --2- 172.21.15.27:0/3708901287 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3d200cbe60 0x7f3d200cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f3d25b82640 1 -- 172.21.15.27:0/3708901287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d20072630 msgr2=0x7f3d20143f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f3d25b82640 1 --2- 172.21.15.27:0/3708901287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3d20072630 0x7f3d20143f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f3d25b82640 1 -- 172.21.15.27:0/3708901287 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d10008550 con 0x7f3d200b3e80 2024-01-15T11:33:26.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f008689a640 1 -- start start 2024-01-15T11:33:26.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7fbdd4dcf640 1 --2- 172.21.15.27:0/2290612635 >> [v2:172.21.15.27:6816/746325995,v1:172.21.15.27:6817/746325995] conn(0x7fbdb006ebe0 0x7fbdb0071000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f9045ba0640 1 --2- 172.21.15.27:0/2816636831 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9024066940 0x7f9024068e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f90400cdff0 tx=0x7f903000b260 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f3d25b82640 1 --2- 172.21.15.27:0/3708901287 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d200b3e80 0x7f3d200ce700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c00c390 tx=0x7f3d1c00c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f4d6e080640 1 --2- 172.21.15.27:0/55026869 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d6815eee0 0x7f4d68143a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000c810 tx=0x7f4d6000ccd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.659+0000 7f4d5e7fc640 1 -- 172.21.15.27:0/55026869 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60003db0 con 0x7f4d6815eee0 2024-01-15T11:33:26.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f4d5e7fc640 1 -- 172.21.15.27:0/55026869 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d60005070 con 0x7f4d6815eee0 2024-01-15T11:33:26.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f4d5e7fc640 1 -- 172.21.15.27:0/55026869 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60005440 con 0x7f4d6815eee0 2024-01-15T11:33:26.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f3d16ffd640 1 -- 172.21.15.27:0/3708901287 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c0074e0 con 0x7f3d200b3e80 2024-01-15T11:33:26.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f4d6fae3640 1 -- 172.21.15.27:0/55026869 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6813edd0 con 0x7f4d6815eee0 2024-01-15T11:33:26.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f4d6fae3640 1 -- 172.21.15.27:0/55026869 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6813f390 con 0x7f4d6815eee0 2024-01-15T11:33:26.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f008689a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0080072280 0x7f0080148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f008689a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f00800b1fb0 0x7f0080159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f008689a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f008015cc80 0x7f008015a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7fbdcd7fa640 1 -- 172.21.15.27:0/2290612635 <== osd.2 v2:172.21.15.27:6816/746325995 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fbdb00716b0 con 0x7fbdb006ebe0 2024-01-15T11:33:26.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f3d16ffd640 1 -- 172.21.15.27:0/3708901287 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1c007640 con 0x7f3d200b3e80 2024-01-15T11:33:26.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f3d16ffd640 1 -- 172.21.15.27:0/3708901287 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c004a30 con 0x7f3d200b3e80 2024-01-15T11:33:26.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f3d285e7640 1 -- 172.21.15.27:0/3708901287 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d2009c000 con 0x7f3d200b3e80 2024-01-15T11:33:26.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f3d285e7640 1 -- 172.21.15.27:0/3708901287 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d2009c5c0 con 0x7f3d200b3e80 2024-01-15T11:33:26.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f9046ba2640 1 --2- 172.21.15.27:0/2816636831 >> [v2:172.21.15.27:6824/1557364309,v1:172.21.15.27:6825/1557364309] conn(0x7f902406eb60 0x7f9024070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7fbcf8b5f640 1 Processor -- start 2024-01-15T11:33:26.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f008689a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008014f700 con 0x7f0080072280 2024-01-15T11:33:26.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f008689a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008014b060 con 0x7f008015cc80 2024-01-15T11:33:26.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f008689a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0080149fc0 con 0x7f00800b1fb0 2024-01-15T11:33:26.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f007ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0080072280 0x7f0080148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f007ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0080072280 0x7f0080148b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55346/0 (socket says 172.21.15.27:55346) 2024-01-15T11:33:26.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f007ffff640 1 -- 172.21.15.27:0/2314272043 learned_addr learned my addr 172.21.15.27:0/2314272043 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:26.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f0084e37640 1 --2- 172.21.15.27:0/2314272043 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f008015cc80 0x7f008015a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f4d6fae3640 1 -- 172.21.15.27:0/55026869 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4d680b5330 con 0x7f4d6815eee0 2024-01-15T11:33:26.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f0084e37640 1 -- 172.21.15.27:0/2314272043 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f00800b1fb0 msgr2=0x7f0080159b80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-15T11:33:26.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f0084e37640 1 --2- 172.21.15.27:0/2314272043 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f00800b1fb0 0x7f0080159b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f0084e37640 1 -- 172.21.15.27:0/2314272043 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0080072280 msgr2=0x7f0080148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f0084e37640 1 --2- 172.21.15.27:0/2314272043 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0080072280 0x7f0080148b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f0084e37640 1 -- 172.21.15.27:0/2314272043 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007800bc80 con 0x7f008015cc80 2024-01-15T11:33:26.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f0084e37640 1 --2- 172.21.15.27:0/2314272043 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f008015cc80 0x7f008015a0c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f008006bf40 tx=0x7f007801b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f007cff9640 1 -- 172.21.15.27:0/2314272043 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00780bd070 con 0x7f008015cc80 2024-01-15T11:33:26.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f007cff9640 1 -- 172.21.15.27:0/2314272043 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00780a7c80 con 0x7f008015cc80 2024-01-15T11:33:26.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f007cff9640 1 -- 172.21.15.27:0/2314272043 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078009540 con 0x7f008015cc80 2024-01-15T11:33:26.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7fbcf8b5f640 1 -- start start 2024-01-15T11:33:26.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f9046ba2640 1 --2- 172.21.15.27:0/2816636831 >> [v2:172.21.15.27:6824/1557364309,v1:172.21.15.27:6825/1557364309] conn(0x7f902406eb60 0x7f9024070f80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f008689a640 1 -- 172.21.15.27:0/2314272043 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008014a2a0 con 0x7f008015cc80 2024-01-15T11:33:26.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f008689a640 1 -- 172.21.15.27:0/2314272043 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f008014a860 con 0x7f008015cc80 2024-01-15T11:33:26.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.667+0000 7f9036ffd640 1 -- 172.21.15.27:0/2816636831 <== osd.3 v2:172.21.15.27:6824/1557364309 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9024071630 con 0x7f902406eb60 2024-01-15T11:33:26.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.667+0000 7f00667fc640 1 -- 172.21.15.27:0/2314272043 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0058000fd0 con 0x7f008015cc80 2024-01-15T11:33:26.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f3d285e7640 1 -- 172.21.15.27:0/3708901287 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3d08000fd0 con 0x7f3d200b3e80 2024-01-15T11:33:26.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.663+0000 7f4d5e7fc640 1 -- 172.21.15.27:0/55026869 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f4d600055a0 con 0x7f4d6815eee0 2024-01-15T11:33:26.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.667+0000 7f4d5e7fc640 1 --2- 172.21.15.27:0/55026869 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4d4c0669c0 0x7f4d4c068e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.667+0000 7f4d5e7fc640 1 -- 172.21.15.27:0/55026869 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d60083e40 con 0x7f4d6815eee0 2024-01-15T11:33:26.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.667+0000 7f4d5e7fc640 1 --2- 172.21.15.27:0/55026869 >> [v2:172.21.15.93:6816/2052561323,v1:172.21.15.93:6817/2052561323] conn(0x7f4d4c06eb60 0x7f4d4c070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.667+0000 7f4d5e7fc640 1 -- 172.21.15.27:0/55026869 --> [v2:172.21.15.93:6816/2052561323,v1:172.21.15.93:6817/2052561323] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d4c071630 con 0x7f4d4c06eb60 2024-01-15T11:33:26.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.667+0000 7f4d5e7fc640 1 -- 172.21.15.27:0/55026869 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d60005850 con 0x7f4d6815eee0 2024-01-15T11:33:26.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.667+0000 7fbcf8b5f640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbcf406c250 0x7fbcf40aae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.667+0000 7fbcf8b5f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbcf4070b10 0x7fbcf41456b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.667+0000 7fbcf8b5f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbcf414b090 0x7fbcf4145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.667+0000 7fbcf37fe640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbcf406c250 0x7fbcf40aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.667+0000 7fbcf37fe640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbcf406c250 0x7fbcf40aae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:40000/0 (socket says 172.21.15.27:40000) 2024-01-15T11:33:26.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.667+0000 7fbcf37fe640 1 -- 172.21.15.27:0/1894696192 learned_addr learned my addr 172.21.15.27:0/1894696192 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:26.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.667+0000 7fbcf8b5f640 1 -- 172.21.15.27:0/1894696192 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf4145220 con 0x7fbcf414b090 2024-01-15T11:33:26.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.667+0000 7fbcf8b5f640 1 -- 172.21.15.27:0/1894696192 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf40adc40 con 0x7fbcf4070b10 2024-01-15T11:33:26.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.667+0000 7fbcf3fff640 1 --2- 172.21.15.27:0/1894696192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbcf414b090 0x7fbcf4145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.667+0000 7fbcf2ffd640 1 --2- 172.21.15.27:0/1894696192 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbcf4070b10 0x7fbcf41456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.667+0000 7fbcf8b5f640 1 -- 172.21.15.27:0/1894696192 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf40adf20 con 0x7fbcf406c250 2024-01-15T11:33:26.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.667+0000 7fbcf2ffd640 1 -- 172.21.15.27:0/1894696192 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbcf406c250 msgr2=0x7fbcf40aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.667+0000 7fbcf2ffd640 1 --2- 172.21.15.27:0/1894696192 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbcf406c250 0x7fbcf40aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.667+0000 7fbcf2ffd640 1 -- 172.21.15.27:0/1894696192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbcf414b090 msgr2=0x7fbcf4145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.667+0000 7fbcf2ffd640 1 --2- 172.21.15.27:0/1894696192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbcf414b090 0x7fbcf4145bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.667+0000 7fbcf2ffd640 1 -- 172.21.15.27:0/1894696192 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce4009420 con 0x7fbcf4070b10 2024-01-15T11:33:26.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.667+0000 7f3d16ffd640 1 -- 172.21.15.27:0/3708901287 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f3d1c004b90 con 0x7f3d200b3e80 2024-01-15T11:33:26.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7f4d6d87f640 1 --2- 172.21.15.27:0/55026869 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4d4c0669c0 0x7f4d4c068e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7f4d6d07e640 1 --2- 172.21.15.27:0/55026869 >> [v2:172.21.15.93:6816/2052561323,v1:172.21.15.93:6817/2052561323] conn(0x7f4d4c06eb60 0x7f4d4c070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7f007cff9640 1 -- 172.21.15.27:0/2314272043 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f00780096c0 con 0x7f008015cc80 2024-01-15T11:33:26.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7f4d6d87f640 1 --2- 172.21.15.27:0/55026869 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4d4c0669c0 0x7f4d4c068e80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4d64005890 tx=0x7f4d64009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7f3d16ffd640 1 --2- 172.21.15.27:0/3708901287 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3d040668f0 0x7f3d04068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7f3d16ffd640 1 -- 172.21.15.27:0/3708901287 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d1c083d70 con 0x7f3d200b3e80 2024-01-15T11:33:26.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7f3d16ffd640 1 --2- 172.21.15.27:0/3708901287 >> [v2:172.21.15.93:6800/1055846984,v1:172.21.15.93:6801/1055846984] conn(0x7f3d0406ea90 0x7f3d04070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7f3d16ffd640 1 -- 172.21.15.27:0/3708901287 --> [v2:172.21.15.93:6800/1055846984,v1:172.21.15.93:6801/1055846984] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3d04071560 con 0x7f3d0406ea90 2024-01-15T11:33:26.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7f3d16ffd640 1 -- 172.21.15.27:0/3708901287 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d1c051060 con 0x7f3d200b3e80 2024-01-15T11:33:26.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7fbcf2ffd640 1 --2- 172.21.15.27:0/1894696192 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbcf4070b10 0x7fbcf41456b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbce800c3e0 tx=0x7fbce800c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7fbcdbfff640 1 -- 172.21.15.27:0/1894696192 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce8011790 con 0x7fbcf4070b10 2024-01-15T11:33:26.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7fbcdbfff640 1 -- 172.21.15.27:0/1894696192 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce80118f0 con 0x7fbcf4070b10 2024-01-15T11:33:26.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7fbcdbfff640 1 -- 172.21.15.27:0/1894696192 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce8011ce0 con 0x7fbcf4070b10 2024-01-15T11:33:26.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7fbcf8b5f640 1 -- 172.21.15.27:0/1894696192 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcec009b30 con 0x7fbcf4070b10 2024-01-15T11:33:26.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7fbcf8b5f640 1 -- 172.21.15.27:0/1894696192 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf4144eb0 con 0x7fbcf4070b10 2024-01-15T11:33:26.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7f4d6d07e640 1 --2- 172.21.15.27:0/55026869 >> [v2:172.21.15.93:6816/2052561323,v1:172.21.15.93:6817/2052561323] conn(0x7f4d4c06eb60 0x7f4d4c070f80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7f3d26383640 1 --2- 172.21.15.27:0/3708901287 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3d040668f0 0x7f3d04068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7f3d26b84640 1 --2- 172.21.15.27:0/3708901287 >> [v2:172.21.15.93:6800/1055846984,v1:172.21.15.93:6801/1055846984] conn(0x7f3d0406ea90 0x7f3d04070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7fbcf8b5f640 1 -- 172.21.15.27:0/1894696192 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbcf40ce8f0 con 0x7fbcf4070b10 2024-01-15T11:33:26.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7f3d26b84640 1 --2- 172.21.15.27:0/3708901287 >> [v2:172.21.15.93:6800/1055846984,v1:172.21.15.93:6801/1055846984] conn(0x7f3d0406ea90 0x7f3d04070eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7f007cff9640 1 --2- 172.21.15.27:0/2314272043 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f006c0668f0 0x7f006c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7f4d5e7fc640 1 -- 172.21.15.27:0/55026869 <== osd.6 v2:172.21.15.93:6816/2052561323 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4d4c071630 con 0x7f4d4c06eb60 2024-01-15T11:33:26.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7f3d26383640 1 --2- 172.21.15.27:0/3708901287 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3d040668f0 0x7f3d04068db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3d100b2000 tx=0x7f3d1000a040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7f007cff9640 1 -- 172.21.15.27:0/2314272043 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f007811f0b0 con 0x7f008015cc80 2024-01-15T11:33:26.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7f007cff9640 1 --2- 172.21.15.27:0/2314272043 >> [v2:172.21.15.93:6824/2215132622,v1:172.21.15.93:6825/2215132622] conn(0x7f006c06ea90 0x7f006c070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.671+0000 7f007cff9640 1 -- 172.21.15.27:0/2314272043 --> [v2:172.21.15.93:6824/2215132622,v1:172.21.15.93:6825/2215132622] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f006c071560 con 0x7f006c06ea90 2024-01-15T11:33:26.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.675+0000 7f007cff9640 1 -- 172.21.15.27:0/2314272043 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f007811da00 con 0x7f008015cc80 2024-01-15T11:33:26.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.675+0000 7f007ffff640 1 --2- 172.21.15.27:0/2314272043 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f006c0668f0 0x7f006c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.675+0000 7f007f7fe640 1 --2- 172.21.15.27:0/2314272043 >> [v2:172.21.15.93:6824/2215132622,v1:172.21.15.93:6825/2215132622] conn(0x7f006c06ea90 0x7f006c070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.675+0000 7f3d16ffd640 1 -- 172.21.15.27:0/3708901287 <== osd.5 v2:172.21.15.93:6800/1055846984 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3d04071560 con 0x7f3d0406ea90 2024-01-15T11:33:26.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.675+0000 7f007ffff640 1 --2- 172.21.15.27:0/2314272043 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f006c0668f0 0x7f006c068db0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0070005030 tx=0x7f0070004eb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.675+0000 7f007f7fe640 1 --2- 172.21.15.27:0/2314272043 >> [v2:172.21.15.93:6824/2215132622,v1:172.21.15.93:6825/2215132622] conn(0x7f006c06ea90 0x7f006c070eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.675+0000 7fbcdbfff640 1 -- 172.21.15.27:0/1894696192 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fbce801c460 con 0x7fbcf4070b10 2024-01-15T11:33:26.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.675+0000 7fbcdbfff640 1 --2- 172.21.15.27:0/1894696192 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbce00669c0 0x7fbce0068e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.675+0000 7fbcf37fe640 1 --2- 172.21.15.27:0/1894696192 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbce00669c0 0x7fbce0068e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.675+0000 7fbcdbfff640 1 -- 172.21.15.27:0/1894696192 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbce80841c0 con 0x7fbcf4070b10 2024-01-15T11:33:26.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.675+0000 7fbcdbfff640 1 --2- 172.21.15.27:0/1894696192 >> [v2:172.21.15.93:6808/472500806,v1:172.21.15.93:6809/472500806] conn(0x7fbce006ebe0 0x7fbce0071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.675+0000 7fbcdbfff640 1 -- 172.21.15.27:0/1894696192 --> [v2:172.21.15.93:6808/472500806,v1:172.21.15.93:6809/472500806] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbce00716b0 con 0x7fbce006ebe0 2024-01-15T11:33:26.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.675+0000 7fbcdbfff640 1 -- 172.21.15.27:0/1894696192 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbce80867e0 con 0x7fbcf4070b10 2024-01-15T11:33:26.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.675+0000 7f007cff9640 1 -- 172.21.15.27:0/2314272043 <== osd.7 v2:172.21.15.93:6824/2215132622 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f006c071560 con 0x7f006c06ea90 2024-01-15T11:33:26.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.679+0000 7fbcf3fff640 1 --2- 172.21.15.27:0/1894696192 >> [v2:172.21.15.93:6808/472500806,v1:172.21.15.93:6809/472500806] conn(0x7fbce006ebe0 0x7fbce0071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.679+0000 7fbcf37fe640 1 --2- 172.21.15.27:0/1894696192 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbce00669c0 0x7fbce0068e80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbcf41fd910 tx=0x7fbce4009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.679+0000 7fbcf3fff640 1 --2- 172.21.15.27:0/1894696192 >> [v2:172.21.15.93:6808/472500806,v1:172.21.15.93:6809/472500806] conn(0x7fbce006ebe0 0x7fbce0071000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.679+0000 7f17b2301640 1 -- 172.21.15.27:0/2331076504 --> [v2:172.21.15.27:6808/4242255864,v1:172.21.15.27:6809/4242255864] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f178c002cc0 con 0x7f179806eae0 2024-01-15T11:33:26.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.679+0000 7fbcdbfff640 1 -- 172.21.15.27:0/1894696192 <== osd.4 v2:172.21.15.93:6808/472500806 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fbce00716b0 con 0x7fbce006ebe0 2024-01-15T11:33:26.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.679+0000 7f17a8ff9640 1 -- 172.21.15.27:0/2331076504 <== osd.1 v2:172.21.15.27:6808/4242255864 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f178c002cc0 con 0x7f179806eae0 2024-01-15T11:33:26.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.683+0000 7f17b2301640 1 -- 172.21.15.27:0/2331076504 >> [v2:172.21.15.27:6808/4242255864,v1:172.21.15.27:6809/4242255864] conn(0x7f179806eae0 msgr2=0x7f1798070f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.683+0000 7f17b2301640 1 --2- 172.21.15.27:0/2331076504 >> [v2:172.21.15.27:6808/4242255864,v1:172.21.15.27:6809/4242255864] conn(0x7f179806eae0 0x7f1798070f00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.683+0000 7f17b2301640 1 -- 172.21.15.27:0/2331076504 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1798066940 msgr2=0x7f1798068e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.683+0000 7f17b2301640 1 --2- 172.21.15.27:0/2331076504 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1798066940 0x7f1798068e00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f179c007fd0 tx=0x7f179c0079a0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.683+0000 7f17b2301640 1 -- 172.21.15.27:0/2331076504 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17ac06e920 msgr2=0x7f17ac168cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.683+0000 7f17b2301640 1 --2- 172.21.15.27:0/2331076504 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17ac06e920 0x7f17ac168cd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f17a000c490 tx=0x7f17a0001e80 comp rx=0 tx=0).stop 2024-01-15T11:33:26.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.683+0000 7f17b089e640 1 -- 172.21.15.27:0/2331076504 reap_dead start 2024-01-15T11:33:26.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.683+0000 7f17b2301640 1 -- 172.21.15.27:0/2331076504 shutdown_connections 2024-01-15T11:33:26.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.683+0000 7f17b2301640 1 -- 172.21.15.27:0/2331076504 >> 172.21.15.27:0/2331076504 conn(0x7f17ac06c340 msgr2=0x7f17ac14e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:26.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.683+0000 7f17b2301640 1 -- 172.21.15.27:0/2331076504 shutdown_connections 2024-01-15T11:33:26.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.683+0000 7f17b2301640 1 -- 172.21.15.27:0/2331076504 wait complete. 2024-01-15T11:33:26.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.691+0000 7fe2c2ffd640 1 -- 172.21.15.27:0/2493120536 --> [v2:172.21.15.27:6800/35041065,v1:172.21.15.27:6801/35041065] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe2b0002cc0 con 0x7fe2bc06eb60 2024-01-15T11:33:26.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.691+0000 7fe2d57fa640 1 -- 172.21.15.27:0/2493120536 <== osd.0 v2:172.21.15.27:6800/35041065 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe2b0002cc0 con 0x7fe2bc06eb60 2024-01-15T11:33:26.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.691+0000 7fe2c2ffd640 1 -- 172.21.15.27:0/2493120536 >> [v2:172.21.15.27:6800/35041065,v1:172.21.15.27:6801/35041065] conn(0x7fe2bc06eb60 msgr2=0x7fe2bc070f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.695+0000 7fe2c2ffd640 1 --2- 172.21.15.27:0/2493120536 >> [v2:172.21.15.27:6800/35041065,v1:172.21.15.27:6801/35041065] conn(0x7fe2bc06eb60 0x7fe2bc070f80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.695+0000 7fe2c2ffd640 1 -- 172.21.15.27:0/2493120536 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fe2bc066940 msgr2=0x7fe2bc068e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.695+0000 7fe2c2ffd640 1 --2- 172.21.15.27:0/2493120536 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fe2bc066940 0x7fe2bc068e00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8064230 tx=0x7fe2d806d040 comp rx=0 tx=0).stop 2024-01-15T11:33:26.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.695+0000 7fe2c2ffd640 1 -- 172.21.15.27:0/2493120536 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe2d00076a0 msgr2=0x7fe2d002c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.695+0000 7fe2c2ffd640 1 --2- 172.21.15.27:0/2493120536 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe2d00076a0 0x7fe2d002c030 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400c500 tx=0x7fe2c400c9c0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.695+0000 7fe2dda3a640 1 -- 172.21.15.27:0/2493120536 reap_dead start 2024-01-15T11:33:26.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.695+0000 7fe2c2ffd640 1 -- 172.21.15.27:0/2493120536 shutdown_connections 2024-01-15T11:33:26.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.695+0000 7fe2c2ffd640 1 -- 172.21.15.27:0/2493120536 >> 172.21.15.27:0/2493120536 conn(0x7fe2d0054c70 msgr2=0x7fe2d004e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:26.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.695+0000 7fe2c2ffd640 1 -- 172.21.15.27:0/2493120536 shutdown_connections 2024-01-15T11:33:26.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.695+0000 7fe2c2ffd640 1 -- 172.21.15.27:0/2493120536 wait complete. 2024-01-15T11:33:26.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.695+0000 7f90473a3640 1 -- 172.21.15.27:0/2816636831 --> [v2:172.21.15.27:6824/1557364309,v1:172.21.15.27:6825/1557364309] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f904015a780 con 0x7f902406eb60 2024-01-15T11:33:26.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.695+0000 7f9036ffd640 1 -- 172.21.15.27:0/2816636831 <== osd.3 v2:172.21.15.27:6824/1557364309 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f903800d860 con 0x7f902406eb60 2024-01-15T11:33:26.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.699+0000 7f90473a3640 1 -- 172.21.15.27:0/2816636831 >> [v2:172.21.15.27:6824/1557364309,v1:172.21.15.27:6825/1557364309] conn(0x7f902406eb60 msgr2=0x7f9024070f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.699+0000 7f90473a3640 1 --2- 172.21.15.27:0/2816636831 >> [v2:172.21.15.27:6824/1557364309,v1:172.21.15.27:6825/1557364309] conn(0x7f902406eb60 0x7f9024070f80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.699+0000 7f90473a3640 1 -- 172.21.15.27:0/2816636831 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9024066940 msgr2=0x7f9024068e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.699+0000 7f90473a3640 1 --2- 172.21.15.27:0/2816636831 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9024066940 0x7f9024068e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f90400cdff0 tx=0x7f903000b260 comp rx=0 tx=0).stop 2024-01-15T11:33:26.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.699+0000 7f90473a3640 1 -- 172.21.15.27:0/2816636831 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f904006d8a0 msgr2=0x7f9040143e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.699+0000 7f90473a3640 1 --2- 172.21.15.27:0/2816636831 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f904006d8a0 0x7f9040143e90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f903c00b3e0 tx=0x7f903c00b8a0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.699+0000 7fbdd6832640 1 -- 172.21.15.27:0/2290612635 --> [v2:172.21.15.27:6816/746325995,v1:172.21.15.27:6817/746325995] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbdd00d0750 con 0x7fbdb006ebe0 2024-01-15T11:33:26.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.699+0000 7fbdcd7fa640 1 -- 172.21.15.27:0/2290612635 <== osd.2 v2:172.21.15.27:6816/746325995 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbdc80019d0 con 0x7fbdb006ebe0 2024-01-15T11:33:26.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.699+0000 7f9046ba2640 1 -- 172.21.15.27:0/2816636831 reap_dead start 2024-01-15T11:33:26.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.699+0000 7fbdd6832640 1 -- 172.21.15.27:0/2290612635 >> [v2:172.21.15.27:6816/746325995,v1:172.21.15.27:6817/746325995] conn(0x7fbdb006ebe0 msgr2=0x7fbdb0071000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.699+0000 7fbdd6832640 1 --2- 172.21.15.27:0/2290612635 >> [v2:172.21.15.27:6816/746325995,v1:172.21.15.27:6817/746325995] conn(0x7fbdb006ebe0 0x7fbdb0071000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.699+0000 7f90473a3640 1 -- 172.21.15.27:0/2816636831 shutdown_connections 2024-01-15T11:33:26.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.699+0000 7f90473a3640 1 -- 172.21.15.27:0/2816636831 >> 172.21.15.27:0/2816636831 conn(0x7f90400b0c20 msgr2=0x7f90400aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:26.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.699+0000 7f90473a3640 1 -- 172.21.15.27:0/2816636831 shutdown_connections 2024-01-15T11:33:26.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.699+0000 7fbdd6832640 1 -- 172.21.15.27:0/2290612635 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbdb00669c0 msgr2=0x7fbdb0068e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.699+0000 7fbdd6832640 1 --2- 172.21.15.27:0/2290612635 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbdb00669c0 0x7fbdb0068e80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80ae000 tx=0x7fbdb80a7000 comp rx=0 tx=0).stop 2024-01-15T11:33:26.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.699+0000 7fbdd6832640 1 -- 172.21.15.27:0/2290612635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbdd00cf1e0 msgr2=0x7fbdd00c8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.699+0000 7fbdd6832640 1 --2- 172.21.15.27:0/2290612635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbdd00cf1e0 0x7fbdd00c8b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbdc000e980 tx=0x7fbdc000ee40 comp rx=0 tx=0).stop 2024-01-15T11:33:26.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.699+0000 7fbdd4dcf640 1 -- 172.21.15.27:0/2290612635 reap_dead start 2024-01-15T11:33:26.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.699+0000 7f90473a3640 1 -- 172.21.15.27:0/2816636831 wait complete. 2024-01-15T11:33:26.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.699+0000 7fbdd6832640 1 -- 172.21.15.27:0/2290612635 shutdown_connections 2024-01-15T11:33:26.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.699+0000 7fbdd6832640 1 -- 172.21.15.27:0/2290612635 >> 172.21.15.27:0/2290612635 conn(0x7fbdd009c750 msgr2=0x7fbdd00d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:26.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.703+0000 7fbdd6832640 1 -- 172.21.15.27:0/2290612635 shutdown_connections 2024-01-15T11:33:26.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.703+0000 7fbdd6832640 1 -- 172.21.15.27:0/2290612635 wait complete. 2024-01-15T11:33:26.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.703+0000 7f4d6fae3640 1 -- 172.21.15.27:0/55026869 --> [v2:172.21.15.93:6816/2052561323,v1:172.21.15.93:6817/2052561323] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4d6804e850 con 0x7f4d4c06eb60 2024-01-15T11:33:26.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.703+0000 7f4d5e7fc640 1 -- 172.21.15.27:0/55026869 <== osd.6 v2:172.21.15.93:6816/2052561323 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4d6804e850 con 0x7f4d4c06eb60 2024-01-15T11:33:26.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.703+0000 7f3d285e7640 1 -- 172.21.15.27:0/3708901287 --> [v2:172.21.15.93:6800/1055846984,v1:172.21.15.93:6801/1055846984] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3d08002cc0 con 0x7f3d0406ea90 2024-01-15T11:33:26.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f4d6fae3640 1 -- 172.21.15.27:0/55026869 >> [v2:172.21.15.93:6816/2052561323,v1:172.21.15.93:6817/2052561323] conn(0x7f4d4c06eb60 msgr2=0x7f4d4c070f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f4d6fae3640 1 --2- 172.21.15.27:0/55026869 >> [v2:172.21.15.93:6816/2052561323,v1:172.21.15.93:6817/2052561323] conn(0x7f4d4c06eb60 0x7f4d4c070f80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f00667fc640 1 -- 172.21.15.27:0/2314272043 --> [v2:172.21.15.93:6824/2215132622,v1:172.21.15.93:6825/2215132622] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0058002cc0 con 0x7f006c06ea90 2024-01-15T11:33:26.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f007cff9640 1 -- 172.21.15.27:0/2314272043 <== osd.7 v2:172.21.15.93:6824/2215132622 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0058002cc0 con 0x7f006c06ea90 2024-01-15T11:33:26.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f4d6fae3640 1 -- 172.21.15.27:0/55026869 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4d4c0669c0 msgr2=0x7f4d4c068e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f4d6fae3640 1 --2- 172.21.15.27:0/55026869 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4d4c0669c0 0x7f4d4c068e80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4d64005890 tx=0x7f4d64009040 comp rx=0 tx=0).stop 2024-01-15T11:33:26.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f3d16ffd640 1 -- 172.21.15.27:0/3708901287 <== osd.5 v2:172.21.15.93:6800/1055846984 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3d08002cc0 con 0x7f3d0406ea90 2024-01-15T11:33:26.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f4d6fae3640 1 -- 172.21.15.27:0/55026869 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d6815eee0 msgr2=0x7f4d68143a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f4d6fae3640 1 --2- 172.21.15.27:0/55026869 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d6815eee0 0x7f4d68143a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000c810 tx=0x7f4d6000ccd0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f4d6e080640 1 -- 172.21.15.27:0/55026869 reap_dead start 2024-01-15T11:33:26.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f4d6fae3640 1 -- 172.21.15.27:0/55026869 shutdown_connections 2024-01-15T11:33:26.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f4d6fae3640 1 -- 172.21.15.27:0/55026869 >> 172.21.15.27:0/55026869 conn(0x7f4d680b2f10 msgr2=0x7f4d680b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:26.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f00667fc640 1 -- 172.21.15.27:0/2314272043 >> [v2:172.21.15.93:6824/2215132622,v1:172.21.15.93:6825/2215132622] conn(0x7f006c06ea90 msgr2=0x7f006c070eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f3d285e7640 1 -- 172.21.15.27:0/3708901287 >> [v2:172.21.15.93:6800/1055846984,v1:172.21.15.93:6801/1055846984] conn(0x7f3d0406ea90 msgr2=0x7f3d04070eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f3d285e7640 1 --2- 172.21.15.27:0/3708901287 >> [v2:172.21.15.93:6800/1055846984,v1:172.21.15.93:6801/1055846984] conn(0x7f3d0406ea90 0x7f3d04070eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f3d285e7640 1 -- 172.21.15.27:0/3708901287 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3d040668f0 msgr2=0x7f3d04068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f3d285e7640 1 --2- 172.21.15.27:0/3708901287 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3d040668f0 0x7f3d04068db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3d100b2000 tx=0x7f3d1000a040 comp rx=0 tx=0).stop 2024-01-15T11:33:26.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f3d285e7640 1 -- 172.21.15.27:0/3708901287 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d200b3e80 msgr2=0x7f3d200ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f3d285e7640 1 --2- 172.21.15.27:0/3708901287 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d200b3e80 0x7f3d200ce700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c00c390 tx=0x7f3d1c00c850 comp rx=0 tx=0).stop 2024-01-15T11:33:26.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f3d26b84640 1 -- 172.21.15.27:0/3708901287 reap_dead start 2024-01-15T11:33:26.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f3d285e7640 1 -- 172.21.15.27:0/3708901287 shutdown_connections 2024-01-15T11:33:26.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f3d285e7640 1 -- 172.21.15.27:0/3708901287 >> 172.21.15.27:0/3708901287 conn(0x7f3d200b0cb0 msgr2=0x7f3d200afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:26.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f3d285e7640 1 -- 172.21.15.27:0/3708901287 shutdown_connections 2024-01-15T11:33:26.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f3d285e7640 1 -- 172.21.15.27:0/3708901287 wait complete. 2024-01-15T11:33:26.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f4d6fae3640 1 -- 172.21.15.27:0/55026869 shutdown_connections 2024-01-15T11:33:26.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f4d6fae3640 1 -- 172.21.15.27:0/55026869 wait complete. 2024-01-15T11:33:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f00667fc640 1 --2- 172.21.15.27:0/2314272043 >> [v2:172.21.15.93:6824/2215132622,v1:172.21.15.93:6825/2215132622] conn(0x7f006c06ea90 0x7f006c070eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f00667fc640 1 -- 172.21.15.27:0/2314272043 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f006c0668f0 msgr2=0x7f006c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f00667fc640 1 --2- 172.21.15.27:0/2314272043 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f006c0668f0 0x7f006c068db0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0070005030 tx=0x7f0070004eb0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f00667fc640 1 -- 172.21.15.27:0/2314272043 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f008015cc80 msgr2=0x7f008015a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f00667fc640 1 --2- 172.21.15.27:0/2314272043 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f008015cc80 0x7f008015a0c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f008006bf40 tx=0x7f007801b860 comp rx=0 tx=0).stop 2024-01-15T11:33:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f0084e37640 1 -- 172.21.15.27:0/2314272043 reap_dead start 2024-01-15T11:33:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f00667fc640 1 -- 172.21.15.27:0/2314272043 shutdown_connections 2024-01-15T11:33:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f00667fc640 1 -- 172.21.15.27:0/2314272043 >> 172.21.15.27:0/2314272043 conn(0x7f00800b0cb0 msgr2=0x7f00800ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f00667fc640 1 -- 172.21.15.27:0/2314272043 shutdown_connections 2024-01-15T11:33:26.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.707+0000 7f00667fc640 1 -- 172.21.15.27:0/2314272043 wait complete. 2024-01-15T11:33:26.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.711+0000 7fbcf8b5f640 1 -- 172.21.15.27:0/1894696192 --> [v2:172.21.15.93:6808/472500806,v1:172.21.15.93:6809/472500806] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbcf41656a0 con 0x7fbce006ebe0 2024-01-15T11:33:26.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.711+0000 7fbcdbfff640 1 -- 172.21.15.27:0/1894696192 <== osd.4 v2:172.21.15.93:6808/472500806 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbce00716b0 con 0x7fbce006ebe0 2024-01-15T11:33:26.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.711+0000 7fbcf8b5f640 1 -- 172.21.15.27:0/1894696192 >> [v2:172.21.15.93:6808/472500806,v1:172.21.15.93:6809/472500806] conn(0x7fbce006ebe0 msgr2=0x7fbce0071000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.711+0000 7fbcf8b5f640 1 --2- 172.21.15.27:0/1894696192 >> [v2:172.21.15.93:6808/472500806,v1:172.21.15.93:6809/472500806] conn(0x7fbce006ebe0 0x7fbce0071000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.715+0000 7fbcf8b5f640 1 -- 172.21.15.27:0/1894696192 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbce00669c0 msgr2=0x7fbce0068e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.715+0000 7fbcf8b5f640 1 --2- 172.21.15.27:0/1894696192 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbce00669c0 0x7fbce0068e80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbcf41fd910 tx=0x7fbce4009190 comp rx=0 tx=0).stop 2024-01-15T11:33:26.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.715+0000 7fbcf8b5f640 1 -- 172.21.15.27:0/1894696192 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbcf4070b10 msgr2=0x7fbcf41456b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.715+0000 7fbcf8b5f640 1 --2- 172.21.15.27:0/1894696192 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbcf4070b10 0x7fbcf41456b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbce800c3e0 tx=0x7fbce800c8a0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.715+0000 7fbcf3fff640 1 -- 172.21.15.27:0/1894696192 reap_dead start 2024-01-15T11:33:26.725 INFO:teuthology.orchestra.run.smithi027.stdout:64424509446 2024-01-15T11:33:26.726 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-15T11:33:26.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.719+0000 7fbcf8b5f640 1 -- 172.21.15.27:0/1894696192 shutdown_connections 2024-01-15T11:33:26.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.719+0000 7fbcf8b5f640 1 -- 172.21.15.27:0/1894696192 >> 172.21.15.27:0/1894696192 conn(0x7fbcf406df30 msgr2=0x7fbcf40b13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:26.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.723+0000 7fbcf8b5f640 1 -- 172.21.15.27:0/1894696192 shutdown_connections 2024-01-15T11:33:26.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.723+0000 7fbcf8b5f640 1 -- 172.21.15.27:0/1894696192 wait complete. 2024-01-15T11:33:26.741 INFO:teuthology.orchestra.run.smithi027.stdout:64424509446 2024-01-15T11:33:26.741 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-15T11:33:26.747 INFO:teuthology.orchestra.run.smithi027.stdout:64424509447 2024-01-15T11:33:26.747 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-15T11:33:26.749 INFO:teuthology.orchestra.run.smithi027.stdout:64424509446 2024-01-15T11:33:26.749 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-15T11:33:26.757 INFO:teuthology.orchestra.run.smithi027.stdout:64424509447 2024-01-15T11:33:26.757 INFO:teuthology.orchestra.run.smithi027.stdout:64424509447 2024-01-15T11:33:26.758 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-15T11:33:26.758 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-15T11:33:26.761 INFO:teuthology.orchestra.run.smithi027.stdout:60129542151 2024-01-15T11:33:26.761 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-15T11:33:26.762 INFO:teuthology.orchestra.run.smithi027.stdout:64424509448 2024-01-15T11:33:26.762 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-15T11:33:26.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.931+0000 7f6ec3d01640 1 Processor -- start 2024-01-15T11:33:26.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.931+0000 7f6ec3d01640 1 -- start start 2024-01-15T11:33:26.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.935+0000 7f6ec3d01640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6ebc15cc80 0x7f6ebc06df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.935+0000 7f6ec3d01640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6ebc0b3ef0 0x7f6ebc0ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.935+0000 7f6ec3d01640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ebc0cbd20 con 0x7f6ebc0b1fb0 2024-01-15T11:33:26.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.935+0000 7f6ec3d01640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ebc0cc810 con 0x7f6ebc15cc80 2024-01-15T11:33:26.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.935+0000 7f6ec3d01640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc072960 con 0x7f6ebc0b3ef0 2024-01-15T11:33:26.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.935+0000 7f6ec1a9d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6ebc15cc80 0x7f6ebc06df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.935+0000 7f6ec229e640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6ebc0b3ef0 0x7f6ebc0ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.935+0000 7f6ec229e640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6ebc0b3ef0 0x7f6ebc0ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:40004/0 (socket says 172.21.15.27:40004) 2024-01-15T11:33:26.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.935+0000 7f6ec229e640 1 -- 172.21.15.27:0/3119764233 learned_addr learned my addr 172.21.15.27:0/3119764233 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:26.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.935+0000 7f6ec229e640 1 -- 172.21.15.27:0/3119764233 >> v2:172.21.15.27:3300/0 conn(0x7f6ebc15cc80 msgr2=0x7f6ebc06df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:26.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.935+0000 7f6ec229e640 1 --2- 172.21.15.27:0/3119764233 >> v2:172.21.15.27:3300/0 conn(0x7f6ebc15cc80 0x7f6ebc06df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.935+0000 7f6ec229e640 1 -- 172.21.15.27:0/3119764233 >> v1:172.21.15.27:6789/0 conn(0x7f6ebc0b1fb0 legacy=0x7f6ebc0b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:26.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.935+0000 7f6ec229e640 1 -- 172.21.15.27:0/3119764233 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ebc0cbf70 con 0x7f6ebc0b3ef0 2024-01-15T11:33:26.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.939+0000 7f6ec1a9d640 1 --2- 172.21.15.27:0/3119764233 >> v2:172.21.15.27:3300/0 conn(0x7f6ebc15cc80 0x7f6ebc06df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:33:26.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.943+0000 7f6ec229e640 1 --2- 172.21.15.27:0/3119764233 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6ebc0b3ef0 0x7f6ebc0ccea0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0091e0 tx=0x7f6eac01d690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6e291c64e1a8642 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.943+0000 7f6ec0a9b640 1 -- 172.21.15.27:0/3119764233 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac0a76f0 con 0x7f6ebc0b3ef0 2024-01-15T11:33:26.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.943+0000 7f6ec0a9b640 1 -- 172.21.15.27:0/3119764233 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac0a7850 con 0x7f6ebc0b3ef0 2024-01-15T11:33:26.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.943+0000 7f6ec0a9b640 1 -- 172.21.15.27:0/3119764233 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac0a76f0 con 0x7f6ebc0b3ef0 2024-01-15T11:33:26.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.943+0000 7fdc8d0ad640 1 Processor -- start 2024-01-15T11:33:26.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.943+0000 7fdc8d0ad640 1 -- start start 2024-01-15T11:33:26.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.943+0000 7f6ec3d01640 1 -- 172.21.15.27:0/3119764233 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6ebc0b3ef0 msgr2=0x7f6ebc0ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.943+0000 7f6ec3d01640 1 --2- 172.21.15.27:0/3119764233 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6ebc0b3ef0 0x7f6ebc0ccea0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0091e0 tx=0x7f6eac01d690 comp rx=0 tx=0).stop 2024-01-15T11:33:26.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.943+0000 7f6ec3d01640 1 -- 172.21.15.27:0/3119764233 shutdown_connections 2024-01-15T11:33:26.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.943+0000 7f6ec3d01640 1 --2- 172.21.15.27:0/3119764233 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6ebc0b3ef0 0x7f6ebc0ccea0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.943+0000 7f6ec3d01640 1 --2- 172.21.15.27:0/3119764233 >> v2:172.21.15.27:3300/0 conn(0x7f6ebc15cc80 0x7f6ebc06df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.947+0000 7f6ec3d01640 1 -- 172.21.15.27:0/3119764233 >> 172.21.15.27:0/3119764233 conn(0x7f6ebc0b0cb0 msgr2=0x7f6ebc0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:26.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.947+0000 7fdc8d0ad640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc8806c6b0 0x7fdc880b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.947+0000 7fdc8d0ad640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc8815ef10 con 0x7fdc88143e50 2024-01-15T11:33:26.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.947+0000 7fdc8d0ad640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc8815f1f0 con 0x7fdc8806c250 2024-01-15T11:33:26.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.947+0000 7fdc8d0ad640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc880cecf0 con 0x7fdc8806c6b0 2024-01-15T11:33:26.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.947+0000 7fdc8c8ac640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc8806c6b0 0x7fdc880b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.947+0000 7fdc877fe640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fdc8806c250 0x7fdc880b3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.27:37392/0 (socket says 172.21.15.27:37392) 2024-01-15T11:33:26.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.947+0000 7fdc877fe640 1 -- 172.21.15.27:0/2541125247 learned_addr learned my addr 172.21.15.27:0/2541125247 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:26.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.947+0000 7fdc8c8ac640 1 -- 172.21.15.27:0/2541125247 >> v1:172.21.15.93:6789/0 conn(0x7fdc8806c250 legacy=0x7fdc880b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.947+0000 7fdc8c8ac640 1 -- 172.21.15.27:0/2541125247 >> v1:172.21.15.27:6789/0 conn(0x7fdc88143e50 legacy=0x7fdc881444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.947+0000 7fdc8c8ac640 1 -- 172.21.15.27:0/2541125247 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8815f4d0 con 0x7fdc8806c6b0 2024-01-15T11:33:26.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.951+0000 7f6ec3d01640 1 -- 172.21.15.27:0/3119764233 shutdown_connections 2024-01-15T11:33:26.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.951+0000 7f6ec3d01640 1 -- 172.21.15.27:0/3119764233 wait complete. 2024-01-15T11:33:26.955 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.951+0000 7fdc8c8ac640 1 --2- 172.21.15.27:0/2541125247 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc8806c6b0 0x7fdc880b3a50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdc80009dc0 tx=0x7fdc8001c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43c9fcad74b11ec9 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.951+0000 7f6ec3d01640 1 Processor -- start 2024-01-15T11:33:26.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.951+0000 7fdc86ffd640 1 -- 172.21.15.27:0/2541125247 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc800a5990 con 0x7fdc8806c6b0 2024-01-15T11:33:26.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.955+0000 7fdc86ffd640 1 -- 172.21.15.27:0/2541125247 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc800a5af0 con 0x7fdc8806c6b0 2024-01-15T11:33:26.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.955+0000 7f6ec3d01640 1 -- start start 2024-01-15T11:33:26.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.955+0000 7fdc86ffd640 1 -- 172.21.15.27:0/2541125247 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc800a5e80 con 0x7fdc8806c6b0 2024-01-15T11:33:26.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.955+0000 7fdc8d0ad640 1 -- 172.21.15.27:0/2541125247 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc8806c6b0 msgr2=0x7fdc880b3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.955+0000 7fdc8d0ad640 1 --2- 172.21.15.27:0/2541125247 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc8806c6b0 0x7fdc880b3a50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdc80009dc0 tx=0x7fdc8001c8d0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.955+0000 7fdc8d0ad640 1 -- 172.21.15.27:0/2541125247 shutdown_connections 2024-01-15T11:33:26.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.955+0000 7fdc8d0ad640 1 --2- 172.21.15.27:0/2541125247 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc8806c6b0 0x7fdc880b3a50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.955+0000 7fdc8d0ad640 1 -- 172.21.15.27:0/2541125247 >> 172.21.15.27:0/2541125247 conn(0x7fdc8806df30 msgr2=0x7fdc8806a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:26.958 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.955+0000 7f6ec3d01640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ebc0b1fb0 0x7f6ebc155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.959 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.955+0000 7f6ec1a9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ebc0b1fb0 0x7f6ebc155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.955+0000 7f6ec1a9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ebc0b1fb0 0x7f6ebc155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55370/0 (socket says 172.21.15.27:55370) 2024-01-15T11:33:26.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.955+0000 7f6ec1a9d640 1 -- 172.21.15.27:0/293877070 learned_addr learned my addr 172.21.15.27:0/293877070 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:26.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.955+0000 7f6ec3d01640 1 --2- 172.21.15.27:0/293877070 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ebc0b3ef0 0x7f6ebc15bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.955+0000 7f6ec3d01640 1 --2- 172.21.15.27:0/293877070 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6ebc15cc80 0x7f6ebc0ce180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.960 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.959+0000 7f6ec129c640 1 --2- 172.21.15.27:0/293877070 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ebc0b3ef0 0x7f6ebc15bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.955+0000 7fdc8d0ad640 1 -- 172.21.15.27:0/2541125247 shutdown_connections 2024-01-15T11:33:26.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.955+0000 7fdc8d0ad640 1 -- 172.21.15.27:0/2541125247 wait complete. 2024-01-15T11:33:26.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.959+0000 7f6ec229e640 1 --2- 172.21.15.27:0/293877070 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6ebc15cc80 0x7f6ebc0ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.959+0000 7f6ec3d01640 1 -- 172.21.15.27:0/293877070 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc15c130 con 0x7f6ebc0b1fb0 2024-01-15T11:33:26.961 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.959+0000 7f6ec3d01640 1 -- 172.21.15.27:0/293877070 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc154d40 con 0x7f6ebc0b3ef0 2024-01-15T11:33:26.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.959+0000 7fdc8d0ad640 1 Processor -- start 2024-01-15T11:33:26.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.959+0000 7f6ec3d01640 1 -- 172.21.15.27:0/293877070 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc155020 con 0x7f6ebc15cc80 2024-01-15T11:33:26.962 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.959+0000 7fdc8d0ad640 1 -- start start 2024-01-15T11:33:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.959+0000 7f6ec129c640 1 -- 172.21.15.27:0/293877070 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6ebc15cc80 msgr2=0x7f6ebc0ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.959+0000 7f6ec129c640 1 --2- 172.21.15.27:0/293877070 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6ebc15cc80 0x7f6ebc0ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.959+0000 7f6ec129c640 1 -- 172.21.15.27:0/293877070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ebc0b1fb0 msgr2=0x7f6ebc155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.959+0000 7f6ec129c640 1 --2- 172.21.15.27:0/293877070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ebc0b1fb0 0x7f6ebc155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.959+0000 7f6ec129c640 1 -- 172.21.15.27:0/293877070 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac009d60 con 0x7f6ebc0b3ef0 2024-01-15T11:33:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.959+0000 7f6ec129c640 1 --2- 172.21.15.27:0/293877070 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ebc0b3ef0 0x7f6ebc15bbf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6eb400c780 tx=0x7f6eb400cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.959+0000 7f6eb27fc640 1 -- 172.21.15.27:0/293877070 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4003d90 con 0x7f6ebc0b3ef0 2024-01-15T11:33:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.959+0000 7f6eb27fc640 1 -- 172.21.15.27:0/293877070 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb400ce30 con 0x7f6ebc0b3ef0 2024-01-15T11:33:26.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.959+0000 7f6eb27fc640 1 -- 172.21.15.27:0/293877070 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4005290 con 0x7f6ebc0b3ef0 2024-01-15T11:33:26.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.959+0000 7f6ec3d01640 1 -- 172.21.15.27:0/293877070 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ebc155300 con 0x7f6ebc0b3ef0 2024-01-15T11:33:26.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.959+0000 7f6ec3d01640 1 -- 172.21.15.27:0/293877070 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ebc1558c0 con 0x7f6ebc0b3ef0 2024-01-15T11:33:26.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.959+0000 7fdc8d0ad640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc8806c250 0x7fdc88138e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.963+0000 7fdc8d0ad640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc8806c6b0 0x7fdc88141a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.963+0000 7fdc8d0ad640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc88143e50 0x7fdc8813fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.963+0000 7fdc87fff640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc8806c250 0x7fdc88138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.963+0000 7fdc87fff640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc8806c250 0x7fdc88138e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:40036/0 (socket says 172.21.15.27:40036) 2024-01-15T11:33:26.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.963+0000 7fdc8c8ac640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc88143e50 0x7fdc8813fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.963+0000 7fdc8c8ac640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc88143e50 0x7fdc8813fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55380/0 (socket says 172.21.15.27:55380) 2024-01-15T11:33:26.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.963+0000 7fdc87fff640 1 -- 172.21.15.27:0/1197487723 learned_addr learned my addr 172.21.15.27:0/1197487723 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:26.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.963+0000 7fdc8d0ad640 1 -- 172.21.15.27:0/1197487723 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc881396b0 con 0x7fdc88143e50 2024-01-15T11:33:26.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.963+0000 7fdc8d0ad640 1 -- 172.21.15.27:0/1197487723 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8815cf40 con 0x7fdc8806c6b0 2024-01-15T11:33:26.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.963+0000 7fdc877fe640 1 --2- 172.21.15.27:0/1197487723 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc8806c6b0 0x7fdc88141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.963+0000 7fdc8d0ad640 1 -- 172.21.15.27:0/1197487723 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8815d220 con 0x7fdc8806c250 2024-01-15T11:33:26.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.963+0000 7fdc877fe640 1 -- 172.21.15.27:0/1197487723 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc8806c250 msgr2=0x7fdc88138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.963+0000 7fdc877fe640 1 --2- 172.21.15.27:0/1197487723 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc8806c250 0x7fdc88138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.963+0000 7fdc877fe640 1 -- 172.21.15.27:0/1197487723 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc88143e50 msgr2=0x7fdc8813fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.963+0000 7fdc877fe640 1 --2- 172.21.15.27:0/1197487723 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc88143e50 0x7fdc8813fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.963+0000 7fdc877fe640 1 -- 172.21.15.27:0/1197487723 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc80009a70 con 0x7fdc8806c6b0 2024-01-15T11:33:26.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.963+0000 7fdc877fe640 1 --2- 172.21.15.27:0/1197487723 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc8806c6b0 0x7fdc88141a20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800c340 tx=0x7fdc7800c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.963+0000 7f6eb27fc640 1 -- 172.21.15.27:0/293877070 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f6eb4006b20 con 0x7f6ebc0b3ef0 2024-01-15T11:33:26.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.963+0000 7f6ec3d01640 1 -- 172.21.15.27:0/293877070 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ebc0678c0 con 0x7f6ebc0b3ef0 2024-01-15T11:33:26.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.967+0000 7fdc84ff9640 1 -- 172.21.15.27:0/1197487723 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc78005cf0 con 0x7fdc8806c6b0 2024-01-15T11:33:26.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.967+0000 7f6eb27fc640 1 --2- 172.21.15.27:0/293877070 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6ea00668f0 0x7f6ea0068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.967+0000 7fdc84ff9640 1 -- 172.21.15.27:0/1197487723 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc78005e50 con 0x7fdc8806c6b0 2024-01-15T11:33:26.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.967+0000 7fdc84ff9640 1 -- 172.21.15.27:0/1197487723 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc780072d0 con 0x7fdc8806c6b0 2024-01-15T11:33:26.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.967+0000 7fb3f5c79640 1 Processor -- start 2024-01-15T11:33:26.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.967+0000 7f6eb27fc640 1 -- 172.21.15.27:0/293877070 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6eb4083730 con 0x7f6ebc0b3ef0 2024-01-15T11:33:26.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.967+0000 7f6ec1a9d640 1 --2- 172.21.15.27:0/293877070 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6ea00668f0 0x7f6ea0068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.967+0000 7fb3f5c79640 1 -- start start 2024-01-15T11:33:26.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.967+0000 7fdc8d0ad640 1 -- 172.21.15.27:0/1197487723 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc8815d500 con 0x7fdc8806c6b0 2024-01-15T11:33:26.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.967+0000 7fdc8d0ad640 1 -- 172.21.15.27:0/1197487723 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc881393a0 con 0x7fdc8806c6b0 2024-01-15T11:33:26.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.967+0000 7f6ec1a9d640 1 --2- 172.21.15.27:0/293877070 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6ea00668f0 0x7f6ea0068db0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800acd0 tx=0x7f6eb8004740 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.967+0000 7fb3f5c79640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3f0159f00 0x7fb3f00ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.967+0000 7fb3f5c79640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb3f00ae680 0x7fb3f00cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.967+0000 7fdc8d0ad640 1 -- 172.21.15.27:0/1197487723 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc88074990 con 0x7fdc8806c6b0 2024-01-15T11:33:26.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.967+0000 7fb3eeffd640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb3f00ae680 0x7fb3f00cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.967+0000 7fb3eeffd640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb3f00ae680 0x7fb3f00cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55384/0 (socket says 172.21.15.27:55384) 2024-01-15T11:33:26.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.967+0000 7fb3ef7fe640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3f0159f00 0x7fb3f00ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.967+0000 7fb3ef7fe640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3f0159f00 0x7fb3f00ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:40052/0 (socket says 172.21.15.27:40052) 2024-01-15T11:33:26.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb3effff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb3f00cd920 0x7fb3f015d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44012/0 (socket says 172.21.15.27:44012) 2024-01-15T11:33:26.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb3effff640 1 -- 172.21.15.27:0/1460674691 learned_addr learned my addr 172.21.15.27:0/1460674691 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:26.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb3f5c79640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f0072950 con 0x7fb3f00cd920 2024-01-15T11:33:26.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb10eebb640 1 Processor -- start 2024-01-15T11:33:26.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb3f5c79640 1 -- 172.21.15.27:0/1460674691 --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3f006e2b0 con 0x7fb3f00ae680 2024-01-15T11:33:26.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb3f5c79640 1 -- 172.21.15.27:0/1460674691 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f006c6f0 con 0x7fb3f0159f00 2024-01-15T11:33:26.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb10eebb640 1 -- start start 2024-01-15T11:33:26.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb3ee7fc640 1 -- 172.21.15.27:0/1460674691 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1502366989 0 0) 0x7fb3f0072950 con 0x7fb3f00cd920 2024-01-15T11:33:26.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb3ee7fc640 1 -- 172.21.15.27:0/1460674691 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3d8003530 con 0x7fb3f00cd920 2024-01-15T11:33:26.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb10eebb640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb1080ced30 0x7fb1080cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb10eebb640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1080cdfb0 con 0x7fb10815d8f0 2024-01-15T11:33:26.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb10eebb640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1080d4140 con 0x7fb1080cf1b0 2024-01-15T11:33:26.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb10eebb640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1080d4420 con 0x7fb1080ced30 2024-01-15T11:33:26.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb3ee7fc640 1 -- 172.21.15.27:0/1460674691 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3061728863 0 0) 0x7fb3d8003530 con 0x7fb3f00cd920 2024-01-15T11:33:26.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb3ee7fc640 1 -- 172.21.15.27:0/1460674691 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3f0159f00 msgr2=0x7fb3f00ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:26.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb3ee7fc640 1 --2- 172.21.15.27:0/1460674691 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3f0159f00 0x7fb3f00ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb3ee7fc640 1 -- 172.21.15.27:0/1460674691 >> v2:172.21.15.27:3300/0 conn(0x7fb3f00ae680 msgr2=0x7fb3f00cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:26.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb3ee7fc640 1 --2- 172.21.15.27:0/1460674691 >> v2:172.21.15.27:3300/0 conn(0x7fb3f00ae680 0x7fb3f00cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb3ee7fc640 1 -- 172.21.15.27:0/1460674691 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f006e550 con 0x7fb3f00cd920 2024-01-15T11:33:26.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb3ee7fc640 1 -- 172.21.15.27:0/1460674691 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1394381265 0 0) 0x7fb3e4001660 con 0x7fb3f00cd920 2024-01-15T11:33:26.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb3ee7fc640 1 -- 172.21.15.27:0/1460674691 >> v1:172.21.15.27:6789/0 conn(0x7fb3f00cd920 legacy=0x7fb3f015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb3ee7fc640 1 --2- 172.21.15.27:0/1460674691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3d80039a0 0x7fb3d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb3ee7fc640 1 --2- 172.21.15.27:0/1460674691 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3d80047d0 0x7fb3d8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb3ee7fc640 1 --2- 172.21.15.27:0/1460674691 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3d8009980 0x7fb3d8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb3ee7fc640 1 -- 172.21.15.27:0/1460674691 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f006e2b0 con 0x7fb3d8009980 2024-01-15T11:33:26.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb3ee7fc640 1 -- 172.21.15.27:0/1460674691 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f006c6f0 con 0x7fb3d80039a0 2024-01-15T11:33:26.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb3ee7fc640 1 -- 172.21.15.27:0/1460674691 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d8009df0 con 0x7fb3d80047d0 2024-01-15T11:33:26.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb3ef7fe640 1 --2- 172.21.15.27:0/1460674691 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3f0159f00 0x7fb3f00ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:33:26.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb3effff640 1 --2- 172.21.15.27:0/1460674691 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3d8009980 0x7fb3d8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7f6eb27fc640 1 -- 172.21.15.27:0/293877070 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6eb4050ab0 con 0x7f6ebc0b3ef0 2024-01-15T11:33:26.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb3eeffd640 1 --2- 172.21.15.27:0/1460674691 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3d80047d0 0x7fb3d8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb3ef7fe640 1 --2- 172.21.15.27:0/1460674691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3d80039a0 0x7fb3d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb107fff640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb1080ced30 0x7fb1080cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb10d458640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fb1080cf1b0 0x7fb1080d1000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.27:37406/0 (socket says 172.21.15.27:37406) 2024-01-15T11:33:26.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.971+0000 7fb10d458640 1 -- 172.21.15.27:0/2891878351 learned_addr learned my addr 172.21.15.27:0/2891878351 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:26.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.975+0000 7fb107fff640 1 -- 172.21.15.27:0/2891878351 >> v1:172.21.15.93:6789/0 conn(0x7fb1080cf1b0 legacy=0x7fb1080d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.975+0000 7fb107fff640 1 -- 172.21.15.27:0/2891878351 >> v1:172.21.15.27:6789/0 conn(0x7fb10815d8f0 legacy=0x7fb10815e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.975+0000 7fb107fff640 1 -- 172.21.15.27:0/2891878351 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1080ce250 con 0x7fb1080ced30 2024-01-15T11:33:26.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.975+0000 7fdc84ff9640 1 -- 172.21.15.27:0/1197487723 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fdc78007430 con 0x7fdc8806c6b0 2024-01-15T11:33:26.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.975+0000 7fdc84ff9640 1 --2- 172.21.15.27:0/1197487723 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fdc740668f0 0x7fdc74068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.975+0000 7fdc84ff9640 1 -- 172.21.15.27:0/1197487723 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc78083ca0 con 0x7fdc8806c6b0 2024-01-15T11:33:26.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.975+0000 7fdc87fff640 1 --2- 172.21.15.27:0/1197487723 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fdc740668f0 0x7fdc74068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.975+0000 7fb3eeffd640 1 -- 172.21.15.27:0/1460674691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3d80039a0 msgr2=0x7fb3d8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:26.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.975+0000 7fb3eeffd640 1 --2- 172.21.15.27:0/1460674691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3d80039a0 0x7fb3d8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.975+0000 7fb3eeffd640 1 -- 172.21.15.27:0/1460674691 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3d8009980 msgr2=0x7fb3d8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:26.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.975+0000 7fb3eeffd640 1 --2- 172.21.15.27:0/1460674691 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3d8009980 0x7fb3d8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.975+0000 7fb3eeffd640 1 -- 172.21.15.27:0/1460674691 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d8003530 con 0x7fb3d80047d0 2024-01-15T11:33:26.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.975+0000 7fb3effff640 1 --2- 172.21.15.27:0/1460674691 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3d8009980 0x7fb3d8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:26.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.979+0000 7fdc84ff9640 1 -- 172.21.15.27:0/1197487723 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdc78051000 con 0x7fdc8806c6b0 2024-01-15T11:33:26.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.979+0000 7fdc87fff640 1 --2- 172.21.15.27:0/1197487723 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fdc740668f0 0x7fdc74068db0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c007fd0 tx=0x7fdc7c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.979+0000 7fb3eeffd640 1 --2- 172.21.15.27:0/1460674691 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3d80047d0 0x7fb3d8004c50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb3e800ba30 tx=0x7fb3e801c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b90a135da4f9650 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.979+0000 7fb107fff640 1 --2- 172.21.15.27:0/2891878351 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb1080ced30 0x7fb1080cfe00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc0097f0 tx=0x7fb0fc01c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1abbf11366b10736 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.979+0000 7fb3ee7fc640 1 -- 172.21.15.27:0/1460674691 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e80aa630 con 0x7fb3d80047d0 2024-01-15T11:33:26.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.979+0000 7fb1077fe640 1 -- 172.21.15.27:0/2891878351 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc0ab600 con 0x7fb1080ced30 2024-01-15T11:33:26.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.979+0000 7fb1077fe640 1 -- 172.21.15.27:0/2891878351 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0fc0a7050 con 0x7fb1080ced30 2024-01-15T11:33:26.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.979+0000 7fb1077fe640 1 -- 172.21.15.27:0/2891878351 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc0ab980 con 0x7fb1080ced30 2024-01-15T11:33:26.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.979+0000 7fb3ee7fc640 1 -- 172.21.15.27:0/1460674691 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e80aa790 con 0x7fb3d80047d0 2024-01-15T11:33:26.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.979+0000 7fb3ee7fc640 1 -- 172.21.15.27:0/1460674691 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e80aa630 con 0x7fb3d80047d0 2024-01-15T11:33:26.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.979+0000 7fb10eebb640 1 -- 172.21.15.27:0/2891878351 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb1080ced30 msgr2=0x7fb1080cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.979+0000 7fb10eebb640 1 --2- 172.21.15.27:0/2891878351 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb1080ced30 0x7fb1080cfe00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc0097f0 tx=0x7fb0fc01c320 comp rx=0 tx=0).stop 2024-01-15T11:33:26.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.979+0000 7fb10eebb640 1 -- 172.21.15.27:0/2891878351 shutdown_connections 2024-01-15T11:33:26.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.979+0000 7fb10eebb640 1 --2- 172.21.15.27:0/2891878351 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb1080ced30 0x7fb1080cfe00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.979+0000 7fb10eebb640 1 -- 172.21.15.27:0/2891878351 >> 172.21.15.27:0/2891878351 conn(0x7fb10809c750 msgr2=0x7fb1080d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:26.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.979+0000 7fb10eebb640 1 -- 172.21.15.27:0/2891878351 shutdown_connections 2024-01-15T11:33:26.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.983+0000 7fb10eebb640 1 -- 172.21.15.27:0/2891878351 wait complete. 2024-01-15T11:33:26.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.983+0000 7fb10eebb640 1 Processor -- start 2024-01-15T11:33:26.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.983+0000 7fb10eebb640 1 -- start start 2024-01-15T11:33:26.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.983+0000 7fb3f5c79640 1 -- 172.21.15.27:0/1460674691 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3d80047d0 msgr2=0x7fb3d8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.983+0000 7fb3f5c79640 1 --2- 172.21.15.27:0/1460674691 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3d80047d0 0x7fb3d8004c50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb3e800ba30 tx=0x7fb3e801c6e0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.987+0000 7fb3effff640 1 -- 172.21.15.27:0/1460674691 reap_dead start 2024-01-15T11:33:26.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.987+0000 7fb3f5c79640 1 -- 172.21.15.27:0/1460674691 shutdown_connections 2024-01-15T11:33:26.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.987+0000 7fb3f5c79640 1 -- 172.21.15.27:0/1460674691 >> 172.21.15.27:0/1460674691 conn(0x7fb3f00b0cb0 msgr2=0x7fb3f00b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:26.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.987+0000 7fb3f5c79640 1 -- 172.21.15.27:0/1460674691 shutdown_connections 2024-01-15T11:33:26.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.987+0000 7fb10eebb640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb1080ced30 0x7fb108154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.987+0000 7fb3f5c79640 1 -- 172.21.15.27:0/1460674691 wait complete. 2024-01-15T11:33:26.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.987+0000 7fb10eebb640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1080cf1b0 0x7fb1081fb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.987+0000 7fb10eebb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb10815d8f0 0x7fb1081fb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.987+0000 7fb10eebb640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1080cb550 con 0x7fb10815d8f0 2024-01-15T11:33:26.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.987+0000 7fb10eebb640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1080cb830 con 0x7fb1080cf1b0 2024-01-15T11:33:26.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.987+0000 7fb10eebb640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1080cbb10 con 0x7fb1080ced30 2024-01-15T11:33:26.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.987+0000 7fb10cc57640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb1080ced30 0x7fb108154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.987+0000 7fb10cc57640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb1080ced30 0x7fb108154920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:40074/0 (socket says 172.21.15.27:40074) 2024-01-15T11:33:26.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.987+0000 7fb10cc57640 1 -- 172.21.15.27:0/1765481867 learned_addr learned my addr 172.21.15.27:0/1765481867 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:26.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.987+0000 7fb107fff640 1 --2- 172.21.15.27:0/1765481867 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1080cf1b0 0x7fb1081fb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.987+0000 7fb10cc57640 1 -- 172.21.15.27:0/1765481867 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1080cf1b0 msgr2=0x7fb1081fb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:26.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.987+0000 7fb10cc57640 1 --2- 172.21.15.27:0/1765481867 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1080cf1b0 0x7fb1081fb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.987+0000 7fb10cc57640 1 -- 172.21.15.27:0/1765481867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb10815d8f0 msgr2=0x7fb1081fb9f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-15T11:33:26.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.987+0000 7fb10d458640 1 --2- 172.21.15.27:0/1765481867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb10815d8f0 0x7fb1081fb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.987+0000 7fb10cc57640 1 --2- 172.21.15.27:0/1765481867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb10815d8f0 0x7fb1081fb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:26.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.987+0000 7fb10cc57640 1 -- 172.21.15.27:0/1765481867 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc009420 con 0x7fb1080ced30 2024-01-15T11:33:26.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.991+0000 7fb10cc57640 1 --2- 172.21.15.27:0/1765481867 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb1080ced30 0x7fb108154920 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb0f800c750 tx=0x7fb0f800cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:26.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.991+0000 7fb3f5c79640 1 Processor -- start 2024-01-15T11:33:26.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.991+0000 7fb1057fa640 1 -- 172.21.15.27:0/1765481867 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8005280 con 0x7fb1080ced30 2024-01-15T11:33:26.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.991+0000 7fb1057fa640 1 -- 172.21.15.27:0/1765481867 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f80053e0 con 0x7fb1080ced30 2024-01-15T11:33:26.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.991+0000 7fb1057fa640 1 -- 172.21.15.27:0/1765481867 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f800a860 con 0x7fb1080ced30 2024-01-15T11:33:26.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.991+0000 7fb10eebb640 1 -- 172.21.15.27:0/1765481867 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1080cbdf0 con 0x7fb1080ced30 2024-01-15T11:33:26.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.991+0000 7fb10eebb640 1 -- 172.21.15.27:0/1765481867 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1080cc3b0 con 0x7fb1080ced30 2024-01-15T11:33:26.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.991+0000 7fb3f5c79640 1 -- start start 2024-01-15T11:33:26.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.991+0000 7fb0eeffd640 1 -- 172.21.15.27:0/1765481867 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10804e850 con 0x7fb1080ced30 2024-01-15T11:33:26.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.991+0000 7fb3f5c79640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3f0151010 0x7fb3f015b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.995+0000 7fb3f5c79640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3f0159240 0x7fb3f0155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.995+0000 7fb3ef7fe640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3f0151010 0x7fb3f015b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.995+0000 7fb3ef7fe640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3f0151010 0x7fb3f015b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:40076/0 (socket says 172.21.15.27:40076) 2024-01-15T11:33:26.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.995+0000 7fb3eeffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3f0159240 0x7fb3f0155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.995+0000 7fb3eeffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3f0159240 0x7fb3f0155610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:52066/0 (socket says 172.21.15.27:52066) 2024-01-15T11:33:26.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.995+0000 7fb3ef7fe640 1 -- 172.21.15.27:0/3778669882 learned_addr learned my addr 172.21.15.27:0/3778669882 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:26.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.995+0000 7fb3f5c79640 1 --2- 172.21.15.27:0/3778669882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3f0155b50 0x7fb3f01f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:26.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.995+0000 7fb3f5c79640 1 -- 172.21.15.27:0/3778669882 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f0156000 con 0x7fb3f0155b50 2024-01-15T11:33:26.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.995+0000 7fb3f5c79640 1 -- 172.21.15.27:0/3778669882 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f0157380 con 0x7fb3f0159240 2024-01-15T11:33:26.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.995+0000 7fb3effff640 1 --2- 172.21.15.27:0/3778669882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3f0155b50 0x7fb3f01f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:26.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.995+0000 7fb3f5c79640 1 -- 172.21.15.27:0/3778669882 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f015c550 con 0x7fb3f0151010 2024-01-15T11:33:27.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.995+0000 7fb3ef7fe640 1 -- 172.21.15.27:0/3778669882 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3f0159240 msgr2=0x7fb3f0155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.995+0000 7fb3ef7fe640 1 --2- 172.21.15.27:0/3778669882 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3f0159240 0x7fb3f0155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.995+0000 7fb3ef7fe640 1 -- 172.21.15.27:0/3778669882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3f0155b50 msgr2=0x7fb3f01f2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.995+0000 7fb3ef7fe640 1 --2- 172.21.15.27:0/3778669882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3f0155b50 0x7fb3f01f2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.995+0000 7fb3ef7fe640 1 -- 172.21.15.27:0/3778669882 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f0099a30 con 0x7fb3f0151010 2024-01-15T11:33:27.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.995+0000 7fb3eeffd640 1 --2- 172.21.15.27:0/3778669882 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3f0159240 0x7fb3f0155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:27.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.995+0000 7fb3ef7fe640 1 --2- 172.21.15.27:0/3778669882 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3f0151010 0x7fb3f015b340 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0007f20 tx=0x7fb3e000f550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:27.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.995+0000 7fb1057fa640 1 -- 172.21.15.27:0/1765481867 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fb0f800a9c0 con 0x7fb1080ced30 2024-01-15T11:33:27.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.995+0000 7fb1057fa640 1 --2- 172.21.15.27:0/1765481867 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb0f4066940 0x7fb0f4068e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.995+0000 7fb1057fa640 1 -- 172.21.15.27:0/1765481867 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0f8083bf0 con 0x7fb1080ced30 2024-01-15T11:33:27.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.999+0000 7fb107fff640 1 --2- 172.21.15.27:0/1765481867 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb0f4066940 0x7fb0f4068e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:26.999+0000 7fb107fff640 1 --2- 172.21.15.27:0/1765481867 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb0f4066940 0x7fb0f4068e00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc0ad000 tx=0x7fb0fc0a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:27.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.003+0000 7fb3d7fff640 1 -- 172.21.15.27:0/3778669882 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0011040 con 0x7fb3f0151010 2024-01-15T11:33:27.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.003+0000 7fb3d7fff640 1 -- 172.21.15.27:0/3778669882 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e000a2d0 con 0x7fb3f0151010 2024-01-15T11:33:27.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.003+0000 7fb3d7fff640 1 -- 172.21.15.27:0/3778669882 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0008660 con 0x7fb3f0151010 2024-01-15T11:33:27.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.003+0000 7fb1057fa640 1 -- 172.21.15.27:0/1765481867 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb0f8050e30 con 0x7fb1080ced30 2024-01-15T11:33:27.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.003+0000 7fb3f5c79640 1 -- 172.21.15.27:0/3778669882 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f015b9d0 con 0x7fb3f0151010 2024-01-15T11:33:27.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.003+0000 7fb3f5c79640 1 -- 172.21.15.27:0/3778669882 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f015bf90 con 0x7fb3f0151010 2024-01-15T11:33:27.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.007+0000 7fb3d7fff640 1 -- 172.21.15.27:0/3778669882 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fb3e00087c0 con 0x7fb3f0151010 2024-01-15T11:33:27.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.007+0000 7fb3d7fff640 1 --2- 172.21.15.27:0/3778669882 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb3dc0669c0 0x7fb3dc068e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.007+0000 7fb3eeffd640 1 --2- 172.21.15.27:0/3778669882 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb3dc0669c0 0x7fb3dc068e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.011+0000 7fb3d7fff640 1 -- 172.21.15.27:0/3778669882 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3e0084930 con 0x7fb3f0151010 2024-01-15T11:33:27.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.011+0000 7fb3d5ffb640 1 -- 172.21.15.27:0/3778669882 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3f00671f0 con 0x7fb3f0151010 2024-01-15T11:33:27.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.011+0000 7fb3eeffd640 1 --2- 172.21.15.27:0/3778669882 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb3dc0669c0 0x7fb3dc068e80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb3e80af000 tx=0x7fb3e80b4040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:27.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.015+0000 7fb3d7fff640 1 -- 172.21.15.27:0/3778669882 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb3e0051b50 con 0x7fb3f0151010 2024-01-15T11:33:27.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.055+0000 7f4778dd8640 1 Processor -- start 2024-01-15T11:33:27.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.055+0000 7f4778dd8640 1 -- start start 2024-01-15T11:33:27.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.055+0000 7f4778dd8640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f477406e920 0x7f47740b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.055+0000 7f4778dd8640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4774159160 0x7f47740cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.059+0000 7f4778dd8640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47740cd860 con 0x7f47740ce230 2024-01-15T11:33:27.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.059+0000 7f4778dd8640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47740ccc90 con 0x7f4774159160 2024-01-15T11:33:27.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.059+0000 7f4778dd8640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47740b4df0 con 0x7f477406e920 2024-01-15T11:33:27.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.059+0000 7f477259c640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f477406e920 0x7f47740b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.059+0000 7f477259c640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f477406e920 0x7f47740b48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:40082/0 (socket says 172.21.15.27:40082) 2024-01-15T11:33:27.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.059+0000 7f477259c640 1 -- 172.21.15.27:0/3782439679 learned_addr learned my addr 172.21.15.27:0/3782439679 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:27.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.059+0000 7f4771d9b640 1 --2- 172.21.15.27:0/3782439679 >> v2:172.21.15.93:3300/0 conn(0x7f4774159160 0x7f47740cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.059+0000 7f477259c640 1 -- 172.21.15.27:0/3782439679 >> v2:172.21.15.93:3300/0 conn(0x7f4774159160 msgr2=0x7f47740cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:27.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.059+0000 7f477259c640 1 --2- 172.21.15.27:0/3782439679 >> v2:172.21.15.93:3300/0 conn(0x7f4774159160 0x7f47740cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.059+0000 7f477259c640 1 -- 172.21.15.27:0/3782439679 >> v1:172.21.15.27:6789/0 conn(0x7f47740ce230 legacy=0x7f4774070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:27.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.059+0000 7f477259c640 1 -- 172.21.15.27:0/3782439679 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47740ccf30 con 0x7f477406e920 2024-01-15T11:33:27.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.067+0000 7f477259c640 1 --2- 172.21.15.27:0/3782439679 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f477406e920 0x7f47740b48b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4764009870 tx=0x7f476401ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2481177a9ca66d server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:27.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.067+0000 7f477159a640 1 -- 172.21.15.27:0/3782439679 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47640a89b0 con 0x7f477406e920 2024-01-15T11:33:27.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.067+0000 7f59b1c74640 1 Processor -- start 2024-01-15T11:33:27.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.067+0000 7f59b1c74640 1 -- start start 2024-01-15T11:33:27.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.067+0000 7f477159a640 1 -- 172.21.15.27:0/3782439679 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47640a8b10 con 0x7f477406e920 2024-01-15T11:33:27.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.067+0000 7f477159a640 1 -- 172.21.15.27:0/3782439679 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47640a8ea0 con 0x7f477406e920 2024-01-15T11:33:27.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.067+0000 7f4778dd8640 1 -- 172.21.15.27:0/3782439679 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f477406e920 msgr2=0x7f47740b48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.067+0000 7f4778dd8640 1 --2- 172.21.15.27:0/3782439679 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f477406e920 0x7f47740b48b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4764009870 tx=0x7f476401ecf0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.067+0000 7f59b1c74640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f59ac1609c0 0x7f59ac0d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.067+0000 7f4778dd8640 1 -- 172.21.15.27:0/3782439679 shutdown_connections 2024-01-15T11:33:27.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.067+0000 7f4778dd8640 1 --2- 172.21.15.27:0/3782439679 >> v2:172.21.15.93:3300/0 conn(0x7f4774159160 0x7f47740cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.067+0000 7f4778dd8640 1 --2- 172.21.15.27:0/3782439679 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f477406e920 0x7f47740b48b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.071+0000 7f4778dd8640 1 -- 172.21.15.27:0/3782439679 >> 172.21.15.27:0/3782439679 conn(0x7f477406c340 msgr2=0x7f477406c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:27.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.071+0000 7f59b0c72640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f59ac1609c0 0x7f59ac0d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.071+0000 7f59b1c74640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f59ac0ce6b0 0x7f59ac0b6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.071+0000 7f59b0c72640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f59ac1609c0 0x7f59ac0d1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55410/0 (socket says 172.21.15.27:55410) 2024-01-15T11:33:27.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.071+0000 7f4778dd8640 1 -- 172.21.15.27:0/3782439679 shutdown_connections 2024-01-15T11:33:27.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.071+0000 7f4778dd8640 1 -- 172.21.15.27:0/3782439679 wait complete. 2024-01-15T11:33:27.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.071+0000 7f59b0c72640 1 -- 172.21.15.27:0/2764742966 learned_addr learned my addr 172.21.15.27:0/2764742966 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:27.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.071+0000 7f59b1473640 1 --2- 172.21.15.27:0/2764742966 >> v2:172.21.15.93:3300/0 conn(0x7f59ac0ce6b0 0x7f59ac0b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.071+0000 7f59b1c74640 1 -- 172.21.15.27:0/2764742966 --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59ac160da0 con 0x7f59ac0b8c80 2024-01-15T11:33:27.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.071+0000 7f59b1c74640 1 -- 172.21.15.27:0/2764742966 --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59ac0d1c70 con 0x7f59ac1609c0 2024-01-15T11:33:27.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.071+0000 7f59b1c74640 1 -- 172.21.15.27:0/2764742966 --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59ac0d1f50 con 0x7f59ac0ce6b0 2024-01-15T11:33:27.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.071+0000 7f59b1473640 1 -- 172.21.15.27:0/2764742966 >> v2:172.21.15.27:3300/0 conn(0x7f59ac1609c0 msgr2=0x7f59ac0d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:27.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.071+0000 7f59b1473640 1 --2- 172.21.15.27:0/2764742966 >> v2:172.21.15.27:3300/0 conn(0x7f59ac1609c0 0x7f59ac0d1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.071+0000 7f59ab7fe640 1 -- 172.21.15.27:0/2764742966 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 872593549 0 0) 0x7f59ac160da0 con 0x7f59ac0b8c80 2024-01-15T11:33:27.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.071+0000 7f59b1473640 1 -- 172.21.15.27:0/2764742966 >> v1:172.21.15.27:6789/0 conn(0x7f59ac0b8c80 legacy=0x7f59ac0cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.071+0000 7f59b1473640 1 -- 172.21.15.27:0/2764742966 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ac0d2230 con 0x7f59ac0ce6b0 2024-01-15T11:33:27.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.075+0000 7f4778dd8640 1 Processor -- start 2024-01-15T11:33:27.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.075+0000 7f4778dd8640 1 -- start start 2024-01-15T11:33:27.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.079+0000 7f59b1473640 1 --2- 172.21.15.27:0/2764742966 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59ac0ce6b0 0x7f59ac0b6370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0cf490 tx=0x7f599c01c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63549d2e82e5e913 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:27.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.079+0000 7f59ab7fe640 1 -- 172.21.15.27:0/2764742966 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c0a59a0 con 0x7f59ac0ce6b0 2024-01-15T11:33:27.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.079+0000 7f4778dd8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f477406e920 0x7f4774165e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.079+0000 7f59ab7fe640 1 -- 172.21.15.27:0/2764742966 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599c0a5b00 con 0x7f59ac0ce6b0 2024-01-15T11:33:27.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.079+0000 7f59ab7fe640 1 -- 172.21.15.27:0/2764742966 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c0a59a0 con 0x7f59ac0ce6b0 2024-01-15T11:33:27.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.079+0000 7f4778dd8640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f47740ce230 0x7f4774166380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.079+0000 7f4778dd8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4774159160 0x7f4774146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.079+0000 7f4771d9b640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f47740ce230 0x7f4774166380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.079+0000 7f4771d9b640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f47740ce230 0x7f4774166380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:40090/0 (socket says 172.21.15.27:40090) 2024-01-15T11:33:27.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.079+0000 7f477259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f477406e920 0x7f4774165e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.079+0000 7f477259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f477406e920 0x7f4774165e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55422/0 (socket says 172.21.15.27:55422) 2024-01-15T11:33:27.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.079+0000 7f4771d9b640 1 -- 172.21.15.27:0/3151418464 learned_addr learned my addr 172.21.15.27:0/3151418464 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:27.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.079+0000 7f4772d9d640 1 --2- 172.21.15.27:0/3151418464 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4774159160 0x7f4774146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.079+0000 7f4778dd8640 1 -- 172.21.15.27:0/3151418464 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477414a090 con 0x7f477406e920 2024-01-15T11:33:27.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.079+0000 7f4778dd8640 1 -- 172.21.15.27:0/3151418464 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4774143600 con 0x7f4774159160 2024-01-15T11:33:27.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.079+0000 7f4778dd8640 1 -- 172.21.15.27:0/3151418464 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47740706a0 con 0x7f47740ce230 2024-01-15T11:33:27.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.079+0000 7f4771d9b640 1 -- 172.21.15.27:0/3151418464 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4774159160 msgr2=0x7f4774146cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.079+0000 7f4771d9b640 1 --2- 172.21.15.27:0/3151418464 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4774159160 0x7f4774146cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.079+0000 7f4771d9b640 1 -- 172.21.15.27:0/3151418464 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f477406e920 msgr2=0x7f4774165e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.079+0000 7f4771d9b640 1 --2- 172.21.15.27:0/3151418464 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f477406e920 0x7f4774165e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.079+0000 7f4771d9b640 1 -- 172.21.15.27:0/3151418464 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47640094d0 con 0x7f47740ce230 2024-01-15T11:33:27.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.083+0000 7f4771d9b640 1 --2- 172.21.15.27:0/3151418464 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f47740ce230 0x7f4774166380 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f476c00efc0 tx=0x7f476c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:27.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.083+0000 7f59b1c74640 1 -- 172.21.15.27:0/2764742966 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59ac0ce6b0 msgr2=0x7f59ac0b6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.083+0000 7f59b1c74640 1 --2- 172.21.15.27:0/2764742966 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59ac0ce6b0 0x7f59ac0b6370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0cf490 tx=0x7f599c01c8e0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.083+0000 7f4762ffd640 1 -- 172.21.15.27:0/3151418464 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c009b80 con 0x7f47740ce230 2024-01-15T11:33:27.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.083+0000 7f59b1c74640 1 -- 172.21.15.27:0/2764742966 shutdown_connections 2024-01-15T11:33:27.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.083+0000 7f59b1c74640 1 --2- 172.21.15.27:0/2764742966 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59ac0ce6b0 0x7f59ac0b6370 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.083+0000 7f59b1c74640 1 --2- 172.21.15.27:0/2764742966 >> v2:172.21.15.27:3300/0 conn(0x7f59ac1609c0 0x7f59ac0d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.083+0000 7f59b1c74640 1 -- 172.21.15.27:0/2764742966 >> 172.21.15.27:0/2764742966 conn(0x7f59ac0668a0 msgr2=0x7f59ac0cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:27.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.083+0000 7f59b1c74640 1 -- 172.21.15.27:0/2764742966 shutdown_connections 2024-01-15T11:33:27.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.083+0000 7f59b1c74640 1 -- 172.21.15.27:0/2764742966 wait complete. 2024-01-15T11:33:27.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.087+0000 7f59b1c74640 1 Processor -- start 2024-01-15T11:33:27.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.083+0000 7f4778dd8640 1 -- 172.21.15.27:0/3151418464 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4774070370 con 0x7f47740ce230 2024-01-15T11:33:27.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.083+0000 7f4778dd8640 1 -- 172.21.15.27:0/3151418464 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4774169410 con 0x7f47740ce230 2024-01-15T11:33:27.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.083+0000 7f4762ffd640 1 -- 172.21.15.27:0/3151418464 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476c00f040 con 0x7f47740ce230 2024-01-15T11:33:27.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.083+0000 7f4762ffd640 1 -- 172.21.15.27:0/3151418464 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c009b80 con 0x7f47740ce230 2024-01-15T11:33:27.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.083+0000 7f4778dd8640 1 -- 172.21.15.27:0/3151418464 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4758005260 con 0x7f47740ce230 2024-01-15T11:33:27.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.087+0000 7f4762ffd640 1 -- 172.21.15.27:0/3151418464 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f476c014480 con 0x7f47740ce230 2024-01-15T11:33:27.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.087+0000 7f59b1c74640 1 -- start start 2024-01-15T11:33:27.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.087+0000 7f4762ffd640 1 --2- 172.21.15.27:0/3151418464 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4754066950 0x7f4754068e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.087+0000 7f4762ffd640 1 -- 172.21.15.27:0/3151418464 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f476c0849f0 con 0x7f47740ce230 2024-01-15T11:33:27.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.087+0000 7f477259c640 1 --2- 172.21.15.27:0/3151418464 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4754066950 0x7f4754068e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.091+0000 7f477259c640 1 --2- 172.21.15.27:0/3151418464 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4754066950 0x7f4754068e10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f47640b2000 tx=0x7f47640aa070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:27.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.091+0000 7f59b1c74640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59ac0ce6b0 0x7f59ac0c32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.091+0000 7f59b1c74640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59ac1609c0 0x7f59ac159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.091+0000 7f59b1c74640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59ac0d3400 0x7f59ac202260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.091+0000 7f59b0c72640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59ac0ce6b0 0x7f59ac0c32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.091+0000 7f59b0c72640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59ac0ce6b0 0x7f59ac0c32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:52106/0 (socket says 172.21.15.27:52106) 2024-01-15T11:33:27.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.091+0000 7f59abfff640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59ac1609c0 0x7f59ac159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.091+0000 7f59b0c72640 1 -- 172.21.15.27:0/2741911340 learned_addr learned my addr 172.21.15.27:0/2741911340 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:27.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.091+0000 7f59b1c74640 1 -- 172.21.15.27:0/2741911340 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac15a720 con 0x7f59ac0d3400 2024-01-15T11:33:27.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.091+0000 7f59b1c74640 1 -- 172.21.15.27:0/2741911340 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac15aa00 con 0x7f59ac0ce6b0 2024-01-15T11:33:27.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.091+0000 7f59b1c74640 1 -- 172.21.15.27:0/2741911340 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ac15ace0 con 0x7f59ac1609c0 2024-01-15T11:33:27.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.091+0000 7f59b1473640 1 --2- 172.21.15.27:0/2741911340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59ac0d3400 0x7f59ac202260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.091+0000 7f59b0c72640 1 -- 172.21.15.27:0/2741911340 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59ac1609c0 msgr2=0x7f59ac159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.091+0000 7f59b0c72640 1 --2- 172.21.15.27:0/2741911340 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59ac1609c0 0x7f59ac159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.091+0000 7f59b0c72640 1 -- 172.21.15.27:0/2741911340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59ac0d3400 msgr2=0x7f59ac202260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.091+0000 7f59b0c72640 1 --2- 172.21.15.27:0/2741911340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59ac0d3400 0x7f59ac202260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.091+0000 7f59b0c72640 1 -- 172.21.15.27:0/2741911340 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599c009a70 con 0x7f59ac0ce6b0 2024-01-15T11:33:27.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.091+0000 7f59b0c72640 1 --2- 172.21.15.27:0/2741911340 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59ac0ce6b0 0x7f59ac0c32b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f599400e870 tx=0x7f599400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:27.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.091+0000 7f4762ffd640 1 -- 172.21.15.27:0/3151418464 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f476c051cd0 con 0x7f47740ce230 2024-01-15T11:33:27.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.091+0000 7f59a97fa640 1 -- 172.21.15.27:0/2741911340 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59940094e0 con 0x7f59ac0ce6b0 2024-01-15T11:33:27.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.095+0000 7f59a97fa640 1 -- 172.21.15.27:0/2741911340 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599400c940 con 0x7f59ac0ce6b0 2024-01-15T11:33:27.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.095+0000 7f59b1c74640 1 -- 172.21.15.27:0/2741911340 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59ac15afc0 con 0x7f59ac0ce6b0 2024-01-15T11:33:27.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.095+0000 7f59a97fa640 1 -- 172.21.15.27:0/2741911340 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599400cd10 con 0x7f59ac0ce6b0 2024-01-15T11:33:27.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.095+0000 7f59b1c74640 1 -- 172.21.15.27:0/2741911340 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59ac15a3e0 con 0x7f59ac0ce6b0 2024-01-15T11:33:27.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.095+0000 7f59b1c74640 1 -- 172.21.15.27:0/2741911340 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59ac0c06c0 con 0x7f59ac0ce6b0 2024-01-15T11:33:27.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.099+0000 7f59a97fa640 1 -- 172.21.15.27:0/2741911340 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f5994013470 con 0x7f59ac0ce6b0 2024-01-15T11:33:27.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.103+0000 7f6c4c804640 1 Processor -- start 2024-01-15T11:33:27.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.103+0000 7f59a97fa640 1 --2- 172.21.15.27:0/2741911340 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f598c0669c0 0x7f598c068e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.103+0000 7f59a97fa640 1 -- 172.21.15.27:0/2741911340 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59940843c0 con 0x7f59ac0ce6b0 2024-01-15T11:33:27.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.103+0000 7f6c4c804640 1 -- start start 2024-01-15T11:33:27.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.103+0000 7f6c4c804640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6c400e30a0 0x7f6c40005ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.103+0000 7f6c4c804640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6c400544d0 0x7f6c4004f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.103+0000 7f6c4c804640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c40037b90 con 0x7f6c4004fa70 2024-01-15T11:33:27.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.103+0000 7f6c4c804640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4004f810 con 0x7f6c400e30a0 2024-01-15T11:33:27.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.103+0000 7f6c4c804640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c40054290 con 0x7f6c400544d0 2024-01-15T11:33:27.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.107+0000 7f6c4759e640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f6c4004fa70 0x7f6c40052a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44042/0 (socket says 172.21.15.27:44042) 2024-01-15T11:33:27.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.107+0000 7f6c4759e640 1 -- 172.21.15.27:0/1025244171 learned_addr learned my addr 172.21.15.27:0/1025244171 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:27.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.107+0000 7f6c46d9d640 1 --2- 172.21.15.27:0/1025244171 >> v2:172.21.15.93:3300/0 conn(0x7f6c400e30a0 0x7f6c40005ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.107+0000 7f6c4659c640 1 --2- 172.21.15.27:0/1025244171 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6c400544d0 0x7f6c4004f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.107+0000 7f59abfff640 1 --2- 172.21.15.27:0/2741911340 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f598c0669c0 0x7f598c068e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.107+0000 7f59a97fa640 1 -- 172.21.15.27:0/2741911340 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f59ac0c06c0 con 0x7f59ac0ce6b0 2024-01-15T11:33:27.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.107+0000 7f59abfff640 1 --2- 172.21.15.27:0/2741911340 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f598c0669c0 0x7f598c068e80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0b53f0 tx=0x7f59a4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:27.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.107+0000 7f6c45d9b640 1 -- 172.21.15.27:0/1025244171 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041342010 0 0) 0x7f6c40037b90 con 0x7f6c4004fa70 2024-01-15T11:33:27.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.107+0000 7f6c45d9b640 1 -- 172.21.15.27:0/1025244171 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c34003530 con 0x7f6c4004fa70 2024-01-15T11:33:27.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.107+0000 7f6c46d9d640 1 -- 172.21.15.27:0/1025244171 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6c400544d0 msgr2=0x7f6c4004f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:27.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.107+0000 7f6c46d9d640 1 --2- 172.21.15.27:0/1025244171 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6c400544d0 0x7f6c4004f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.107+0000 7f6c46d9d640 1 -- 172.21.15.27:0/1025244171 >> v1:172.21.15.27:6789/0 conn(0x7f6c4004fa70 legacy=0x7f6c40052a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.107+0000 7f6c46d9d640 1 -- 172.21.15.27:0/1025244171 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c400e7820 con 0x7f6c400e30a0 2024-01-15T11:33:27.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.111+0000 7f6c46d9d640 1 --2- 172.21.15.27:0/1025244171 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6c400e30a0 0x7f6c40005ec0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6c380097c0 tx=0x7f6c3801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df267b87b259c2b3 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:27.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.111+0000 7f6c45d9b640 1 -- 172.21.15.27:0/1025244171 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c380a8970 con 0x7f6c400e30a0 2024-01-15T11:33:27.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.111+0000 7f6c45d9b640 1 -- 172.21.15.27:0/1025244171 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c380a8ad0 con 0x7f6c400e30a0 2024-01-15T11:33:27.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.111+0000 7f6c45d9b640 1 -- 172.21.15.27:0/1025244171 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c380a8e60 con 0x7f6c400e30a0 2024-01-15T11:33:27.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.115+0000 7f8a10757640 1 Processor -- start 2024-01-15T11:33:27.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.115+0000 7f8a10757640 1 -- start start 2024-01-15T11:33:27.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.115+0000 7f6c4c804640 1 -- 172.21.15.27:0/1025244171 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6c400e30a0 msgr2=0x7f6c40005ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.115+0000 7f6c4c804640 1 --2- 172.21.15.27:0/1025244171 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6c400e30a0 0x7f6c40005ec0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6c380097c0 tx=0x7f6c3801ec90 comp rx=0 tx=0).stop 2024-01-15T11:33:27.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.115+0000 7f6c4c804640 1 -- 172.21.15.27:0/1025244171 shutdown_connections 2024-01-15T11:33:27.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.115+0000 7f6c4c804640 1 --2- 172.21.15.27:0/1025244171 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6c400544d0 0x7f6c4004f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.115+0000 7f6c4c804640 1 --2- 172.21.15.27:0/1025244171 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6c400e30a0 0x7f6c40005ec0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.115+0000 7f6c4c804640 1 -- 172.21.15.27:0/1025244171 >> 172.21.15.27:0/1025244171 conn(0x7f6c40009f90 msgr2=0x7f6c4000a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:27.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.115+0000 7f6c4c804640 1 -- 172.21.15.27:0/1025244171 shutdown_connections 2024-01-15T11:33:27.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.115+0000 7f6c4c804640 1 -- 172.21.15.27:0/1025244171 wait complete. 2024-01-15T11:33:27.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.115+0000 7f8a10757640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8a080cc460 0x7f8a080abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.115+0000 7f8a10757640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a080b2710 con 0x7f8a080b34d0 2024-01-15T11:33:27.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.115+0000 7f8a10757640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a080b29f0 con 0x7f8a0815a710 2024-01-15T11:33:27.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.115+0000 7f8a10757640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a080cca80 con 0x7f8a080cc460 2024-01-15T11:33:27.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0dcf2640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8a080cc460 0x7f8a080abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0ecf4640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f8a080b34d0 0x7f8a080b3960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44050/0 (socket says 172.21.15.27:44050) 2024-01-15T11:33:27.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0ecf4640 1 -- 172.21.15.27:0/2054765376 learned_addr learned my addr 172.21.15.27:0/2054765376 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:27.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f6c4c804640 1 Processor -- start 2024-01-15T11:33:27.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f6c4c804640 1 -- start start 2024-01-15T11:33:27.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0d4f1640 1 -- 172.21.15.27:0/2054765376 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246202856 0 0) 0x7f8a080b2710 con 0x7f8a080b34d0 2024-01-15T11:33:27.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0d4f1640 1 -- 172.21.15.27:0/2054765376 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89f4003530 con 0x7f8a080b34d0 2024-01-15T11:33:27.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0d4f1640 1 -- 172.21.15.27:0/2054765376 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2544748962 0 0) 0x7f89f4003530 con 0x7f8a080b34d0 2024-01-15T11:33:27.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0d4f1640 1 -- 172.21.15.27:0/2054765376 >> v2:172.21.15.93:3300/0 conn(0x7f8a080cc460 msgr2=0x7f8a080abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:27.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0d4f1640 1 --2- 172.21.15.27:0/2054765376 >> v2:172.21.15.93:3300/0 conn(0x7f8a080cc460 0x7f8a080abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0d4f1640 1 -- 172.21.15.27:0/2054765376 >> v1:172.21.15.93:6789/0 conn(0x7f8a0815a710 legacy=0x7f8a080cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:27.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0d4f1640 1 -- 172.21.15.27:0/2054765376 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a081611b0 con 0x7f8a080b34d0 2024-01-15T11:33:27.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0d4f1640 1 -- 172.21.15.27:0/2054765376 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1394381265 0 0) 0x7f8a00001a00 con 0x7f8a080b34d0 2024-01-15T11:33:27.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0d4f1640 1 -- 172.21.15.27:0/2054765376 >> v1:172.21.15.27:6789/0 conn(0x7f8a080b34d0 legacy=0x7f8a080b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f6c4c804640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6c4004fa70 0x7f6c400dbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f6c4c804640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6c400544d0 0x7f6c40035cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0d4f1640 1 --2- 172.21.15.27:0/2054765376 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89f4003980 0x7f89f4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0d4f1640 1 --2- 172.21.15.27:0/2054765376 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89f40047d0 0x7f89f4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0d4f1640 1 --2- 172.21.15.27:0/2054765376 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f89f4005190 0x7f89f400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0d4f1640 1 -- 172.21.15.27:0/2054765376 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a080cca80 con 0x7f89f4003980 2024-01-15T11:33:27.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0d4f1640 1 -- 172.21.15.27:0/2054765376 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f400c010 con 0x7f89f40047d0 2024-01-15T11:33:27.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f6c4c804640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c400e30a0 0x7f6c400dcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f6c4659c640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6c400544d0 0x7f6c40035cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f6c4659c640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6c400544d0 0x7f6c40035cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:40144/0 (socket says 172.21.15.27:40144) 2024-01-15T11:33:27.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0d4f1640 1 -- 172.21.15.27:0/2054765376 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f400c1d0 con 0x7f89f4005190 2024-01-15T11:33:27.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0ecf4640 1 --2- 172.21.15.27:0/2054765376 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f89f4005190 0x7f89f400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.123+0000 7f6c4659c640 1 -- 172.21.15.27:0/813913768 learned_addr learned my addr 172.21.15.27:0/813913768 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:27.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.123+0000 7f6c46d9d640 1 --2- 172.21.15.27:0/813913768 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6c4004fa70 0x7f6c400dbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.123+0000 7f6c4c804640 1 -- 172.21.15.27:0/813913768 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c400344b0 con 0x7f6c400e30a0 2024-01-15T11:33:27.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.123+0000 7f6c4c804640 1 -- 172.21.15.27:0/813913768 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c40035030 con 0x7f6c4004fa70 2024-01-15T11:33:27.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.123+0000 7f6c4c804640 1 -- 172.21.15.27:0/813913768 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c40036210 con 0x7f6c400544d0 2024-01-15T11:33:27.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0dcf2640 1 --2- 172.21.15.27:0/2054765376 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89f40047d0 0x7f89f4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0e4f3640 1 --2- 172.21.15.27:0/2054765376 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89f4003980 0x7f89f4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0dcf2640 1 -- 172.21.15.27:0/2054765376 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f89f4005190 msgr2=0x7f89f400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:27.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0dcf2640 1 --2- 172.21.15.27:0/2054765376 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f89f4005190 0x7f89f400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0dcf2640 1 -- 172.21.15.27:0/2054765376 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89f4003980 msgr2=0x7f89f4003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:27.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0dcf2640 1 --2- 172.21.15.27:0/2054765376 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89f4003980 0x7f89f4003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0dcf2640 1 -- 172.21.15.27:0/2054765376 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a081611b0 con 0x7f89f40047d0 2024-01-15T11:33:27.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.119+0000 7f8a0e4f3640 1 --2- 172.21.15.27:0/2054765376 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89f4003980 0x7f89f4003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:27.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.123+0000 7f8a0ecf4640 1 -- 172.21.15.27:0/2054765376 reap_dead start 2024-01-15T11:33:27.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.123+0000 7f6c46d9d640 1 -- 172.21.15.27:0/813913768 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6c400544d0 msgr2=0x7f6c40035cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.123+0000 7f6c46d9d640 1 --2- 172.21.15.27:0/813913768 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6c400544d0 0x7f6c40035cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.123+0000 7f6c46d9d640 1 -- 172.21.15.27:0/813913768 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c400e30a0 msgr2=0x7f6c400dcdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.123+0000 7f6c46d9d640 1 --2- 172.21.15.27:0/813913768 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c400e30a0 0x7f6c400dcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.123+0000 7f6c46d9d640 1 -- 172.21.15.27:0/813913768 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c38009420 con 0x7f6c4004fa70 2024-01-15T11:33:27.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.123+0000 7f6c46d9d640 1 --2- 172.21.15.27:0/813913768 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6c4004fa70 0x7f6c400dbe90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6c380af000 tx=0x7f6c3801ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:27.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.123+0000 7f6c4659c640 1 --2- 172.21.15.27:0/813913768 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6c400544d0 0x7f6c40035cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:33:27.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.123+0000 7f6c3f7fe640 1 -- 172.21.15.27:0/813913768 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c380b1de0 con 0x7f6c4004fa70 2024-01-15T11:33:27.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.123+0000 7f6c3f7fe640 1 -- 172.21.15.27:0/813913768 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c380b9410 con 0x7f6c4004fa70 2024-01-15T11:33:27.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.123+0000 7f6c3f7fe640 1 -- 172.21.15.27:0/813913768 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c380b1de0 con 0x7f6c4004fa70 2024-01-15T11:33:27.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.123+0000 7f6c4c804640 1 -- 172.21.15.27:0/813913768 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c40034700 con 0x7f6c4004fa70 2024-01-15T11:33:27.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.123+0000 7f6c4c804640 1 -- 172.21.15.27:0/813913768 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c40034cc0 con 0x7f6c4004fa70 2024-01-15T11:33:27.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.127+0000 7f6c4c804640 1 -- 172.21.15.27:0/813913768 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c2c005260 con 0x7f6c4004fa70 2024-01-15T11:33:27.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.127+0000 7f8a0dcf2640 1 --2- 172.21.15.27:0/2054765376 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89f40047d0 0x7f89f4004c50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f89f8009ae0 tx=0x7f89f801cab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cc9178af92eb76c server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:27.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.127+0000 7f8a0d4f1640 1 -- 172.21.15.27:0/2054765376 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f80a5620 con 0x7f89f40047d0 2024-01-15T11:33:27.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.127+0000 7f8a0d4f1640 1 -- 172.21.15.27:0/2054765376 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f80a5780 con 0x7f89f40047d0 2024-01-15T11:33:27.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.127+0000 7f8a0d4f1640 1 -- 172.21.15.27:0/2054765376 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f80a5b70 con 0x7f89f40047d0 2024-01-15T11:33:27.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.127+0000 7f8a10757640 1 -- 172.21.15.27:0/2054765376 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89f40047d0 msgr2=0x7f89f4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.127+0000 7f8a10757640 1 --2- 172.21.15.27:0/2054765376 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89f40047d0 0x7f89f4004c50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f89f8009ae0 tx=0x7f89f801cab0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.127+0000 7f6c3f7fe640 1 -- 172.21.15.27:0/813913768 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f6c380b7040 con 0x7f6c4004fa70 2024-01-15T11:33:27.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.131+0000 7f8a10757640 1 -- 172.21.15.27:0/2054765376 shutdown_connections 2024-01-15T11:33:27.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.131+0000 7f8a10757640 1 --2- 172.21.15.27:0/2054765376 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89f40047d0 0x7f89f4004c50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.131+0000 7f8a10757640 1 -- 172.21.15.27:0/2054765376 >> 172.21.15.27:0/2054765376 conn(0x7f8a080b0cb0 msgr2=0x7f8a080b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:27.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.131+0000 7f8a10757640 1 -- 172.21.15.27:0/2054765376 shutdown_connections 2024-01-15T11:33:27.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.131+0000 7f8a10757640 1 -- 172.21.15.27:0/2054765376 wait complete. 2024-01-15T11:33:27.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.131+0000 7f6c3f7fe640 1 --2- 172.21.15.27:0/813913768 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6c28066950 0x7f6c28068e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.131+0000 7f6c4659c640 1 --2- 172.21.15.27:0/813913768 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6c28066950 0x7f6c28068e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.131+0000 7f6c4659c640 1 --2- 172.21.15.27:0/813913768 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6c28066950 0x7f6c28068e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6c40039dc0 tx=0x7f6c30008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:27.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.131+0000 7f6c3f7fe640 1 -- 172.21.15.27:0/813913768 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c38122040 con 0x7f6c4004fa70 2024-01-15T11:33:27.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.131+0000 7f8a10757640 1 Processor -- start 2024-01-15T11:33:27.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.131+0000 7f8a10757640 1 -- start start 2024-01-15T11:33:27.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.135+0000 7f6c3f7fe640 1 -- 172.21.15.27:0/813913768 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c380ef390 con 0x7f6c4004fa70 2024-01-15T11:33:27.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.135+0000 7f8a10757640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89f40047d0 0x7f8a08156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.135+0000 7f8a10757640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8a0815cb20 0x7f8a0815c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.135+0000 7f8a10757640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a0815c6d0 0x7f8a08203250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.135+0000 7f8a10757640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a08202e30 con 0x7f8a0815c6d0 2024-01-15T11:33:27.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.135+0000 7f8a10757640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a08099a30 con 0x7f89f40047d0 2024-01-15T11:33:27.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.135+0000 7f8a10757640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a08099c40 con 0x7f8a0815cb20 2024-01-15T11:33:27.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.135+0000 7f8a0e4f3640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89f40047d0 0x7f8a08156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.135+0000 7f8a0dcf2640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8a0815cb20 0x7f8a0815c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.135+0000 7f8a0e4f3640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89f40047d0 0x7f8a08156c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:52134/0 (socket says 172.21.15.27:52134) 2024-01-15T11:33:27.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.135+0000 7f8a0dcf2640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8a0815cb20 0x7f8a0815c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:40160/0 (socket says 172.21.15.27:40160) 2024-01-15T11:33:27.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.135+0000 7f8a0e4f3640 1 -- 172.21.15.27:0/2983293066 learned_addr learned my addr 172.21.15.27:0/2983293066 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:27.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.135+0000 7f8a0ecf4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a0815c6d0 0x7f8a08203250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.135+0000 7f8a0e4f3640 1 -- 172.21.15.27:0/2983293066 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8a0815cb20 msgr2=0x7f8a0815c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.135+0000 7f8a0e4f3640 1 --2- 172.21.15.27:0/2983293066 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8a0815cb20 0x7f8a0815c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.135+0000 7f8a0e4f3640 1 -- 172.21.15.27:0/2983293066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a0815c6d0 msgr2=0x7f8a08203250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.135+0000 7f8a0e4f3640 1 --2- 172.21.15.27:0/2983293066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a0815c6d0 0x7f8a08203250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.135+0000 7f8a0e4f3640 1 -- 172.21.15.27:0/2983293066 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a08099f20 con 0x7f89f40047d0 2024-01-15T11:33:27.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.139+0000 7f8a0e4f3640 1 --2- 172.21.15.27:0/2983293066 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89f40047d0 0x7f8a08156c40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a0400e520 tx=0x7f8a0400e9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:27.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.139+0000 7f89feffd640 1 -- 172.21.15.27:0/2983293066 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a04019070 con 0x7f89f40047d0 2024-01-15T11:33:27.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.139+0000 7f89feffd640 1 -- 172.21.15.27:0/2983293066 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a04007020 con 0x7f89f40047d0 2024-01-15T11:33:27.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.139+0000 7f89feffd640 1 -- 172.21.15.27:0/2983293066 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a04019070 con 0x7f89f40047d0 2024-01-15T11:33:27.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.139+0000 7f8a10757640 1 -- 172.21.15.27:0/2983293066 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0809a200 con 0x7f89f40047d0 2024-01-15T11:33:27.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.139+0000 7f8a10757640 1 -- 172.21.15.27:0/2983293066 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0809a4e0 con 0x7f89f40047d0 2024-01-15T11:33:27.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.143+0000 7f89feffd640 1 -- 172.21.15.27:0/2983293066 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f8a04007190 con 0x7f89f40047d0 2024-01-15T11:33:27.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.143+0000 7f89feffd640 1 --2- 172.21.15.27:0/2983293066 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f89ec066950 0x7f89ec068e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:27.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.143+0000 7f89feffd640 1 -- 172.21.15.27:0/2983293066 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a04054f10 con 0x7f89f40047d0 2024-01-15T11:33:27.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.147+0000 7f8a10757640 1 -- 172.21.15.27:0/2983293066 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a080671f0 con 0x7f89f40047d0 2024-01-15T11:33:27.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.147+0000 7f8a0dcf2640 1 --2- 172.21.15.27:0/2983293066 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f89ec066950 0x7f89ec068e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:27.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.147+0000 7f8a0dcf2640 1 --2- 172.21.15.27:0/2983293066 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f89ec066950 0x7f89ec068e10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f89f80af000 tx=0x7f89f80046d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:27.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.151+0000 7f89feffd640 1 -- 172.21.15.27:0/2983293066 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8a040519e0 con 0x7f89f40047d0 2024-01-15T11:33:27.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.315+0000 7f6ec3d01640 1 -- 172.21.15.27:0/293877070 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6ebc04e850 con 0x7f6ebc0b3ef0 2024-01-15T11:33:27.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.319+0000 7f6eb27fc640 1 -- 172.21.15.27:0/293877070 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6eb4017020 con 0x7f6ebc0b3ef0 2024-01-15T11:33:27.321 INFO:teuthology.orchestra.run.smithi027.stdout:64424509445 2024-01-15T11:33:27.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.319+0000 7fdc8d0ad640 1 -- 172.21.15.27:0/1197487723 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdc8815d080 con 0x7fdc8806c6b0 2024-01-15T11:33:27.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.319+0000 7fdc84ff9640 1 -- 172.21.15.27:0/1197487723 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdc78017020 con 0x7fdc8806c6b0 2024-01-15T11:33:27.321 INFO:teuthology.orchestra.run.smithi027.stdout:64424509445 2024-01-15T11:33:27.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.319+0000 7f6ec3d01640 1 -- 172.21.15.27:0/293877070 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6ea00668f0 msgr2=0x7f6ea0068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.319+0000 7f6ec3d01640 1 --2- 172.21.15.27:0/293877070 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6ea00668f0 0x7f6ea0068db0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800acd0 tx=0x7f6eb8004740 comp rx=0 tx=0).stop 2024-01-15T11:33:27.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.319+0000 7f6ec3d01640 1 -- 172.21.15.27:0/293877070 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ebc0b3ef0 msgr2=0x7f6ebc15bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.319+0000 7f6ec3d01640 1 --2- 172.21.15.27:0/293877070 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ebc0b3ef0 0x7f6ebc15bbf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6eb400c780 tx=0x7f6eb400cc40 comp rx=0 tx=0).stop 2024-01-15T11:33:27.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.323+0000 7f6ec3d01640 1 -- 172.21.15.27:0/293877070 shutdown_connections 2024-01-15T11:33:27.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.323+0000 7f6ec3d01640 1 --2- 172.21.15.27:0/293877070 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6ebc15cc80 0x7f6ebc0ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.323+0000 7f6ec3d01640 1 --2- 172.21.15.27:0/293877070 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6ea00668f0 0x7f6ea0068db0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.323+0000 7f6ec3d01640 1 --2- 172.21.15.27:0/293877070 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ebc0b3ef0 0x7f6ebc15bbf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.323+0000 7f6ec3d01640 1 --2- 172.21.15.27:0/293877070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ebc0b1fb0 0x7f6ebc155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.323+0000 7f6ec3d01640 1 -- 172.21.15.27:0/293877070 >> 172.21.15.27:0/293877070 conn(0x7f6ebc0b0cb0 msgr2=0x7f6ebc0aedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:27.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.323+0000 7f6ec3d01640 1 -- 172.21.15.27:0/293877070 shutdown_connections 2024-01-15T11:33:27.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.323+0000 7f6ec3d01640 1 -- 172.21.15.27:0/293877070 wait complete. 2024-01-15T11:33:27.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.323+0000 7fdc8d0ad640 1 -- 172.21.15.27:0/1197487723 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fdc740668f0 msgr2=0x7fdc74068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.323+0000 7fdc8d0ad640 1 --2- 172.21.15.27:0/1197487723 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fdc740668f0 0x7fdc74068db0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c007fd0 tx=0x7fdc7c009040 comp rx=0 tx=0).stop 2024-01-15T11:33:27.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.323+0000 7fdc8d0ad640 1 -- 172.21.15.27:0/1197487723 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc8806c6b0 msgr2=0x7fdc88141a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.323+0000 7fdc8d0ad640 1 --2- 172.21.15.27:0/1197487723 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc8806c6b0 0x7fdc88141a20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800c340 tx=0x7fdc7800c800 comp rx=0 tx=0).stop 2024-01-15T11:33:27.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.323+0000 7fdc8d0ad640 1 -- 172.21.15.27:0/1197487723 shutdown_connections 2024-01-15T11:33:27.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.323+0000 7fdc8d0ad640 1 --2- 172.21.15.27:0/1197487723 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc88143e50 0x7fdc8813fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.323+0000 7fdc8d0ad640 1 --2- 172.21.15.27:0/1197487723 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fdc740668f0 0x7fdc74068db0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.323+0000 7fdc8d0ad640 1 --2- 172.21.15.27:0/1197487723 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc8806c6b0 0x7fdc88141a20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.323+0000 7fdc8d0ad640 1 --2- 172.21.15.27:0/1197487723 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc8806c250 0x7fdc88138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.323+0000 7fdc8d0ad640 1 -- 172.21.15.27:0/1197487723 >> 172.21.15.27:0/1197487723 conn(0x7fdc8806df30 msgr2=0x7fdc880b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:27.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.323+0000 7fdc8d0ad640 1 -- 172.21.15.27:0/1197487723 shutdown_connections 2024-01-15T11:33:27.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.323+0000 7fdc8d0ad640 1 -- 172.21.15.27:0/1197487723 wait complete. 2024-01-15T11:33:27.356 INFO:teuthology.orchestra.run.smithi027.stdout:64424509445 2024-01-15T11:33:27.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.351+0000 7fb0eeffd640 1 -- 172.21.15.27:0/1765481867 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb1080cbc50 con 0x7fb1080ced30 2024-01-15T11:33:27.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.351+0000 7fb1057fa640 1 -- 172.21.15.27:0/1765481867 <== mon.2 v2:172.21.15.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb1080cbc50 con 0x7fb1080ced30 2024-01-15T11:33:27.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.351+0000 7fb0eeffd640 1 -- 172.21.15.27:0/1765481867 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb0f4066940 msgr2=0x7fb0f4068e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.351+0000 7fb0eeffd640 1 --2- 172.21.15.27:0/1765481867 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb0f4066940 0x7fb0f4068e00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc0ad000 tx=0x7fb0fc0a6000 comp rx=0 tx=0).stop 2024-01-15T11:33:27.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.355+0000 7fb0eeffd640 1 -- 172.21.15.27:0/1765481867 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb1080ced30 msgr2=0x7fb108154920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.355+0000 7fb0eeffd640 1 --2- 172.21.15.27:0/1765481867 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb1080ced30 0x7fb108154920 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb0f800c750 tx=0x7fb0f800cc10 comp rx=0 tx=0).stop 2024-01-15T11:33:27.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.355+0000 7fb0eeffd640 1 -- 172.21.15.27:0/1765481867 shutdown_connections 2024-01-15T11:33:27.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.355+0000 7fb0eeffd640 1 --2- 172.21.15.27:0/1765481867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb10815d8f0 0x7fb1081fb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.355+0000 7fb0eeffd640 1 --2- 172.21.15.27:0/1765481867 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb0f4066940 0x7fb0f4068e00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.355+0000 7fb0eeffd640 1 --2- 172.21.15.27:0/1765481867 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1080cf1b0 0x7fb1081fb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.355+0000 7fb0eeffd640 1 --2- 172.21.15.27:0/1765481867 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb1080ced30 0x7fb108154920 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.355+0000 7fb0eeffd640 1 -- 172.21.15.27:0/1765481867 >> 172.21.15.27:0/1765481867 conn(0x7fb10809c750 msgr2=0x7fb1080b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:27.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.355+0000 7fb0eeffd640 1 -- 172.21.15.27:0/1765481867 shutdown_connections 2024-01-15T11:33:27.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.355+0000 7fb0eeffd640 1 -- 172.21.15.27:0/1765481867 wait complete. 2024-01-15T11:33:27.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.355+0000 7fb3d5ffb640 1 -- 172.21.15.27:0/3778669882 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb3f006b460 con 0x7fb3f0151010 2024-01-15T11:33:27.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.355+0000 7fb3d7fff640 1 -- 172.21.15.27:0/3778669882 <== mon.2 v2:172.21.15.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb3e0055170 con 0x7fb3f0151010 2024-01-15T11:33:27.361 INFO:teuthology.orchestra.run.smithi027.stdout:64424509446 2024-01-15T11:33:27.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.0 2024-01-15T11:33:27.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.359+0000 7fb3d5ffb640 1 -- 172.21.15.27:0/3778669882 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb3dc0669c0 msgr2=0x7fb3dc068e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.359+0000 7fb3d5ffb640 1 --2- 172.21.15.27:0/3778669882 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb3dc0669c0 0x7fb3dc068e80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb3e80af000 tx=0x7fb3e80b4040 comp rx=0 tx=0).stop 2024-01-15T11:33:27.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.359+0000 7fb3d5ffb640 1 -- 172.21.15.27:0/3778669882 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3f0151010 msgr2=0x7fb3f015b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.359+0000 7fb3d5ffb640 1 --2- 172.21.15.27:0/3778669882 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3f0151010 0x7fb3f015b340 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0007f20 tx=0x7fb3e000f550 comp rx=0 tx=0).stop 2024-01-15T11:33:27.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.359+0000 7fb3d5ffb640 1 -- 172.21.15.27:0/3778669882 shutdown_connections 2024-01-15T11:33:27.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.359+0000 7fb3d5ffb640 1 --2- 172.21.15.27:0/3778669882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3f0155b50 0x7fb3f01f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.359+0000 7fb3d5ffb640 1 --2- 172.21.15.27:0/3778669882 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb3dc0669c0 0x7fb3dc068e80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.359+0000 7fb3d5ffb640 1 --2- 172.21.15.27:0/3778669882 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3f0159240 0x7fb3f0155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.359+0000 7fb3d5ffb640 1 --2- 172.21.15.27:0/3778669882 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3f0151010 0x7fb3f015b340 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.359+0000 7fb3d5ffb640 1 -- 172.21.15.27:0/3778669882 >> 172.21.15.27:0/3778669882 conn(0x7fb3f00b0cb0 msgr2=0x7fb3f0070690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:27.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.1 2024-01-15T11:33:27.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.359+0000 7fb3d5ffb640 1 -- 172.21.15.27:0/3778669882 shutdown_connections 2024-01-15T11:33:27.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.359+0000 7fb3d5ffb640 1 -- 172.21.15.27:0/3778669882 wait complete. 2024-01-15T11:33:27.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.3 2024-01-15T11:33:27.393 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.2 2024-01-15T11:33:27.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.407+0000 7f4778dd8640 1 -- 172.21.15.27:0/3151418464 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f4758005510 con 0x7f47740ce230 2024-01-15T11:33:27.411 INFO:teuthology.orchestra.run.smithi027.stdout:64424509446 2024-01-15T11:33:27.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.407+0000 7f4762ffd640 1 -- 172.21.15.27:0/3151418464 <== mon.2 v2:172.21.15.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f476c018090 con 0x7f47740ce230 2024-01-15T11:33:27.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.411+0000 7f4778dd8640 1 -- 172.21.15.27:0/3151418464 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4754066950 msgr2=0x7f4754068e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.411+0000 7f4778dd8640 1 --2- 172.21.15.27:0/3151418464 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4754066950 0x7f4754068e10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f47640b2000 tx=0x7f47640aa070 comp rx=0 tx=0).stop 2024-01-15T11:33:27.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.411+0000 7f4778dd8640 1 -- 172.21.15.27:0/3151418464 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f47740ce230 msgr2=0x7f4774166380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.411+0000 7f4778dd8640 1 --2- 172.21.15.27:0/3151418464 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f47740ce230 0x7f4774166380 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f476c00efc0 tx=0x7f476c00c490 comp rx=0 tx=0).stop 2024-01-15T11:33:27.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.411+0000 7f4778dd8640 1 -- 172.21.15.27:0/3151418464 shutdown_connections 2024-01-15T11:33:27.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.411+0000 7f4778dd8640 1 --2- 172.21.15.27:0/3151418464 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4754066950 0x7f4754068e10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.411+0000 7f4778dd8640 1 --2- 172.21.15.27:0/3151418464 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4774159160 0x7f4774146cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.411+0000 7f4778dd8640 1 --2- 172.21.15.27:0/3151418464 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f47740ce230 0x7f4774166380 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.411+0000 7f4778dd8640 1 --2- 172.21.15.27:0/3151418464 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f477406e920 0x7f4774165e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.411+0000 7f4778dd8640 1 -- 172.21.15.27:0/3151418464 >> 172.21.15.27:0/3151418464 conn(0x7f477406c340 msgr2=0x7f4774159a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:27.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.411+0000 7f4778dd8640 1 -- 172.21.15.27:0/3151418464 shutdown_connections 2024-01-15T11:33:27.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.411+0000 7f4778dd8640 1 -- 172.21.15.27:0/3151418464 wait complete. 2024-01-15T11:33:27.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.419+0000 7f8a10757640 1 -- 172.21.15.27:0/2983293066 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f8a0806b460 con 0x7f89f40047d0 2024-01-15T11:33:27.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.423+0000 7f89feffd640 1 -- 172.21.15.27:0/2983293066 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8a04051b80 con 0x7f89f40047d0 2024-01-15T11:33:27.425 INFO:teuthology.orchestra.run.smithi027.stdout:64424509447 2024-01-15T11:33:27.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.423+0000 7f8a10757640 1 -- 172.21.15.27:0/2983293066 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f89ec066950 msgr2=0x7f89ec068e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.423+0000 7f8a10757640 1 --2- 172.21.15.27:0/2983293066 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f89ec066950 0x7f89ec068e10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f89f80af000 tx=0x7f89f80046d0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.423+0000 7f8a10757640 1 -- 172.21.15.27:0/2983293066 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89f40047d0 msgr2=0x7f8a08156c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.423+0000 7f8a10757640 1 --2- 172.21.15.27:0/2983293066 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89f40047d0 0x7f8a08156c40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a0400e520 tx=0x7f8a0400e9e0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.423+0000 7f8a10757640 1 -- 172.21.15.27:0/2983293066 shutdown_connections 2024-01-15T11:33:27.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.423+0000 7f8a10757640 1 --2- 172.21.15.27:0/2983293066 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a0815c6d0 0x7f8a08203250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.423+0000 7f8a10757640 1 --2- 172.21.15.27:0/2983293066 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8a0815cb20 0x7f8a0815c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.423+0000 7f8a10757640 1 --2- 172.21.15.27:0/2983293066 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f89ec066950 0x7f89ec068e10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.423+0000 7f8a10757640 1 --2- 172.21.15.27:0/2983293066 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89f40047d0 0x7f8a08156c40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.423+0000 7f8a10757640 1 -- 172.21.15.27:0/2983293066 >> 172.21.15.27:0/2983293066 conn(0x7f8a080b0cb0 msgr2=0x7f8a080ac3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:27.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.423+0000 7f8a10757640 1 -- 172.21.15.27:0/2983293066 shutdown_connections 2024-01-15T11:33:27.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.423+0000 7f8a10757640 1 -- 172.21.15.27:0/2983293066 wait complete. 2024-01-15T11:33:27.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.7 2024-01-15T11:33:27.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.4 2024-01-15T11:33:27.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.443+0000 7f59b1c74640 1 -- 172.21.15.27:0/2741911340 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f59ac0c06c0 con 0x7f59ac0ce6b0 2024-01-15T11:33:27.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.443+0000 7f59a97fa640 1 -- 172.21.15.27:0/2741911340 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f59ac0c06c0 con 0x7f59ac0ce6b0 2024-01-15T11:33:27.448 INFO:teuthology.orchestra.run.smithi027.stdout:64424509446 2024-01-15T11:33:27.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.447+0000 7f59b1c74640 1 -- 172.21.15.27:0/2741911340 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f598c0669c0 msgr2=0x7f598c068e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.447+0000 7f59b1c74640 1 --2- 172.21.15.27:0/2741911340 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f598c0669c0 0x7f598c068e80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0b53f0 tx=0x7f59a4009040 comp rx=0 tx=0).stop 2024-01-15T11:33:27.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.447+0000 7f59b1c74640 1 -- 172.21.15.27:0/2741911340 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59ac0ce6b0 msgr2=0x7f59ac0c32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.447+0000 7f59b1c74640 1 --2- 172.21.15.27:0/2741911340 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59ac0ce6b0 0x7f59ac0c32b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f599400e870 tx=0x7f599400ed30 comp rx=0 tx=0).stop 2024-01-15T11:33:27.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.447+0000 7f59b1c74640 1 -- 172.21.15.27:0/2741911340 shutdown_connections 2024-01-15T11:33:27.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.447+0000 7f59b1c74640 1 --2- 172.21.15.27:0/2741911340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59ac0d3400 0x7f59ac202260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.447+0000 7f59b1c74640 1 --2- 172.21.15.27:0/2741911340 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59ac1609c0 0x7f59ac159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.447+0000 7f59b1c74640 1 --2- 172.21.15.27:0/2741911340 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f598c0669c0 0x7f598c068e80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.447+0000 7f59b1c74640 1 --2- 172.21.15.27:0/2741911340 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59ac0ce6b0 0x7f59ac0c32b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.447+0000 7f59b1c74640 1 -- 172.21.15.27:0/2741911340 >> 172.21.15.27:0/2741911340 conn(0x7f59ac0668a0 msgr2=0x7f59ac0cda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:27.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.447+0000 7f59b1c74640 1 -- 172.21.15.27:0/2741911340 shutdown_connections 2024-01-15T11:33:27.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.447+0000 7f59b1c74640 1 -- 172.21.15.27:0/2741911340 wait complete. 2024-01-15T11:33:27.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.467+0000 7f6c4c804640 1 -- 172.21.15.27:0/813913768 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6c2c005510 con 0x7f6c4004fa70 2024-01-15T11:33:27.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.467+0000 7f6c3f7fe640 1 -- 172.21.15.27:0/813913768 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6c380f29b0 con 0x7f6c4004fa70 2024-01-15T11:33:27.472 INFO:teuthology.orchestra.run.smithi027.stdout:60129542149 2024-01-15T11:33:27.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.471+0000 7f6c4c804640 1 -- 172.21.15.27:0/813913768 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6c28066950 msgr2=0x7f6c28068e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.471+0000 7f6c4c804640 1 --2- 172.21.15.27:0/813913768 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6c28066950 0x7f6c28068e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6c40039dc0 tx=0x7f6c30008040 comp rx=0 tx=0).stop 2024-01-15T11:33:27.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.471+0000 7f6c4c804640 1 -- 172.21.15.27:0/813913768 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6c4004fa70 msgr2=0x7f6c400dbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:27.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.471+0000 7f6c4c804640 1 --2- 172.21.15.27:0/813913768 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6c4004fa70 0x7f6c400dbe90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6c380af000 tx=0x7f6c3801ba30 comp rx=0 tx=0).stop 2024-01-15T11:33:27.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.471+0000 7f6c4c804640 1 -- 172.21.15.27:0/813913768 shutdown_connections 2024-01-15T11:33:27.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.471+0000 7f6c4c804640 1 --2- 172.21.15.27:0/813913768 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6c400e30a0 0x7f6c400dcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.471+0000 7f6c4c804640 1 --2- 172.21.15.27:0/813913768 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6c400544d0 0x7f6c40035cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.471+0000 7f6c4c804640 1 --2- 172.21.15.27:0/813913768 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6c28066950 0x7f6c28068e10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.471+0000 7f6c4c804640 1 --2- 172.21.15.27:0/813913768 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6c4004fa70 0x7f6c400dbe90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:27.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.471+0000 7f6c4c804640 1 -- 172.21.15.27:0/813913768 >> 172.21.15.27:0/813913768 conn(0x7f6c40009f90 msgr2=0x7f6c40006a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:27.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.471+0000 7f6c4c804640 1 -- 172.21.15.27:0/813913768 shutdown_connections 2024-01-15T11:33:27.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:27.471+0000 7f6c4c804640 1 -- 172.21.15.27:0/813913768 wait complete. 2024-01-15T11:33:27.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.6 2024-01-15T11:33:27.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.5 2024-01-15T11:33:28.362 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-15T11:33:28.366 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-15T11:33:28.391 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-15T11:33:28.394 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-15T11:33:28.434 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-15T11:33:28.448 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-15T11:33:28.477 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-15T11:33:28.494 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-15T11:33:28.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.543+0000 7f67c813e640 1 Processor -- start 2024-01-15T11:33:28.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.543+0000 7f67c813e640 1 -- start start 2024-01-15T11:33:28.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.547+0000 7f67c813e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f67c0160b30 0x7f67c006d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.547+0000 7f67c813e640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f67c00b4030 0x7f67c00cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.547+0000 7f67c813e640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67c0161cd0 0x7f67c00cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.547+0000 7f67c813e640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c00b3ba0 con 0x7f67c0160b30 2024-01-15T11:33:28.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.547+0000 7f67c813e640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c006e240 con 0x7f67c00b4030 2024-01-15T11:33:28.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.547+0000 7f67c813e640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c00b3550 con 0x7f67c0161cd0 2024-01-15T11:33:28.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.547+0000 7f67c66db640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67c0161cd0 0x7f67c00cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.547+0000 7f67c66db640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67c0161cd0 0x7f67c00cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:40162/0 (socket says 172.21.15.27:40162) 2024-01-15T11:33:28.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.547+0000 7f67c66db640 1 -- 172.21.15.27:0/574915925 learned_addr learned my addr 172.21.15.27:0/574915925 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:28.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.551+0000 7f67c66db640 1 -- 172.21.15.27:0/574915925 >> v2:172.21.15.93:3300/0 conn(0x7f67c00b4030 msgr2=0x7f67c00cbc50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-15T11:33:28.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.551+0000 7f67c66db640 1 --2- 172.21.15.27:0/574915925 >> v2:172.21.15.93:3300/0 conn(0x7f67c00b4030 0x7f67c00cbc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.551+0000 7f67c66db640 1 -- 172.21.15.27:0/574915925 >> v2:172.21.15.27:3300/0 conn(0x7f67c0160b30 msgr2=0x7f67c006d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:28.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.551+0000 7f67c66db640 1 --2- 172.21.15.27:0/574915925 >> v2:172.21.15.27:3300/0 conn(0x7f67c0160b30 0x7f67c006d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.551+0000 7f67c66db640 1 -- 172.21.15.27:0/574915925 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c00b3830 con 0x7f67c0161cd0 2024-01-15T11:33:28.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.555+0000 7f67c66db640 1 --2- 172.21.15.27:0/574915925 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67c0161cd0 0x7f67c00cc190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f67c00b2960 tx=0x7f67bc01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a21b46945102d640 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:28.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.555+0000 7f67c4ed8640 1 -- 172.21.15.27:0/574915925 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc0ab5f0 con 0x7f67c0161cd0 2024-01-15T11:33:28.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.555+0000 7f67c4ed8640 1 -- 172.21.15.27:0/574915925 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67bc0ab750 con 0x7f67c0161cd0 2024-01-15T11:33:28.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.555+0000 7f67c4ed8640 1 -- 172.21.15.27:0/574915925 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc0abae0 con 0x7f67c0161cd0 2024-01-15T11:33:28.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.559+0000 7f67c813e640 1 -- 172.21.15.27:0/574915925 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67c0161cd0 msgr2=0x7f67c00cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.559+0000 7f67c813e640 1 --2- 172.21.15.27:0/574915925 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67c0161cd0 0x7f67c00cc190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f67c00b2960 tx=0x7f67bc01c490 comp rx=0 tx=0).stop 2024-01-15T11:33:28.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.559+0000 7f67c813e640 1 -- 172.21.15.27:0/574915925 shutdown_connections 2024-01-15T11:33:28.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.559+0000 7f67c813e640 1 --2- 172.21.15.27:0/574915925 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67c0161cd0 0x7f67c00cc190 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.559+0000 7f67c813e640 1 --2- 172.21.15.27:0/574915925 >> v2:172.21.15.93:3300/0 conn(0x7f67c00b4030 0x7f67c00cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.559+0000 7f67c813e640 1 --2- 172.21.15.27:0/574915925 >> v2:172.21.15.27:3300/0 conn(0x7f67c0160b30 0x7f67c006d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.559+0000 7f67c813e640 1 -- 172.21.15.27:0/574915925 >> 172.21.15.27:0/574915925 conn(0x7f67c00b0cb0 msgr2=0x7f67c00b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:28.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.559+0000 7f67c813e640 1 -- 172.21.15.27:0/574915925 shutdown_connections 2024-01-15T11:33:28.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.559+0000 7f67c813e640 1 -- 172.21.15.27:0/574915925 wait complete. 2024-01-15T11:33:28.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.563+0000 7f67c813e640 1 Processor -- start 2024-01-15T11:33:28.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.559+0000 7ff72e1f5640 1 Processor -- start 2024-01-15T11:33:28.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.559+0000 7ff72e1f5640 1 -- start start 2024-01-15T11:33:28.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.559+0000 7ff72e1f5640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff72806d910 0x7ff72806dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.559+0000 7ff72e1f5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff728162bd0 0x7ff7281654f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.559+0000 7ff72e1f5640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff728165a30 0x7ff72806c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.559+0000 7ff72e1f5640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7281627b0 con 0x7ff72806d910 2024-01-15T11:33:28.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.559+0000 7ff72e1f5640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff728166430 con 0x7ff728162bd0 2024-01-15T11:33:28.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.559+0000 7ff72e1f5640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff728165ee0 con 0x7ff728165a30 2024-01-15T11:33:28.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.563+0000 7f67c813e640 1 -- start start 2024-01-15T11:33:28.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.563+0000 7ff7277fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff72806d910 0x7ff72806dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.563+0000 7ff7277fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff72806d910 0x7ff72806dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55482/0 (socket says 172.21.15.27:55482) 2024-01-15T11:33:28.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.563+0000 7ff7277fe640 1 -- 172.21.15.27:0/3626997547 learned_addr learned my addr 172.21.15.27:0/3626997547 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:28.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.563+0000 7ff7277fe640 1 -- 172.21.15.27:0/3626997547 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff728165a30 msgr2=0x7ff72806c6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-15T11:33:28.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.563+0000 7ff7277fe640 1 --2- 172.21.15.27:0/3626997547 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff728165a30 0x7ff72806c6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.563+0000 7ff7277fe640 1 -- 172.21.15.27:0/3626997547 >> v2:172.21.15.93:3300/0 conn(0x7ff728162bd0 msgr2=0x7ff7281654f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-15T11:33:28.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.563+0000 7ff7277fe640 1 --2- 172.21.15.27:0/3626997547 >> v2:172.21.15.93:3300/0 conn(0x7ff728162bd0 0x7ff7281654f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.563+0000 7ff7277fe640 1 -- 172.21.15.27:0/3626997547 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7280cbf20 con 0x7ff72806d910 2024-01-15T11:33:28.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.563+0000 7f67c813e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67c00b4030 0x7f67c0205c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.563+0000 7f67c813e640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67c0160b30 0x7f67c015fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.563+0000 7f67c813e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67c0161cd0 0x7f67c0158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.563+0000 7f67c813e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c0203f20 con 0x7f67c00b4030 2024-01-15T11:33:28.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.563+0000 7f67c813e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c0203a90 con 0x7f67c0161cd0 2024-01-15T11:33:28.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.563+0000 7f67c813e640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c02052d0 con 0x7f67c0160b30 2024-01-15T11:33:28.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.563+0000 7f67c56d9640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67c0160b30 0x7f67c015fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.563+0000 7f67c66db640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67c0161cd0 0x7f67c0158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.563+0000 7f67c66db640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67c0161cd0 0x7f67c0158530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:52156/0 (socket says 172.21.15.27:52156) 2024-01-15T11:33:28.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.563+0000 7f67c66db640 1 -- 172.21.15.27:0/2816654030 learned_addr learned my addr 172.21.15.27:0/2816654030 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:28.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.563+0000 7f67c5eda640 1 --2- 172.21.15.27:0/2816654030 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67c00b4030 0x7f67c0205c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.567+0000 7f67c66db640 1 -- 172.21.15.27:0/2816654030 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67c0160b30 msgr2=0x7f67c015fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.567+0000 7f67c66db640 1 --2- 172.21.15.27:0/2816654030 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67c0160b30 0x7f67c015fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.567+0000 7f67c66db640 1 -- 172.21.15.27:0/2816654030 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67c00b4030 msgr2=0x7f67c0205c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.567+0000 7f67c66db640 1 --2- 172.21.15.27:0/2816654030 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67c00b4030 0x7f67c0205c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.567+0000 7f67c66db640 1 -- 172.21.15.27:0/2816654030 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67bc0094d0 con 0x7f67c0161cd0 2024-01-15T11:33:28.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.567+0000 7f67c56d9640 1 --2- 172.21.15.27:0/2816654030 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67c0160b30 0x7f67c015fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:28.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.567+0000 7f67c5eda640 1 --2- 172.21.15.27:0/2816654030 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67c00b4030 0x7f67c0205c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:28.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.567+0000 7ff7277fe640 1 --2- 172.21.15.27:0/3626997547 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff72806d910 0x7ff72806dcf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff7280aebf0 tx=0x7ff71c01c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260cddfc95510ad1 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:28.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.567+0000 7f67c66db640 1 --2- 172.21.15.27:0/2816654030 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67c0161cd0 0x7f67c0158530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f67bc0ad040 tx=0x7f67bc019230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:28.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.567+0000 7ff7267fc640 1 -- 172.21.15.27:0/3626997547 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c0ab600 con 0x7ff72806d910 2024-01-15T11:33:28.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.567+0000 7ff7267fc640 1 -- 172.21.15.27:0/3626997547 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c0a7050 con 0x7ff72806d910 2024-01-15T11:33:28.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.567+0000 7ff7267fc640 1 -- 172.21.15.27:0/3626997547 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c0ab980 con 0x7ff72806d910 2024-01-15T11:33:28.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.567+0000 7f67b67fc640 1 -- 172.21.15.27:0/2816654030 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc0c0680 con 0x7f67c0161cd0 2024-01-15T11:33:28.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.567+0000 7f67b67fc640 1 -- 172.21.15.27:0/2816654030 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67bc0b9070 con 0x7f67c0161cd0 2024-01-15T11:33:28.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.567+0000 7f67b67fc640 1 -- 172.21.15.27:0/2816654030 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc0c0a20 con 0x7f67c0161cd0 2024-01-15T11:33:28.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.567+0000 7f67c813e640 1 -- 172.21.15.27:0/2816654030 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c0202e80 con 0x7f67c0161cd0 2024-01-15T11:33:28.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.567+0000 7f67c813e640 1 -- 172.21.15.27:0/2816654030 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c0203440 con 0x7f67c0161cd0 2024-01-15T11:33:28.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.571+0000 7ff72e1f5640 1 -- 172.21.15.27:0/3626997547 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff72806d910 msgr2=0x7ff72806dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.571+0000 7ff72e1f5640 1 --2- 172.21.15.27:0/3626997547 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff72806d910 0x7ff72806dcf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff7280aebf0 tx=0x7ff71c01c280 comp rx=0 tx=0).stop 2024-01-15T11:33:28.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.571+0000 7ff72e1f5640 1 -- 172.21.15.27:0/3626997547 shutdown_connections 2024-01-15T11:33:28.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.571+0000 7ff72e1f5640 1 --2- 172.21.15.27:0/3626997547 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff728165a30 0x7ff72806c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.571+0000 7ff72e1f5640 1 --2- 172.21.15.27:0/3626997547 >> v2:172.21.15.93:3300/0 conn(0x7ff728162bd0 0x7ff7281654f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.571+0000 7ff72e1f5640 1 --2- 172.21.15.27:0/3626997547 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff72806d910 0x7ff72806dcf0 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff7280aebf0 tx=0x7ff71c01c280 comp rx=0 tx=0).stop 2024-01-15T11:33:28.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.571+0000 7ff72e1f5640 1 -- 172.21.15.27:0/3626997547 >> 172.21.15.27:0/3626997547 conn(0x7ff7280b0cb0 msgr2=0x7ff7280b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:28.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.571+0000 7f67c813e640 1 -- 172.21.15.27:0/2816654030 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67c0203c00 con 0x7f67c0161cd0 2024-01-15T11:33:28.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.571+0000 7ff72e1f5640 1 -- 172.21.15.27:0/3626997547 shutdown_connections 2024-01-15T11:33:28.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.571+0000 7ff72e1f5640 1 -- 172.21.15.27:0/3626997547 wait complete. 2024-01-15T11:33:28.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.575+0000 7ff72e1f5640 1 Processor -- start 2024-01-15T11:33:28.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.571+0000 7f67b67fc640 1 -- 172.21.15.27:0/2816654030 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f67bc0c0b80 con 0x7f67c0161cd0 2024-01-15T11:33:28.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.575+0000 7f67b67fc640 1 --2- 172.21.15.27:0/2816654030 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f67a4066940 0x7f67a4068e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.575+0000 7f67b67fc640 1 -- 172.21.15.27:0/2816654030 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67bc0bb070 con 0x7f67c0161cd0 2024-01-15T11:33:28.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.575+0000 7ff72e1f5640 1 -- start start 2024-01-15T11:33:28.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.575+0000 7f67c5eda640 1 --2- 172.21.15.27:0/2816654030 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f67a4066940 0x7f67a4068e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.575+0000 7f67c5eda640 1 --2- 172.21.15.27:0/2816654030 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f67a4066940 0x7f67a4068e00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f67b800a7b0 tx=0x7f67b800d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:28.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.575+0000 7ff72e1f5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff728162bd0 0x7ff72814c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.575+0000 7ff72e1f5640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff728165a30 0x7ff7280adf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.579+0000 7ff7277fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff728162bd0 0x7ff72814c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.579+0000 7ff726ffd640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff728165a30 0x7ff7280adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.579+0000 7ff726ffd640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff728165a30 0x7ff7280adf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:40184/0 (socket says 172.21.15.27:40184) 2024-01-15T11:33:28.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.579+0000 7ff7277fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff728162bd0 0x7ff72814c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55486/0 (socket says 172.21.15.27:55486) 2024-01-15T11:33:28.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.579+0000 7ff72e1f5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7280ae480 0x7ff728160f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.579+0000 7ff726ffd640 1 -- 172.21.15.27:0/1696236411 learned_addr learned my addr 172.21.15.27:0/1696236411 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:28.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.579+0000 7f67b67fc640 1 -- 172.21.15.27:0/2816654030 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f67bc0ec670 con 0x7f67c0161cd0 2024-01-15T11:33:28.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.579+0000 7ff727fff640 1 --2- 172.21.15.27:0/1696236411 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7280ae480 0x7ff728160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.579+0000 7ff72e1f5640 1 -- 172.21.15.27:0/1696236411 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72815bc30 con 0x7ff728162bd0 2024-01-15T11:33:28.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.579+0000 7ff72e1f5640 1 -- 172.21.15.27:0/1696236411 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72814c7d0 con 0x7ff7280ae480 2024-01-15T11:33:28.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.579+0000 7ff72e1f5640 1 -- 172.21.15.27:0/1696236411 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff728099a30 con 0x7ff728165a30 2024-01-15T11:33:28.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.579+0000 7ff726ffd640 1 -- 172.21.15.27:0/1696236411 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7280ae480 msgr2=0x7ff728160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.579+0000 7ff726ffd640 1 --2- 172.21.15.27:0/1696236411 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7280ae480 0x7ff728160f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.579+0000 7ff726ffd640 1 -- 172.21.15.27:0/1696236411 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff728162bd0 msgr2=0x7ff72814c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.579+0000 7ff726ffd640 1 --2- 172.21.15.27:0/1696236411 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff728162bd0 0x7ff72814c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.579+0000 7ff726ffd640 1 -- 172.21.15.27:0/1696236411 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71c0094d0 con 0x7ff728165a30 2024-01-15T11:33:28.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.579+0000 7ff727fff640 1 --2- 172.21.15.27:0/1696236411 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7280ae480 0x7ff728160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:28.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.579+0000 7ff726ffd640 1 --2- 172.21.15.27:0/1696236411 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff728165a30 0x7ff7280adf40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff72000ba10 tx=0x7ff72000bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:28.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.583+0000 7ff70ffff640 1 -- 172.21.15.27:0/1696236411 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72000cbd0 con 0x7ff728165a30 2024-01-15T11:33:28.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.583+0000 7ff70ffff640 1 -- 172.21.15.27:0/1696236411 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72000cd30 con 0x7ff728165a30 2024-01-15T11:33:28.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.583+0000 7ff70ffff640 1 -- 172.21.15.27:0/1696236411 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72000cea0 con 0x7ff728165a30 2024-01-15T11:33:28.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.583+0000 7ff72e1f5640 1 -- 172.21.15.27:0/1696236411 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff728099d10 con 0x7ff728165a30 2024-01-15T11:33:28.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.583+0000 7ff72e1f5640 1 -- 172.21.15.27:0/1696236411 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff72809a2d0 con 0x7ff728165a30 2024-01-15T11:33:28.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.587+0000 7ff70ffff640 1 -- 172.21.15.27:0/1696236411 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7ff720014680 con 0x7ff728165a30 2024-01-15T11:33:28.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.587+0000 7ff70ffff640 1 --2- 172.21.15.27:0/1696236411 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff7140669c0 0x7ff714068e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.587+0000 7ff70ffff640 1 -- 172.21.15.27:0/1696236411 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff720084290 con 0x7ff728165a30 2024-01-15T11:33:28.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.587+0000 7ff72e1f5640 1 -- 172.21.15.27:0/1696236411 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff708005260 con 0x7ff728165a30 2024-01-15T11:33:28.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.587+0000 7ff7277fe640 1 --2- 172.21.15.27:0/1696236411 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff7140669c0 0x7ff714068e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.591+0000 7ff7277fe640 1 --2- 172.21.15.27:0/1696236411 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff7140669c0 0x7ff714068e80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0ad000 tx=0x7ff71c0a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:28.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.595+0000 7ff70ffff640 1 -- 172.21.15.27:0/1696236411 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff720051560 con 0x7ff728165a30 2024-01-15T11:33:28.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.615+0000 7f9114c9c640 1 Processor -- start 2024-01-15T11:33:28.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.615+0000 7f9114c9c640 1 -- start start 2024-01-15T11:33:28.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.619+0000 7f9114c9c640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9110070490 0x7f911006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.619+0000 7f9114c9c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f911006dde0 0x7f91100cd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.619+0000 7f9114c9c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f911006e220 con 0x7f911014b120 2024-01-15T11:33:28.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.619+0000 7f9114c9c640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f911014b500 con 0x7f911006dde0 2024-01-15T11:33:28.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.619+0000 7f9114c9c640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91100719e0 con 0x7f9110070490 2024-01-15T11:33:28.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.619+0000 7f910ffff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f911006dde0 0x7f91100cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.619+0000 7f910ffff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f911006dde0 0x7f91100cd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55494/0 (socket says 172.21.15.27:55494) 2024-01-15T11:33:28.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.619+0000 7f910ffff640 1 -- 172.21.15.27:0/2836024606 learned_addr learned my addr 172.21.15.27:0/2836024606 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:28.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.619+0000 7f910effd640 1 --2- 172.21.15.27:0/2836024606 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9110070490 0x7f911006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.619+0000 7f910e7fc640 1 -- 172.21.15.27:0/2836024606 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536018321 0 0) 0x7f911006e220 con 0x7f911014b120 2024-01-15T11:33:28.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.619+0000 7f910ffff640 1 -- 172.21.15.27:0/2836024606 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9110070490 msgr2=0x7f911006d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:28.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.623+0000 7f910ffff640 1 --2- 172.21.15.27:0/2836024606 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9110070490 0x7f911006d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.623+0000 7f910ffff640 1 -- 172.21.15.27:0/2836024606 >> v1:172.21.15.93:6789/0 conn(0x7f911014b120 legacy=0x7f91100712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.623+0000 7f910ffff640 1 -- 172.21.15.27:0/2836024606 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9110071c90 con 0x7f911006dde0 2024-01-15T11:33:28.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.623+0000 7f910effd640 1 --2- 172.21.15.27:0/2836024606 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9110070490 0x7f911006d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:33:28.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.623+0000 7fd338e68640 1 Processor -- start 2024-01-15T11:33:28.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.623+0000 7fd338e68640 1 -- start start 2024-01-15T11:33:28.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.627+0000 7fd338e68640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd32c0e11f0 0x7fd32c007620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.627+0000 7f910ffff640 1 --2- 172.21.15.27:0/2836024606 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f911006dde0 0x7f91100cd070 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f91040098a0 tx=0x7f910401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f54d2b47664fd3 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:28.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.627+0000 7fd338e68640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd32c036140 0x7fd32c0516e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.627+0000 7fd338e68640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd32c035b80 0x7fd32c051c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.627+0000 7fd338e68640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32c056ac0 con 0x7fd32c0e11f0 2024-01-15T11:33:28.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.627+0000 7fd338e68640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32c0567e0 con 0x7fd32c035b80 2024-01-15T11:33:28.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.627+0000 7fd338e68640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c006b40 con 0x7fd32c036140 2024-01-15T11:33:28.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.627+0000 7f910e7fc640 1 -- 172.21.15.27:0/2836024606 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91040aa650 con 0x7f911006dde0 2024-01-15T11:33:28.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.627+0000 7f910e7fc640 1 -- 172.21.15.27:0/2836024606 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91040aa7b0 con 0x7f911006dde0 2024-01-15T11:33:28.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.627+0000 7f910e7fc640 1 -- 172.21.15.27:0/2836024606 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91040aa650 con 0x7f911006dde0 2024-01-15T11:33:28.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.627+0000 7fd331d9b640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd32c036140 0x7fd32c0516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.627+0000 7fd331d9b640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd32c036140 0x7fd32c0516e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:40198/0 (socket says 172.21.15.27:40198) 2024-01-15T11:33:28.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.627+0000 7fd331d9b640 1 -- 172.21.15.27:0/4232616307 learned_addr learned my addr 172.21.15.27:0/4232616307 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:28.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.627+0000 7fd33259c640 1 --2- 172.21.15.27:0/4232616307 >> v2:172.21.15.93:3300/0 conn(0x7fd32c035b80 0x7fd32c051c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.627+0000 7fd33359e640 1 --2- 172.21.15.27:0/4232616307 >> v2:172.21.15.27:3300/0 conn(0x7fd32c0e11f0 0x7fd32c007620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.631+0000 7f9114c9c640 1 -- 172.21.15.27:0/2836024606 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f911006dde0 msgr2=0x7f91100cd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.631+0000 7f9114c9c640 1 --2- 172.21.15.27:0/2836024606 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f911006dde0 0x7f91100cd070 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f91040098a0 tx=0x7f910401c4f0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.631+0000 7fd33359e640 1 -- 172.21.15.27:0/4232616307 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd32c036140 msgr2=0x7fd32c0516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:28.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.631+0000 7fd33359e640 1 --2- 172.21.15.27:0/4232616307 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd32c036140 0x7fd32c0516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.631+0000 7fd33359e640 1 -- 172.21.15.27:0/4232616307 >> v2:172.21.15.93:3300/0 conn(0x7fd32c035b80 msgr2=0x7fd32c051c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:28.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.631+0000 7fd33359e640 1 --2- 172.21.15.27:0/4232616307 >> v2:172.21.15.93:3300/0 conn(0x7fd32c035b80 0x7fd32c051c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.631+0000 7fd33359e640 1 -- 172.21.15.27:0/4232616307 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32c006e20 con 0x7fd32c0e11f0 2024-01-15T11:33:28.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.631+0000 7f9114c9c640 1 -- 172.21.15.27:0/2836024606 shutdown_connections 2024-01-15T11:33:28.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.631+0000 7f9114c9c640 1 --2- 172.21.15.27:0/2836024606 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f911006dde0 0x7f91100cd070 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.631+0000 7f9114c9c640 1 --2- 172.21.15.27:0/2836024606 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9110070490 0x7f911006d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.631+0000 7f9114c9c640 1 -- 172.21.15.27:0/2836024606 >> 172.21.15.27:0/2836024606 conn(0x7f91100b0c20 msgr2=0x7f91100b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:28.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.631+0000 7f9114c9c640 1 -- 172.21.15.27:0/2836024606 shutdown_connections 2024-01-15T11:33:28.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.631+0000 7f9114c9c640 1 -- 172.21.15.27:0/2836024606 wait complete. 2024-01-15T11:33:28.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.635+0000 7fd33359e640 1 --2- 172.21.15.27:0/4232616307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd32c0e11f0 0x7fd32c007620 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd3340682a0 tx=0x7fd3340994f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8823ec11bc3312b server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:28.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.635+0000 7fd33159a640 1 -- 172.21.15.27:0/4232616307 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd334129640 con 0x7fd32c0e11f0 2024-01-15T11:33:28.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.635+0000 7fd33159a640 1 -- 172.21.15.27:0/4232616307 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd334125050 con 0x7fd32c0e11f0 2024-01-15T11:33:28.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.635+0000 7fd33159a640 1 -- 172.21.15.27:0/4232616307 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd334129a20 con 0x7fd32c0e11f0 2024-01-15T11:33:28.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.635+0000 7f9114c9c640 1 Processor -- start 2024-01-15T11:33:28.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.635+0000 7f9114c9c640 1 -- start start 2024-01-15T11:33:28.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.635+0000 7fd338e68640 1 -- 172.21.15.27:0/4232616307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd32c0e11f0 msgr2=0x7fd32c007620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.635+0000 7fd338e68640 1 --2- 172.21.15.27:0/4232616307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd32c0e11f0 0x7fd32c007620 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd3340682a0 tx=0x7fd3340994f0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.635+0000 7fd338e68640 1 -- 172.21.15.27:0/4232616307 shutdown_connections 2024-01-15T11:33:28.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.635+0000 7fd338e68640 1 --2- 172.21.15.27:0/4232616307 >> v2:172.21.15.93:3300/0 conn(0x7fd32c035b80 0x7fd32c051c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.635+0000 7fd338e68640 1 --2- 172.21.15.27:0/4232616307 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd32c036140 0x7fd32c0516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.635+0000 7fd338e68640 1 --2- 172.21.15.27:0/4232616307 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd32c0e11f0 0x7fd32c007620 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.635+0000 7fd338e68640 1 -- 172.21.15.27:0/4232616307 >> 172.21.15.27:0/4232616307 conn(0x7fd32c056e80 msgr2=0x7fd32c057290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:28.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.635+0000 7fd338e68640 1 -- 172.21.15.27:0/4232616307 shutdown_connections 2024-01-15T11:33:28.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.635+0000 7f9114c9c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f911006dde0 0x7f91101347e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.635+0000 7f9114c9c640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9110070490 0x7f91100ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.635+0000 7f9114c9c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f911014b120 0x7f9110137880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.635+0000 7f9114c9c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91100b39c0 con 0x7f911014b120 2024-01-15T11:33:28.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.635+0000 7f9114c9c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91101334f0 con 0x7f911006dde0 2024-01-15T11:33:28.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.635+0000 7f9114c9c640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9110134d20 con 0x7f9110070490 2024-01-15T11:33:28.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.639+0000 7f910effd640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9110070490 0x7f91100ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.639+0000 7f910effd640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9110070490 0x7f91100ade80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:40206/0 (socket says 172.21.15.27:40206) 2024-01-15T11:33:28.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.639+0000 7f910effd640 1 -- 172.21.15.27:0/1842570226 learned_addr learned my addr 172.21.15.27:0/1842570226 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:28.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.639+0000 7fd338e68640 1 -- 172.21.15.27:0/4232616307 wait complete. 2024-01-15T11:33:28.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.639+0000 7f910f7fe640 1 --2- 172.21.15.27:0/1842570226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f911006dde0 0x7f91101347e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.643 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.639+0000 7fd338e68640 1 Processor -- start 2024-01-15T11:33:28.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.639+0000 7fd338e68640 1 -- start start 2024-01-15T11:33:28.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.639+0000 7f910ffff640 1 --2- 172.21.15.27:0/1842570226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f911014b120 0x7f9110137880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.639+0000 7f910f7fe640 1 -- 172.21.15.27:0/1842570226 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9110070490 msgr2=0x7f91100ade80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.639+0000 7f910f7fe640 1 --2- 172.21.15.27:0/1842570226 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9110070490 0x7f91100ade80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.639+0000 7f910f7fe640 1 -- 172.21.15.27:0/1842570226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f911014b120 msgr2=0x7f9110137880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.639+0000 7f910f7fe640 1 --2- 172.21.15.27:0/1842570226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f911014b120 0x7f9110137880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.639+0000 7f910f7fe640 1 -- 172.21.15.27:0/1842570226 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91040094d0 con 0x7f911006dde0 2024-01-15T11:33:28.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.643+0000 7f910f7fe640 1 --2- 172.21.15.27:0/1842570226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f911006dde0 0x7f91101347e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9100000f70 tx=0x7f910000c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:28.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.643+0000 7f90f7fff640 1 -- 172.21.15.27:0/1842570226 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91000054e0 con 0x7f911006dde0 2024-01-15T11:33:28.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.643+0000 7f90f7fff640 1 -- 172.21.15.27:0/1842570226 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9100003600 con 0x7f911006dde0 2024-01-15T11:33:28.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.643+0000 7f90f7fff640 1 -- 172.21.15.27:0/1842570226 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91000054e0 con 0x7f911006dde0 2024-01-15T11:33:28.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.643+0000 7f9114c9c640 1 -- 172.21.15.27:0/1842570226 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91100ae3c0 con 0x7f911006dde0 2024-01-15T11:33:28.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.643+0000 7f9114c9c640 1 -- 172.21.15.27:0/1842570226 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9110133a20 con 0x7f911006dde0 2024-01-15T11:33:28.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.643+0000 7fd338e68640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd32c035b80 0x7fd32c049b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.643+0000 7fd338e68640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd32c036140 0x7fd32c0d9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.643+0000 7fd338e68640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd32c0e11f0 0x7fd32c04e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.647 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.643+0000 7fd338e68640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c039ab0 con 0x7fd32c036140 2024-01-15T11:33:28.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.643+0000 7fd338e68640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c0505f0 con 0x7fd32c0e11f0 2024-01-15T11:33:28.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.643+0000 7fd338e68640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c039d50 con 0x7fd32c035b80 2024-01-15T11:33:28.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.643+0000 7fd33259c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd32c0e11f0 0x7fd32c04e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.643+0000 7fd33259c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd32c0e11f0 0x7fd32c04e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:52198/0 (socket says 172.21.15.27:52198) 2024-01-15T11:33:28.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.643+0000 7fd33259c640 1 -- 172.21.15.27:0/3811824231 learned_addr learned my addr 172.21.15.27:0/3811824231 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:28.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.643+0000 7fd33359e640 1 --2- 172.21.15.27:0/3811824231 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd32c035b80 0x7fd32c049b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.643+0000 7fd331d9b640 1 --2- 172.21.15.27:0/3811824231 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd32c036140 0x7fd32c0d9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.643+0000 7fd33259c640 1 -- 172.21.15.27:0/3811824231 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd32c035b80 msgr2=0x7fd32c049b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.643+0000 7fd33259c640 1 --2- 172.21.15.27:0/3811824231 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd32c035b80 0x7fd32c049b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.643+0000 7fd33259c640 1 -- 172.21.15.27:0/3811824231 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd32c036140 msgr2=0x7fd32c0d9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.643+0000 7fd33259c640 1 --2- 172.21.15.27:0/3811824231 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd32c036140 0x7fd32c0d9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.643+0000 7fd33259c640 1 -- 172.21.15.27:0/3811824231 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33404f7e0 con 0x7fd32c0e11f0 2024-01-15T11:33:28.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.647+0000 7fd33259c640 1 --2- 172.21.15.27:0/3811824231 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd32c0e11f0 0x7fd32c04e960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd32800e850 tx=0x7fd32800ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:28.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.647+0000 7fd322ffd640 1 -- 172.21.15.27:0/3811824231 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd328009630 con 0x7fd32c0e11f0 2024-01-15T11:33:28.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.647+0000 7fd322ffd640 1 -- 172.21.15.27:0/3811824231 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32800c940 con 0x7fd32c0e11f0 2024-01-15T11:33:28.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.647+0000 7fd322ffd640 1 -- 172.21.15.27:0/3811824231 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd328009630 con 0x7fd32c0e11f0 2024-01-15T11:33:28.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.647+0000 7fd338e68640 1 -- 172.21.15.27:0/3811824231 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd32c050890 con 0x7fd32c0e11f0 2024-01-15T11:33:28.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.647+0000 7f9114c9c640 1 -- 172.21.15.27:0/1842570226 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9110074990 con 0x7f911006dde0 2024-01-15T11:33:28.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.647+0000 7f90f7fff640 1 -- 172.21.15.27:0/1842570226 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f91000037b0 con 0x7f911006dde0 2024-01-15T11:33:28.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.647+0000 7fd338e68640 1 -- 172.21.15.27:0/3811824231 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32c04eea0 con 0x7fd32c0e11f0 2024-01-15T11:33:28.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.647+0000 7f90f7fff640 1 --2- 172.21.15.27:0/1842570226 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f90fc066980 0x7f90fc068e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.647+0000 7f90f7fff640 1 -- 172.21.15.27:0/1842570226 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9100083490 con 0x7f911006dde0 2024-01-15T11:33:28.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.651+0000 7f910effd640 1 --2- 172.21.15.27:0/1842570226 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f90fc066980 0x7f90fc068e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.651+0000 7fd338e68640 1 -- 172.21.15.27:0/3811824231 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32c050450 con 0x7fd32c0e11f0 2024-01-15T11:33:28.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.651+0000 7f910effd640 1 --2- 172.21.15.27:0/1842570226 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f90fc066980 0x7f90fc068e40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f911013e0a0 tx=0x7f91080078a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:28.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.655+0000 7f90f7fff640 1 -- 172.21.15.27:0/1842570226 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f91000506e0 con 0x7f911006dde0 2024-01-15T11:33:28.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.655+0000 7fd322ffd640 1 -- 172.21.15.27:0/3811824231 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fd32800cab0 con 0x7fd32c0e11f0 2024-01-15T11:33:28.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.655+0000 7fd322ffd640 1 --2- 172.21.15.27:0/3811824231 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd314066950 0x7fd314068e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.655+0000 7fd322ffd640 1 -- 172.21.15.27:0/3811824231 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3280847e0 con 0x7fd32c0e11f0 2024-01-15T11:33:28.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.659+0000 7fd322ffd640 1 -- 172.21.15.27:0/3811824231 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd328051ab0 con 0x7fd32c0e11f0 2024-01-15T11:33:28.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.659+0000 7fd33359e640 1 --2- 172.21.15.27:0/3811824231 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd314066950 0x7fd314068e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.663+0000 7fd33359e640 1 --2- 172.21.15.27:0/3811824231 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd314066950 0x7fd314068e10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd32c00f8f0 tx=0x7fd334124000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:28.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.719+0000 7f9b3cf93640 1 Processor -- start 2024-01-15T11:33:28.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.719+0000 7f9b3cf93640 1 -- start start 2024-01-15T11:33:28.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.723+0000 7f9b3cf93640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9b38070490 0x7f9b3806d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.723+0000 7f9b3cf93640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3806e220 con 0x7f9b3806dde0 2024-01-15T11:33:28.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.723+0000 7f9b3cf93640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3814b500 con 0x7f9b3814b120 2024-01-15T11:33:28.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.723+0000 7f9b3cf93640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b380719e0 con 0x7f9b38070490 2024-01-15T11:33:28.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.723+0000 7f9b36ffd640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9b38070490 0x7f9b3806d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.723+0000 7f9b36ffd640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9b38070490 0x7f9b3806d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:40216/0 (socket says 172.21.15.27:40216) 2024-01-15T11:33:28.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.723+0000 7f9b36ffd640 1 -- 172.21.15.27:0/2469953955 learned_addr learned my addr 172.21.15.27:0/2469953955 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:28.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.727+0000 7f59ebfff640 1 Processor -- start 2024-01-15T11:33:28.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.723+0000 7f9b36ffd640 1 -- 172.21.15.27:0/2469953955 >> v1:172.21.15.93:6789/0 conn(0x7f9b3814b120 legacy=0x7f9b380712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:28.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.723+0000 7f9b36ffd640 1 -- 172.21.15.27:0/2469953955 >> v1:172.21.15.27:6789/0 conn(0x7f9b3806dde0 legacy=0x7f9b380cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:28.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.723+0000 7f9b36ffd640 1 -- 172.21.15.27:0/2469953955 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b38071c90 con 0x7f9b38070490 2024-01-15T11:33:28.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.727+0000 7f59ebfff640 1 -- start start 2024-01-15T11:33:28.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.731+0000 7f59ebfff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f59ec143900 0x7f59ec072290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.731+0000 7f59ebfff640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59ec0ac8a0 0x7f59ec0adf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.731+0000 7f59ebfff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f59ec0ae480 0x7f59ec160de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.731+0000 7f9b36ffd640 1 --2- 172.21.15.27:0/2469953955 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9b38070490 0x7f9b3806d8a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0098a0 tx=0x7f9b2c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46ea7cd57daaa58e server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:28.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.731+0000 7f9b367fc640 1 -- 172.21.15.27:0/2469953955 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c0ab670 con 0x7f9b38070490 2024-01-15T11:33:28.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.731+0000 7f9b367fc640 1 -- 172.21.15.27:0/2469953955 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c0ab7d0 con 0x7f9b38070490 2024-01-15T11:33:28.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.731+0000 7f9b367fc640 1 -- 172.21.15.27:0/2469953955 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c0abb60 con 0x7f9b38070490 2024-01-15T11:33:28.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.731+0000 7f59ebfff640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59ec0ae8d0 con 0x7f59ec0ae480 2024-01-15T11:33:28.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.731+0000 7f59ebfff640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59ec143ce0 con 0x7f59ec143900 2024-01-15T11:33:28.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.731+0000 7f59ebfff640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec0acda0 con 0x7f59ec0ac8a0 2024-01-15T11:33:28.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.731+0000 7f59ea7fc640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59ec0ac8a0 0x7f59ec0adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.731+0000 7f59ea7fc640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59ec0ac8a0 0x7f59ec0adf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:40224/0 (socket says 172.21.15.27:40224) 2024-01-15T11:33:28.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.731+0000 7f59ea7fc640 1 -- 172.21.15.27:0/1234519886 learned_addr learned my addr 172.21.15.27:0/1234519886 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:28.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.731+0000 7f59eaffd640 1 --2- 172.21.15.27:0/1234519886 >> v2:172.21.15.93:3300/0 conn(0x7f59ec143900 0x7f59ec072290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.731+0000 7f59eaffd640 1 -- 172.21.15.27:0/1234519886 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59ec0ac8a0 msgr2=0x7f59ec0adf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:28.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.731+0000 7f59eaffd640 1 --2- 172.21.15.27:0/1234519886 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59ec0ac8a0 0x7f59ec0adf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.731+0000 7f59eaffd640 1 -- 172.21.15.27:0/1234519886 >> v2:172.21.15.27:3300/0 conn(0x7f59ec0ae480 msgr2=0x7f59ec160de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:28.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.731+0000 7f59eaffd640 1 --2- 172.21.15.27:0/1234519886 >> v2:172.21.15.27:3300/0 conn(0x7f59ec0ae480 0x7f59ec160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.731+0000 7f59eaffd640 1 -- 172.21.15.27:0/1234519886 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ec0ad080 con 0x7f59ec143900 2024-01-15T11:33:28.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.735+0000 7f9b3cf93640 1 -- 172.21.15.27:0/2469953955 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9b38070490 msgr2=0x7f9b3806d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.735+0000 7f9b3cf93640 1 --2- 172.21.15.27:0/2469953955 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9b38070490 0x7f9b3806d8a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0098a0 tx=0x7f9b2c01c4b0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.735+0000 7f9b3cf93640 1 -- 172.21.15.27:0/2469953955 shutdown_connections 2024-01-15T11:33:28.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.735+0000 7f9b3cf93640 1 --2- 172.21.15.27:0/2469953955 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9b38070490 0x7f9b3806d8a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.735+0000 7f9b3cf93640 1 -- 172.21.15.27:0/2469953955 >> 172.21.15.27:0/2469953955 conn(0x7f9b380b0c20 msgr2=0x7f9b380b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:28.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.735+0000 7f9b3cf93640 1 -- 172.21.15.27:0/2469953955 shutdown_connections 2024-01-15T11:33:28.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.735+0000 7f9b3cf93640 1 -- 172.21.15.27:0/2469953955 wait complete. 2024-01-15T11:33:28.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.735+0000 7f59eaffd640 1 --2- 172.21.15.27:0/1234519886 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59ec143900 0x7f59ec072290 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f59ec06e710 tx=0x7f59dc01c1b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=212fbaee8474b9c8 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:28.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.739+0000 7f59e9ffb640 1 -- 172.21.15.27:0/1234519886 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc0ab600 con 0x7f59ec143900 2024-01-15T11:33:28.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.739+0000 7f59e9ffb640 1 -- 172.21.15.27:0/1234519886 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59dc0a7050 con 0x7f59ec143900 2024-01-15T11:33:28.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.739+0000 7f59e9ffb640 1 -- 172.21.15.27:0/1234519886 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc0ab600 con 0x7f59ec143900 2024-01-15T11:33:28.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.739+0000 7f9b3cf93640 1 Processor -- start 2024-01-15T11:33:28.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.739+0000 7f59ebfff640 1 -- 172.21.15.27:0/1234519886 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59ec143900 msgr2=0x7f59ec072290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.739+0000 7f59ebfff640 1 --2- 172.21.15.27:0/1234519886 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59ec143900 0x7f59ec072290 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f59ec06e710 tx=0x7f59dc01c1b0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.739+0000 7f59ebfff640 1 -- 172.21.15.27:0/1234519886 shutdown_connections 2024-01-15T11:33:28.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.739+0000 7f59ebfff640 1 --2- 172.21.15.27:0/1234519886 >> v2:172.21.15.27:3300/0 conn(0x7f59ec0ae480 0x7f59ec160de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.739+0000 7f59ebfff640 1 --2- 172.21.15.27:0/1234519886 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59ec0ac8a0 0x7f59ec0adf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.739+0000 7f59ebfff640 1 --2- 172.21.15.27:0/1234519886 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59ec143900 0x7f59ec072290 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.739+0000 7f59ebfff640 1 -- 172.21.15.27:0/1234519886 >> 172.21.15.27:0/1234519886 conn(0x7f59ec0b0c20 msgr2=0x7f59ec0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:28.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.739+0000 7f9b3cf93640 1 -- start start 2024-01-15T11:33:28.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.739+0000 7f59ebfff640 1 -- 172.21.15.27:0/1234519886 shutdown_connections 2024-01-15T11:33:28.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.739+0000 7f9b3cf93640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9b3806dde0 0x7f9b381340f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.739+0000 7f9b3cf93640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b38070490 0x7f9b38148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.739+0000 7f9b3cf93640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b3814b120 0x7f9b38160cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.739+0000 7f9b3cf93640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b381371e0 con 0x7f9b3814b120 2024-01-15T11:33:28.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.739+0000 7f9b3cf93640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b38132da0 con 0x7f9b38070490 2024-01-15T11:33:28.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.739+0000 7f9b3cf93640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b381346d0 con 0x7f9b3806dde0 2024-01-15T11:33:28.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.739+0000 7f59ebfff640 1 -- 172.21.15.27:0/1234519886 wait complete. 2024-01-15T11:33:28.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.743+0000 7f9b377fe640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9b3806dde0 0x7f9b381340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.743+0000 7f9b37fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b3814b120 0x7f9b38160cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.743+0000 7f9b37fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b3814b120 0x7f9b38160cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55538/0 (socket says 172.21.15.27:55538) 2024-01-15T11:33:28.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.743+0000 7f9b37fff640 1 -- 172.21.15.27:0/4144276271 learned_addr learned my addr 172.21.15.27:0/4144276271 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:28.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.743+0000 7f9b36ffd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b38070490 0x7f9b38148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.743+0000 7f59ebfff640 1 Processor -- start 2024-01-15T11:33:28.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.743+0000 7f9b37fff640 1 -- 172.21.15.27:0/4144276271 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9b3806dde0 msgr2=0x7f9b381340f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.743+0000 7f9b37fff640 1 --2- 172.21.15.27:0/4144276271 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9b3806dde0 0x7f9b381340f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.743+0000 7f9b37fff640 1 -- 172.21.15.27:0/4144276271 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b38070490 msgr2=0x7f9b38148d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.743+0000 7f9b37fff640 1 --2- 172.21.15.27:0/4144276271 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b38070490 0x7f9b38148d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.743+0000 7f59ebfff640 1 -- start start 2024-01-15T11:33:28.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.743+0000 7f9b37fff640 1 -- 172.21.15.27:0/4144276271 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c0094d0 con 0x7f9b3814b120 2024-01-15T11:33:28.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.743+0000 7f9b377fe640 1 --2- 172.21.15.27:0/4144276271 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9b3806dde0 0x7f9b381340f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:33:28.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.743+0000 7f9b36ffd640 1 --2- 172.21.15.27:0/4144276271 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b38070490 0x7f9b38148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:28.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.743+0000 7f59ebfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59ec0ac8a0 0x7f59ec15d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.743+0000 7f9b37fff640 1 --2- 172.21.15.27:0/4144276271 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b3814b120 0x7f9b38160cd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000caf0 tx=0x7f9b30002100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:28.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.743+0000 7f59ebfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59ec0ae480 0x7f59ec15b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.743+0000 7f59ebfff640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59ec143900 0x7f59ec0cda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.747+0000 7f59ebfff640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec15bf00 con 0x7f59ec0ac8a0 2024-01-15T11:33:28.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.747+0000 7f59ebfff640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec15c1e0 con 0x7f59ec0ae480 2024-01-15T11:33:28.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.747+0000 7f59ebfff640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec15c4c0 con 0x7f59ec143900 2024-01-15T11:33:28.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.747+0000 7f59ea7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59ec0ae480 0x7f59ec15b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.747+0000 7f59ea7fc640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59ec0ae480 0x7f59ec15b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:52220/0 (socket says 172.21.15.27:52220) 2024-01-15T11:33:28.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.747+0000 7f59ea7fc640 1 -- 172.21.15.27:0/4009209614 learned_addr learned my addr 172.21.15.27:0/4009209614 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:28.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.747+0000 7f59eb7fe640 1 --2- 172.21.15.27:0/4009209614 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59ec143900 0x7f59ec0cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.747+0000 7f9b1ffff640 1 -- 172.21.15.27:0/4144276271 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b30003b80 con 0x7f9b3814b120 2024-01-15T11:33:28.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.747+0000 7f9b1ffff640 1 -- 172.21.15.27:0/4144276271 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b30003d00 con 0x7f9b3814b120 2024-01-15T11:33:28.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.747+0000 7f9b1ffff640 1 -- 172.21.15.27:0/4144276271 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3000a9a0 con 0x7f9b3814b120 2024-01-15T11:33:28.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.747+0000 7f59eb7fe640 1 -- 172.21.15.27:0/4009209614 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59ec0ae480 msgr2=0x7f59ec15b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.747+0000 7f59eb7fe640 1 --2- 172.21.15.27:0/4009209614 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59ec0ae480 0x7f59ec15b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.747+0000 7f59eb7fe640 1 -- 172.21.15.27:0/4009209614 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59ec0ac8a0 msgr2=0x7f59ec15d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.747+0000 7f59eb7fe640 1 --2- 172.21.15.27:0/4009209614 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59ec0ac8a0 0x7f59ec15d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.747+0000 7f9b3cf93640 1 -- 172.21.15.27:0/4144276271 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b38133060 con 0x7f9b3814b120 2024-01-15T11:33:28.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.747+0000 7f59eb7fe640 1 -- 172.21.15.27:0/4009209614 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc009420 con 0x7f59ec143900 2024-01-15T11:33:28.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.747+0000 7f59ea7fc640 1 --2- 172.21.15.27:0/4009209614 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59ec0ae480 0x7f59ec15b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:28.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.747+0000 7f9b3cf93640 1 -- 172.21.15.27:0/4144276271 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b38136920 con 0x7f9b3814b120 2024-01-15T11:33:28.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.751+0000 7f59eb7fe640 1 --2- 172.21.15.27:0/4009209614 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59ec143900 0x7f59ec0cda90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f59e400be20 tx=0x7f59e400bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:28.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.751+0000 7f59d3fff640 1 -- 172.21.15.27:0/4009209614 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e400ce70 con 0x7f59ec143900 2024-01-15T11:33:28.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.751+0000 7f59ebfff640 1 -- 172.21.15.27:0/4009209614 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59ec15c7a0 con 0x7f59ec143900 2024-01-15T11:33:28.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.751+0000 7f59ebfff640 1 -- 172.21.15.27:0/4009209614 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59ec15d190 con 0x7f59ec143900 2024-01-15T11:33:28.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.751+0000 7f59d3fff640 1 -- 172.21.15.27:0/4009209614 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e4014440 con 0x7f59ec143900 2024-01-15T11:33:28.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.751+0000 7f9b1ffff640 1 -- 172.21.15.27:0/4144276271 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f9b3000ab00 con 0x7f9b3814b120 2024-01-15T11:33:28.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.751+0000 7f9b1ffff640 1 --2- 172.21.15.27:0/4144276271 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9b24066970 0x7f9b24068e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.751+0000 7f59d3fff640 1 -- 172.21.15.27:0/4009209614 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e400ce70 con 0x7f59ec143900 2024-01-15T11:33:28.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.751+0000 7f9b3cf93640 1 -- 172.21.15.27:0/4144276271 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b18005260 con 0x7f9b3814b120 2024-01-15T11:33:28.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.751+0000 7f59ebfff640 1 -- 172.21.15.27:0/4009209614 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59ec15ccc0 con 0x7f59ec143900 2024-01-15T11:33:28.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.755+0000 7f9b1ffff640 1 -- 172.21.15.27:0/4144276271 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b300552d0 con 0x7f9b3814b120 2024-01-15T11:33:28.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.759+0000 7f9b377fe640 1 --2- 172.21.15.27:0/4144276271 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9b24066970 0x7f9b24068e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.755+0000 7f59d3fff640 1 -- 172.21.15.27:0/4009209614 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f59e401d3b0 con 0x7f59ec143900 2024-01-15T11:33:28.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.759+0000 7f59d3fff640 1 --2- 172.21.15.27:0/4009209614 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f59d80669b0 0x7f59d8068e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.759+0000 7f9b377fe640 1 --2- 172.21.15.27:0/4144276271 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9b24066970 0x7f9b24068e30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9b2800a830 tx=0x7f9b28008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:28.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.759+0000 7f59eaffd640 1 --2- 172.21.15.27:0/4009209614 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f59d80669b0 0x7f59d8068e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.759+0000 7f59d3fff640 1 -- 172.21.15.27:0/4009209614 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59e40557b0 con 0x7f59ec143900 2024-01-15T11:33:28.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.759+0000 7f59d3fff640 1 -- 172.21.15.27:0/4009209614 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f59e4052280 con 0x7f59ec143900 2024-01-15T11:33:28.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.759+0000 7f59eaffd640 1 --2- 172.21.15.27:0/4009209614 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f59d80669b0 0x7f59d8068e70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0ad000 tx=0x7f59dc004740 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:28.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.763+0000 7f9b1ffff640 1 -- 172.21.15.27:0/4144276271 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9b300516a0 con 0x7f9b3814b120 2024-01-15T11:33:28.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.787+0000 7f4af1a68640 1 Processor -- start 2024-01-15T11:33:28.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.787+0000 7f4af1a68640 1 -- start start 2024-01-15T11:33:28.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.787+0000 7f4af1a68640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4aec146000 0x7f4aec0ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.787+0000 7f4af1a68640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4aec072430 0x7f4aec160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.792 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.787+0000 7f4af1a68640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aec070ce0 con 0x7f4aec1463e0 2024-01-15T11:33:28.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.787+0000 7f4af1a68640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aec0709e0 con 0x7f4aec072430 2024-01-15T11:33:28.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.787+0000 7f4af1a68640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aec146880 con 0x7f4aec146000 2024-01-15T11:33:28.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.791+0000 7f4aeb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4aec146000 0x7f4aec0ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.791+0000 7f4aeb7fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4aec146000 0x7f4aec0ac8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:52226/0 (socket says 172.21.15.27:52226) 2024-01-15T11:33:28.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.791+0000 7f4aeb7fe640 1 -- 172.21.15.27:0/4241641753 learned_addr learned my addr 172.21.15.27:0/4241641753 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:28.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.791+0000 7f4aeb7fe640 1 -- 172.21.15.27:0/4241641753 >> v2:172.21.15.27:3300/0 conn(0x7f4aec072430 msgr2=0x7f4aec160fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:28.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.791+0000 7f4aeb7fe640 1 --2- 172.21.15.27:0/4241641753 >> v2:172.21.15.27:3300/0 conn(0x7f4aec072430 0x7f4aec160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.791+0000 7f4aeb7fe640 1 -- 172.21.15.27:0/4241641753 >> v1:172.21.15.93:6789/0 conn(0x7f4aec1463e0 legacy=0x7f4aec071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.791+0000 7f4aeb7fe640 1 -- 172.21.15.27:0/4241641753 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aec161d90 con 0x7f4aec146000 2024-01-15T11:33:28.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.795+0000 7f4aeb7fe640 1 --2- 172.21.15.27:0/4241641753 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4aec146000 0x7f4aec0ac8a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0b1de0 tx=0x7f4ae001c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec7e4c1a7d7753e1 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:28.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.795+0000 7f4aea7fc640 1 -- 172.21.15.27:0/4241641753 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae00ab600 con 0x7f4aec146000 2024-01-15T11:33:28.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.795+0000 7f4aea7fc640 1 -- 172.21.15.27:0/4241641753 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae00a7050 con 0x7f4aec146000 2024-01-15T11:33:28.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.795+0000 7f4aea7fc640 1 -- 172.21.15.27:0/4241641753 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae00ab980 con 0x7f4aec146000 2024-01-15T11:33:28.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.795+0000 7f1a37f65640 1 Processor -- start 2024-01-15T11:33:28.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.799+0000 7f4af1a68640 1 -- 172.21.15.27:0/4241641753 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4aec146000 msgr2=0x7f4aec0ac8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.799+0000 7f4af1a68640 1 --2- 172.21.15.27:0/4241641753 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4aec146000 0x7f4aec0ac8a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0b1de0 tx=0x7f4ae001c540 comp rx=0 tx=0).stop 2024-01-15T11:33:28.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.799+0000 7f1a37f65640 1 -- start start 2024-01-15T11:33:28.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.799+0000 7f4af1a68640 1 -- 172.21.15.27:0/4241641753 shutdown_connections 2024-01-15T11:33:28.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.799+0000 7f4af1a68640 1 --2- 172.21.15.27:0/4241641753 >> v2:172.21.15.27:3300/0 conn(0x7f4aec072430 0x7f4aec160fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.799+0000 7f4af1a68640 1 --2- 172.21.15.27:0/4241641753 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4aec146000 0x7f4aec0ac8a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.799+0000 7f4af1a68640 1 -- 172.21.15.27:0/4241641753 >> 172.21.15.27:0/4241641753 conn(0x7f4aec06c340 msgr2=0x7f4aec06c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:28.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.799+0000 7f4af1a68640 1 -- 172.21.15.27:0/4241641753 shutdown_connections 2024-01-15T11:33:28.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.799+0000 7f4af1a68640 1 -- 172.21.15.27:0/4241641753 wait complete. 2024-01-15T11:33:28.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.799+0000 7f1a37f65640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1a300b46b0 0x7f1a30070470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.799+0000 7f1a37f65640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1a3014b320 0x7f1a300b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.799+0000 7f1a37f65640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a300b2350 con 0x7f1a3014af40 2024-01-15T11:33:28.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.799+0000 7f1a37f65640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a30070a50 con 0x7f1a300b46b0 2024-01-15T11:33:28.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.799+0000 7f1a37f65640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a30070d30 con 0x7f1a3014b320 2024-01-15T11:33:28.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.799+0000 7f1a35500640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1a300b46b0 0x7f1a30070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.799+0000 7f1a35500640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1a300b46b0 0x7f1a30070470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55566/0 (socket says 172.21.15.27:55566) 2024-01-15T11:33:28.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.803+0000 7f4af1a68640 1 Processor -- start 2024-01-15T11:33:28.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.799+0000 7f1a35500640 1 -- 172.21.15.27:0/3132270701 learned_addr learned my addr 172.21.15.27:0/3132270701 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:28.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.799+0000 7f1a36502640 1 --2- 172.21.15.27:0/3132270701 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1a3014b320 0x7f1a300b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.803+0000 7f1a36502640 1 -- 172.21.15.27:0/3132270701 >> v2:172.21.15.27:3300/0 conn(0x7f1a300b46b0 msgr2=0x7f1a30070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:28.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.803+0000 7f1a36502640 1 --2- 172.21.15.27:0/3132270701 >> v2:172.21.15.27:3300/0 conn(0x7f1a300b46b0 0x7f1a30070470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.803+0000 7f4af1a68640 1 -- start start 2024-01-15T11:33:28.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.803+0000 7f1a36502640 1 -- 172.21.15.27:0/3132270701 >> v1:172.21.15.27:6789/0 conn(0x7f1a3014af40 legacy=0x7f1a300b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:28.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.803+0000 7f1a36502640 1 -- 172.21.15.27:0/3132270701 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a30071010 con 0x7f1a3014b320 2024-01-15T11:33:28.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.803+0000 7f1a35500640 1 --2- 172.21.15.27:0/3132270701 >> v2:172.21.15.27:3300/0 conn(0x7f1a300b46b0 0x7f1a30070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:28.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.803+0000 7f4af1a68640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4aec072430 0x7f4aec141940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.803+0000 7f4af1a68640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4aec146000 0x7f4aec13f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.803+0000 7f4af1a68640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4aec1463e0 0x7f4aec1628a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.803+0000 7f4af1a68640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec143140 con 0x7f4aec072430 2024-01-15T11:33:28.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.803+0000 7f4aeaffd640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4aec146000 0x7f4aec13f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.803+0000 7f4aeaffd640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4aec146000 0x7f4aec13f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:40252/0 (socket says 172.21.15.27:40252) 2024-01-15T11:33:28.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.803+0000 7f4aeaffd640 1 -- 172.21.15.27:0/3918491433 learned_addr learned my addr 172.21.15.27:0/3918491433 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:28.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.803+0000 7f4aebfff640 1 --2- 172.21.15.27:0/3918491433 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4aec1463e0 0x7f4aec1628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.803+0000 7f4af1a68640 1 -- 172.21.15.27:0/3918491433 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec143420 con 0x7f4aec1463e0 2024-01-15T11:33:28.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.803+0000 7f4af1a68640 1 -- 172.21.15.27:0/3918491433 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec140e60 con 0x7f4aec146000 2024-01-15T11:33:28.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.807+0000 7f4aeaffd640 1 -- 172.21.15.27:0/3918491433 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4aec1463e0 msgr2=0x7f4aec1628a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.807+0000 7f4aeaffd640 1 --2- 172.21.15.27:0/3918491433 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4aec1463e0 0x7f4aec1628a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.807+0000 7f4aeaffd640 1 -- 172.21.15.27:0/3918491433 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4aec072430 msgr2=0x7f4aec141940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.807+0000 7f4aeaffd640 1 --2- 172.21.15.27:0/3918491433 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4aec072430 0x7f4aec141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.807+0000 7f4aeaffd640 1 -- 172.21.15.27:0/3918491433 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae00094d0 con 0x7f4aec146000 2024-01-15T11:33:28.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.807+0000 7f4aeaffd640 1 --2- 172.21.15.27:0/3918491433 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4aec146000 0x7f4aec13f090 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00c3c0 tx=0x7f4adc00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:28.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.807+0000 7f1a36502640 1 --2- 172.21.15.27:0/3132270701 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1a3014b320 0x7f1a300b2f60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1a28009d90 tx=0x7f1a2801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aac97b04f833dad2 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:28.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.807+0000 7f4ad3fff640 1 -- 172.21.15.27:0/3918491433 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc0052d0 con 0x7f4aec146000 2024-01-15T11:33:28.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.807+0000 7f4ad3fff640 1 -- 172.21.15.27:0/3918491433 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4adc005430 con 0x7f4aec146000 2024-01-15T11:33:28.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.807+0000 7f4ad3fff640 1 -- 172.21.15.27:0/3918491433 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc003820 con 0x7f4aec146000 2024-01-15T11:33:28.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.807+0000 7f4af1a68640 1 -- 172.21.15.27:0/3918491433 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aec141140 con 0x7f4aec146000 2024-01-15T11:33:28.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.807+0000 7f4af1a68640 1 -- 172.21.15.27:0/3918491433 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aec160640 con 0x7f4aec146000 2024-01-15T11:33:28.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.807+0000 7f1a34cff640 1 -- 172.21.15.27:0/3132270701 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a280a5960 con 0x7f1a3014b320 2024-01-15T11:33:28.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.811+0000 7f1a34cff640 1 -- 172.21.15.27:0/3132270701 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a280a5ac0 con 0x7f1a3014b320 2024-01-15T11:33:28.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.811+0000 7f1a34cff640 1 -- 172.21.15.27:0/3132270701 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a280a5e50 con 0x7f1a3014b320 2024-01-15T11:33:28.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.811+0000 7f4af1a68640 1 -- 172.21.15.27:0/3918491433 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aec074990 con 0x7f4aec146000 2024-01-15T11:33:28.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.811+0000 7f1a37f65640 1 -- 172.21.15.27:0/3132270701 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1a3014b320 msgr2=0x7f1a300b2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.811+0000 7f1a37f65640 1 --2- 172.21.15.27:0/3132270701 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1a3014b320 0x7f1a300b2f60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1a28009d90 tx=0x7f1a2801c8e0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.811+0000 7f1a37f65640 1 -- 172.21.15.27:0/3132270701 shutdown_connections 2024-01-15T11:33:28.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.811+0000 7f1a37f65640 1 --2- 172.21.15.27:0/3132270701 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1a3014b320 0x7f1a300b2f60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.811+0000 7f1a37f65640 1 --2- 172.21.15.27:0/3132270701 >> v2:172.21.15.27:3300/0 conn(0x7f1a300b46b0 0x7f1a30070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.811+0000 7f1a37f65640 1 -- 172.21.15.27:0/3132270701 >> 172.21.15.27:0/3132270701 conn(0x7f1a300b0d90 msgr2=0x7f1a300b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:28.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.815+0000 7f4ad3fff640 1 -- 172.21.15.27:0/3918491433 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f4adc003980 con 0x7f4aec146000 2024-01-15T11:33:28.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.815+0000 7f1a37f65640 1 -- 172.21.15.27:0/3132270701 shutdown_connections 2024-01-15T11:33:28.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.815+0000 7f1a37f65640 1 -- 172.21.15.27:0/3132270701 wait complete. 2024-01-15T11:33:28.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.815+0000 7f4ad3fff640 1 --2- 172.21.15.27:0/3918491433 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4ad80669c0 0x7f4ad8068e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.815+0000 7f4ad3fff640 1 -- 172.21.15.27:0/3918491433 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4adc083b20 con 0x7f4aec146000 2024-01-15T11:33:28.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.815+0000 7f4aeb7fe640 1 --2- 172.21.15.27:0/3918491433 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4ad80669c0 0x7f4ad8068e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.815+0000 7f1a37f65640 1 Processor -- start 2024-01-15T11:33:28.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.815+0000 7f4ad3fff640 1 -- 172.21.15.27:0/3918491433 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4adc050df0 con 0x7f4aec146000 2024-01-15T11:33:28.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.815+0000 7f1a37f65640 1 -- start start 2024-01-15T11:33:28.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.819+0000 7f4aeb7fe640 1 --2- 172.21.15.27:0/3918491433 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4ad80669c0 0x7f4ad8068e80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00ad000 tx=0x7f4ae0004740 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:28.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.819+0000 7f1a37f65640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a300b46b0 0x7f1a300cd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.819+0000 7f1a37f65640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1a3014af40 0x7f1a300cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.819+0000 7f1a37f65640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a3014b320 0x7f1a3015d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.819+0000 7f1a37f65640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3015cc30 con 0x7f1a3014b320 2024-01-15T11:33:28.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.819+0000 7f1a37f65640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3015bd60 con 0x7f1a300b46b0 2024-01-15T11:33:28.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.819+0000 7f1a37f65640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3015d050 con 0x7f1a3014af40 2024-01-15T11:33:28.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.819+0000 7f1a35d01640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a300b46b0 0x7f1a300cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.819+0000 7f1a36502640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a3014b320 0x7f1a3015d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.819+0000 7f1a36502640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a3014b320 0x7f1a3015d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55574/0 (socket says 172.21.15.27:55574) 2024-01-15T11:33:28.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.819+0000 7f1a36502640 1 -- 172.21.15.27:0/4018320595 learned_addr learned my addr 172.21.15.27:0/4018320595 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:28.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.819+0000 7f1a35500640 1 --2- 172.21.15.27:0/4018320595 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1a3014af40 0x7f1a300cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.823+0000 7f1a36502640 1 -- 172.21.15.27:0/4018320595 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1a3014af40 msgr2=0x7f1a300cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.823+0000 7f1a36502640 1 --2- 172.21.15.27:0/4018320595 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1a3014af40 0x7f1a300cdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.823+0000 7f1a36502640 1 -- 172.21.15.27:0/4018320595 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a300b46b0 msgr2=0x7f1a300cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.823+0000 7f1a36502640 1 --2- 172.21.15.27:0/4018320595 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a300b46b0 0x7f1a300cd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.823+0000 7f1a36502640 1 -- 172.21.15.27:0/4018320595 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a28009a70 con 0x7f1a3014b320 2024-01-15T11:33:28.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.823+0000 7f1a36502640 1 --2- 172.21.15.27:0/4018320595 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a3014b320 0x7f1a3015d590 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1a2801af90 tx=0x7f1a28019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:28.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.823+0000 7f1a267fc640 1 -- 172.21.15.27:0/4018320595 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a280adb80 con 0x7f1a3014b320 2024-01-15T11:33:28.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.823+0000 7f1a267fc640 1 -- 172.21.15.27:0/4018320595 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a280adce0 con 0x7f1a3014b320 2024-01-15T11:33:28.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.823+0000 7f1a37f65640 1 -- 172.21.15.27:0/4018320595 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a3015bfb0 con 0x7f1a3014b320 2024-01-15T11:33:28.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.823+0000 7f1a37f65640 1 -- 172.21.15.27:0/4018320595 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a3015c570 con 0x7f1a3014b320 2024-01-15T11:33:28.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.823+0000 7f1a267fc640 1 -- 172.21.15.27:0/4018320595 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a280adb80 con 0x7f1a3014b320 2024-01-15T11:33:28.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.827+0000 7f1a37f65640 1 -- 172.21.15.27:0/4018320595 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a18005260 con 0x7f1a3014b320 2024-01-15T11:33:28.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.827+0000 7f1a267fc640 1 -- 172.21.15.27:0/4018320595 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f1a280ca430 con 0x7f1a3014b320 2024-01-15T11:33:28.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.831+0000 7f1a267fc640 1 --2- 172.21.15.27:0/4018320595 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1a14066910 0x7f1a14068dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:28.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.831+0000 7f1a267fc640 1 -- 172.21.15.27:0/4018320595 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a2811fc50 con 0x7f1a3014b320 2024-01-15T11:33:28.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.831+0000 7f1a35d01640 1 --2- 172.21.15.27:0/4018320595 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1a14066910 0x7f1a14068dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:28.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.839+0000 7f1a35d01640 1 --2- 172.21.15.27:0/4018320595 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1a14066910 0x7f1a14068dd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1a20007fd0 tx=0x7f1a20007e40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:28.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.839+0000 7f1a267fc640 1 -- 172.21.15.27:0/4018320595 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1a2811fe60 con 0x7f1a3014b320 2024-01-15T11:33:28.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.923+0000 7f67c813e640 1 -- 172.21.15.27:0/2816654030 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f67c004e850 con 0x7f67c0161cd0 2024-01-15T11:33:28.928 INFO:teuthology.orchestra.run.smithi027.stdout:64424509447 2024-01-15T11:33:28.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.923+0000 7f67b67fc640 1 -- 172.21.15.27:0/2816654030 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f67bc0efc90 con 0x7f67c0161cd0 2024-01-15T11:33:28.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.927+0000 7f67c813e640 1 -- 172.21.15.27:0/2816654030 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f67a4066940 msgr2=0x7f67a4068e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.927+0000 7f67c813e640 1 --2- 172.21.15.27:0/2816654030 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f67a4066940 0x7f67a4068e00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f67b800a7b0 tx=0x7f67b800d040 comp rx=0 tx=0).stop 2024-01-15T11:33:28.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.927+0000 7f67c813e640 1 -- 172.21.15.27:0/2816654030 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67c0161cd0 msgr2=0x7f67c0158530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.927+0000 7f67c813e640 1 --2- 172.21.15.27:0/2816654030 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67c0161cd0 0x7f67c0158530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f67bc0ad040 tx=0x7f67bc019230 comp rx=0 tx=0).stop 2024-01-15T11:33:28.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.927+0000 7f67c813e640 1 -- 172.21.15.27:0/2816654030 shutdown_connections 2024-01-15T11:33:28.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.927+0000 7f67c813e640 1 --2- 172.21.15.27:0/2816654030 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f67a4066940 0x7f67a4068e00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.927+0000 7f67c813e640 1 --2- 172.21.15.27:0/2816654030 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67c0161cd0 0x7f67c0158530 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.927+0000 7f67c813e640 1 --2- 172.21.15.27:0/2816654030 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67c0160b30 0x7f67c015fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.927+0000 7f67c813e640 1 --2- 172.21.15.27:0/2816654030 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67c00b4030 0x7f67c0205c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.927+0000 7f67c813e640 1 -- 172.21.15.27:0/2816654030 >> 172.21.15.27:0/2816654030 conn(0x7f67c00b0cb0 msgr2=0x7f67c0071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:28.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.927+0000 7f67c813e640 1 -- 172.21.15.27:0/2816654030 shutdown_connections 2024-01-15T11:33:28.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.927+0000 7f67c813e640 1 -- 172.21.15.27:0/2816654030 wait complete. 2024-01-15T11:33:28.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.939+0000 7ff72e1f5640 1 -- 172.21.15.27:0/1696236411 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff708005510 con 0x7ff728165a30 2024-01-15T11:33:28.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.943+0000 7ff70ffff640 1 -- 172.21.15.27:0/1696236411 <== mon.2 v2:172.21.15.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff720019070 con 0x7ff728165a30 2024-01-15T11:33:28.947 INFO:teuthology.orchestra.run.smithi027.stdout:64424509447 2024-01-15T11:33:28.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.943+0000 7ff72e1f5640 1 -- 172.21.15.27:0/1696236411 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff7140669c0 msgr2=0x7ff714068e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.943+0000 7ff72e1f5640 1 --2- 172.21.15.27:0/1696236411 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff7140669c0 0x7ff714068e80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0ad000 tx=0x7ff71c0a6000 comp rx=0 tx=0).stop 2024-01-15T11:33:28.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.943+0000 7ff72e1f5640 1 -- 172.21.15.27:0/1696236411 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff728165a30 msgr2=0x7ff7280adf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.943+0000 7ff72e1f5640 1 --2- 172.21.15.27:0/1696236411 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff728165a30 0x7ff7280adf40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff72000ba10 tx=0x7ff72000bed0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.947+0000 7ff72e1f5640 1 -- 172.21.15.27:0/1696236411 shutdown_connections 2024-01-15T11:33:28.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.947+0000 7ff72e1f5640 1 --2- 172.21.15.27:0/1696236411 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff7140669c0 0x7ff714068e80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.947+0000 7ff72e1f5640 1 --2- 172.21.15.27:0/1696236411 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7280ae480 0x7ff728160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.947+0000 7ff72e1f5640 1 --2- 172.21.15.27:0/1696236411 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff728165a30 0x7ff7280adf40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.947+0000 7ff72e1f5640 1 --2- 172.21.15.27:0/1696236411 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff728162bd0 0x7ff72814c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.947+0000 7ff72e1f5640 1 -- 172.21.15.27:0/1696236411 >> 172.21.15.27:0/1696236411 conn(0x7ff7280b0cb0 msgr2=0x7ff7280b3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:28.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.947+0000 7ff72e1f5640 1 -- 172.21.15.27:0/1696236411 shutdown_connections 2024-01-15T11:33:28.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.947+0000 7ff72e1f5640 1 -- 172.21.15.27:0/1696236411 wait complete. 2024-01-15T11:33:28.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.0 2024-01-15T11:33:28.963 DEBUG:teuthology.parallel:result is None 2024-01-15T11:33:28.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.1 2024-01-15T11:33:28.974 DEBUG:teuthology.parallel:result is None 2024-01-15T11:33:28.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.991+0000 7fd338e68640 1 -- 172.21.15.27:0/3811824231 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd32c050450 con 0x7fd32c0e11f0 2024-01-15T11:33:28.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.991+0000 7fd322ffd640 1 -- 172.21.15.27:0/3811824231 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd328017020 con 0x7fd32c0e11f0 2024-01-15T11:33:28.993 INFO:teuthology.orchestra.run.smithi027.stdout:64424509447 2024-01-15T11:33:28.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.995+0000 7fd338e68640 1 -- 172.21.15.27:0/3811824231 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd314066950 msgr2=0x7fd314068e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.995+0000 7fd338e68640 1 --2- 172.21.15.27:0/3811824231 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd314066950 0x7fd314068e10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd32c00f8f0 tx=0x7fd334124000 comp rx=0 tx=0).stop 2024-01-15T11:33:28.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.995+0000 7fd338e68640 1 -- 172.21.15.27:0/3811824231 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd32c0e11f0 msgr2=0x7fd32c04e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:28.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.995+0000 7fd338e68640 1 --2- 172.21.15.27:0/3811824231 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd32c0e11f0 0x7fd32c04e960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd32800e850 tx=0x7fd32800ed10 comp rx=0 tx=0).stop 2024-01-15T11:33:28.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.995+0000 7fd338e68640 1 -- 172.21.15.27:0/3811824231 shutdown_connections 2024-01-15T11:33:28.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.995+0000 7fd338e68640 1 --2- 172.21.15.27:0/3811824231 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd314066950 0x7fd314068e10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.995+0000 7fd338e68640 1 --2- 172.21.15.27:0/3811824231 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd32c0e11f0 0x7fd32c04e960 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.995+0000 7fd338e68640 1 --2- 172.21.15.27:0/3811824231 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd32c036140 0x7fd32c0d9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.995+0000 7fd338e68640 1 --2- 172.21.15.27:0/3811824231 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd32c035b80 0x7fd32c049b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:28.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.995+0000 7fd338e68640 1 -- 172.21.15.27:0/3811824231 >> 172.21.15.27:0/3811824231 conn(0x7fd32c056e80 msgr2=0x7fd32c0e15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:28.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.995+0000 7fd338e68640 1 -- 172.21.15.27:0/3811824231 shutdown_connections 2024-01-15T11:33:28.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:28.995+0000 7fd338e68640 1 -- 172.21.15.27:0/3811824231 wait complete. 2024-01-15T11:33:29.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.007+0000 7f9114c9c640 1 -- 172.21.15.27:0/1842570226 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f911013dd20 con 0x7f911006dde0 2024-01-15T11:33:29.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.007+0000 7f90f7fff640 1 -- 172.21.15.27:0/1842570226 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9100017020 con 0x7f911006dde0 2024-01-15T11:33:29.010 INFO:teuthology.orchestra.run.smithi027.stdout:64424509448 2024-01-15T11:33:29.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.011+0000 7f9114c9c640 1 -- 172.21.15.27:0/1842570226 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f90fc066980 msgr2=0x7f90fc068e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:29.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.011+0000 7f9114c9c640 1 --2- 172.21.15.27:0/1842570226 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f90fc066980 0x7f90fc068e40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f911013e0a0 tx=0x7f91080078a0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.011+0000 7f9114c9c640 1 -- 172.21.15.27:0/1842570226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f911006dde0 msgr2=0x7f91101347e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:29.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.011+0000 7f9114c9c640 1 --2- 172.21.15.27:0/1842570226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f911006dde0 0x7f91101347e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9100000f70 tx=0x7f910000c870 comp rx=0 tx=0).stop 2024-01-15T11:33:29.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.011+0000 7f9114c9c640 1 -- 172.21.15.27:0/1842570226 shutdown_connections 2024-01-15T11:33:29.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.011+0000 7f9114c9c640 1 --2- 172.21.15.27:0/1842570226 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f911014b120 0x7f9110137880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.011+0000 7f9114c9c640 1 --2- 172.21.15.27:0/1842570226 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9110070490 0x7f91100ade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.011+0000 7f9114c9c640 1 --2- 172.21.15.27:0/1842570226 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f90fc066980 0x7f90fc068e40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.011+0000 7f9114c9c640 1 --2- 172.21.15.27:0/1842570226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f911006dde0 0x7f91101347e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.011+0000 7f9114c9c640 1 -- 172.21.15.27:0/1842570226 >> 172.21.15.27:0/1842570226 conn(0x7f91100b0c20 msgr2=0x7f91100b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:29.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.011+0000 7f9114c9c640 1 -- 172.21.15.27:0/1842570226 shutdown_connections 2024-01-15T11:33:29.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.011+0000 7f9114c9c640 1 -- 172.21.15.27:0/1842570226 wait complete. 2024-01-15T11:33:29.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.2 2024-01-15T11:33:29.027 DEBUG:teuthology.parallel:result is None 2024-01-15T11:33:29.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.3 2024-01-15T11:33:29.044 DEBUG:teuthology.parallel:result is None 2024-01-15T11:33:29.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.091+0000 7f4af1a68640 1 -- 172.21.15.27:0/3918491433 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4aec140fa0 con 0x7f4aec146000 2024-01-15T11:33:29.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.091+0000 7f4ad3fff640 1 -- 172.21.15.27:0/3918491433 <== mon.2 v2:172.21.15.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4adc017020 con 0x7f4aec146000 2024-01-15T11:33:29.095 INFO:teuthology.orchestra.run.smithi027.stdout:64424509448 2024-01-15T11:33:29.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.091+0000 7f4af1a68640 1 -- 172.21.15.27:0/3918491433 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4ad80669c0 msgr2=0x7f4ad8068e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:29.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.091+0000 7f4af1a68640 1 --2- 172.21.15.27:0/3918491433 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4ad80669c0 0x7f4ad8068e80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00ad000 tx=0x7f4ae0004740 comp rx=0 tx=0).stop 2024-01-15T11:33:29.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.091+0000 7f4af1a68640 1 -- 172.21.15.27:0/3918491433 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4aec146000 msgr2=0x7f4aec13f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:29.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.091+0000 7f4af1a68640 1 --2- 172.21.15.27:0/3918491433 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4aec146000 0x7f4aec13f090 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00c3c0 tx=0x7f4adc00c880 comp rx=0 tx=0).stop 2024-01-15T11:33:29.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.091+0000 7f4af1a68640 1 -- 172.21.15.27:0/3918491433 shutdown_connections 2024-01-15T11:33:29.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.091+0000 7f4af1a68640 1 --2- 172.21.15.27:0/3918491433 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4ad80669c0 0x7f4ad8068e80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.091+0000 7f4af1a68640 1 --2- 172.21.15.27:0/3918491433 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4aec1463e0 0x7f4aec1628a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.091+0000 7f4af1a68640 1 --2- 172.21.15.27:0/3918491433 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4aec146000 0x7f4aec13f090 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.091+0000 7f4af1a68640 1 --2- 172.21.15.27:0/3918491433 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4aec072430 0x7f4aec141940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.091+0000 7f4af1a68640 1 -- 172.21.15.27:0/3918491433 >> 172.21.15.27:0/3918491433 conn(0x7f4aec06c340 msgr2=0x7f4aec0cdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:29.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.095+0000 7f4af1a68640 1 -- 172.21.15.27:0/3918491433 shutdown_connections 2024-01-15T11:33:29.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.095+0000 7f4af1a68640 1 -- 172.21.15.27:0/3918491433 wait complete. 2024-01-15T11:33:29.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.095+0000 7f1a37f65640 1 -- 172.21.15.27:0/4018320595 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1a180057e0 con 0x7f1a3014b320 2024-01-15T11:33:29.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.095+0000 7f1a267fc640 1 -- 172.21.15.27:0/4018320595 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a280b2020 con 0x7f1a3014b320 2024-01-15T11:33:29.100 INFO:teuthology.orchestra.run.smithi027.stdout:60129542151 2024-01-15T11:33:29.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.099+0000 7f1a37f65640 1 -- 172.21.15.27:0/4018320595 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1a14066910 msgr2=0x7f1a14068dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:29.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.099+0000 7f1a37f65640 1 --2- 172.21.15.27:0/4018320595 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1a14066910 0x7f1a14068dd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1a20007fd0 tx=0x7f1a20007e40 comp rx=0 tx=0).stop 2024-01-15T11:33:29.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.099+0000 7f1a37f65640 1 -- 172.21.15.27:0/4018320595 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a3014b320 msgr2=0x7f1a3015d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:29.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.099+0000 7f1a37f65640 1 --2- 172.21.15.27:0/4018320595 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a3014b320 0x7f1a3015d590 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1a2801af90 tx=0x7f1a28019680 comp rx=0 tx=0).stop 2024-01-15T11:33:29.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.099+0000 7f1a37f65640 1 -- 172.21.15.27:0/4018320595 shutdown_connections 2024-01-15T11:33:29.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.099+0000 7f1a37f65640 1 --2- 172.21.15.27:0/4018320595 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a3014b320 0x7f1a3015d590 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.099+0000 7f1a37f65640 1 --2- 172.21.15.27:0/4018320595 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1a3014af40 0x7f1a300cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.099+0000 7f1a37f65640 1 --2- 172.21.15.27:0/4018320595 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1a14066910 0x7f1a14068dd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.099+0000 7f1a37f65640 1 --2- 172.21.15.27:0/4018320595 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a300b46b0 0x7f1a300cd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.099+0000 7f1a37f65640 1 -- 172.21.15.27:0/4018320595 >> 172.21.15.27:0/4018320595 conn(0x7f1a300b0d90 msgr2=0x7f1a30143ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:29.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.099+0000 7f1a37f65640 1 -- 172.21.15.27:0/4018320595 shutdown_connections 2024-01-15T11:33:29.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.099+0000 7f1a37f65640 1 -- 172.21.15.27:0/4018320595 wait complete. 2024-01-15T11:33:29.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.099+0000 7f59ebfff640 1 -- 172.21.15.27:0/4009209614 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f59ec074990 con 0x7f59ec143900 2024-01-15T11:33:29.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.099+0000 7f59d3fff640 1 -- 172.21.15.27:0/4009209614 <== mon.2 v2:172.21.15.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f59e4019070 con 0x7f59ec143900 2024-01-15T11:33:29.103 INFO:teuthology.orchestra.run.smithi027.stdout:64424509448 2024-01-15T11:33:29.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.103+0000 7f59ebfff640 1 -- 172.21.15.27:0/4009209614 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f59d80669b0 msgr2=0x7f59d8068e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:29.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.103+0000 7f59ebfff640 1 --2- 172.21.15.27:0/4009209614 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f59d80669b0 0x7f59d8068e70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0ad000 tx=0x7f59dc004740 comp rx=0 tx=0).stop 2024-01-15T11:33:29.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.103+0000 7f59ebfff640 1 -- 172.21.15.27:0/4009209614 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59ec143900 msgr2=0x7f59ec0cda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:29.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.103+0000 7f59ebfff640 1 --2- 172.21.15.27:0/4009209614 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59ec143900 0x7f59ec0cda90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f59e400be20 tx=0x7f59e400bf10 comp rx=0 tx=0).stop 2024-01-15T11:33:29.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.103+0000 7f59ebfff640 1 -- 172.21.15.27:0/4009209614 shutdown_connections 2024-01-15T11:33:29.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.103+0000 7f59ebfff640 1 --2- 172.21.15.27:0/4009209614 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59ec143900 0x7f59ec0cda90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.103+0000 7f59ebfff640 1 --2- 172.21.15.27:0/4009209614 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f59d80669b0 0x7f59d8068e70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.103+0000 7f59ebfff640 1 --2- 172.21.15.27:0/4009209614 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59ec0ae480 0x7f59ec15b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.103+0000 7f59ebfff640 1 --2- 172.21.15.27:0/4009209614 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59ec0ac8a0 0x7f59ec15d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.103+0000 7f59ebfff640 1 -- 172.21.15.27:0/4009209614 >> 172.21.15.27:0/4009209614 conn(0x7f59ec0b0c20 msgr2=0x7f59ec06ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:29.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.103+0000 7f59ebfff640 1 -- 172.21.15.27:0/4009209614 shutdown_connections 2024-01-15T11:33:29.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.103+0000 7f59ebfff640 1 -- 172.21.15.27:0/4009209614 wait complete. 2024-01-15T11:33:29.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.107+0000 7f9b3cf93640 1 -- 172.21.15.27:0/4144276271 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f9b180057e0 con 0x7f9b3814b120 2024-01-15T11:33:29.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.107+0000 7f9b1ffff640 1 -- 172.21.15.27:0/4144276271 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9b30051840 con 0x7f9b3814b120 2024-01-15T11:33:29.110 INFO:teuthology.orchestra.run.smithi027.stdout:64424509449 2024-01-15T11:33:29.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.107+0000 7f9b3cf93640 1 -- 172.21.15.27:0/4144276271 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9b24066970 msgr2=0x7f9b24068e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:29.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.107+0000 7f9b3cf93640 1 --2- 172.21.15.27:0/4144276271 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9b24066970 0x7f9b24068e30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9b2800a830 tx=0x7f9b28008040 comp rx=0 tx=0).stop 2024-01-15T11:33:29.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.107+0000 7f9b3cf93640 1 -- 172.21.15.27:0/4144276271 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b3814b120 msgr2=0x7f9b38160cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:29.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.107+0000 7f9b3cf93640 1 --2- 172.21.15.27:0/4144276271 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b3814b120 0x7f9b38160cd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000caf0 tx=0x7f9b30002100 comp rx=0 tx=0).stop 2024-01-15T11:33:29.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.107+0000 7f9b3cf93640 1 -- 172.21.15.27:0/4144276271 shutdown_connections 2024-01-15T11:33:29.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.107+0000 7f9b3cf93640 1 --2- 172.21.15.27:0/4144276271 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b3814b120 0x7f9b38160cd0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.107+0000 7f9b3cf93640 1 --2- 172.21.15.27:0/4144276271 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9b24066970 0x7f9b24068e30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.107+0000 7f9b3cf93640 1 --2- 172.21.15.27:0/4144276271 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b38070490 0x7f9b38148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.107+0000 7f9b3cf93640 1 --2- 172.21.15.27:0/4144276271 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9b3806dde0 0x7f9b381340f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.107+0000 7f9b3cf93640 1 -- 172.21.15.27:0/4144276271 >> 172.21.15.27:0/4144276271 conn(0x7f9b380b0c20 msgr2=0x7f9b380aeb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:29.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.107+0000 7f9b3cf93640 1 -- 172.21.15.27:0/4144276271 shutdown_connections 2024-01-15T11:33:29.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.107+0000 7f9b3cf93640 1 -- 172.21.15.27:0/4144276271 wait complete. 2024-01-15T11:33:29.122 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.6 2024-01-15T11:33:29.122 DEBUG:teuthology.parallel:result is None 2024-01-15T11:33:29.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.5 2024-01-15T11:33:29.129 DEBUG:teuthology.parallel:result is None 2024-01-15T11:33:29.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.7 2024-01-15T11:33:29.131 DEBUG:teuthology.parallel:result is None 2024-01-15T11:33:29.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509449 for osd.4 2024-01-15T11:33:29.136 DEBUG:teuthology.parallel:result is None 2024-01-15T11:33:29.136 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-15T11:33:29.136 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-15T11:33:29.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.323+0000 7f3424957640 1 Processor -- start 2024-01-15T11:33:29.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.323+0000 7f3424957640 1 -- start start 2024-01-15T11:33:29.328 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.323+0000 7f3424957640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3420146240 0x7f3420161ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:29.328 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.323+0000 7f3424957640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3420146860 0x7f34200b4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:29.328 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.323+0000 7f3424957640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f342006c840 con 0x7f34200b4750 2024-01-15T11:33:29.328 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.323+0000 7f3424957640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34200b4bc0 con 0x7f3420146240 2024-01-15T11:33:29.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.323+0000 7f3424957640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f342015eb00 con 0x7f3420146860 2024-01-15T11:33:29.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.323+0000 7f341e59c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3420146240 0x7f3420161ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:29.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.323+0000 7f341e59c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3420146240 0x7f3420161ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55578/0 (socket says 172.21.15.27:55578) 2024-01-15T11:33:29.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.323+0000 7f341e59c640 1 -- 172.21.15.27:0/3844054256 learned_addr learned my addr 172.21.15.27:0/3844054256 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:29.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.323+0000 7f341dd9b640 1 --2- 172.21.15.27:0/3844054256 >> v2:172.21.15.93:3300/0 conn(0x7f3420146860 0x7f34200b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:29.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.323+0000 7f341e59c640 1 -- 172.21.15.27:0/3844054256 >> v2:172.21.15.93:3300/0 conn(0x7f3420146860 msgr2=0x7f34200b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:29.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.323+0000 7f341e59c640 1 --2- 172.21.15.27:0/3844054256 >> v2:172.21.15.93:3300/0 conn(0x7f3420146860 0x7f34200b4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.323+0000 7f341e59c640 1 -- 172.21.15.27:0/3844054256 >> v1:172.21.15.93:6789/0 conn(0x7f34200b4750 legacy=0x7f34200700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:29.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.327+0000 7f341e59c640 1 -- 172.21.15.27:0/3844054256 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3420146620 con 0x7f3420146240 2024-01-15T11:33:29.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.327+0000 7f341e59c640 1 --2- 172.21.15.27:0/3844054256 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3420146240 0x7f3420161ac0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f34200b3fd0 tx=0x7f341001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241bbabca0931853 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:29.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.327+0000 7f341d59a640 1 -- 172.21.15.27:0/3844054256 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34100ab600 con 0x7f3420146240 2024-01-15T11:33:29.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.327+0000 7f341d59a640 1 -- 172.21.15.27:0/3844054256 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34100ab760 con 0x7f3420146240 2024-01-15T11:33:29.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.327+0000 7f341d59a640 1 -- 172.21.15.27:0/3844054256 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34100abaf0 con 0x7f3420146240 2024-01-15T11:33:29.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.327+0000 7f3424957640 1 -- 172.21.15.27:0/3844054256 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3420146240 msgr2=0x7f3420161ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:29.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.327+0000 7f3424957640 1 --2- 172.21.15.27:0/3844054256 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3420146240 0x7f3420161ac0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f34200b3fd0 tx=0x7f341001c4e0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.327+0000 7f3424957640 1 -- 172.21.15.27:0/3844054256 shutdown_connections 2024-01-15T11:33:29.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.327+0000 7f3424957640 1 --2- 172.21.15.27:0/3844054256 >> v2:172.21.15.93:3300/0 conn(0x7f3420146860 0x7f34200b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.327+0000 7f3424957640 1 --2- 172.21.15.27:0/3844054256 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3420146240 0x7f3420161ac0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.327+0000 7f3424957640 1 -- 172.21.15.27:0/3844054256 >> 172.21.15.27:0/3844054256 conn(0x7f342006e950 msgr2=0x7f342006ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:29.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.327+0000 7f3424957640 1 -- 172.21.15.27:0/3844054256 shutdown_connections 2024-01-15T11:33:29.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.331+0000 7f3424957640 1 -- 172.21.15.27:0/3844054256 wait complete. 2024-01-15T11:33:29.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.331+0000 7f3424957640 1 Processor -- start 2024-01-15T11:33:29.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.331+0000 7f3424957640 1 -- start start 2024-01-15T11:33:29.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.331+0000 7f3424957640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34200b4750 0x7f342015cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:29.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.331+0000 7f3424957640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3420146240 0x7f3420140800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:29.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.331+0000 7f3424957640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3420146860 0x7f3420166f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:29.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.331+0000 7f3424957640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3420166b60 con 0x7f3420146240 2024-01-15T11:33:29.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.331+0000 7f3424957640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342015d500 con 0x7f34200b4750 2024-01-15T11:33:29.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.331+0000 7f3424957640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34201411c0 con 0x7f3420146860 2024-01-15T11:33:29.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.331+0000 7f341dd9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3420146240 0x7f3420140800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:29.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.331+0000 7f341dd9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3420146240 0x7f3420140800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55594/0 (socket says 172.21.15.27:55594) 2024-01-15T11:33:29.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.331+0000 7f341dd9b640 1 -- 172.21.15.27:0/2900888529 learned_addr learned my addr 172.21.15.27:0/2900888529 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:29.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.331+0000 7f341e59c640 1 --2- 172.21.15.27:0/2900888529 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34200b4750 0x7f342015cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:29.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.331+0000 7f341ed9d640 1 --2- 172.21.15.27:0/2900888529 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3420146860 0x7f3420166f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:29.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.331+0000 7f341dd9b640 1 -- 172.21.15.27:0/2900888529 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3420146860 msgr2=0x7f3420166f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:29.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.331+0000 7f341dd9b640 1 --2- 172.21.15.27:0/2900888529 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3420146860 0x7f3420166f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.331+0000 7f341dd9b640 1 -- 172.21.15.27:0/2900888529 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34200b4750 msgr2=0x7f342015cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:29.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.331+0000 7f341dd9b640 1 --2- 172.21.15.27:0/2900888529 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34200b4750 0x7f342015cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.331+0000 7f341dd9b640 1 -- 172.21.15.27:0/2900888529 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34100094d0 con 0x7f3420146240 2024-01-15T11:33:29.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.331+0000 7f341ed9d640 1 --2- 172.21.15.27:0/2900888529 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3420146860 0x7f3420166f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:29.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.331+0000 7f341dd9b640 1 --2- 172.21.15.27:0/2900888529 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3420146240 0x7f3420140800 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f341400e930 tx=0x7f341400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:29.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.331+0000 7f340effd640 1 -- 172.21.15.27:0/2900888529 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3414009690 con 0x7f3420146240 2024-01-15T11:33:29.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.335+0000 7f340effd640 1 -- 172.21.15.27:0/2900888529 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341400ca00 con 0x7f3420146240 2024-01-15T11:33:29.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.335+0000 7f340effd640 1 -- 172.21.15.27:0/2900888529 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341400cd70 con 0x7f3420146240 2024-01-15T11:33:29.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.335+0000 7f3424957640 1 -- 172.21.15.27:0/2900888529 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34201414a0 con 0x7f3420146240 2024-01-15T11:33:29.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.335+0000 7f3424957640 1 -- 172.21.15.27:0/2900888529 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3420141a60 con 0x7f3420146240 2024-01-15T11:33:29.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.335+0000 7f3424957640 1 -- 172.21.15.27:0/2900888529 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f342006ccb0 con 0x7f3420146240 2024-01-15T11:33:29.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.335+0000 7f340effd640 1 -- 172.21.15.27:0/2900888529 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f3414013470 con 0x7f3420146240 2024-01-15T11:33:29.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.335+0000 7f340effd640 1 --2- 172.21.15.27:0/2900888529 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3400066920 0x7f3400068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:29.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.335+0000 7f340effd640 1 -- 172.21.15.27:0/2900888529 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3414084600 con 0x7f3420146240 2024-01-15T11:33:29.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.335+0000 7f341e59c640 1 --2- 172.21.15.27:0/2900888529 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3400066920 0x7f3400068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:29.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.335+0000 7f341e59c640 1 --2- 172.21.15.27:0/2900888529 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3400066920 0x7f3400068de0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f34100af000 tx=0x7f34100b6040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:29.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.339+0000 7f340effd640 1 -- 172.21.15.27:0/2900888529 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f342006ccb0 con 0x7f3420146240 2024-01-15T11:33:29.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.499+0000 7f3424957640 1 -- 172.21.15.27:0/2900888529 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34200b5380 con 0x7f3400066920 2024-01-15T11:33:29.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.507+0000 7f340effd640 1 -- 172.21.15.27:0/2900888529 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264600 (secure 0 0 0) 0x7f34200b5380 con 0x7f3400066920 2024-01-15T11:33:29.512 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:29.514 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-01-15T11:33:29.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.511+0000 7f3424957640 1 -- 172.21.15.27:0/2900888529 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3400066920 msgr2=0x7f3400068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:29.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.511+0000 7f3424957640 1 --2- 172.21.15.27:0/2900888529 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3400066920 0x7f3400068de0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f34100af000 tx=0x7f34100b6040 comp rx=0 tx=0).stop 2024-01-15T11:33:29.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.511+0000 7f3424957640 1 -- 172.21.15.27:0/2900888529 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3420146240 msgr2=0x7f3420140800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:29.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.511+0000 7f3424957640 1 --2- 172.21.15.27:0/2900888529 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3420146240 0x7f3420140800 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f341400e930 tx=0x7f341400edf0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.511+0000 7f3424957640 1 -- 172.21.15.27:0/2900888529 shutdown_connections 2024-01-15T11:33:29.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.511+0000 7f3424957640 1 --2- 172.21.15.27:0/2900888529 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3420146860 0x7f3420166f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.511+0000 7f3424957640 1 --2- 172.21.15.27:0/2900888529 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3420146240 0x7f3420140800 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.511+0000 7f3424957640 1 --2- 172.21.15.27:0/2900888529 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3400066920 0x7f3400068de0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.511+0000 7f3424957640 1 --2- 172.21.15.27:0/2900888529 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34200b4750 0x7f342015cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.511+0000 7f3424957640 1 -- 172.21.15.27:0/2900888529 >> 172.21.15.27:0/2900888529 conn(0x7f342006e950 msgr2=0x7f34201602c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:29.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.511+0000 7f3424957640 1 -- 172.21.15.27:0/2900888529 shutdown_connections 2024-01-15T11:33:29.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.511+0000 7f3424957640 1 -- 172.21.15.27:0/2900888529 wait complete. 2024-01-15T11:33:29.533 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-01-15T11:33:28.066687+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219144,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755576,"statfs":{"total":773094113280,"available":772869709824,"internally_reserved":0,"allocated":3022848,"data_stored":1795572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002013"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049923+0000","last_change":"2024-01-15T11:33:20.716411+0000","last_active":"2024-01-15T11:33:22.049923+0000","last_peered":"2024-01-15T11:33:22.049923+0000","last_clean":"2024-01-15T11:33:22.049923+0000","last_became_active":"2024-01-15T11:33:20.716169+0000","last_became_peered":"2024-01-15T11:33:20.716169+0000","last_unstale":"2024-01-15T11:33:22.049923+0000","last_undegraded":"2024-01-15T11:33:22.049923+0000","last_fullsized":"2024-01-15T11:33:22.049923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:43:30.219449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.821785+0000","last_change":"2024-01-15T11:33:20.713459+0000","last_active":"2024-01-15T11:33:22.821785+0000","last_peered":"2024-01-15T11:33:22.821785+0000","last_clean":"2024-01-15T11:33:22.821785+0000","last_became_active":"2024-01-15T11:33:20.713141+0000","last_became_peered":"2024-01-15T11:33:20.713141+0000","last_unstale":"2024-01-15T11:33:22.821785+0000","last_undegraded":"2024-01-15T11:33:22.821785+0000","last_fullsized":"2024-01-15T11:33:22.821785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:23:59.431150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.821811+0000","last_change":"2024-01-15T11:33:20.715526+0000","last_active":"2024-01-15T11:33:22.821811+0000","last_peered":"2024-01-15T11:33:22.821811+0000","last_clean":"2024-01-15T11:33:22.821811+0000","last_became_active":"2024-01-15T11:33:20.715226+0000","last_became_peered":"2024-01-15T11:33:20.715226+0000","last_unstale":"2024-01-15T11:33:22.821811+0000","last_undegraded":"2024-01-15T11:33:22.821811+0000","last_fullsized":"2024-01-15T11:33:22.821811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:31:58.874374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.823741+0000","last_change":"2024-01-15T11:33:20.699790+0000","last_active":"2024-01-15T11:33:22.823741+0000","last_peered":"2024-01-15T11:33:22.823741+0000","last_clean":"2024-01-15T11:33:22.823741+0000","last_became_active":"2024-01-15T11:33:20.699497+0000","last_became_peered":"2024-01-15T11:33:20.699497+0000","last_unstale":"2024-01-15T11:33:22.823741+0000","last_undegraded":"2024-01-15T11:33:22.823741+0000","last_fullsized":"2024-01-15T11:33:22.823741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:30:25.661172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049813+0000","last_change":"2024-01-15T11:33:20.714669+0000","last_active":"2024-01-15T11:33:22.049813+0000","last_peered":"2024-01-15T11:33:22.049813+0000","last_clean":"2024-01-15T11:33:22.049813+0000","last_became_active":"2024-01-15T11:33:20.714267+0000","last_became_peered":"2024-01-15T11:33:20.714267+0000","last_unstale":"2024-01-15T11:33:22.049813+0000","last_undegraded":"2024-01-15T11:33:22.049813+0000","last_fullsized":"2024-01-15T11:33:22.049813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T11:40:03.906758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.823681+0000","last_change":"2024-01-15T11:33:20.700208+0000","last_active":"2024-01-15T11:33:22.823681+0000","last_peered":"2024-01-15T11:33:22.823681+0000","last_clean":"2024-01-15T11:33:22.823681+0000","last_became_active":"2024-01-15T11:33:20.698271+0000","last_became_peered":"2024-01-15T11:33:20.698271+0000","last_unstale":"2024-01-15T11:33:22.823681+0000","last_undegraded":"2024-01-15T11:33:22.823681+0000","last_fullsized":"2024-01-15T11:33:22.823681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:21:39.120264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049558+0000","last_change":"2024-01-15T11:33:20.709080+0000","last_active":"2024-01-15T11:33:22.049558+0000","last_peered":"2024-01-15T11:33:22.049558+0000","last_clean":"2024-01-15T11:33:22.049558+0000","last_became_active":"2024-01-15T11:33:20.707734+0000","last_became_peered":"2024-01-15T11:33:20.707734+0000","last_unstale":"2024-01-15T11:33:22.049558+0000","last_undegraded":"2024-01-15T11:33:22.049558+0000","last_fullsized":"2024-01-15T11:33:22.049558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:30:57.472645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.821820+0000","last_change":"2024-01-15T11:33:20.721012+0000","last_active":"2024-01-15T11:33:22.821820+0000","last_peered":"2024-01-15T11:33:22.821820+0000","last_clean":"2024-01-15T11:33:22.821820+0000","last_became_active":"2024-01-15T11:33:20.720749+0000","last_became_peered":"2024-01-15T11:33:20.720749+0000","last_unstale":"2024-01-15T11:33:22.821820+0000","last_undegraded":"2024-01-15T11:33:22.821820+0000","last_fullsized":"2024-01-15T11:33:22.821820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:28:49.151092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.738843+0000","last_change":"2024-01-15T11:33:20.712100+0000","last_active":"2024-01-15T11:33:22.738843+0000","last_peered":"2024-01-15T11:33:22.738843+0000","last_clean":"2024-01-15T11:33:22.738843+0000","last_became_active":"2024-01-15T11:33:20.711811+0000","last_became_peered":"2024-01-15T11:33:20.711811+0000","last_unstale":"2024-01-15T11:33:22.738843+0000","last_undegraded":"2024-01-15T11:33:22.738843+0000","last_fullsized":"2024-01-15T11:33:22.738843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:54:20.821257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049776+0000","last_change":"2024-01-15T11:33:20.707038+0000","last_active":"2024-01-15T11:33:22.049776+0000","last_peered":"2024-01-15T11:33:22.049776+0000","last_clean":"2024-01-15T11:33:22.049776+0000","last_became_active":"2024-01-15T11:33:20.706364+0000","last_became_peered":"2024-01-15T11:33:20.706364+0000","last_unstale":"2024-01-15T11:33:22.049776+0000","last_undegraded":"2024-01-15T11:33:22.049776+0000","last_fullsized":"2024-01-15T11:33:22.049776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:06:51.078552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049883+0000","last_change":"2024-01-15T11:33:20.716954+0000","last_active":"2024-01-15T11:33:22.049883+0000","last_peered":"2024-01-15T11:33:22.049883+0000","last_clean":"2024-01-15T11:33:22.049883+0000","last_became_active":"2024-01-15T11:33:20.716582+0000","last_became_peered":"2024-01-15T11:33:20.716582+0000","last_unstale":"2024-01-15T11:33:22.049883+0000","last_undegraded":"2024-01-15T11:33:22.049883+0000","last_fullsized":"2024-01-15T11:33:22.049883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:37:58.693069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049767+0000","last_change":"2024-01-15T11:33:20.717724+0000","last_active":"2024-01-15T11:33:22.049767+0000","last_peered":"2024-01-15T11:33:22.049767+0000","last_clean":"2024-01-15T11:33:22.049767+0000","last_became_active":"2024-01-15T11:33:20.717228+0000","last_became_peered":"2024-01-15T11:33:20.717228+0000","last_unstale":"2024-01-15T11:33:22.049767+0000","last_undegraded":"2024-01-15T11:33:22.049767+0000","last_fullsized":"2024-01-15T11:33:22.049767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:25:16.576586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.822348+0000","last_change":"2024-01-15T11:33:20.715589+0000","last_active":"2024-01-15T11:33:22.822348+0000","last_peered":"2024-01-15T11:33:22.822348+0000","last_clean":"2024-01-15T11:33:22.822348+0000","last_became_active":"2024-01-15T11:33:20.714841+0000","last_became_peered":"2024-01-15T11:33:20.714841+0000","last_unstale":"2024-01-15T11:33:22.822348+0000","last_undegraded":"2024-01-15T11:33:22.822348+0000","last_fullsized":"2024-01-15T11:33:22.822348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:28:17.783937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.821585+0000","last_change":"2024-01-15T11:33:20.703953+0000","last_active":"2024-01-15T11:33:22.821585+0000","last_peered":"2024-01-15T11:33:22.821585+0000","last_clean":"2024-01-15T11:33:22.821585+0000","last_became_active":"2024-01-15T11:33:20.703653+0000","last_became_peered":"2024-01-15T11:33:20.703653+0000","last_unstale":"2024-01-15T11:33:22.821585+0000","last_undegraded":"2024-01-15T11:33:22.821585+0000","last_fullsized":"2024-01-15T11:33:22.821585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:35:15.716032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.821776+0000","last_change":"2024-01-15T11:33:20.719103+0000","last_active":"2024-01-15T11:33:22.821776+0000","last_peered":"2024-01-15T11:33:22.821776+0000","last_clean":"2024-01-15T11:33:22.821776+0000","last_became_active":"2024-01-15T11:33:20.718591+0000","last_became_peered":"2024-01-15T11:33:20.718591+0000","last_unstale":"2024-01-15T11:33:22.821776+0000","last_undegraded":"2024-01-15T11:33:22.821776+0000","last_fullsized":"2024-01-15T11:33:22.821776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:05:43.854972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694295+0000","last_change":"2024-01-15T11:33:20.701415+0000","last_active":"2024-01-15T11:33:21.694295+0000","last_peered":"2024-01-15T11:33:21.694295+0000","last_clean":"2024-01-15T11:33:21.694295+0000","last_became_active":"2024-01-15T11:33:20.701093+0000","last_became_peered":"2024-01-15T11:33:20.701093+0000","last_unstale":"2024-01-15T11:33:21.694295+0000","last_undegraded":"2024-01-15T11:33:21.694295+0000","last_fullsized":"2024-01-15T11:33:21.694295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:43:30.219449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694973+0000","last_change":"2024-01-15T11:33:20.718200+0000","last_active":"2024-01-15T11:33:21.694973+0000","last_peered":"2024-01-15T11:33:21.694973+0000","last_clean":"2024-01-15T11:33:21.694973+0000","last_became_active":"2024-01-15T11:33:20.717333+0000","last_became_peered":"2024-01-15T11:33:20.717333+0000","last_unstale":"2024-01-15T11:33:21.694973+0000","last_undegraded":"2024-01-15T11:33:21.694973+0000","last_fullsized":"2024-01-15T11:33:21.694973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:01:50.198012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.693034+0000","last_change":"2024-01-15T11:33:20.701000+0000","last_active":"2024-01-15T11:33:21.693034+0000","last_peered":"2024-01-15T11:33:21.693034+0000","last_clean":"2024-01-15T11:33:21.693034+0000","last_became_active":"2024-01-15T11:33:20.700312+0000","last_became_peered":"2024-01-15T11:33:20.700312+0000","last_unstale":"2024-01-15T11:33:21.693034+0000","last_undegraded":"2024-01-15T11:33:21.693034+0000","last_fullsized":"2024-01-15T11:33:21.693034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:30:25.661172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694717+0000","last_change":"2024-01-15T11:33:20.703054+0000","last_active":"2024-01-15T11:33:21.694717+0000","last_peered":"2024-01-15T11:33:21.694717+0000","last_clean":"2024-01-15T11:33:21.694717+0000","last_became_active":"2024-01-15T11:33:20.702256+0000","last_became_peered":"2024-01-15T11:33:20.702256+0000","last_unstale":"2024-01-15T11:33:21.694717+0000","last_undegraded":"2024-01-15T11:33:21.694717+0000","last_fullsized":"2024-01-15T11:33:21.694717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:27:46.642600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049810+0000","last_change":"2024-01-15T11:33:20.717634+0000","last_active":"2024-01-15T11:33:22.049810+0000","last_peered":"2024-01-15T11:33:22.049810+0000","last_clean":"2024-01-15T11:33:22.049810+0000","last_became_active":"2024-01-15T11:33:20.716991+0000","last_became_peered":"2024-01-15T11:33:20.716991+0000","last_unstale":"2024-01-15T11:33:22.049810+0000","last_undegraded":"2024-01-15T11:33:22.049810+0000","last_fullsized":"2024-01-15T11:33:22.049810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:29:53.572044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692042+0000","last_change":"2024-01-15T11:33:20.706694+0000","last_active":"2024-01-15T11:33:21.692042+0000","last_peered":"2024-01-15T11:33:21.692042+0000","last_clean":"2024-01-15T11:33:21.692042+0000","last_became_active":"2024-01-15T11:33:20.706408+0000","last_became_peered":"2024-01-15T11:33:20.706408+0000","last_unstale":"2024-01-15T11:33:21.692042+0000","last_undegraded":"2024-01-15T11:33:21.692042+0000","last_fullsized":"2024-01-15T11:33:21.692042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:38:46.122065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.738643+0000","last_change":"2024-01-15T11:33:20.720066+0000","last_active":"2024-01-15T11:33:22.738643+0000","last_peered":"2024-01-15T11:33:22.738643+0000","last_clean":"2024-01-15T11:33:22.738643+0000","last_became_active":"2024-01-15T11:33:20.719629+0000","last_became_peered":"2024-01-15T11:33:20.719629+0000","last_unstale":"2024-01-15T11:33:22.738643+0000","last_undegraded":"2024-01-15T11:33:22.738643+0000","last_fullsized":"2024-01-15T11:33:22.738643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:30:25.661172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.822081+0000","last_change":"2024-01-15T11:33:20.713988+0000","last_active":"2024-01-15T11:33:22.822081+0000","last_peered":"2024-01-15T11:33:22.822081+0000","last_clean":"2024-01-15T11:33:22.822081+0000","last_became_active":"2024-01-15T11:33:20.713701+0000","last_became_peered":"2024-01-15T11:33:20.713701+0000","last_unstale":"2024-01-15T11:33:22.822081+0000","last_undegraded":"2024-01-15T11:33:22.822081+0000","last_fullsized":"2024-01-15T11:33:22.822081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:25:18.671745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694293+0000","last_change":"2024-01-15T11:33:20.716478+0000","last_active":"2024-01-15T11:33:21.694293+0000","last_peered":"2024-01-15T11:33:21.694293+0000","last_clean":"2024-01-15T11:33:21.694293+0000","last_became_active":"2024-01-15T11:33:20.716205+0000","last_became_peered":"2024-01-15T11:33:20.716205+0000","last_unstale":"2024-01-15T11:33:21.694293+0000","last_undegraded":"2024-01-15T11:33:21.694293+0000","last_fullsized":"2024-01-15T11:33:21.694293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:37:58.693069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.821888+0000","last_change":"2024-01-15T11:33:20.716995+0000","last_active":"2024-01-15T11:33:22.821888+0000","last_peered":"2024-01-15T11:33:22.821888+0000","last_clean":"2024-01-15T11:33:22.821888+0000","last_became_active":"2024-01-15T11:33:20.716752+0000","last_became_peered":"2024-01-15T11:33:20.716752+0000","last_unstale":"2024-01-15T11:33:22.821888+0000","last_undegraded":"2024-01-15T11:33:22.821888+0000","last_fullsized":"2024-01-15T11:33:22.821888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:06:24.798645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.824119+0000","last_change":"2024-01-15T11:33:20.701779+0000","last_active":"2024-01-15T11:33:22.824119+0000","last_peered":"2024-01-15T11:33:22.824119+0000","last_clean":"2024-01-15T11:33:22.824119+0000","last_became_active":"2024-01-15T11:33:20.701423+0000","last_became_peered":"2024-01-15T11:33:20.701423+0000","last_unstale":"2024-01-15T11:33:22.824119+0000","last_undegraded":"2024-01-15T11:33:22.824119+0000","last_fullsized":"2024-01-15T11:33:22.824119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:54:20.821257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.822456+0000","last_change":"2024-01-15T11:33:20.703490+0000","last_active":"2024-01-15T11:33:22.822456+0000","last_peered":"2024-01-15T11:33:22.822456+0000","last_clean":"2024-01-15T11:33:22.822456+0000","last_became_active":"2024-01-15T11:33:20.703217+0000","last_became_peered":"2024-01-15T11:33:20.703217+0000","last_unstale":"2024-01-15T11:33:22.822456+0000","last_undegraded":"2024-01-15T11:33:22.822456+0000","last_fullsized":"2024-01-15T11:33:22.822456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:38:46.122065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.822398+0000","last_change":"2024-01-15T11:33:20.721606+0000","last_active":"2024-01-15T11:33:22.822398+0000","last_peered":"2024-01-15T11:33:22.822398+0000","last_clean":"2024-01-15T11:33:22.822398+0000","last_became_active":"2024-01-15T11:33:20.721213+0000","last_became_peered":"2024-01-15T11:33:20.721213+0000","last_unstale":"2024-01-15T11:33:22.822398+0000","last_undegraded":"2024-01-15T11:33:22.822398+0000","last_fullsized":"2024-01-15T11:33:22.822398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:24:56.488321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.821789+0000","last_change":"2024-01-15T11:33:20.709187+0000","last_active":"2024-01-15T11:33:22.821789+0000","last_peered":"2024-01-15T11:33:22.821789+0000","last_clean":"2024-01-15T11:33:22.821789+0000","last_became_active":"2024-01-15T11:33:20.708936+0000","last_became_peered":"2024-01-15T11:33:20.708936+0000","last_unstale":"2024-01-15T11:33:22.821789+0000","last_undegraded":"2024-01-15T11:33:22.821789+0000","last_fullsized":"2024-01-15T11:33:22.821789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:10:06.157496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694339+0000","last_change":"2024-01-15T11:33:20.713513+0000","last_active":"2024-01-15T11:33:21.694339+0000","last_peered":"2024-01-15T11:33:21.694339+0000","last_clean":"2024-01-15T11:33:21.694339+0000","last_became_active":"2024-01-15T11:33:20.713242+0000","last_became_peered":"2024-01-15T11:33:20.713242+0000","last_unstale":"2024-01-15T11:33:21.694339+0000","last_undegraded":"2024-01-15T11:33:21.694339+0000","last_fullsized":"2024-01-15T11:33:21.694339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:16:29.898998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692439+0000","last_change":"2024-01-15T11:33:20.708040+0000","last_active":"2024-01-15T11:33:21.692439+0000","last_peered":"2024-01-15T11:33:21.692439+0000","last_clean":"2024-01-15T11:33:21.692439+0000","last_became_active":"2024-01-15T11:33:20.707700+0000","last_became_peered":"2024-01-15T11:33:20.707700+0000","last_unstale":"2024-01-15T11:33:21.692439+0000","last_undegraded":"2024-01-15T11:33:21.692439+0000","last_fullsized":"2024-01-15T11:33:21.692439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:21:39.120264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.823741+0000","last_change":"2024-01-15T11:33:20.708725+0000","last_active":"2024-01-15T11:33:22.823741+0000","last_peered":"2024-01-15T11:33:22.823741+0000","last_clean":"2024-01-15T11:33:22.823741+0000","last_became_active":"2024-01-15T11:33:20.707260+0000","last_became_peered":"2024-01-15T11:33:20.707260+0000","last_unstale":"2024-01-15T11:33:22.823741+0000","last_undegraded":"2024-01-15T11:33:22.823741+0000","last_fullsized":"2024-01-15T11:33:22.823741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:24:38.829986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.738658+0000","last_change":"2024-01-15T11:33:20.719952+0000","last_active":"2024-01-15T11:33:22.738658+0000","last_peered":"2024-01-15T11:33:22.738658+0000","last_clean":"2024-01-15T11:33:22.738658+0000","last_became_active":"2024-01-15T11:33:20.719219+0000","last_became_peered":"2024-01-15T11:33:20.719219+0000","last_unstale":"2024-01-15T11:33:22.738658+0000","last_undegraded":"2024-01-15T11:33:22.738658+0000","last_fullsized":"2024-01-15T11:33:22.738658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:47:34.231170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.076347+0000","last_change":"2024-01-15T11:33:19.694356+0000","last_active":"2024-01-15T11:33:21.076347+0000","last_peered":"2024-01-15T11:33:21.076347+0000","last_clean":"2024-01-15T11:33:21.076347+0000","last_became_active":"2024-01-15T11:33:19.693392+0000","last_became_peered":"2024-01-15T11:33:19.693392+0000","last_unstale":"2024-01-15T11:33:21.076347+0000","last_undegraded":"2024-01-15T11:33:21.076347+0000","last_fullsized":"2024-01-15T11:33:21.076347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:00:25.349679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692151+0000","last_change":"2024-01-15T11:33:20.715147+0000","last_active":"2024-01-15T11:33:21.692151+0000","last_peered":"2024-01-15T11:33:21.692151+0000","last_clean":"2024-01-15T11:33:21.692151+0000","last_became_active":"2024-01-15T11:33:20.714851+0000","last_became_peered":"2024-01-15T11:33:20.714851+0000","last_unstale":"2024-01-15T11:33:21.692151+0000","last_undegraded":"2024-01-15T11:33:21.692151+0000","last_fullsized":"2024-01-15T11:33:21.692151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:19:46.455034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694644+0000","last_change":"2024-01-15T11:33:19.695468+0000","last_active":"2024-01-15T11:33:21.694644+0000","last_peered":"2024-01-15T11:33:21.694644+0000","last_clean":"2024-01-15T11:33:21.694644+0000","last_became_active":"2024-01-15T11:33:19.694811+0000","last_became_peered":"2024-01-15T11:33:19.694811+0000","last_unstale":"2024-01-15T11:33:21.694644+0000","last_undegraded":"2024-01-15T11:33:21.694644+0000","last_fullsized":"2024-01-15T11:33:21.694644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:59:05.422692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.078730+0000","last_change":"2024-01-15T11:33:19.703161+0000","last_active":"2024-01-15T11:33:22.078730+0000","last_peered":"2024-01-15T11:33:22.078730+0000","last_clean":"2024-01-15T11:33:22.078730+0000","last_became_active":"2024-01-15T11:33:19.702777+0000","last_became_peered":"2024-01-15T11:33:19.702777+0000","last_unstale":"2024-01-15T11:33:22.078730+0000","last_undegraded":"2024-01-15T11:33:22.078730+0000","last_fullsized":"2024-01-15T11:33:22.078730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:55:14.164103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.822030+0000","last_change":"2024-01-15T11:33:20.713246+0000","last_active":"2024-01-15T11:33:22.822030+0000","last_peered":"2024-01-15T11:33:22.822030+0000","last_clean":"2024-01-15T11:33:22.822030+0000","last_became_active":"2024-01-15T11:33:20.712606+0000","last_became_peered":"2024-01-15T11:33:20.712606+0000","last_unstale":"2024-01-15T11:33:22.822030+0000","last_undegraded":"2024-01-15T11:33:22.822030+0000","last_fullsized":"2024-01-15T11:33:22.822030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:56:15.552491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694396+0000","last_change":"2024-01-15T11:33:19.688561+0000","last_active":"2024-01-15T11:33:21.694396+0000","last_peered":"2024-01-15T11:33:21.694396+0000","last_clean":"2024-01-15T11:33:21.694396+0000","last_became_active":"2024-01-15T11:33:19.688262+0000","last_became_peered":"2024-01-15T11:33:19.688262+0000","last_unstale":"2024-01-15T11:33:21.694396+0000","last_undegraded":"2024-01-15T11:33:21.694396+0000","last_fullsized":"2024-01-15T11:33:21.694396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:10:11.542737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692151+0000","last_change":"2024-01-15T11:33:20.707012+0000","last_active":"2024-01-15T11:33:21.692151+0000","last_peered":"2024-01-15T11:33:21.692151+0000","last_clean":"2024-01-15T11:33:21.692151+0000","last_became_active":"2024-01-15T11:33:20.706739+0000","last_became_peered":"2024-01-15T11:33:20.706739+0000","last_unstale":"2024-01-15T11:33:21.692151+0000","last_undegraded":"2024-01-15T11:33:21.692151+0000","last_fullsized":"2024-01-15T11:33:21.692151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:56:03.543465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.085203+0000","last_change":"2024-01-15T11:33:19.681692+0000","last_active":"2024-01-15T11:33:22.085203+0000","last_peered":"2024-01-15T11:33:22.085203+0000","last_clean":"2024-01-15T11:33:22.085203+0000","last_became_active":"2024-01-15T11:33:19.681438+0000","last_became_peered":"2024-01-15T11:33:19.681438+0000","last_unstale":"2024-01-15T11:33:22.085203+0000","last_undegraded":"2024-01-15T11:33:22.085203+0000","last_fullsized":"2024-01-15T11:33:22.085203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:29:59.035408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.824134+0000","last_change":"2024-01-15T11:33:20.703299+0000","last_active":"2024-01-15T11:33:22.824134+0000","last_peered":"2024-01-15T11:33:22.824134+0000","last_clean":"2024-01-15T11:33:22.824134+0000","last_became_active":"2024-01-15T11:33:20.702790+0000","last_became_peered":"2024-01-15T11:33:20.702790+0000","last_unstale":"2024-01-15T11:33:22.824134+0000","last_undegraded":"2024-01-15T11:33:22.824134+0000","last_fullsized":"2024-01-15T11:33:22.824134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:35:15.716032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049957+0000","last_change":"2024-01-15T11:33:19.705105+0000","last_active":"2024-01-15T11:33:22.049957+0000","last_peered":"2024-01-15T11:33:22.049957+0000","last_clean":"2024-01-15T11:33:22.049957+0000","last_became_active":"2024-01-15T11:33:19.704838+0000","last_became_peered":"2024-01-15T11:33:19.704838+0000","last_unstale":"2024-01-15T11:33:22.049957+0000","last_undegraded":"2024-01-15T11:33:22.049957+0000","last_fullsized":"2024-01-15T11:33:22.049957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:10:11.542737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.822106+0000","last_change":"2024-01-15T11:33:20.714206+0000","last_active":"2024-01-15T11:33:22.822106+0000","last_peered":"2024-01-15T11:33:22.822106+0000","last_clean":"2024-01-15T11:33:22.822106+0000","last_became_active":"2024-01-15T11:33:20.713849+0000","last_became_peered":"2024-01-15T11:33:20.713849+0000","last_unstale":"2024-01-15T11:33:22.822106+0000","last_undegraded":"2024-01-15T11:33:22.822106+0000","last_fullsized":"2024-01-15T11:33:22.822106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:29:59.709361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692762+0000","last_change":"2024-01-15T11:33:19.693447+0000","last_active":"2024-01-15T11:33:21.692762+0000","last_peered":"2024-01-15T11:33:21.692762+0000","last_clean":"2024-01-15T11:33:21.692762+0000","last_became_active":"2024-01-15T11:33:19.692828+0000","last_became_peered":"2024-01-15T11:33:19.692828+0000","last_unstale":"2024-01-15T11:33:21.692762+0000","last_undegraded":"2024-01-15T11:33:21.692762+0000","last_fullsized":"2024-01-15T11:33:21.692762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:43:19.032876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694795+0000","last_change":"2024-01-15T11:33:20.708034+0000","last_active":"2024-01-15T11:33:21.694795+0000","last_peered":"2024-01-15T11:33:21.694795+0000","last_clean":"2024-01-15T11:33:21.694795+0000","last_became_active":"2024-01-15T11:33:20.707770+0000","last_became_peered":"2024-01-15T11:33:20.707770+0000","last_unstale":"2024-01-15T11:33:21.694795+0000","last_undegraded":"2024-01-15T11:33:21.694795+0000","last_fullsized":"2024-01-15T11:33:21.694795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:05:32.012901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.084856+0000","last_change":"2024-01-15T11:33:19.689357+0000","last_active":"2024-01-15T11:33:22.084856+0000","last_peered":"2024-01-15T11:33:22.084856+0000","last_clean":"2024-01-15T11:33:22.084856+0000","last_became_active":"2024-01-15T11:33:19.685961+0000","last_became_peered":"2024-01-15T11:33:19.685961+0000","last_unstale":"2024-01-15T11:33:22.084856+0000","last_undegraded":"2024-01-15T11:33:22.084856+0000","last_fullsized":"2024-01-15T11:33:22.084856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:10:41.101806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.050023+0000","last_change":"2024-01-15T11:33:20.717161+0000","last_active":"2024-01-15T11:33:22.050023+0000","last_peered":"2024-01-15T11:33:22.050023+0000","last_clean":"2024-01-15T11:33:22.050023+0000","last_became_active":"2024-01-15T11:33:20.716866+0000","last_became_peered":"2024-01-15T11:33:20.716866+0000","last_unstale":"2024-01-15T11:33:22.050023+0000","last_undegraded":"2024-01-15T11:33:22.050023+0000","last_fullsized":"2024-01-15T11:33:22.050023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:40:37.948024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.693226+0000","last_change":"2024-01-15T11:33:19.698607+0000","last_active":"2024-01-15T11:33:21.693226+0000","last_peered":"2024-01-15T11:33:21.693226+0000","last_clean":"2024-01-15T11:33:21.693226+0000","last_became_active":"2024-01-15T11:33:19.698300+0000","last_became_peered":"2024-01-15T11:33:19.698300+0000","last_unstale":"2024-01-15T11:33:21.693226+0000","last_undegraded":"2024-01-15T11:33:21.693226+0000","last_fullsized":"2024-01-15T11:33:21.693226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:10:16.449986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.821477+0000","last_change":"2024-01-15T11:33:20.704242+0000","last_active":"2024-01-15T11:33:22.821477+0000","last_peered":"2024-01-15T11:33:22.821477+0000","last_clean":"2024-01-15T11:33:22.821477+0000","last_became_active":"2024-01-15T11:33:20.703938+0000","last_became_peered":"2024-01-15T11:33:20.703938+0000","last_unstale":"2024-01-15T11:33:22.821477+0000","last_undegraded":"2024-01-15T11:33:22.821477+0000","last_fullsized":"2024-01-15T11:33:22.821477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:54:20.821257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694704+0000","last_change":"2024-01-15T11:33:19.695692+0000","last_active":"2024-01-15T11:33:21.694704+0000","last_peered":"2024-01-15T11:33:21.694704+0000","last_clean":"2024-01-15T11:33:21.694704+0000","last_became_active":"2024-01-15T11:33:19.695189+0000","last_became_peered":"2024-01-15T11:33:19.695189+0000","last_unstale":"2024-01-15T11:33:21.694704+0000","last_undegraded":"2024-01-15T11:33:21.694704+0000","last_fullsized":"2024-01-15T11:33:21.694704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:30:56.466865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694542+0000","last_change":"2024-01-15T11:33:20.718461+0000","last_active":"2024-01-15T11:33:21.694542+0000","last_peered":"2024-01-15T11:33:21.694542+0000","last_clean":"2024-01-15T11:33:21.694542+0000","last_became_active":"2024-01-15T11:33:20.718129+0000","last_became_peered":"2024-01-15T11:33:20.718129+0000","last_unstale":"2024-01-15T11:33:21.694542+0000","last_undegraded":"2024-01-15T11:33:21.694542+0000","last_fullsized":"2024-01-15T11:33:21.694542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:31:06.263833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049542+0000","last_change":"2024-01-15T11:33:19.704099+0000","last_active":"2024-01-15T11:33:22.049542+0000","last_peered":"2024-01-15T11:33:22.049542+0000","last_clean":"2024-01-15T11:33:22.049542+0000","last_became_active":"2024-01-15T11:33:19.699225+0000","last_became_peered":"2024-01-15T11:33:19.699225+0000","last_unstale":"2024-01-15T11:33:22.049542+0000","last_undegraded":"2024-01-15T11:33:22.049542+0000","last_fullsized":"2024-01-15T11:33:22.049542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:38:45.116285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.738426+0000","last_change":"2024-01-15T11:33:20.719867+0000","last_active":"2024-01-15T11:33:22.738426+0000","last_peered":"2024-01-15T11:33:22.738426+0000","last_clean":"2024-01-15T11:33:22.738426+0000","last_became_active":"2024-01-15T11:33:20.719528+0000","last_became_peered":"2024-01-15T11:33:20.719528+0000","last_unstale":"2024-01-15T11:33:22.738426+0000","last_undegraded":"2024-01-15T11:33:22.738426+0000","last_fullsized":"2024-01-15T11:33:22.738426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:21:39.120264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692059+0000","last_change":"2024-01-15T11:33:19.688957+0000","last_active":"2024-01-15T11:33:21.692059+0000","last_peered":"2024-01-15T11:33:21.692059+0000","last_clean":"2024-01-15T11:33:21.692059+0000","last_became_active":"2024-01-15T11:33:19.688682+0000","last_became_peered":"2024-01-15T11:33:19.688682+0000","last_unstale":"2024-01-15T11:33:21.692059+0000","last_undegraded":"2024-01-15T11:33:21.692059+0000","last_fullsized":"2024-01-15T11:33:21.692059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:24:37.824206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694356+0000","last_change":"2024-01-15T11:33:20.703451+0000","last_active":"2024-01-15T11:33:21.694356+0000","last_peered":"2024-01-15T11:33:21.694356+0000","last_clean":"2024-01-15T11:33:21.694356+0000","last_became_active":"2024-01-15T11:33:20.703004+0000","last_became_peered":"2024-01-15T11:33:20.703004+0000","last_unstale":"2024-01-15T11:33:21.694356+0000","last_undegraded":"2024-01-15T11:33:21.694356+0000","last_fullsized":"2024-01-15T11:33:21.694356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:40:37.948024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.050081+0000","last_change":"2024-01-15T11:33:19.700886+0000","last_active":"2024-01-15T11:33:22.050081+0000","last_peered":"2024-01-15T11:33:22.050081+0000","last_clean":"2024-01-15T11:33:22.050081+0000","last_became_active":"2024-01-15T11:33:19.700536+0000","last_became_peered":"2024-01-15T11:33:19.700536+0000","last_unstale":"2024-01-15T11:33:22.050081+0000","last_undegraded":"2024-01-15T11:33:22.050081+0000","last_fullsized":"2024-01-15T11:33:22.050081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:10:23.063991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.824207+0000","last_change":"2024-01-15T11:33:20.698576+0000","last_active":"2024-01-15T11:33:22.824207+0000","last_peered":"2024-01-15T11:33:22.824207+0000","last_clean":"2024-01-15T11:33:22.824207+0000","last_became_active":"2024-01-15T11:33:20.698281+0000","last_became_peered":"2024-01-15T11:33:20.698281+0000","last_unstale":"2024-01-15T11:33:22.824207+0000","last_undegraded":"2024-01-15T11:33:22.824207+0000","last_fullsized":"2024-01-15T11:33:22.824207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:28:17.783937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692467+0000","last_change":"2024-01-15T11:33:19.686942+0000","last_active":"2024-01-15T11:33:21.692467+0000","last_peered":"2024-01-15T11:33:21.692467+0000","last_clean":"2024-01-15T11:33:21.692467+0000","last_became_active":"2024-01-15T11:33:19.686670+0000","last_became_peered":"2024-01-15T11:33:19.686670+0000","last_unstale":"2024-01-15T11:33:21.692467+0000","last_undegraded":"2024-01-15T11:33:21.692467+0000","last_fullsized":"2024-01-15T11:33:21.692467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:54:19.815477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.050080+0000","last_change":"2024-01-15T11:33:20.717627+0000","last_active":"2024-01-15T11:33:22.050080+0000","last_peered":"2024-01-15T11:33:22.050080+0000","last_clean":"2024-01-15T11:33:22.050080+0000","last_became_active":"2024-01-15T11:33:20.717314+0000","last_became_peered":"2024-01-15T11:33:20.717314+0000","last_unstale":"2024-01-15T11:33:22.050080+0000","last_undegraded":"2024-01-15T11:33:22.050080+0000","last_fullsized":"2024-01-15T11:33:22.050080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:06:38.712115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.076385+0000","last_change":"2024-01-15T11:33:19.686445+0000","last_active":"2024-01-15T11:33:21.076385+0000","last_peered":"2024-01-15T11:33:21.076385+0000","last_clean":"2024-01-15T11:33:21.076385+0000","last_became_active":"2024-01-15T11:33:19.686095+0000","last_became_peered":"2024-01-15T11:33:19.686095+0000","last_unstale":"2024-01-15T11:33:21.076385+0000","last_undegraded":"2024-01-15T11:33:21.076385+0000","last_fullsized":"2024-01-15T11:33:21.076385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:40:08.252519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049946+0000","last_change":"2024-01-15T11:33:20.717522+0000","last_active":"2024-01-15T11:33:22.049946+0000","last_peered":"2024-01-15T11:33:22.049946+0000","last_clean":"2024-01-15T11:33:22.049946+0000","last_became_active":"2024-01-15T11:33:20.716509+0000","last_became_peered":"2024-01-15T11:33:20.716509+0000","last_unstale":"2024-01-15T11:33:22.049946+0000","last_undegraded":"2024-01-15T11:33:22.049946+0000","last_fullsized":"2024-01-15T11:33:22.049946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:16:29.898998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.078811+0000","last_change":"2024-01-15T11:33:19.704598+0000","last_active":"2024-01-15T11:33:22.078811+0000","last_peered":"2024-01-15T11:33:22.078811+0000","last_clean":"2024-01-15T11:33:22.078811+0000","last_became_active":"2024-01-15T11:33:19.704325+0000","last_became_peered":"2024-01-15T11:33:19.704325+0000","last_unstale":"2024-01-15T11:33:22.078811+0000","last_undegraded":"2024-01-15T11:33:22.078811+0000","last_fullsized":"2024-01-15T11:33:22.078811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:30:24.655392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694647+0000","last_change":"2024-01-15T11:33:20.713073+0000","last_active":"2024-01-15T11:33:21.694647+0000","last_peered":"2024-01-15T11:33:21.694647+0000","last_clean":"2024-01-15T11:33:21.694647+0000","last_became_active":"2024-01-15T11:33:20.712445+0000","last_became_peered":"2024-01-15T11:33:20.712445+0000","last_unstale":"2024-01-15T11:33:21.694647+0000","last_undegraded":"2024-01-15T11:33:21.694647+0000","last_fullsized":"2024-01-15T11:33:21.694647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:43:36.505459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.700621+0000","last_change":"2024-01-15T11:33:09.200536+0000","last_active":"2024-01-15T11:33:20.700621+0000","last_peered":"2024-01-15T11:33:20.700621+0000","last_clean":"2024-01-15T11:33:20.700621+0000","last_became_active":"2024-01-15T11:33:09.199051+0000","last_became_peered":"2024-01-15T11:33:09.199051+0000","last_unstale":"2024-01-15T11:33:20.700621+0000","last_undegraded":"2024-01-15T11:33:20.700621+0000","last_fullsized":"2024-01-15T11:33:20.700621+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:08.185347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:08.185347+0000","last_clean_scrub_stamp":"2024-01-15T11:33:08.185347+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:04:15.799885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694629+0000","last_change":"2024-01-15T11:33:19.696884+0000","last_active":"2024-01-15T11:33:21.694629+0000","last_peered":"2024-01-15T11:33:21.694629+0000","last_clean":"2024-01-15T11:33:21.694629+0000","last_became_active":"2024-01-15T11:33:19.696613+0000","last_became_peered":"2024-01-15T11:33:19.696613+0000","last_unstale":"2024-01-15T11:33:21.694629+0000","last_undegraded":"2024-01-15T11:33:21.694629+0000","last_fullsized":"2024-01-15T11:33:21.694629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:39:06.448053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692244+0000","last_change":"2024-01-15T11:33:20.699247+0000","last_active":"2024-01-15T11:33:21.692244+0000","last_peered":"2024-01-15T11:33:21.692244+0000","last_clean":"2024-01-15T11:33:21.692244+0000","last_became_active":"2024-01-15T11:33:20.698918+0000","last_became_peered":"2024-01-15T11:33:20.698918+0000","last_unstale":"2024-01-15T11:33:21.692244+0000","last_undegraded":"2024-01-15T11:33:21.692244+0000","last_fullsized":"2024-01-15T11:33:21.692244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:10:12.548516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694391+0000","last_change":"2024-01-15T11:33:19.697464+0000","last_active":"2024-01-15T11:33:21.694391+0000","last_peered":"2024-01-15T11:33:21.694391+0000","last_clean":"2024-01-15T11:33:21.694391+0000","last_became_active":"2024-01-15T11:33:19.697216+0000","last_became_peered":"2024-01-15T11:33:19.697216+0000","last_unstale":"2024-01-15T11:33:21.694391+0000","last_undegraded":"2024-01-15T11:33:21.694391+0000","last_fullsized":"2024-01-15T11:33:21.694391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:10:23.063991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.821437+0000","last_change":"2024-01-15T11:33:20.705721+0000","last_active":"2024-01-15T11:33:22.821437+0000","last_peered":"2024-01-15T11:33:22.821437+0000","last_clean":"2024-01-15T11:33:22.821437+0000","last_became_active":"2024-01-15T11:33:20.705377+0000","last_became_peered":"2024-01-15T11:33:20.705377+0000","last_unstale":"2024-01-15T11:33:22.821437+0000","last_undegraded":"2024-01-15T11:33:22.821437+0000","last_fullsized":"2024-01-15T11:33:22.821437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:47:34.231170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692543+0000","last_change":"2024-01-15T11:33:19.695074+0000","last_active":"2024-01-15T11:33:21.692543+0000","last_peered":"2024-01-15T11:33:21.692543+0000","last_clean":"2024-01-15T11:33:21.692543+0000","last_became_active":"2024-01-15T11:33:19.694782+0000","last_became_peered":"2024-01-15T11:33:19.694782+0000","last_unstale":"2024-01-15T11:33:21.692543+0000","last_undegraded":"2024-01-15T11:33:21.692543+0000","last_fullsized":"2024-01-15T11:33:21.692543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:23:46.972470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.822061+0000","last_change":"2024-01-15T11:33:20.710903+0000","last_active":"2024-01-15T11:33:22.822061+0000","last_peered":"2024-01-15T11:33:22.822061+0000","last_clean":"2024-01-15T11:33:22.822061+0000","last_became_active":"2024-01-15T11:33:20.710654+0000","last_became_peered":"2024-01-15T11:33:20.710654+0000","last_unstale":"2024-01-15T11:33:22.822061+0000","last_undegraded":"2024-01-15T11:33:22.822061+0000","last_fullsized":"2024-01-15T11:33:22.822061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:24:04.683090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694751+0000","last_change":"2024-01-15T11:33:19.695513+0000","last_active":"2024-01-15T11:33:21.694751+0000","last_peered":"2024-01-15T11:33:21.694751+0000","last_clean":"2024-01-15T11:33:21.694751+0000","last_became_active":"2024-01-15T11:33:19.694979+0000","last_became_peered":"2024-01-15T11:33:19.694979+0000","last_unstale":"2024-01-15T11:33:21.694751+0000","last_undegraded":"2024-01-15T11:33:21.694751+0000","last_fullsized":"2024-01-15T11:33:21.694751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T11:40:02.900978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049811+0000","last_change":"2024-01-15T11:33:20.714405+0000","last_active":"2024-01-15T11:33:22.049811+0000","last_peered":"2024-01-15T11:33:22.049811+0000","last_clean":"2024-01-15T11:33:22.049811+0000","last_became_active":"2024-01-15T11:33:20.714117+0000","last_became_peered":"2024-01-15T11:33:20.714117+0000","last_unstale":"2024-01-15T11:33:22.049811+0000","last_undegraded":"2024-01-15T11:33:22.049811+0000","last_fullsized":"2024-01-15T11:33:22.049811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:39:07.453832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.076366+0000","last_change":"2024-01-15T11:33:19.687389+0000","last_active":"2024-01-15T11:33:21.076366+0000","last_peered":"2024-01-15T11:33:21.076366+0000","last_clean":"2024-01-15T11:33:21.076366+0000","last_became_active":"2024-01-15T11:33:19.687007+0000","last_became_peered":"2024-01-15T11:33:19.687007+0000","last_unstale":"2024-01-15T11:33:21.076366+0000","last_undegraded":"2024-01-15T11:33:21.076366+0000","last_fullsized":"2024-01-15T11:33:21.076366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:48:31.960351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.823962+0000","last_change":"2024-01-15T11:33:20.707549+0000","last_active":"2024-01-15T11:33:22.823962+0000","last_peered":"2024-01-15T11:33:22.823962+0000","last_clean":"2024-01-15T11:33:22.823962+0000","last_became_active":"2024-01-15T11:33:20.707209+0000","last_became_peered":"2024-01-15T11:33:20.707209+0000","last_unstale":"2024-01-15T11:33:22.823962+0000","last_undegraded":"2024-01-15T11:33:22.823962+0000","last_fullsized":"2024-01-15T11:33:22.823962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:47:34.231170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694720+0000","last_change":"2024-01-15T11:33:19.694270+0000","last_active":"2024-01-15T11:33:21.694720+0000","last_peered":"2024-01-15T11:33:21.694720+0000","last_clean":"2024-01-15T11:33:21.694720+0000","last_became_active":"2024-01-15T11:33:19.693994+0000","last_became_peered":"2024-01-15T11:33:19.693994+0000","last_unstale":"2024-01-15T11:33:21.694720+0000","last_undegraded":"2024-01-15T11:33:21.694720+0000","last_fullsized":"2024-01-15T11:33:21.694720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:06:50.072772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.822556+0000","last_change":"2024-01-15T11:33:20.710508+0000","last_active":"2024-01-15T11:33:22.822556+0000","last_peered":"2024-01-15T11:33:22.822556+0000","last_clean":"2024-01-15T11:33:22.822556+0000","last_became_active":"2024-01-15T11:33:20.710227+0000","last_became_peered":"2024-01-15T11:33:20.710227+0000","last_unstale":"2024-01-15T11:33:22.822556+0000","last_undegraded":"2024-01-15T11:33:22.822556+0000","last_fullsized":"2024-01-15T11:33:22.822556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:56:03.543465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.085139+0000","last_change":"2024-01-15T11:33:19.695648+0000","last_active":"2024-01-15T11:33:22.085139+0000","last_peered":"2024-01-15T11:33:22.085139+0000","last_clean":"2024-01-15T11:33:22.085139+0000","last_became_active":"2024-01-15T11:33:19.695275+0000","last_became_peered":"2024-01-15T11:33:19.695275+0000","last_unstale":"2024-01-15T11:33:22.085139+0000","last_undegraded":"2024-01-15T11:33:22.085139+0000","last_fullsized":"2024-01-15T11:33:22.085139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:35:14.710253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692522+0000","last_change":"2024-01-15T11:33:20.702612+0000","last_active":"2024-01-15T11:33:21.692522+0000","last_peered":"2024-01-15T11:33:21.692522+0000","last_clean":"2024-01-15T11:33:21.692522+0000","last_became_active":"2024-01-15T11:33:20.702237+0000","last_became_peered":"2024-01-15T11:33:20.702237+0000","last_unstale":"2024-01-15T11:33:21.692522+0000","last_undegraded":"2024-01-15T11:33:21.692522+0000","last_fullsized":"2024-01-15T11:33:21.692522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:59:06.428472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694987+0000","last_change":"2024-01-15T11:33:19.703609+0000","last_active":"2024-01-15T11:33:21.694987+0000","last_peered":"2024-01-15T11:33:21.694987+0000","last_clean":"2024-01-15T11:33:21.694987+0000","last_became_active":"2024-01-15T11:33:19.703303+0000","last_became_peered":"2024-01-15T11:33:19.703303+0000","last_unstale":"2024-01-15T11:33:21.694987+0000","last_undegraded":"2024-01-15T11:33:21.694987+0000","last_fullsized":"2024-01-15T11:33:21.694987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:25:15.570806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692384+0000","last_change":"2024-01-15T11:33:20.698701+0000","last_active":"2024-01-15T11:33:21.692384+0000","last_peered":"2024-01-15T11:33:21.692384+0000","last_clean":"2024-01-15T11:33:21.692384+0000","last_became_active":"2024-01-15T11:33:20.698404+0000","last_became_peered":"2024-01-15T11:33:20.698404+0000","last_unstale":"2024-01-15T11:33:21.692384+0000","last_undegraded":"2024-01-15T11:33:21.692384+0000","last_fullsized":"2024-01-15T11:33:21.692384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:10:24.069771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049423+0000","last_change":"2024-01-15T11:33:19.692573+0000","last_active":"2024-01-15T11:33:22.049423+0000","last_peered":"2024-01-15T11:33:22.049423+0000","last_clean":"2024-01-15T11:33:22.049423+0000","last_became_active":"2024-01-15T11:33:19.692258+0000","last_became_peered":"2024-01-15T11:33:19.692258+0000","last_unstale":"2024-01-15T11:33:22.049423+0000","last_undegraded":"2024-01-15T11:33:22.049423+0000","last_fullsized":"2024-01-15T11:33:22.049423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:24:55.482541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694384+0000","last_change":"2024-01-15T11:33:20.702022+0000","last_active":"2024-01-15T11:33:21.694384+0000","last_peered":"2024-01-15T11:33:21.694384+0000","last_clean":"2024-01-15T11:33:21.694384+0000","last_became_active":"2024-01-15T11:33:20.701623+0000","last_became_peered":"2024-01-15T11:33:20.701623+0000","last_unstale":"2024-01-15T11:33:21.694384+0000","last_undegraded":"2024-01-15T11:33:21.694384+0000","last_fullsized":"2024-01-15T11:33:21.694384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:06:38.712115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692157+0000","last_change":"2024-01-15T11:33:19.695563+0000","last_active":"2024-01-15T11:33:21.692157+0000","last_peered":"2024-01-15T11:33:21.692157+0000","last_clean":"2024-01-15T11:33:21.692157+0000","last_became_active":"2024-01-15T11:33:19.695286+0000","last_became_peered":"2024-01-15T11:33:19.695286+0000","last_unstale":"2024-01-15T11:33:21.692157+0000","last_undegraded":"2024-01-15T11:33:21.692157+0000","last_fullsized":"2024-01-15T11:33:21.692157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:47:33.225390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.691971+0000","last_change":"2024-01-15T11:33:20.698692+0000","last_active":"2024-01-15T11:33:21.691971+0000","last_peered":"2024-01-15T11:33:21.691971+0000","last_clean":"2024-01-15T11:33:21.691971+0000","last_became_active":"2024-01-15T11:33:20.698341+0000","last_became_peered":"2024-01-15T11:33:20.698341+0000","last_unstale":"2024-01-15T11:33:21.691971+0000","last_undegraded":"2024-01-15T11:33:21.691971+0000","last_fullsized":"2024-01-15T11:33:21.691971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:24:56.488321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.078760+0000","last_change":"2024-01-15T11:33:19.697600+0000","last_active":"2024-01-15T11:33:22.078760+0000","last_peered":"2024-01-15T11:33:22.078760+0000","last_clean":"2024-01-15T11:33:22.078760+0000","last_became_active":"2024-01-15T11:33:19.697340+0000","last_became_peered":"2024-01-15T11:33:19.697340+0000","last_unstale":"2024-01-15T11:33:22.078760+0000","last_undegraded":"2024-01-15T11:33:22.078760+0000","last_fullsized":"2024-01-15T11:33:22.078760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:24:37.824206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.693173+0000","last_change":"2024-01-15T11:33:20.699235+0000","last_active":"2024-01-15T11:33:21.693173+0000","last_peered":"2024-01-15T11:33:21.693173+0000","last_clean":"2024-01-15T11:33:21.693173+0000","last_became_active":"2024-01-15T11:33:20.698686+0000","last_became_peered":"2024-01-15T11:33:20.698686+0000","last_unstale":"2024-01-15T11:33:21.693173+0000","last_undegraded":"2024-01-15T11:33:21.693173+0000","last_fullsized":"2024-01-15T11:33:21.693173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:24:38.829986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694531+0000","last_change":"2024-01-15T11:33:19.701728+0000","last_active":"2024-01-15T11:33:21.694531+0000","last_peered":"2024-01-15T11:33:21.694531+0000","last_clean":"2024-01-15T11:33:21.694531+0000","last_became_active":"2024-01-15T11:33:19.701429+0000","last_became_peered":"2024-01-15T11:33:19.701429+0000","last_unstale":"2024-01-15T11:33:21.694531+0000","last_undegraded":"2024-01-15T11:33:21.694531+0000","last_fullsized":"2024-01-15T11:33:21.694531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:29:52.566265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694539+0000","last_change":"2024-01-15T11:33:20.710518+0000","last_active":"2024-01-15T11:33:21.694539+0000","last_peered":"2024-01-15T11:33:21.694539+0000","last_clean":"2024-01-15T11:33:21.694539+0000","last_became_active":"2024-01-15T11:33:20.709615+0000","last_became_peered":"2024-01-15T11:33:20.709615+0000","last_unstale":"2024-01-15T11:33:21.694539+0000","last_undegraded":"2024-01-15T11:33:21.694539+0000","last_fullsized":"2024-01-15T11:33:21.694539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:03:30.363934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694665+0000","last_change":"2024-01-15T11:33:20.718816+0000","last_active":"2024-01-15T11:33:21.694665+0000","last_peered":"2024-01-15T11:33:21.694665+0000","last_clean":"2024-01-15T11:33:21.694665+0000","last_became_active":"2024-01-15T11:33:20.716841+0000","last_became_peered":"2024-01-15T11:33:20.716841+0000","last_unstale":"2024-01-15T11:33:21.694665+0000","last_undegraded":"2024-01-15T11:33:21.694665+0000","last_fullsized":"2024-01-15T11:33:21.694665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:13:30.740169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049911+0000","last_change":"2024-01-15T11:33:19.706026+0000","last_active":"2024-01-15T11:33:22.049911+0000","last_peered":"2024-01-15T11:33:22.049911+0000","last_clean":"2024-01-15T11:33:22.049911+0000","last_became_active":"2024-01-15T11:33:19.705650+0000","last_became_peered":"2024-01-15T11:33:19.705650+0000","last_unstale":"2024-01-15T11:33:22.049911+0000","last_undegraded":"2024-01-15T11:33:22.049911+0000","last_fullsized":"2024-01-15T11:33:22.049911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:19:45.449255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.738654+0000","last_change":"2024-01-15T11:33:20.723707+0000","last_active":"2024-01-15T11:33:22.738654+0000","last_peered":"2024-01-15T11:33:22.738654+0000","last_clean":"2024-01-15T11:33:22.738654+0000","last_became_active":"2024-01-15T11:33:20.723420+0000","last_became_peered":"2024-01-15T11:33:20.723420+0000","last_unstale":"2024-01-15T11:33:22.738654+0000","last_undegraded":"2024-01-15T11:33:22.738654+0000","last_fullsized":"2024-01-15T11:33:22.738654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:24:38.829986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.050061+0000","last_change":"2024-01-15T11:33:19.707453+0000","last_active":"2024-01-15T11:33:22.050061+0000","last_peered":"2024-01-15T11:33:22.050061+0000","last_clean":"2024-01-15T11:33:22.050061+0000","last_became_active":"2024-01-15T11:33:19.707108+0000","last_became_peered":"2024-01-15T11:33:19.707108+0000","last_unstale":"2024-01-15T11:33:22.050061+0000","last_undegraded":"2024-01-15T11:33:22.050061+0000","last_fullsized":"2024-01-15T11:33:22.050061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:56:02.537685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.821973+0000","last_change":"2024-01-15T11:33:20.716694+0000","last_active":"2024-01-15T11:33:22.821973+0000","last_peered":"2024-01-15T11:33:22.821973+0000","last_clean":"2024-01-15T11:33:22.821973+0000","last_became_active":"2024-01-15T11:33:20.716405+0000","last_became_peered":"2024-01-15T11:33:20.716405+0000","last_unstale":"2024-01-15T11:33:22.821973+0000","last_undegraded":"2024-01-15T11:33:22.821973+0000","last_fullsized":"2024-01-15T11:33:22.821973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:11:38.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.076414+0000","last_change":"2024-01-15T11:33:19.690015+0000","last_active":"2024-01-15T11:33:21.076414+0000","last_peered":"2024-01-15T11:33:21.076414+0000","last_clean":"2024-01-15T11:33:21.076414+0000","last_became_active":"2024-01-15T11:33:19.688306+0000","last_became_peered":"2024-01-15T11:33:19.688306+0000","last_unstale":"2024-01-15T11:33:21.076414+0000","last_undegraded":"2024-01-15T11:33:21.076414+0000","last_fullsized":"2024-01-15T11:33:21.076414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:41:03.219134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.821958+0000","last_change":"2024-01-15T11:33:20.713812+0000","last_active":"2024-01-15T11:33:22.821958+0000","last_peered":"2024-01-15T11:33:22.821958+0000","last_clean":"2024-01-15T11:33:22.821958+0000","last_became_active":"2024-01-15T11:33:20.713505+0000","last_became_peered":"2024-01-15T11:33:20.713505+0000","last_unstale":"2024-01-15T11:33:22.821958+0000","last_undegraded":"2024-01-15T11:33:22.821958+0000","last_fullsized":"2024-01-15T11:33:22.821958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:25:28.883635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692650+0000","last_change":"2024-01-15T11:33:19.691915+0000","last_active":"2024-01-15T11:33:21.692650+0000","last_peered":"2024-01-15T11:33:21.692650+0000","last_clean":"2024-01-15T11:33:21.692650+0000","last_became_active":"2024-01-15T11:33:19.691570+0000","last_became_peered":"2024-01-15T11:33:19.691570+0000","last_unstale":"2024-01-15T11:33:21.692650+0000","last_undegraded":"2024-01-15T11:33:21.692650+0000","last_fullsized":"2024-01-15T11:33:21.692650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:28:16.778157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":76376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":76252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":78536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]}]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":76834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":77864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":666690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":76308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-15T11:33:29.537 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-15T11:33:29.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.719+0000 7fc9ce71e640 1 Processor -- start 2024-01-15T11:33:29.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.719+0000 7fc9ce71e640 1 -- start start 2024-01-15T11:33:29.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.719+0000 7fc9ce71e640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc9c80d3760 0x7fc9c80d3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:29.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.719+0000 7fc9ce71e640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc9c80cfa20 0x7fc9c80cfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:29.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.719+0000 7fc9ce71e640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c80d15f0 con 0x7fc9c815d880 2024-01-15T11:33:29.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.719+0000 7fc9ce71e640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c80d4110 con 0x7fc9c80d3760 2024-01-15T11:33:29.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.719+0000 7fc9ce71e640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80d03d0 con 0x7fc9c80cfa20 2024-01-15T11:33:29.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.719+0000 7fc9ccf1b640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc9c80d3760 0x7fc9c80d3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:29.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.719+0000 7fc9ccf1b640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc9c80d3760 0x7fc9c80d3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55602/0 (socket says 172.21.15.27:55602) 2024-01-15T11:33:29.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.719+0000 7fc9ccf1b640 1 -- 172.21.15.27:0/2958646104 learned_addr learned my addr 172.21.15.27:0/2958646104 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:29.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.719+0000 7fc9cdf1d640 1 --2- 172.21.15.27:0/2958646104 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc9c80cfa20 0x7fc9c80cfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:29.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.719+0000 7fc9ccf1b640 1 -- 172.21.15.27:0/2958646104 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc9c80cfa20 msgr2=0x7fc9c80cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:29.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.719+0000 7fc9ccf1b640 1 --2- 172.21.15.27:0/2958646104 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc9c80cfa20 0x7fc9c80cfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.719+0000 7fc9ccf1b640 1 -- 172.21.15.27:0/2958646104 >> v1:172.21.15.93:6789/0 conn(0x7fc9c815d880 legacy=0x7fc9c80b6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:29.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.719+0000 7fc9ccf1b640 1 -- 172.21.15.27:0/2958646104 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c80ce000 con 0x7fc9c80d3760 2024-01-15T11:33:29.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.723+0000 7fc9ccf1b640 1 --2- 172.21.15.27:0/2958646104 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc9c80d3760 0x7fc9c80d3bd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8009870 tx=0x7fc9b801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f9b8104163b98 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:29.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.723+0000 7fc9bffff640 1 -- 172.21.15.27:0/2958646104 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b80a9400 con 0x7fc9c80d3760 2024-01-15T11:33:29.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.723+0000 7fc9bffff640 1 -- 172.21.15.27:0/2958646104 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b80a9560 con 0x7fc9c80d3760 2024-01-15T11:33:29.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.723+0000 7fc9bffff640 1 -- 172.21.15.27:0/2958646104 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b80a98f0 con 0x7fc9c80d3760 2024-01-15T11:33:29.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.723+0000 7fc9ce71e640 1 -- 172.21.15.27:0/2958646104 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc9c80d3760 msgr2=0x7fc9c80d3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:29.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.723+0000 7fc9ce71e640 1 --2- 172.21.15.27:0/2958646104 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc9c80d3760 0x7fc9c80d3bd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8009870 tx=0x7fc9b801c540 comp rx=0 tx=0).stop 2024-01-15T11:33:29.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.723+0000 7fc9ce71e640 1 -- 172.21.15.27:0/2958646104 shutdown_connections 2024-01-15T11:33:29.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.723+0000 7fc9ce71e640 1 --2- 172.21.15.27:0/2958646104 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc9c80cfa20 0x7fc9c80cfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.723+0000 7fc9ce71e640 1 --2- 172.21.15.27:0/2958646104 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc9c80d3760 0x7fc9c80d3bd0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.723+0000 7fc9ce71e640 1 -- 172.21.15.27:0/2958646104 >> 172.21.15.27:0/2958646104 conn(0x7fc9c806b9f0 msgr2=0x7fc9c806be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:29.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.723+0000 7fc9ce71e640 1 -- 172.21.15.27:0/2958646104 shutdown_connections 2024-01-15T11:33:29.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.723+0000 7fc9ce71e640 1 -- 172.21.15.27:0/2958646104 wait complete. 2024-01-15T11:33:29.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.727+0000 7fc9ce71e640 1 Processor -- start 2024-01-15T11:33:29.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.727+0000 7fc9ce71e640 1 -- start start 2024-01-15T11:33:29.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.727+0000 7fc9ce71e640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc9c80cfa20 0x7fc9c8159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:29.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.727+0000 7fc9ce71e640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc9c80d3760 0x7fc9c8154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:29.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.727+0000 7fc9ce71e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc9c815d880 0x7fc9c8157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:29.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.727+0000 7fc9ce71e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c81574f0 con 0x7fc9c815d880 2024-01-15T11:33:29.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.727+0000 7fc9ce71e640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c8155310 con 0x7fc9c80d3760 2024-01-15T11:33:29.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.727+0000 7fc9ce71e640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80cd910 con 0x7fc9c80cfa20 2024-01-15T11:33:29.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.727+0000 7fc9cdf1d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc9c815d880 0x7fc9c8157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:29.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.727+0000 7fc9cdf1d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc9c815d880 0x7fc9c8157f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55606/0 (socket says 172.21.15.27:55606) 2024-01-15T11:33:29.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.727+0000 7fc9cdf1d640 1 -- 172.21.15.27:0/2448921318 learned_addr learned my addr 172.21.15.27:0/2448921318 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:29.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.727+0000 7fc9ccf1b640 1 --2- 172.21.15.27:0/2448921318 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc9c80d3760 0x7fc9c8154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:29.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.727+0000 7fc9cd71c640 1 --2- 172.21.15.27:0/2448921318 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc9c80cfa20 0x7fc9c8159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:29.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.727+0000 7fc9cdf1d640 1 -- 172.21.15.27:0/2448921318 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc9c80cfa20 msgr2=0x7fc9c8159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:29.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.727+0000 7fc9cdf1d640 1 --2- 172.21.15.27:0/2448921318 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc9c80cfa20 0x7fc9c8159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.727+0000 7fc9cdf1d640 1 -- 172.21.15.27:0/2448921318 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc9c80d3760 msgr2=0x7fc9c8154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:29.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.727+0000 7fc9cdf1d640 1 --2- 172.21.15.27:0/2448921318 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc9c80d3760 0x7fc9c8154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.727+0000 7fc9cdf1d640 1 -- 172.21.15.27:0/2448921318 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b80094d0 con 0x7fc9c815d880 2024-01-15T11:33:29.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.727+0000 7fc9cdf1d640 1 --2- 172.21.15.27:0/2448921318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc9c815d880 0x7fc9c8157f40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0007e40 tx=0x7fc9c000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:29.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.727+0000 7fc9bdffb640 1 -- 172.21.15.27:0/2448921318 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0014620 con 0x7fc9c815d880 2024-01-15T11:33:29.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.727+0000 7fc9bdffb640 1 -- 172.21.15.27:0/2448921318 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c000ee90 con 0x7fc9c815d880 2024-01-15T11:33:29.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.727+0000 7fc9ce71e640 1 -- 172.21.15.27:0/2448921318 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c8159a80 con 0x7fc9c815d880 2024-01-15T11:33:29.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.727+0000 7fc9bdffb640 1 -- 172.21.15.27:0/2448921318 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c00149e0 con 0x7fc9c815d880 2024-01-15T11:33:29.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.727+0000 7fc9ce71e640 1 -- 172.21.15.27:0/2448921318 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c8157740 con 0x7fc9c815d880 2024-01-15T11:33:29.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.731+0000 7fc9ce71e640 1 -- 172.21.15.27:0/2448921318 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c8159fa0 con 0x7fc9c815d880 2024-01-15T11:33:29.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.731+0000 7fc9bdffb640 1 -- 172.21.15.27:0/2448921318 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fc9c0014b40 con 0x7fc9c815d880 2024-01-15T11:33:29.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.731+0000 7fc9bdffb640 1 --2- 172.21.15.27:0/2448921318 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc9ac0668f0 0x7fc9ac068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:29.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.731+0000 7fc9bdffb640 1 -- 172.21.15.27:0/2448921318 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9c0084d40 con 0x7fc9c815d880 2024-01-15T11:33:29.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.731+0000 7fc9cd71c640 1 --2- 172.21.15.27:0/2448921318 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc9ac0668f0 0x7fc9ac068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:29.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.731+0000 7fc9cd71c640 1 --2- 172.21.15.27:0/2448921318 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc9ac0668f0 0x7fc9ac068db0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80cd2d0 tx=0x7fc9c4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:29.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.735+0000 7fc9bdffb640 1 -- 172.21.15.27:0/2448921318 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc9c0051f90 con 0x7fc9c815d880 2024-01-15T11:33:29.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.891+0000 7fc9ce71e640 1 -- 172.21.15.27:0/2448921318 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc9c80b6e40 con 0x7fc9ac0668f0 2024-01-15T11:33:29.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.899+0000 7fc9bdffb640 1 -- 172.21.15.27:0/2448921318 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264600 (secure 0 0 0) 0x7fc9c4001470 con 0x7fc9ac0668f0 2024-01-15T11:33:29.905 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:29.906 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-01-15T11:33:29.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.903+0000 7fc9ce71e640 1 -- 172.21.15.27:0/2448921318 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc9ac0668f0 msgr2=0x7fc9ac068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:29.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.903+0000 7fc9ce71e640 1 --2- 172.21.15.27:0/2448921318 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc9ac0668f0 0x7fc9ac068db0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80cd2d0 tx=0x7fc9c4009040 comp rx=0 tx=0).stop 2024-01-15T11:33:29.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.903+0000 7fc9ce71e640 1 -- 172.21.15.27:0/2448921318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc9c815d880 msgr2=0x7fc9c8157f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:29.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.903+0000 7fc9ce71e640 1 --2- 172.21.15.27:0/2448921318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc9c815d880 0x7fc9c8157f40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0007e40 tx=0x7fc9c000e4b0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.903+0000 7fc9ce71e640 1 -- 172.21.15.27:0/2448921318 shutdown_connections 2024-01-15T11:33:29.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.903+0000 7fc9ce71e640 1 --2- 172.21.15.27:0/2448921318 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc9c815d880 0x7fc9c8157f40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.903+0000 7fc9ce71e640 1 --2- 172.21.15.27:0/2448921318 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc9ac0668f0 0x7fc9ac068db0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.903+0000 7fc9ce71e640 1 --2- 172.21.15.27:0/2448921318 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc9c80d3760 0x7fc9c8154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.903+0000 7fc9ce71e640 1 --2- 172.21.15.27:0/2448921318 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc9c80cfa20 0x7fc9c8159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:29.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.903+0000 7fc9ce71e640 1 -- 172.21.15.27:0/2448921318 >> 172.21.15.27:0/2448921318 conn(0x7fc9c806b9f0 msgr2=0x7fc9c80ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:29.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.903+0000 7fc9ce71e640 1 -- 172.21.15.27:0/2448921318 shutdown_connections 2024-01-15T11:33:29.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:29.903+0000 7fc9ce71e640 1 -- 172.21.15.27:0/2448921318 wait complete. 2024-01-15T11:33:29.925 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-01-15T11:33:28.066687+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219144,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755576,"statfs":{"total":773094113280,"available":772869709824,"internally_reserved":0,"allocated":3022848,"data_stored":1795572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002013"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049923+0000","last_change":"2024-01-15T11:33:20.716411+0000","last_active":"2024-01-15T11:33:22.049923+0000","last_peered":"2024-01-15T11:33:22.049923+0000","last_clean":"2024-01-15T11:33:22.049923+0000","last_became_active":"2024-01-15T11:33:20.716169+0000","last_became_peered":"2024-01-15T11:33:20.716169+0000","last_unstale":"2024-01-15T11:33:22.049923+0000","last_undegraded":"2024-01-15T11:33:22.049923+0000","last_fullsized":"2024-01-15T11:33:22.049923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:43:30.219449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.821785+0000","last_change":"2024-01-15T11:33:20.713459+0000","last_active":"2024-01-15T11:33:22.821785+0000","last_peered":"2024-01-15T11:33:22.821785+0000","last_clean":"2024-01-15T11:33:22.821785+0000","last_became_active":"2024-01-15T11:33:20.713141+0000","last_became_peered":"2024-01-15T11:33:20.713141+0000","last_unstale":"2024-01-15T11:33:22.821785+0000","last_undegraded":"2024-01-15T11:33:22.821785+0000","last_fullsized":"2024-01-15T11:33:22.821785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:23:59.431150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.821811+0000","last_change":"2024-01-15T11:33:20.715526+0000","last_active":"2024-01-15T11:33:22.821811+0000","last_peered":"2024-01-15T11:33:22.821811+0000","last_clean":"2024-01-15T11:33:22.821811+0000","last_became_active":"2024-01-15T11:33:20.715226+0000","last_became_peered":"2024-01-15T11:33:20.715226+0000","last_unstale":"2024-01-15T11:33:22.821811+0000","last_undegraded":"2024-01-15T11:33:22.821811+0000","last_fullsized":"2024-01-15T11:33:22.821811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:31:58.874374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.823741+0000","last_change":"2024-01-15T11:33:20.699790+0000","last_active":"2024-01-15T11:33:22.823741+0000","last_peered":"2024-01-15T11:33:22.823741+0000","last_clean":"2024-01-15T11:33:22.823741+0000","last_became_active":"2024-01-15T11:33:20.699497+0000","last_became_peered":"2024-01-15T11:33:20.699497+0000","last_unstale":"2024-01-15T11:33:22.823741+0000","last_undegraded":"2024-01-15T11:33:22.823741+0000","last_fullsized":"2024-01-15T11:33:22.823741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:30:25.661172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049813+0000","last_change":"2024-01-15T11:33:20.714669+0000","last_active":"2024-01-15T11:33:22.049813+0000","last_peered":"2024-01-15T11:33:22.049813+0000","last_clean":"2024-01-15T11:33:22.049813+0000","last_became_active":"2024-01-15T11:33:20.714267+0000","last_became_peered":"2024-01-15T11:33:20.714267+0000","last_unstale":"2024-01-15T11:33:22.049813+0000","last_undegraded":"2024-01-15T11:33:22.049813+0000","last_fullsized":"2024-01-15T11:33:22.049813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T11:40:03.906758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.823681+0000","last_change":"2024-01-15T11:33:20.700208+0000","last_active":"2024-01-15T11:33:22.823681+0000","last_peered":"2024-01-15T11:33:22.823681+0000","last_clean":"2024-01-15T11:33:22.823681+0000","last_became_active":"2024-01-15T11:33:20.698271+0000","last_became_peered":"2024-01-15T11:33:20.698271+0000","last_unstale":"2024-01-15T11:33:22.823681+0000","last_undegraded":"2024-01-15T11:33:22.823681+0000","last_fullsized":"2024-01-15T11:33:22.823681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:21:39.120264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049558+0000","last_change":"2024-01-15T11:33:20.709080+0000","last_active":"2024-01-15T11:33:22.049558+0000","last_peered":"2024-01-15T11:33:22.049558+0000","last_clean":"2024-01-15T11:33:22.049558+0000","last_became_active":"2024-01-15T11:33:20.707734+0000","last_became_peered":"2024-01-15T11:33:20.707734+0000","last_unstale":"2024-01-15T11:33:22.049558+0000","last_undegraded":"2024-01-15T11:33:22.049558+0000","last_fullsized":"2024-01-15T11:33:22.049558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:30:57.472645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.821820+0000","last_change":"2024-01-15T11:33:20.721012+0000","last_active":"2024-01-15T11:33:22.821820+0000","last_peered":"2024-01-15T11:33:22.821820+0000","last_clean":"2024-01-15T11:33:22.821820+0000","last_became_active":"2024-01-15T11:33:20.720749+0000","last_became_peered":"2024-01-15T11:33:20.720749+0000","last_unstale":"2024-01-15T11:33:22.821820+0000","last_undegraded":"2024-01-15T11:33:22.821820+0000","last_fullsized":"2024-01-15T11:33:22.821820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:28:49.151092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.738843+0000","last_change":"2024-01-15T11:33:20.712100+0000","last_active":"2024-01-15T11:33:22.738843+0000","last_peered":"2024-01-15T11:33:22.738843+0000","last_clean":"2024-01-15T11:33:22.738843+0000","last_became_active":"2024-01-15T11:33:20.711811+0000","last_became_peered":"2024-01-15T11:33:20.711811+0000","last_unstale":"2024-01-15T11:33:22.738843+0000","last_undegraded":"2024-01-15T11:33:22.738843+0000","last_fullsized":"2024-01-15T11:33:22.738843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:54:20.821257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049776+0000","last_change":"2024-01-15T11:33:20.707038+0000","last_active":"2024-01-15T11:33:22.049776+0000","last_peered":"2024-01-15T11:33:22.049776+0000","last_clean":"2024-01-15T11:33:22.049776+0000","last_became_active":"2024-01-15T11:33:20.706364+0000","last_became_peered":"2024-01-15T11:33:20.706364+0000","last_unstale":"2024-01-15T11:33:22.049776+0000","last_undegraded":"2024-01-15T11:33:22.049776+0000","last_fullsized":"2024-01-15T11:33:22.049776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:06:51.078552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049883+0000","last_change":"2024-01-15T11:33:20.716954+0000","last_active":"2024-01-15T11:33:22.049883+0000","last_peered":"2024-01-15T11:33:22.049883+0000","last_clean":"2024-01-15T11:33:22.049883+0000","last_became_active":"2024-01-15T11:33:20.716582+0000","last_became_peered":"2024-01-15T11:33:20.716582+0000","last_unstale":"2024-01-15T11:33:22.049883+0000","last_undegraded":"2024-01-15T11:33:22.049883+0000","last_fullsized":"2024-01-15T11:33:22.049883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:37:58.693069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049767+0000","last_change":"2024-01-15T11:33:20.717724+0000","last_active":"2024-01-15T11:33:22.049767+0000","last_peered":"2024-01-15T11:33:22.049767+0000","last_clean":"2024-01-15T11:33:22.049767+0000","last_became_active":"2024-01-15T11:33:20.717228+0000","last_became_peered":"2024-01-15T11:33:20.717228+0000","last_unstale":"2024-01-15T11:33:22.049767+0000","last_undegraded":"2024-01-15T11:33:22.049767+0000","last_fullsized":"2024-01-15T11:33:22.049767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:25:16.576586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.822348+0000","last_change":"2024-01-15T11:33:20.715589+0000","last_active":"2024-01-15T11:33:22.822348+0000","last_peered":"2024-01-15T11:33:22.822348+0000","last_clean":"2024-01-15T11:33:22.822348+0000","last_became_active":"2024-01-15T11:33:20.714841+0000","last_became_peered":"2024-01-15T11:33:20.714841+0000","last_unstale":"2024-01-15T11:33:22.822348+0000","last_undegraded":"2024-01-15T11:33:22.822348+0000","last_fullsized":"2024-01-15T11:33:22.822348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:28:17.783937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.821585+0000","last_change":"2024-01-15T11:33:20.703953+0000","last_active":"2024-01-15T11:33:22.821585+0000","last_peered":"2024-01-15T11:33:22.821585+0000","last_clean":"2024-01-15T11:33:22.821585+0000","last_became_active":"2024-01-15T11:33:20.703653+0000","last_became_peered":"2024-01-15T11:33:20.703653+0000","last_unstale":"2024-01-15T11:33:22.821585+0000","last_undegraded":"2024-01-15T11:33:22.821585+0000","last_fullsized":"2024-01-15T11:33:22.821585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:35:15.716032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.821776+0000","last_change":"2024-01-15T11:33:20.719103+0000","last_active":"2024-01-15T11:33:22.821776+0000","last_peered":"2024-01-15T11:33:22.821776+0000","last_clean":"2024-01-15T11:33:22.821776+0000","last_became_active":"2024-01-15T11:33:20.718591+0000","last_became_peered":"2024-01-15T11:33:20.718591+0000","last_unstale":"2024-01-15T11:33:22.821776+0000","last_undegraded":"2024-01-15T11:33:22.821776+0000","last_fullsized":"2024-01-15T11:33:22.821776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:05:43.854972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694295+0000","last_change":"2024-01-15T11:33:20.701415+0000","last_active":"2024-01-15T11:33:21.694295+0000","last_peered":"2024-01-15T11:33:21.694295+0000","last_clean":"2024-01-15T11:33:21.694295+0000","last_became_active":"2024-01-15T11:33:20.701093+0000","last_became_peered":"2024-01-15T11:33:20.701093+0000","last_unstale":"2024-01-15T11:33:21.694295+0000","last_undegraded":"2024-01-15T11:33:21.694295+0000","last_fullsized":"2024-01-15T11:33:21.694295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:43:30.219449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694973+0000","last_change":"2024-01-15T11:33:20.718200+0000","last_active":"2024-01-15T11:33:21.694973+0000","last_peered":"2024-01-15T11:33:21.694973+0000","last_clean":"2024-01-15T11:33:21.694973+0000","last_became_active":"2024-01-15T11:33:20.717333+0000","last_became_peered":"2024-01-15T11:33:20.717333+0000","last_unstale":"2024-01-15T11:33:21.694973+0000","last_undegraded":"2024-01-15T11:33:21.694973+0000","last_fullsized":"2024-01-15T11:33:21.694973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:01:50.198012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.693034+0000","last_change":"2024-01-15T11:33:20.701000+0000","last_active":"2024-01-15T11:33:21.693034+0000","last_peered":"2024-01-15T11:33:21.693034+0000","last_clean":"2024-01-15T11:33:21.693034+0000","last_became_active":"2024-01-15T11:33:20.700312+0000","last_became_peered":"2024-01-15T11:33:20.700312+0000","last_unstale":"2024-01-15T11:33:21.693034+0000","last_undegraded":"2024-01-15T11:33:21.693034+0000","last_fullsized":"2024-01-15T11:33:21.693034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:30:25.661172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694717+0000","last_change":"2024-01-15T11:33:20.703054+0000","last_active":"2024-01-15T11:33:21.694717+0000","last_peered":"2024-01-15T11:33:21.694717+0000","last_clean":"2024-01-15T11:33:21.694717+0000","last_became_active":"2024-01-15T11:33:20.702256+0000","last_became_peered":"2024-01-15T11:33:20.702256+0000","last_unstale":"2024-01-15T11:33:21.694717+0000","last_undegraded":"2024-01-15T11:33:21.694717+0000","last_fullsized":"2024-01-15T11:33:21.694717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:27:46.642600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049810+0000","last_change":"2024-01-15T11:33:20.717634+0000","last_active":"2024-01-15T11:33:22.049810+0000","last_peered":"2024-01-15T11:33:22.049810+0000","last_clean":"2024-01-15T11:33:22.049810+0000","last_became_active":"2024-01-15T11:33:20.716991+0000","last_became_peered":"2024-01-15T11:33:20.716991+0000","last_unstale":"2024-01-15T11:33:22.049810+0000","last_undegraded":"2024-01-15T11:33:22.049810+0000","last_fullsized":"2024-01-15T11:33:22.049810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:29:53.572044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692042+0000","last_change":"2024-01-15T11:33:20.706694+0000","last_active":"2024-01-15T11:33:21.692042+0000","last_peered":"2024-01-15T11:33:21.692042+0000","last_clean":"2024-01-15T11:33:21.692042+0000","last_became_active":"2024-01-15T11:33:20.706408+0000","last_became_peered":"2024-01-15T11:33:20.706408+0000","last_unstale":"2024-01-15T11:33:21.692042+0000","last_undegraded":"2024-01-15T11:33:21.692042+0000","last_fullsized":"2024-01-15T11:33:21.692042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:38:46.122065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.738643+0000","last_change":"2024-01-15T11:33:20.720066+0000","last_active":"2024-01-15T11:33:22.738643+0000","last_peered":"2024-01-15T11:33:22.738643+0000","last_clean":"2024-01-15T11:33:22.738643+0000","last_became_active":"2024-01-15T11:33:20.719629+0000","last_became_peered":"2024-01-15T11:33:20.719629+0000","last_unstale":"2024-01-15T11:33:22.738643+0000","last_undegraded":"2024-01-15T11:33:22.738643+0000","last_fullsized":"2024-01-15T11:33:22.738643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:30:25.661172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.822081+0000","last_change":"2024-01-15T11:33:20.713988+0000","last_active":"2024-01-15T11:33:22.822081+0000","last_peered":"2024-01-15T11:33:22.822081+0000","last_clean":"2024-01-15T11:33:22.822081+0000","last_became_active":"2024-01-15T11:33:20.713701+0000","last_became_peered":"2024-01-15T11:33:20.713701+0000","last_unstale":"2024-01-15T11:33:22.822081+0000","last_undegraded":"2024-01-15T11:33:22.822081+0000","last_fullsized":"2024-01-15T11:33:22.822081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:25:18.671745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694293+0000","last_change":"2024-01-15T11:33:20.716478+0000","last_active":"2024-01-15T11:33:21.694293+0000","last_peered":"2024-01-15T11:33:21.694293+0000","last_clean":"2024-01-15T11:33:21.694293+0000","last_became_active":"2024-01-15T11:33:20.716205+0000","last_became_peered":"2024-01-15T11:33:20.716205+0000","last_unstale":"2024-01-15T11:33:21.694293+0000","last_undegraded":"2024-01-15T11:33:21.694293+0000","last_fullsized":"2024-01-15T11:33:21.694293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:37:58.693069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.821888+0000","last_change":"2024-01-15T11:33:20.716995+0000","last_active":"2024-01-15T11:33:22.821888+0000","last_peered":"2024-01-15T11:33:22.821888+0000","last_clean":"2024-01-15T11:33:22.821888+0000","last_became_active":"2024-01-15T11:33:20.716752+0000","last_became_peered":"2024-01-15T11:33:20.716752+0000","last_unstale":"2024-01-15T11:33:22.821888+0000","last_undegraded":"2024-01-15T11:33:22.821888+0000","last_fullsized":"2024-01-15T11:33:22.821888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:06:24.798645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.824119+0000","last_change":"2024-01-15T11:33:20.701779+0000","last_active":"2024-01-15T11:33:22.824119+0000","last_peered":"2024-01-15T11:33:22.824119+0000","last_clean":"2024-01-15T11:33:22.824119+0000","last_became_active":"2024-01-15T11:33:20.701423+0000","last_became_peered":"2024-01-15T11:33:20.701423+0000","last_unstale":"2024-01-15T11:33:22.824119+0000","last_undegraded":"2024-01-15T11:33:22.824119+0000","last_fullsized":"2024-01-15T11:33:22.824119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:54:20.821257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.822456+0000","last_change":"2024-01-15T11:33:20.703490+0000","last_active":"2024-01-15T11:33:22.822456+0000","last_peered":"2024-01-15T11:33:22.822456+0000","last_clean":"2024-01-15T11:33:22.822456+0000","last_became_active":"2024-01-15T11:33:20.703217+0000","last_became_peered":"2024-01-15T11:33:20.703217+0000","last_unstale":"2024-01-15T11:33:22.822456+0000","last_undegraded":"2024-01-15T11:33:22.822456+0000","last_fullsized":"2024-01-15T11:33:22.822456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:38:46.122065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.822398+0000","last_change":"2024-01-15T11:33:20.721606+0000","last_active":"2024-01-15T11:33:22.822398+0000","last_peered":"2024-01-15T11:33:22.822398+0000","last_clean":"2024-01-15T11:33:22.822398+0000","last_became_active":"2024-01-15T11:33:20.721213+0000","last_became_peered":"2024-01-15T11:33:20.721213+0000","last_unstale":"2024-01-15T11:33:22.822398+0000","last_undegraded":"2024-01-15T11:33:22.822398+0000","last_fullsized":"2024-01-15T11:33:22.822398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:24:56.488321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.821789+0000","last_change":"2024-01-15T11:33:20.709187+0000","last_active":"2024-01-15T11:33:22.821789+0000","last_peered":"2024-01-15T11:33:22.821789+0000","last_clean":"2024-01-15T11:33:22.821789+0000","last_became_active":"2024-01-15T11:33:20.708936+0000","last_became_peered":"2024-01-15T11:33:20.708936+0000","last_unstale":"2024-01-15T11:33:22.821789+0000","last_undegraded":"2024-01-15T11:33:22.821789+0000","last_fullsized":"2024-01-15T11:33:22.821789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:10:06.157496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694339+0000","last_change":"2024-01-15T11:33:20.713513+0000","last_active":"2024-01-15T11:33:21.694339+0000","last_peered":"2024-01-15T11:33:21.694339+0000","last_clean":"2024-01-15T11:33:21.694339+0000","last_became_active":"2024-01-15T11:33:20.713242+0000","last_became_peered":"2024-01-15T11:33:20.713242+0000","last_unstale":"2024-01-15T11:33:21.694339+0000","last_undegraded":"2024-01-15T11:33:21.694339+0000","last_fullsized":"2024-01-15T11:33:21.694339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:16:29.898998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692439+0000","last_change":"2024-01-15T11:33:20.708040+0000","last_active":"2024-01-15T11:33:21.692439+0000","last_peered":"2024-01-15T11:33:21.692439+0000","last_clean":"2024-01-15T11:33:21.692439+0000","last_became_active":"2024-01-15T11:33:20.707700+0000","last_became_peered":"2024-01-15T11:33:20.707700+0000","last_unstale":"2024-01-15T11:33:21.692439+0000","last_undegraded":"2024-01-15T11:33:21.692439+0000","last_fullsized":"2024-01-15T11:33:21.692439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:21:39.120264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.823741+0000","last_change":"2024-01-15T11:33:20.708725+0000","last_active":"2024-01-15T11:33:22.823741+0000","last_peered":"2024-01-15T11:33:22.823741+0000","last_clean":"2024-01-15T11:33:22.823741+0000","last_became_active":"2024-01-15T11:33:20.707260+0000","last_became_peered":"2024-01-15T11:33:20.707260+0000","last_unstale":"2024-01-15T11:33:22.823741+0000","last_undegraded":"2024-01-15T11:33:22.823741+0000","last_fullsized":"2024-01-15T11:33:22.823741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:24:38.829986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.738658+0000","last_change":"2024-01-15T11:33:20.719952+0000","last_active":"2024-01-15T11:33:22.738658+0000","last_peered":"2024-01-15T11:33:22.738658+0000","last_clean":"2024-01-15T11:33:22.738658+0000","last_became_active":"2024-01-15T11:33:20.719219+0000","last_became_peered":"2024-01-15T11:33:20.719219+0000","last_unstale":"2024-01-15T11:33:22.738658+0000","last_undegraded":"2024-01-15T11:33:22.738658+0000","last_fullsized":"2024-01-15T11:33:22.738658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:47:34.231170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.076347+0000","last_change":"2024-01-15T11:33:19.694356+0000","last_active":"2024-01-15T11:33:21.076347+0000","last_peered":"2024-01-15T11:33:21.076347+0000","last_clean":"2024-01-15T11:33:21.076347+0000","last_became_active":"2024-01-15T11:33:19.693392+0000","last_became_peered":"2024-01-15T11:33:19.693392+0000","last_unstale":"2024-01-15T11:33:21.076347+0000","last_undegraded":"2024-01-15T11:33:21.076347+0000","last_fullsized":"2024-01-15T11:33:21.076347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:00:25.349679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692151+0000","last_change":"2024-01-15T11:33:20.715147+0000","last_active":"2024-01-15T11:33:21.692151+0000","last_peered":"2024-01-15T11:33:21.692151+0000","last_clean":"2024-01-15T11:33:21.692151+0000","last_became_active":"2024-01-15T11:33:20.714851+0000","last_became_peered":"2024-01-15T11:33:20.714851+0000","last_unstale":"2024-01-15T11:33:21.692151+0000","last_undegraded":"2024-01-15T11:33:21.692151+0000","last_fullsized":"2024-01-15T11:33:21.692151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:19:46.455034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694644+0000","last_change":"2024-01-15T11:33:19.695468+0000","last_active":"2024-01-15T11:33:21.694644+0000","last_peered":"2024-01-15T11:33:21.694644+0000","last_clean":"2024-01-15T11:33:21.694644+0000","last_became_active":"2024-01-15T11:33:19.694811+0000","last_became_peered":"2024-01-15T11:33:19.694811+0000","last_unstale":"2024-01-15T11:33:21.694644+0000","last_undegraded":"2024-01-15T11:33:21.694644+0000","last_fullsized":"2024-01-15T11:33:21.694644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:59:05.422692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.078730+0000","last_change":"2024-01-15T11:33:19.703161+0000","last_active":"2024-01-15T11:33:22.078730+0000","last_peered":"2024-01-15T11:33:22.078730+0000","last_clean":"2024-01-15T11:33:22.078730+0000","last_became_active":"2024-01-15T11:33:19.702777+0000","last_became_peered":"2024-01-15T11:33:19.702777+0000","last_unstale":"2024-01-15T11:33:22.078730+0000","last_undegraded":"2024-01-15T11:33:22.078730+0000","last_fullsized":"2024-01-15T11:33:22.078730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:55:14.164103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.822030+0000","last_change":"2024-01-15T11:33:20.713246+0000","last_active":"2024-01-15T11:33:22.822030+0000","last_peered":"2024-01-15T11:33:22.822030+0000","last_clean":"2024-01-15T11:33:22.822030+0000","last_became_active":"2024-01-15T11:33:20.712606+0000","last_became_peered":"2024-01-15T11:33:20.712606+0000","last_unstale":"2024-01-15T11:33:22.822030+0000","last_undegraded":"2024-01-15T11:33:22.822030+0000","last_fullsized":"2024-01-15T11:33:22.822030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:56:15.552491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694396+0000","last_change":"2024-01-15T11:33:19.688561+0000","last_active":"2024-01-15T11:33:21.694396+0000","last_peered":"2024-01-15T11:33:21.694396+0000","last_clean":"2024-01-15T11:33:21.694396+0000","last_became_active":"2024-01-15T11:33:19.688262+0000","last_became_peered":"2024-01-15T11:33:19.688262+0000","last_unstale":"2024-01-15T11:33:21.694396+0000","last_undegraded":"2024-01-15T11:33:21.694396+0000","last_fullsized":"2024-01-15T11:33:21.694396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:10:11.542737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692151+0000","last_change":"2024-01-15T11:33:20.707012+0000","last_active":"2024-01-15T11:33:21.692151+0000","last_peered":"2024-01-15T11:33:21.692151+0000","last_clean":"2024-01-15T11:33:21.692151+0000","last_became_active":"2024-01-15T11:33:20.706739+0000","last_became_peered":"2024-01-15T11:33:20.706739+0000","last_unstale":"2024-01-15T11:33:21.692151+0000","last_undegraded":"2024-01-15T11:33:21.692151+0000","last_fullsized":"2024-01-15T11:33:21.692151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:56:03.543465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.085203+0000","last_change":"2024-01-15T11:33:19.681692+0000","last_active":"2024-01-15T11:33:22.085203+0000","last_peered":"2024-01-15T11:33:22.085203+0000","last_clean":"2024-01-15T11:33:22.085203+0000","last_became_active":"2024-01-15T11:33:19.681438+0000","last_became_peered":"2024-01-15T11:33:19.681438+0000","last_unstale":"2024-01-15T11:33:22.085203+0000","last_undegraded":"2024-01-15T11:33:22.085203+0000","last_fullsized":"2024-01-15T11:33:22.085203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:29:59.035408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.824134+0000","last_change":"2024-01-15T11:33:20.703299+0000","last_active":"2024-01-15T11:33:22.824134+0000","last_peered":"2024-01-15T11:33:22.824134+0000","last_clean":"2024-01-15T11:33:22.824134+0000","last_became_active":"2024-01-15T11:33:20.702790+0000","last_became_peered":"2024-01-15T11:33:20.702790+0000","last_unstale":"2024-01-15T11:33:22.824134+0000","last_undegraded":"2024-01-15T11:33:22.824134+0000","last_fullsized":"2024-01-15T11:33:22.824134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:35:15.716032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049957+0000","last_change":"2024-01-15T11:33:19.705105+0000","last_active":"2024-01-15T11:33:22.049957+0000","last_peered":"2024-01-15T11:33:22.049957+0000","last_clean":"2024-01-15T11:33:22.049957+0000","last_became_active":"2024-01-15T11:33:19.704838+0000","last_became_peered":"2024-01-15T11:33:19.704838+0000","last_unstale":"2024-01-15T11:33:22.049957+0000","last_undegraded":"2024-01-15T11:33:22.049957+0000","last_fullsized":"2024-01-15T11:33:22.049957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:10:11.542737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.822106+0000","last_change":"2024-01-15T11:33:20.714206+0000","last_active":"2024-01-15T11:33:22.822106+0000","last_peered":"2024-01-15T11:33:22.822106+0000","last_clean":"2024-01-15T11:33:22.822106+0000","last_became_active":"2024-01-15T11:33:20.713849+0000","last_became_peered":"2024-01-15T11:33:20.713849+0000","last_unstale":"2024-01-15T11:33:22.822106+0000","last_undegraded":"2024-01-15T11:33:22.822106+0000","last_fullsized":"2024-01-15T11:33:22.822106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:29:59.709361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692762+0000","last_change":"2024-01-15T11:33:19.693447+0000","last_active":"2024-01-15T11:33:21.692762+0000","last_peered":"2024-01-15T11:33:21.692762+0000","last_clean":"2024-01-15T11:33:21.692762+0000","last_became_active":"2024-01-15T11:33:19.692828+0000","last_became_peered":"2024-01-15T11:33:19.692828+0000","last_unstale":"2024-01-15T11:33:21.692762+0000","last_undegraded":"2024-01-15T11:33:21.692762+0000","last_fullsized":"2024-01-15T11:33:21.692762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:43:19.032876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694795+0000","last_change":"2024-01-15T11:33:20.708034+0000","last_active":"2024-01-15T11:33:21.694795+0000","last_peered":"2024-01-15T11:33:21.694795+0000","last_clean":"2024-01-15T11:33:21.694795+0000","last_became_active":"2024-01-15T11:33:20.707770+0000","last_became_peered":"2024-01-15T11:33:20.707770+0000","last_unstale":"2024-01-15T11:33:21.694795+0000","last_undegraded":"2024-01-15T11:33:21.694795+0000","last_fullsized":"2024-01-15T11:33:21.694795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:05:32.012901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.084856+0000","last_change":"2024-01-15T11:33:19.689357+0000","last_active":"2024-01-15T11:33:22.084856+0000","last_peered":"2024-01-15T11:33:22.084856+0000","last_clean":"2024-01-15T11:33:22.084856+0000","last_became_active":"2024-01-15T11:33:19.685961+0000","last_became_peered":"2024-01-15T11:33:19.685961+0000","last_unstale":"2024-01-15T11:33:22.084856+0000","last_undegraded":"2024-01-15T11:33:22.084856+0000","last_fullsized":"2024-01-15T11:33:22.084856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:10:41.101806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.050023+0000","last_change":"2024-01-15T11:33:20.717161+0000","last_active":"2024-01-15T11:33:22.050023+0000","last_peered":"2024-01-15T11:33:22.050023+0000","last_clean":"2024-01-15T11:33:22.050023+0000","last_became_active":"2024-01-15T11:33:20.716866+0000","last_became_peered":"2024-01-15T11:33:20.716866+0000","last_unstale":"2024-01-15T11:33:22.050023+0000","last_undegraded":"2024-01-15T11:33:22.050023+0000","last_fullsized":"2024-01-15T11:33:22.050023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:40:37.948024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.693226+0000","last_change":"2024-01-15T11:33:19.698607+0000","last_active":"2024-01-15T11:33:21.693226+0000","last_peered":"2024-01-15T11:33:21.693226+0000","last_clean":"2024-01-15T11:33:21.693226+0000","last_became_active":"2024-01-15T11:33:19.698300+0000","last_became_peered":"2024-01-15T11:33:19.698300+0000","last_unstale":"2024-01-15T11:33:21.693226+0000","last_undegraded":"2024-01-15T11:33:21.693226+0000","last_fullsized":"2024-01-15T11:33:21.693226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:10:16.449986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.821477+0000","last_change":"2024-01-15T11:33:20.704242+0000","last_active":"2024-01-15T11:33:22.821477+0000","last_peered":"2024-01-15T11:33:22.821477+0000","last_clean":"2024-01-15T11:33:22.821477+0000","last_became_active":"2024-01-15T11:33:20.703938+0000","last_became_peered":"2024-01-15T11:33:20.703938+0000","last_unstale":"2024-01-15T11:33:22.821477+0000","last_undegraded":"2024-01-15T11:33:22.821477+0000","last_fullsized":"2024-01-15T11:33:22.821477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:54:20.821257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694704+0000","last_change":"2024-01-15T11:33:19.695692+0000","last_active":"2024-01-15T11:33:21.694704+0000","last_peered":"2024-01-15T11:33:21.694704+0000","last_clean":"2024-01-15T11:33:21.694704+0000","last_became_active":"2024-01-15T11:33:19.695189+0000","last_became_peered":"2024-01-15T11:33:19.695189+0000","last_unstale":"2024-01-15T11:33:21.694704+0000","last_undegraded":"2024-01-15T11:33:21.694704+0000","last_fullsized":"2024-01-15T11:33:21.694704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:30:56.466865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694542+0000","last_change":"2024-01-15T11:33:20.718461+0000","last_active":"2024-01-15T11:33:21.694542+0000","last_peered":"2024-01-15T11:33:21.694542+0000","last_clean":"2024-01-15T11:33:21.694542+0000","last_became_active":"2024-01-15T11:33:20.718129+0000","last_became_peered":"2024-01-15T11:33:20.718129+0000","last_unstale":"2024-01-15T11:33:21.694542+0000","last_undegraded":"2024-01-15T11:33:21.694542+0000","last_fullsized":"2024-01-15T11:33:21.694542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:31:06.263833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049542+0000","last_change":"2024-01-15T11:33:19.704099+0000","last_active":"2024-01-15T11:33:22.049542+0000","last_peered":"2024-01-15T11:33:22.049542+0000","last_clean":"2024-01-15T11:33:22.049542+0000","last_became_active":"2024-01-15T11:33:19.699225+0000","last_became_peered":"2024-01-15T11:33:19.699225+0000","last_unstale":"2024-01-15T11:33:22.049542+0000","last_undegraded":"2024-01-15T11:33:22.049542+0000","last_fullsized":"2024-01-15T11:33:22.049542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:38:45.116285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.738426+0000","last_change":"2024-01-15T11:33:20.719867+0000","last_active":"2024-01-15T11:33:22.738426+0000","last_peered":"2024-01-15T11:33:22.738426+0000","last_clean":"2024-01-15T11:33:22.738426+0000","last_became_active":"2024-01-15T11:33:20.719528+0000","last_became_peered":"2024-01-15T11:33:20.719528+0000","last_unstale":"2024-01-15T11:33:22.738426+0000","last_undegraded":"2024-01-15T11:33:22.738426+0000","last_fullsized":"2024-01-15T11:33:22.738426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:21:39.120264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692059+0000","last_change":"2024-01-15T11:33:19.688957+0000","last_active":"2024-01-15T11:33:21.692059+0000","last_peered":"2024-01-15T11:33:21.692059+0000","last_clean":"2024-01-15T11:33:21.692059+0000","last_became_active":"2024-01-15T11:33:19.688682+0000","last_became_peered":"2024-01-15T11:33:19.688682+0000","last_unstale":"2024-01-15T11:33:21.692059+0000","last_undegraded":"2024-01-15T11:33:21.692059+0000","last_fullsized":"2024-01-15T11:33:21.692059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:24:37.824206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694356+0000","last_change":"2024-01-15T11:33:20.703451+0000","last_active":"2024-01-15T11:33:21.694356+0000","last_peered":"2024-01-15T11:33:21.694356+0000","last_clean":"2024-01-15T11:33:21.694356+0000","last_became_active":"2024-01-15T11:33:20.703004+0000","last_became_peered":"2024-01-15T11:33:20.703004+0000","last_unstale":"2024-01-15T11:33:21.694356+0000","last_undegraded":"2024-01-15T11:33:21.694356+0000","last_fullsized":"2024-01-15T11:33:21.694356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:40:37.948024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.050081+0000","last_change":"2024-01-15T11:33:19.700886+0000","last_active":"2024-01-15T11:33:22.050081+0000","last_peered":"2024-01-15T11:33:22.050081+0000","last_clean":"2024-01-15T11:33:22.050081+0000","last_became_active":"2024-01-15T11:33:19.700536+0000","last_became_peered":"2024-01-15T11:33:19.700536+0000","last_unstale":"2024-01-15T11:33:22.050081+0000","last_undegraded":"2024-01-15T11:33:22.050081+0000","last_fullsized":"2024-01-15T11:33:22.050081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:10:23.063991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.824207+0000","last_change":"2024-01-15T11:33:20.698576+0000","last_active":"2024-01-15T11:33:22.824207+0000","last_peered":"2024-01-15T11:33:22.824207+0000","last_clean":"2024-01-15T11:33:22.824207+0000","last_became_active":"2024-01-15T11:33:20.698281+0000","last_became_peered":"2024-01-15T11:33:20.698281+0000","last_unstale":"2024-01-15T11:33:22.824207+0000","last_undegraded":"2024-01-15T11:33:22.824207+0000","last_fullsized":"2024-01-15T11:33:22.824207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:28:17.783937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692467+0000","last_change":"2024-01-15T11:33:19.686942+0000","last_active":"2024-01-15T11:33:21.692467+0000","last_peered":"2024-01-15T11:33:21.692467+0000","last_clean":"2024-01-15T11:33:21.692467+0000","last_became_active":"2024-01-15T11:33:19.686670+0000","last_became_peered":"2024-01-15T11:33:19.686670+0000","last_unstale":"2024-01-15T11:33:21.692467+0000","last_undegraded":"2024-01-15T11:33:21.692467+0000","last_fullsized":"2024-01-15T11:33:21.692467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:54:19.815477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.050080+0000","last_change":"2024-01-15T11:33:20.717627+0000","last_active":"2024-01-15T11:33:22.050080+0000","last_peered":"2024-01-15T11:33:22.050080+0000","last_clean":"2024-01-15T11:33:22.050080+0000","last_became_active":"2024-01-15T11:33:20.717314+0000","last_became_peered":"2024-01-15T11:33:20.717314+0000","last_unstale":"2024-01-15T11:33:22.050080+0000","last_undegraded":"2024-01-15T11:33:22.050080+0000","last_fullsized":"2024-01-15T11:33:22.050080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:06:38.712115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.076385+0000","last_change":"2024-01-15T11:33:19.686445+0000","last_active":"2024-01-15T11:33:21.076385+0000","last_peered":"2024-01-15T11:33:21.076385+0000","last_clean":"2024-01-15T11:33:21.076385+0000","last_became_active":"2024-01-15T11:33:19.686095+0000","last_became_peered":"2024-01-15T11:33:19.686095+0000","last_unstale":"2024-01-15T11:33:21.076385+0000","last_undegraded":"2024-01-15T11:33:21.076385+0000","last_fullsized":"2024-01-15T11:33:21.076385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:40:08.252519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049946+0000","last_change":"2024-01-15T11:33:20.717522+0000","last_active":"2024-01-15T11:33:22.049946+0000","last_peered":"2024-01-15T11:33:22.049946+0000","last_clean":"2024-01-15T11:33:22.049946+0000","last_became_active":"2024-01-15T11:33:20.716509+0000","last_became_peered":"2024-01-15T11:33:20.716509+0000","last_unstale":"2024-01-15T11:33:22.049946+0000","last_undegraded":"2024-01-15T11:33:22.049946+0000","last_fullsized":"2024-01-15T11:33:22.049946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:16:29.898998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.078811+0000","last_change":"2024-01-15T11:33:19.704598+0000","last_active":"2024-01-15T11:33:22.078811+0000","last_peered":"2024-01-15T11:33:22.078811+0000","last_clean":"2024-01-15T11:33:22.078811+0000","last_became_active":"2024-01-15T11:33:19.704325+0000","last_became_peered":"2024-01-15T11:33:19.704325+0000","last_unstale":"2024-01-15T11:33:22.078811+0000","last_undegraded":"2024-01-15T11:33:22.078811+0000","last_fullsized":"2024-01-15T11:33:22.078811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:30:24.655392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694647+0000","last_change":"2024-01-15T11:33:20.713073+0000","last_active":"2024-01-15T11:33:21.694647+0000","last_peered":"2024-01-15T11:33:21.694647+0000","last_clean":"2024-01-15T11:33:21.694647+0000","last_became_active":"2024-01-15T11:33:20.712445+0000","last_became_peered":"2024-01-15T11:33:20.712445+0000","last_unstale":"2024-01-15T11:33:21.694647+0000","last_undegraded":"2024-01-15T11:33:21.694647+0000","last_fullsized":"2024-01-15T11:33:21.694647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:43:36.505459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:20.700621+0000","last_change":"2024-01-15T11:33:09.200536+0000","last_active":"2024-01-15T11:33:20.700621+0000","last_peered":"2024-01-15T11:33:20.700621+0000","last_clean":"2024-01-15T11:33:20.700621+0000","last_became_active":"2024-01-15T11:33:09.199051+0000","last_became_peered":"2024-01-15T11:33:09.199051+0000","last_unstale":"2024-01-15T11:33:20.700621+0000","last_undegraded":"2024-01-15T11:33:20.700621+0000","last_fullsized":"2024-01-15T11:33:20.700621+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:08.185347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:08.185347+0000","last_clean_scrub_stamp":"2024-01-15T11:33:08.185347+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:04:15.799885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694629+0000","last_change":"2024-01-15T11:33:19.696884+0000","last_active":"2024-01-15T11:33:21.694629+0000","last_peered":"2024-01-15T11:33:21.694629+0000","last_clean":"2024-01-15T11:33:21.694629+0000","last_became_active":"2024-01-15T11:33:19.696613+0000","last_became_peered":"2024-01-15T11:33:19.696613+0000","last_unstale":"2024-01-15T11:33:21.694629+0000","last_undegraded":"2024-01-15T11:33:21.694629+0000","last_fullsized":"2024-01-15T11:33:21.694629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:39:06.448053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692244+0000","last_change":"2024-01-15T11:33:20.699247+0000","last_active":"2024-01-15T11:33:21.692244+0000","last_peered":"2024-01-15T11:33:21.692244+0000","last_clean":"2024-01-15T11:33:21.692244+0000","last_became_active":"2024-01-15T11:33:20.698918+0000","last_became_peered":"2024-01-15T11:33:20.698918+0000","last_unstale":"2024-01-15T11:33:21.692244+0000","last_undegraded":"2024-01-15T11:33:21.692244+0000","last_fullsized":"2024-01-15T11:33:21.692244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:10:12.548516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694391+0000","last_change":"2024-01-15T11:33:19.697464+0000","last_active":"2024-01-15T11:33:21.694391+0000","last_peered":"2024-01-15T11:33:21.694391+0000","last_clean":"2024-01-15T11:33:21.694391+0000","last_became_active":"2024-01-15T11:33:19.697216+0000","last_became_peered":"2024-01-15T11:33:19.697216+0000","last_unstale":"2024-01-15T11:33:21.694391+0000","last_undegraded":"2024-01-15T11:33:21.694391+0000","last_fullsized":"2024-01-15T11:33:21.694391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:10:23.063991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.821437+0000","last_change":"2024-01-15T11:33:20.705721+0000","last_active":"2024-01-15T11:33:22.821437+0000","last_peered":"2024-01-15T11:33:22.821437+0000","last_clean":"2024-01-15T11:33:22.821437+0000","last_became_active":"2024-01-15T11:33:20.705377+0000","last_became_peered":"2024-01-15T11:33:20.705377+0000","last_unstale":"2024-01-15T11:33:22.821437+0000","last_undegraded":"2024-01-15T11:33:22.821437+0000","last_fullsized":"2024-01-15T11:33:22.821437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:47:34.231170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692543+0000","last_change":"2024-01-15T11:33:19.695074+0000","last_active":"2024-01-15T11:33:21.692543+0000","last_peered":"2024-01-15T11:33:21.692543+0000","last_clean":"2024-01-15T11:33:21.692543+0000","last_became_active":"2024-01-15T11:33:19.694782+0000","last_became_peered":"2024-01-15T11:33:19.694782+0000","last_unstale":"2024-01-15T11:33:21.692543+0000","last_undegraded":"2024-01-15T11:33:21.692543+0000","last_fullsized":"2024-01-15T11:33:21.692543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:23:46.972470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.822061+0000","last_change":"2024-01-15T11:33:20.710903+0000","last_active":"2024-01-15T11:33:22.822061+0000","last_peered":"2024-01-15T11:33:22.822061+0000","last_clean":"2024-01-15T11:33:22.822061+0000","last_became_active":"2024-01-15T11:33:20.710654+0000","last_became_peered":"2024-01-15T11:33:20.710654+0000","last_unstale":"2024-01-15T11:33:22.822061+0000","last_undegraded":"2024-01-15T11:33:22.822061+0000","last_fullsized":"2024-01-15T11:33:22.822061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:24:04.683090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694751+0000","last_change":"2024-01-15T11:33:19.695513+0000","last_active":"2024-01-15T11:33:21.694751+0000","last_peered":"2024-01-15T11:33:21.694751+0000","last_clean":"2024-01-15T11:33:21.694751+0000","last_became_active":"2024-01-15T11:33:19.694979+0000","last_became_peered":"2024-01-15T11:33:19.694979+0000","last_unstale":"2024-01-15T11:33:21.694751+0000","last_undegraded":"2024-01-15T11:33:21.694751+0000","last_fullsized":"2024-01-15T11:33:21.694751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T11:40:02.900978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049811+0000","last_change":"2024-01-15T11:33:20.714405+0000","last_active":"2024-01-15T11:33:22.049811+0000","last_peered":"2024-01-15T11:33:22.049811+0000","last_clean":"2024-01-15T11:33:22.049811+0000","last_became_active":"2024-01-15T11:33:20.714117+0000","last_became_peered":"2024-01-15T11:33:20.714117+0000","last_unstale":"2024-01-15T11:33:22.049811+0000","last_undegraded":"2024-01-15T11:33:22.049811+0000","last_fullsized":"2024-01-15T11:33:22.049811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:39:07.453832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.076366+0000","last_change":"2024-01-15T11:33:19.687389+0000","last_active":"2024-01-15T11:33:21.076366+0000","last_peered":"2024-01-15T11:33:21.076366+0000","last_clean":"2024-01-15T11:33:21.076366+0000","last_became_active":"2024-01-15T11:33:19.687007+0000","last_became_peered":"2024-01-15T11:33:19.687007+0000","last_unstale":"2024-01-15T11:33:21.076366+0000","last_undegraded":"2024-01-15T11:33:21.076366+0000","last_fullsized":"2024-01-15T11:33:21.076366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:48:31.960351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.823962+0000","last_change":"2024-01-15T11:33:20.707549+0000","last_active":"2024-01-15T11:33:22.823962+0000","last_peered":"2024-01-15T11:33:22.823962+0000","last_clean":"2024-01-15T11:33:22.823962+0000","last_became_active":"2024-01-15T11:33:20.707209+0000","last_became_peered":"2024-01-15T11:33:20.707209+0000","last_unstale":"2024-01-15T11:33:22.823962+0000","last_undegraded":"2024-01-15T11:33:22.823962+0000","last_fullsized":"2024-01-15T11:33:22.823962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:47:34.231170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694720+0000","last_change":"2024-01-15T11:33:19.694270+0000","last_active":"2024-01-15T11:33:21.694720+0000","last_peered":"2024-01-15T11:33:21.694720+0000","last_clean":"2024-01-15T11:33:21.694720+0000","last_became_active":"2024-01-15T11:33:19.693994+0000","last_became_peered":"2024-01-15T11:33:19.693994+0000","last_unstale":"2024-01-15T11:33:21.694720+0000","last_undegraded":"2024-01-15T11:33:21.694720+0000","last_fullsized":"2024-01-15T11:33:21.694720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:06:50.072772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.822556+0000","last_change":"2024-01-15T11:33:20.710508+0000","last_active":"2024-01-15T11:33:22.822556+0000","last_peered":"2024-01-15T11:33:22.822556+0000","last_clean":"2024-01-15T11:33:22.822556+0000","last_became_active":"2024-01-15T11:33:20.710227+0000","last_became_peered":"2024-01-15T11:33:20.710227+0000","last_unstale":"2024-01-15T11:33:22.822556+0000","last_undegraded":"2024-01-15T11:33:22.822556+0000","last_fullsized":"2024-01-15T11:33:22.822556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:56:03.543465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.085139+0000","last_change":"2024-01-15T11:33:19.695648+0000","last_active":"2024-01-15T11:33:22.085139+0000","last_peered":"2024-01-15T11:33:22.085139+0000","last_clean":"2024-01-15T11:33:22.085139+0000","last_became_active":"2024-01-15T11:33:19.695275+0000","last_became_peered":"2024-01-15T11:33:19.695275+0000","last_unstale":"2024-01-15T11:33:22.085139+0000","last_undegraded":"2024-01-15T11:33:22.085139+0000","last_fullsized":"2024-01-15T11:33:22.085139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:35:14.710253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692522+0000","last_change":"2024-01-15T11:33:20.702612+0000","last_active":"2024-01-15T11:33:21.692522+0000","last_peered":"2024-01-15T11:33:21.692522+0000","last_clean":"2024-01-15T11:33:21.692522+0000","last_became_active":"2024-01-15T11:33:20.702237+0000","last_became_peered":"2024-01-15T11:33:20.702237+0000","last_unstale":"2024-01-15T11:33:21.692522+0000","last_undegraded":"2024-01-15T11:33:21.692522+0000","last_fullsized":"2024-01-15T11:33:21.692522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:59:06.428472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694987+0000","last_change":"2024-01-15T11:33:19.703609+0000","last_active":"2024-01-15T11:33:21.694987+0000","last_peered":"2024-01-15T11:33:21.694987+0000","last_clean":"2024-01-15T11:33:21.694987+0000","last_became_active":"2024-01-15T11:33:19.703303+0000","last_became_peered":"2024-01-15T11:33:19.703303+0000","last_unstale":"2024-01-15T11:33:21.694987+0000","last_undegraded":"2024-01-15T11:33:21.694987+0000","last_fullsized":"2024-01-15T11:33:21.694987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:25:15.570806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692384+0000","last_change":"2024-01-15T11:33:20.698701+0000","last_active":"2024-01-15T11:33:21.692384+0000","last_peered":"2024-01-15T11:33:21.692384+0000","last_clean":"2024-01-15T11:33:21.692384+0000","last_became_active":"2024-01-15T11:33:20.698404+0000","last_became_peered":"2024-01-15T11:33:20.698404+0000","last_unstale":"2024-01-15T11:33:21.692384+0000","last_undegraded":"2024-01-15T11:33:21.692384+0000","last_fullsized":"2024-01-15T11:33:21.692384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:10:24.069771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049423+0000","last_change":"2024-01-15T11:33:19.692573+0000","last_active":"2024-01-15T11:33:22.049423+0000","last_peered":"2024-01-15T11:33:22.049423+0000","last_clean":"2024-01-15T11:33:22.049423+0000","last_became_active":"2024-01-15T11:33:19.692258+0000","last_became_peered":"2024-01-15T11:33:19.692258+0000","last_unstale":"2024-01-15T11:33:22.049423+0000","last_undegraded":"2024-01-15T11:33:22.049423+0000","last_fullsized":"2024-01-15T11:33:22.049423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:24:55.482541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694384+0000","last_change":"2024-01-15T11:33:20.702022+0000","last_active":"2024-01-15T11:33:21.694384+0000","last_peered":"2024-01-15T11:33:21.694384+0000","last_clean":"2024-01-15T11:33:21.694384+0000","last_became_active":"2024-01-15T11:33:20.701623+0000","last_became_peered":"2024-01-15T11:33:20.701623+0000","last_unstale":"2024-01-15T11:33:21.694384+0000","last_undegraded":"2024-01-15T11:33:21.694384+0000","last_fullsized":"2024-01-15T11:33:21.694384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:06:38.712115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692157+0000","last_change":"2024-01-15T11:33:19.695563+0000","last_active":"2024-01-15T11:33:21.692157+0000","last_peered":"2024-01-15T11:33:21.692157+0000","last_clean":"2024-01-15T11:33:21.692157+0000","last_became_active":"2024-01-15T11:33:19.695286+0000","last_became_peered":"2024-01-15T11:33:19.695286+0000","last_unstale":"2024-01-15T11:33:21.692157+0000","last_undegraded":"2024-01-15T11:33:21.692157+0000","last_fullsized":"2024-01-15T11:33:21.692157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:47:33.225390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.691971+0000","last_change":"2024-01-15T11:33:20.698692+0000","last_active":"2024-01-15T11:33:21.691971+0000","last_peered":"2024-01-15T11:33:21.691971+0000","last_clean":"2024-01-15T11:33:21.691971+0000","last_became_active":"2024-01-15T11:33:20.698341+0000","last_became_peered":"2024-01-15T11:33:20.698341+0000","last_unstale":"2024-01-15T11:33:21.691971+0000","last_undegraded":"2024-01-15T11:33:21.691971+0000","last_fullsized":"2024-01-15T11:33:21.691971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:24:56.488321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.078760+0000","last_change":"2024-01-15T11:33:19.697600+0000","last_active":"2024-01-15T11:33:22.078760+0000","last_peered":"2024-01-15T11:33:22.078760+0000","last_clean":"2024-01-15T11:33:22.078760+0000","last_became_active":"2024-01-15T11:33:19.697340+0000","last_became_peered":"2024-01-15T11:33:19.697340+0000","last_unstale":"2024-01-15T11:33:22.078760+0000","last_undegraded":"2024-01-15T11:33:22.078760+0000","last_fullsized":"2024-01-15T11:33:22.078760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:24:37.824206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.693173+0000","last_change":"2024-01-15T11:33:20.699235+0000","last_active":"2024-01-15T11:33:21.693173+0000","last_peered":"2024-01-15T11:33:21.693173+0000","last_clean":"2024-01-15T11:33:21.693173+0000","last_became_active":"2024-01-15T11:33:20.698686+0000","last_became_peered":"2024-01-15T11:33:20.698686+0000","last_unstale":"2024-01-15T11:33:21.693173+0000","last_undegraded":"2024-01-15T11:33:21.693173+0000","last_fullsized":"2024-01-15T11:33:21.693173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:24:38.829986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694531+0000","last_change":"2024-01-15T11:33:19.701728+0000","last_active":"2024-01-15T11:33:21.694531+0000","last_peered":"2024-01-15T11:33:21.694531+0000","last_clean":"2024-01-15T11:33:21.694531+0000","last_became_active":"2024-01-15T11:33:19.701429+0000","last_became_peered":"2024-01-15T11:33:19.701429+0000","last_unstale":"2024-01-15T11:33:21.694531+0000","last_undegraded":"2024-01-15T11:33:21.694531+0000","last_fullsized":"2024-01-15T11:33:21.694531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:29:52.566265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694539+0000","last_change":"2024-01-15T11:33:20.710518+0000","last_active":"2024-01-15T11:33:21.694539+0000","last_peered":"2024-01-15T11:33:21.694539+0000","last_clean":"2024-01-15T11:33:21.694539+0000","last_became_active":"2024-01-15T11:33:20.709615+0000","last_became_peered":"2024-01-15T11:33:20.709615+0000","last_unstale":"2024-01-15T11:33:21.694539+0000","last_undegraded":"2024-01-15T11:33:21.694539+0000","last_fullsized":"2024-01-15T11:33:21.694539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:03:30.363934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.694665+0000","last_change":"2024-01-15T11:33:20.718816+0000","last_active":"2024-01-15T11:33:21.694665+0000","last_peered":"2024-01-15T11:33:21.694665+0000","last_clean":"2024-01-15T11:33:21.694665+0000","last_became_active":"2024-01-15T11:33:20.716841+0000","last_became_peered":"2024-01-15T11:33:20.716841+0000","last_unstale":"2024-01-15T11:33:21.694665+0000","last_undegraded":"2024-01-15T11:33:21.694665+0000","last_fullsized":"2024-01-15T11:33:21.694665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:13:30.740169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.049911+0000","last_change":"2024-01-15T11:33:19.706026+0000","last_active":"2024-01-15T11:33:22.049911+0000","last_peered":"2024-01-15T11:33:22.049911+0000","last_clean":"2024-01-15T11:33:22.049911+0000","last_became_active":"2024-01-15T11:33:19.705650+0000","last_became_peered":"2024-01-15T11:33:19.705650+0000","last_unstale":"2024-01-15T11:33:22.049911+0000","last_undegraded":"2024-01-15T11:33:22.049911+0000","last_fullsized":"2024-01-15T11:33:22.049911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:19:45.449255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.738654+0000","last_change":"2024-01-15T11:33:20.723707+0000","last_active":"2024-01-15T11:33:22.738654+0000","last_peered":"2024-01-15T11:33:22.738654+0000","last_clean":"2024-01-15T11:33:22.738654+0000","last_became_active":"2024-01-15T11:33:20.723420+0000","last_became_peered":"2024-01-15T11:33:20.723420+0000","last_unstale":"2024-01-15T11:33:22.738654+0000","last_undegraded":"2024-01-15T11:33:22.738654+0000","last_fullsized":"2024-01-15T11:33:22.738654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:24:38.829986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.050061+0000","last_change":"2024-01-15T11:33:19.707453+0000","last_active":"2024-01-15T11:33:22.050061+0000","last_peered":"2024-01-15T11:33:22.050061+0000","last_clean":"2024-01-15T11:33:22.050061+0000","last_became_active":"2024-01-15T11:33:19.707108+0000","last_became_peered":"2024-01-15T11:33:19.707108+0000","last_unstale":"2024-01-15T11:33:22.050061+0000","last_undegraded":"2024-01-15T11:33:22.050061+0000","last_fullsized":"2024-01-15T11:33:22.050061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:56:02.537685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.821973+0000","last_change":"2024-01-15T11:33:20.716694+0000","last_active":"2024-01-15T11:33:22.821973+0000","last_peered":"2024-01-15T11:33:22.821973+0000","last_clean":"2024-01-15T11:33:22.821973+0000","last_became_active":"2024-01-15T11:33:20.716405+0000","last_became_peered":"2024-01-15T11:33:20.716405+0000","last_unstale":"2024-01-15T11:33:22.821973+0000","last_undegraded":"2024-01-15T11:33:22.821973+0000","last_fullsized":"2024-01-15T11:33:22.821973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:11:38.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.076414+0000","last_change":"2024-01-15T11:33:19.690015+0000","last_active":"2024-01-15T11:33:21.076414+0000","last_peered":"2024-01-15T11:33:21.076414+0000","last_clean":"2024-01-15T11:33:21.076414+0000","last_became_active":"2024-01-15T11:33:19.688306+0000","last_became_peered":"2024-01-15T11:33:19.688306+0000","last_unstale":"2024-01-15T11:33:21.076414+0000","last_undegraded":"2024-01-15T11:33:21.076414+0000","last_fullsized":"2024-01-15T11:33:21.076414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:41:03.219134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:22.821958+0000","last_change":"2024-01-15T11:33:20.713812+0000","last_active":"2024-01-15T11:33:22.821958+0000","last_peered":"2024-01-15T11:33:22.821958+0000","last_clean":"2024-01-15T11:33:22.821958+0000","last_became_active":"2024-01-15T11:33:20.713505+0000","last_became_peered":"2024-01-15T11:33:20.713505+0000","last_unstale":"2024-01-15T11:33:22.821958+0000","last_undegraded":"2024-01-15T11:33:22.821958+0000","last_fullsized":"2024-01-15T11:33:22.821958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:19.662421+0000","last_clean_scrub_stamp":"2024-01-15T11:33:19.662421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:25:28.883635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-15T11:33:21.692650+0000","last_change":"2024-01-15T11:33:19.691915+0000","last_active":"2024-01-15T11:33:21.692650+0000","last_peered":"2024-01-15T11:33:21.692650+0000","last_clean":"2024-01-15T11:33:21.692650+0000","last_became_active":"2024-01-15T11:33:19.691570+0000","last_became_peered":"2024-01-15T11:33:19.691570+0000","last_unstale":"2024-01-15T11:33:21.692650+0000","last_undegraded":"2024-01-15T11:33:21.692650+0000","last_fullsized":"2024-01-15T11:33:21.692650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:18.656641+0000","last_clean_scrub_stamp":"2024-01-15T11:33:18.656641+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:28:16.778157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":76376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":76252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":78536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]}]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":76834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":77864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":666690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":76308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-15T11:33:29.929 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-15T11:33:29.929 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-15T11:33:29.929 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-01-15T11:33:29.929 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-01-15T11:33:30.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.107+0000 7fb3934dd640 1 Processor -- start 2024-01-15T11:33:30.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.107+0000 7fb3934dd640 1 -- start start 2024-01-15T11:33:30.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.107+0000 7fb3934dd640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb38c15d760 0x7fb38c0b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:30.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.107+0000 7fb3934dd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb38c0b3490 0x7fb38c0cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:30.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.107+0000 7fb3934dd640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb38c0b3c60 con 0x7fb38c1539d0 2024-01-15T11:33:30.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.107+0000 7fb3934dd640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb38c0b3f40 con 0x7fb38c0b3490 2024-01-15T11:33:30.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.107+0000 7fb3934dd640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c0cd430 con 0x7fb38c15d760 2024-01-15T11:33:30.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.107+0000 7fb391279640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb38c1539d0 0x7fb38c15d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44070/0 (socket says 172.21.15.27:44070) 2024-01-15T11:33:30.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.107+0000 7fb391279640 1 -- 172.21.15.27:0/1248982418 learned_addr learned my addr 172.21.15.27:0/1248982418 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:30.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.107+0000 7fb390a78640 1 --2- 172.21.15.27:0/1248982418 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb38c15d760 0x7fb38c0b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:30.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.107+0000 7fb391a7a640 1 --2- 172.21.15.27:0/1248982418 >> v2:172.21.15.93:3300/0 conn(0x7fb38c0b3490 0x7fb38c0cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:30.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.107+0000 7fb383fff640 1 -- 172.21.15.27:0/1248982418 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077269988 0 0) 0x7fb38c0b3c60 con 0x7fb38c1539d0 2024-01-15T11:33:30.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.107+0000 7fb383fff640 1 -- 172.21.15.27:0/1248982418 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb378005740 con 0x7fb38c1539d0 2024-01-15T11:33:30.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.111+0000 7fb390a78640 1 -- 172.21.15.27:0/1248982418 >> v2:172.21.15.93:3300/0 conn(0x7fb38c0b3490 msgr2=0x7fb38c0cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:30.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.111+0000 7fb390a78640 1 --2- 172.21.15.27:0/1248982418 >> v2:172.21.15.93:3300/0 conn(0x7fb38c0b3490 0x7fb38c0cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.111+0000 7fb390a78640 1 -- 172.21.15.27:0/1248982418 >> v1:172.21.15.27:6789/0 conn(0x7fb38c1539d0 legacy=0x7fb38c15d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:30.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.111+0000 7fb383fff640 1 -- 172.21.15.27:0/1248982418 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 699177020 0 0) 0x7fb378005740 con 0x7fb38c1539d0 2024-01-15T11:33:30.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.111+0000 7fb390a78640 1 -- 172.21.15.27:0/1248982418 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38c0cd710 con 0x7fb38c15d760 2024-01-15T11:33:30.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.111+0000 7fb391a7a640 1 --2- 172.21.15.27:0/1248982418 >> v2:172.21.15.93:3300/0 conn(0x7fb38c0b3490 0x7fb38c0cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:30.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.111+0000 7fb390a78640 1 --2- 172.21.15.27:0/1248982418 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb38c15d760 0x7fb38c0b2f50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0097c0 tx=0x7fb37c01c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7700d724d457e202 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:30.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.111+0000 7fb383fff640 1 -- 172.21.15.27:0/1248982418 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388001680 con 0x7fb38c15d760 2024-01-15T11:33:30.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.111+0000 7fb383fff640 1 -- 172.21.15.27:0/1248982418 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37c0a7050 con 0x7fb38c15d760 2024-01-15T11:33:30.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.111+0000 7fb383fff640 1 -- 172.21.15.27:0/1248982418 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c0ab600 con 0x7fb38c15d760 2024-01-15T11:33:30.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.111+0000 7fb3934dd640 1 -- 172.21.15.27:0/1248982418 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb38c15d760 msgr2=0x7fb38c0b2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:30.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.111+0000 7fb3934dd640 1 --2- 172.21.15.27:0/1248982418 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb38c15d760 0x7fb38c0b2f50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0097c0 tx=0x7fb37c01c370 comp rx=0 tx=0).stop 2024-01-15T11:33:30.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.115+0000 7fb3934dd640 1 -- 172.21.15.27:0/1248982418 shutdown_connections 2024-01-15T11:33:30.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.115+0000 7fb3934dd640 1 --2- 172.21.15.27:0/1248982418 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb38c15d760 0x7fb38c0b2f50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.115+0000 7fb3934dd640 1 --2- 172.21.15.27:0/1248982418 >> v2:172.21.15.93:3300/0 conn(0x7fb38c0b3490 0x7fb38c0cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.115+0000 7fb3934dd640 1 -- 172.21.15.27:0/1248982418 >> 172.21.15.27:0/1248982418 conn(0x7fb38c06a5b0 msgr2=0x7fb38c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:30.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.115+0000 7fb3934dd640 1 -- 172.21.15.27:0/1248982418 shutdown_connections 2024-01-15T11:33:30.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.115+0000 7fb3934dd640 1 -- 172.21.15.27:0/1248982418 wait complete. 2024-01-15T11:33:30.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.115+0000 7fb3934dd640 1 Processor -- start 2024-01-15T11:33:30.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.115+0000 7fb3934dd640 1 -- start start 2024-01-15T11:33:30.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.115+0000 7fb3934dd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb38c0b3490 0x7fb38c140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:30.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.115+0000 7fb3934dd640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb38c1539d0 0x7fb38c159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:30.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.115+0000 7fb3934dd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb38c15d760 0x7fb38c150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:30.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.115+0000 7fb3934dd640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c15b1e0 con 0x7fb38c0b3490 2024-01-15T11:33:30.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.115+0000 7fb3934dd640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c1412a0 con 0x7fb38c15d760 2024-01-15T11:33:30.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.115+0000 7fb3934dd640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c15a560 con 0x7fb38c1539d0 2024-01-15T11:33:30.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.115+0000 7fb391279640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb38c0b3490 0x7fb38c140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:30.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.115+0000 7fb391279640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb38c0b3490 0x7fb38c140d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55622/0 (socket says 172.21.15.27:55622) 2024-01-15T11:33:30.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.115+0000 7fb391279640 1 -- 172.21.15.27:0/1316872084 learned_addr learned my addr 172.21.15.27:0/1316872084 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:30.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.115+0000 7fb391a7a640 1 --2- 172.21.15.27:0/1316872084 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb38c15d760 0x7fb38c150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:30.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.115+0000 7fb390a78640 1 --2- 172.21.15.27:0/1316872084 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb38c1539d0 0x7fb38c159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:30.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.115+0000 7fb391279640 1 -- 172.21.15.27:0/1316872084 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb38c1539d0 msgr2=0x7fb38c159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:30.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.115+0000 7fb391279640 1 --2- 172.21.15.27:0/1316872084 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb38c1539d0 0x7fb38c159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.115+0000 7fb391279640 1 -- 172.21.15.27:0/1316872084 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb38c15d760 msgr2=0x7fb38c150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:30.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.115+0000 7fb391279640 1 --2- 172.21.15.27:0/1316872084 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb38c15d760 0x7fb38c150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.115+0000 7fb391279640 1 -- 172.21.15.27:0/1316872084 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb384009a70 con 0x7fb38c0b3490 2024-01-15T11:33:30.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.119+0000 7fb391279640 1 --2- 172.21.15.27:0/1316872084 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb38c0b3490 0x7fb38c140d60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb38800c750 tx=0x7fb38800cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:30.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.119+0000 7fb381ffb640 1 -- 172.21.15.27:0/1316872084 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388005ae0 con 0x7fb38c0b3490 2024-01-15T11:33:30.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.119+0000 7fb381ffb640 1 -- 172.21.15.27:0/1316872084 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38800ce90 con 0x7fb38c0b3490 2024-01-15T11:33:30.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.119+0000 7fb3934dd640 1 -- 172.21.15.27:0/1316872084 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb37c009420 con 0x7fb38c0b3490 2024-01-15T11:33:30.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.119+0000 7fb381ffb640 1 -- 172.21.15.27:0/1316872084 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388007070 con 0x7fb38c0b3490 2024-01-15T11:33:30.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.119+0000 7fb3934dd640 1 -- 172.21.15.27:0/1316872084 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb38c15ab20 con 0x7fb38c0b3490 2024-01-15T11:33:30.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.119+0000 7fb3934dd640 1 -- 172.21.15.27:0/1316872084 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb38c04e850 con 0x7fb38c0b3490 2024-01-15T11:33:30.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.119+0000 7fb381ffb640 1 -- 172.21.15.27:0/1316872084 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fb3880071d0 con 0x7fb38c0b3490 2024-01-15T11:33:30.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.119+0000 7fb381ffb640 1 --2- 172.21.15.27:0/1316872084 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb3700668f0 0x7fb370068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:30.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.119+0000 7fb381ffb640 1 -- 172.21.15.27:0/1316872084 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb388083970 con 0x7fb38c0b3490 2024-01-15T11:33:30.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.119+0000 7fb390a78640 1 --2- 172.21.15.27:0/1316872084 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb3700668f0 0x7fb370068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:30.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.123+0000 7fb390a78640 1 --2- 172.21.15.27:0/1316872084 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb3700668f0 0x7fb370068db0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0ad000 tx=0x7fb37c0a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:30.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.123+0000 7fb381ffb640 1 -- 172.21.15.27:0/1316872084 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb388050cd0 con 0x7fb38c0b3490 2024-01-15T11:33:30.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.315+0000 7fb3934dd640 1 -- 172.21.15.27:0/1316872084 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb38c1641c0 con 0x7fb38c0b3490 2024-01-15T11:33:30.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.315+0000 7fb381ffb640 1 -- 172.21.15.27:0/1316872084 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fb388017080 con 0x7fb38c0b3490 2024-01-15T11:33:30.320 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:30.320 INFO:teuthology.orchestra.run.smithi027.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-15T11:33:30.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.319+0000 7fb3934dd640 1 -- 172.21.15.27:0/1316872084 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb3700668f0 msgr2=0x7fb370068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:30.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.319+0000 7fb3934dd640 1 --2- 172.21.15.27:0/1316872084 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb3700668f0 0x7fb370068db0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0ad000 tx=0x7fb37c0a6000 comp rx=0 tx=0).stop 2024-01-15T11:33:30.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.319+0000 7fb3934dd640 1 -- 172.21.15.27:0/1316872084 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb38c0b3490 msgr2=0x7fb38c140d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:30.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.319+0000 7fb3934dd640 1 --2- 172.21.15.27:0/1316872084 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb38c0b3490 0x7fb38c140d60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb38800c750 tx=0x7fb38800cb50 comp rx=0 tx=0).stop 2024-01-15T11:33:30.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.319+0000 7fb3934dd640 1 -- 172.21.15.27:0/1316872084 shutdown_connections 2024-01-15T11:33:30.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.319+0000 7fb3934dd640 1 --2- 172.21.15.27:0/1316872084 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb3700668f0 0x7fb370068db0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.319+0000 7fb3934dd640 1 --2- 172.21.15.27:0/1316872084 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb38c15d760 0x7fb38c150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.319+0000 7fb3934dd640 1 --2- 172.21.15.27:0/1316872084 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb38c1539d0 0x7fb38c159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.319+0000 7fb3934dd640 1 --2- 172.21.15.27:0/1316872084 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb38c0b3490 0x7fb38c140d60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.319+0000 7fb3934dd640 1 -- 172.21.15.27:0/1316872084 >> 172.21.15.27:0/1316872084 conn(0x7fb38c06a5b0 msgr2=0x7fb38c0b08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:30.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.319+0000 7fb3934dd640 1 -- 172.21.15.27:0/1316872084 shutdown_connections 2024-01-15T11:33:30.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.319+0000 7fb3934dd640 1 -- 172.21.15.27:0/1316872084 wait complete. 2024-01-15T11:33:30.341 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-01-15T11:33:30.342 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:33:30.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.483+0000 7fba30fc1640 1 Processor -- start 2024-01-15T11:33:30.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.483+0000 7fba30fc1640 1 -- start start 2024-01-15T11:33:30.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.483+0000 7fba30fc1640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fba2c15d7b0 0x7fba2c0d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:30.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.483+0000 7fba30fc1640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fba2c0cead0 0x7fba2c0d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:30.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.483+0000 7fba30fc1640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fba2c0d1eb0 0x7fba2c0cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:30.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.483+0000 7fba30fc1640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba2c0d2340 con 0x7fba2c0cead0 2024-01-15T11:33:30.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.483+0000 7fba30fc1640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba2c0cefd0 con 0x7fba2c0d1eb0 2024-01-15T11:33:30.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.483+0000 7fba30fc1640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c0cf2b0 con 0x7fba2c15d7b0 2024-01-15T11:33:30.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.483+0000 7fba23fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fba2c0cead0 0x7fba2c0d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:30.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.483+0000 7fba23fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fba2c0cead0 0x7fba2c0d1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55634/0 (socket says 172.21.15.27:55634) 2024-01-15T11:33:30.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.483+0000 7fba23fff640 1 -- 172.21.15.27:0/2763422186 learned_addr learned my addr 172.21.15.27:0/2763422186 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:30.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.483+0000 7fba23fff640 1 -- 172.21.15.27:0/2763422186 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fba2c15d7b0 msgr2=0x7fba2c0d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:30.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.483+0000 7fba2ad9d640 1 --2- 172.21.15.27:0/2763422186 >> v2:172.21.15.93:3300/0 conn(0x7fba2c0d1eb0 0x7fba2c0cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:30.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.483+0000 7fba2a59c640 1 --2- 172.21.15.27:0/2763422186 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fba2c15d7b0 0x7fba2c0d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:30.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.483+0000 7fba23fff640 1 --2- 172.21.15.27:0/2763422186 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fba2c15d7b0 0x7fba2c0d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.483+0000 7fba23fff640 1 -- 172.21.15.27:0/2763422186 >> v2:172.21.15.93:3300/0 conn(0x7fba2c0d1eb0 msgr2=0x7fba2c0cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:30.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.483+0000 7fba23fff640 1 --2- 172.21.15.27:0/2763422186 >> v2:172.21.15.93:3300/0 conn(0x7fba2c0d1eb0 0x7fba2c0cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.483+0000 7fba23fff640 1 -- 172.21.15.27:0/2763422186 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2c06b3f0 con 0x7fba2c0cead0 2024-01-15T11:33:30.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.483+0000 7fba2ad9d640 1 --2- 172.21.15.27:0/2763422186 >> v2:172.21.15.93:3300/0 conn(0x7fba2c0d1eb0 0x7fba2c0cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:33:30.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.483+0000 7fba2a59c640 1 --2- 172.21.15.27:0/2763422186 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fba2c15d7b0 0x7fba2c0d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:33:30.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.487+0000 7fba23fff640 1 --2- 172.21.15.27:0/2763422186 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba2c0cead0 0x7fba2c0d1970 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fba2c08c870 tx=0x7fba1401c0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c710c7e2a1260ba7 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:30.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.487+0000 7fba29d9b640 1 -- 172.21.15.27:0/2763422186 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba140ab600 con 0x7fba2c0cead0 2024-01-15T11:33:30.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.487+0000 7fba29d9b640 1 -- 172.21.15.27:0/2763422186 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba140a7050 con 0x7fba2c0cead0 2024-01-15T11:33:30.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.487+0000 7fba29d9b640 1 -- 172.21.15.27:0/2763422186 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba140ab980 con 0x7fba2c0cead0 2024-01-15T11:33:30.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.487+0000 7fba30fc1640 1 -- 172.21.15.27:0/2763422186 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba2c0cead0 msgr2=0x7fba2c0d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:30.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.487+0000 7fba30fc1640 1 --2- 172.21.15.27:0/2763422186 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba2c0cead0 0x7fba2c0d1970 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fba2c08c870 tx=0x7fba1401c0f0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.487+0000 7fba30fc1640 1 -- 172.21.15.27:0/2763422186 shutdown_connections 2024-01-15T11:33:30.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.487+0000 7fba30fc1640 1 --2- 172.21.15.27:0/2763422186 >> v2:172.21.15.93:3300/0 conn(0x7fba2c0d1eb0 0x7fba2c0cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.487+0000 7fba30fc1640 1 --2- 172.21.15.27:0/2763422186 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba2c0cead0 0x7fba2c0d1970 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.487+0000 7fba30fc1640 1 --2- 172.21.15.27:0/2763422186 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fba2c15d7b0 0x7fba2c0d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.487+0000 7fba30fc1640 1 -- 172.21.15.27:0/2763422186 >> 172.21.15.27:0/2763422186 conn(0x7fba2c0d33b0 msgr2=0x7fba2c0d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:30.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.487+0000 7fba30fc1640 1 -- 172.21.15.27:0/2763422186 shutdown_connections 2024-01-15T11:33:30.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.487+0000 7fba30fc1640 1 -- 172.21.15.27:0/2763422186 wait complete. 2024-01-15T11:33:30.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.491+0000 7fba30fc1640 1 Processor -- start 2024-01-15T11:33:30.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.491+0000 7fba30fc1640 1 -- start start 2024-01-15T11:33:30.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.491+0000 7fba30fc1640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fba2c0cead0 0x7fba2c0cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:30.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.491+0000 7fba30fc1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fba2c0d1eb0 0x7fba2c155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:30.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.491+0000 7fba30fc1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba2c15d7b0 0x7fba2c0b82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:30.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.491+0000 7fba30fc1640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c0cc770 con 0x7fba2c15d7b0 2024-01-15T11:33:30.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.491+0000 7fba30fc1640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c156340 con 0x7fba2c0d1eb0 2024-01-15T11:33:30.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.491+0000 7fba30fc1640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c0cb4a0 con 0x7fba2c0cead0 2024-01-15T11:33:30.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.491+0000 7fba2ad9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba2c15d7b0 0x7fba2c0b82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:30.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.491+0000 7fba2ad9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba2c15d7b0 0x7fba2c0b82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55648/0 (socket says 172.21.15.27:55648) 2024-01-15T11:33:30.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.491+0000 7fba2ad9d640 1 -- 172.21.15.27:0/3966851328 learned_addr learned my addr 172.21.15.27:0/3966851328 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:30.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.491+0000 7fba2a59c640 1 --2- 172.21.15.27:0/3966851328 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fba2c0cead0 0x7fba2c0cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:30.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.491+0000 7fba23fff640 1 --2- 172.21.15.27:0/3966851328 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fba2c0d1eb0 0x7fba2c155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:30.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.491+0000 7fba2ad9d640 1 -- 172.21.15.27:0/3966851328 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fba2c0cead0 msgr2=0x7fba2c0cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:30.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.491+0000 7fba2ad9d640 1 --2- 172.21.15.27:0/3966851328 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fba2c0cead0 0x7fba2c0cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.491+0000 7fba2ad9d640 1 -- 172.21.15.27:0/3966851328 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fba2c0d1eb0 msgr2=0x7fba2c155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:30.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.491+0000 7fba2ad9d640 1 --2- 172.21.15.27:0/3966851328 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fba2c0d1eb0 0x7fba2c155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.491+0000 7fba2ad9d640 1 -- 172.21.15.27:0/3966851328 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba140094d0 con 0x7fba2c15d7b0 2024-01-15T11:33:30.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.491+0000 7fba2ad9d640 1 --2- 172.21.15.27:0/3966851328 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba2c15d7b0 0x7fba2c0b82b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fba2400ce70 tx=0x7fba2400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:30.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.491+0000 7fba22ffd640 1 -- 172.21.15.27:0/3966851328 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2400d840 con 0x7fba2c15d7b0 2024-01-15T11:33:30.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.491+0000 7fba22ffd640 1 -- 172.21.15.27:0/3966851328 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2400d9a0 con 0x7fba2c15d7b0 2024-01-15T11:33:30.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.491+0000 7fba22ffd640 1 -- 172.21.15.27:0/3966851328 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2400dd50 con 0x7fba2c15d7b0 2024-01-15T11:33:30.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.491+0000 7fba30fc1640 1 -- 172.21.15.27:0/3966851328 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba2c15b100 con 0x7fba2c15d7b0 2024-01-15T11:33:30.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.491+0000 7fba30fc1640 1 -- 172.21.15.27:0/3966851328 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2c0caee0 con 0x7fba2c15d7b0 2024-01-15T11:33:30.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.491+0000 7fba30fc1640 1 -- 172.21.15.27:0/3966851328 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba2c04e850 con 0x7fba2c15d7b0 2024-01-15T11:33:30.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.495+0000 7fba22ffd640 1 -- 172.21.15.27:0/3966851328 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fba2401e3b0 con 0x7fba2c15d7b0 2024-01-15T11:33:30.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.495+0000 7fba22ffd640 1 --2- 172.21.15.27:0/3966851328 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fba0c0668f0 0x7fba0c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:30.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.495+0000 7fba22ffd640 1 -- 172.21.15.27:0/3966851328 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba24084d70 con 0x7fba2c15d7b0 2024-01-15T11:33:30.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.495+0000 7fba2a59c640 1 --2- 172.21.15.27:0/3966851328 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fba0c0668f0 0x7fba0c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:30.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.495+0000 7fba2a59c640 1 --2- 172.21.15.27:0/3966851328 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fba0c0668f0 0x7fba0c068db0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fba1c006fd0 tx=0x7fba1c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:30.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.499+0000 7fba22ffd640 1 -- 172.21.15.27:0/3966851328 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fba24052050 con 0x7fba2c15d7b0 2024-01-15T11:33:30.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.659+0000 7fba30fc1640 1 -- 172.21.15.27:0/3966851328 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba2c0d18c0 con 0x7fba2c15d7b0 2024-01-15T11:33:30.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.659+0000 7fba22ffd640 1 -- 172.21.15.27:0/3966851328 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16425 (secure 0 0 0) 0x7fba2401a020 con 0x7fba2c15d7b0 2024-01-15T11:33:30.664 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:30.664 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:33:21.682894+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T11:33:18.397200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T11:33:19.061383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:33:30.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.663+0000 7fba30fc1640 1 -- 172.21.15.27:0/3966851328 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fba0c0668f0 msgr2=0x7fba0c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:30.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.663+0000 7fba30fc1640 1 --2- 172.21.15.27:0/3966851328 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fba0c0668f0 0x7fba0c068db0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fba1c006fd0 tx=0x7fba1c008040 comp rx=0 tx=0).stop 2024-01-15T11:33:30.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.663+0000 7fba30fc1640 1 -- 172.21.15.27:0/3966851328 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba2c15d7b0 msgr2=0x7fba2c0b82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:30.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.663+0000 7fba30fc1640 1 --2- 172.21.15.27:0/3966851328 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba2c15d7b0 0x7fba2c0b82b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fba2400ce70 tx=0x7fba2400a710 comp rx=0 tx=0).stop 2024-01-15T11:33:30.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.663+0000 7fba30fc1640 1 -- 172.21.15.27:0/3966851328 shutdown_connections 2024-01-15T11:33:30.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.663+0000 7fba30fc1640 1 --2- 172.21.15.27:0/3966851328 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fba2c15d7b0 0x7fba2c0b82b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.663+0000 7fba30fc1640 1 --2- 172.21.15.27:0/3966851328 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fba0c0668f0 0x7fba0c068db0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.663+0000 7fba30fc1640 1 --2- 172.21.15.27:0/3966851328 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fba2c0d1eb0 0x7fba2c155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.663+0000 7fba30fc1640 1 --2- 172.21.15.27:0/3966851328 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fba2c0cead0 0x7fba2c0cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.663+0000 7fba30fc1640 1 -- 172.21.15.27:0/3966851328 >> 172.21.15.27:0/3966851328 conn(0x7fba2c0d33b0 msgr2=0x7fba2c0b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:30.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.663+0000 7fba30fc1640 1 -- 172.21.15.27:0/3966851328 shutdown_connections 2024-01-15T11:33:30.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.663+0000 7fba30fc1640 1 -- 172.21.15.27:0/3966851328 wait complete. 2024-01-15T11:33:30.685 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T11:33:08.134662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-15T11:33:18.397200+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-15T11:33:19.061383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T11:33:30.686 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T11:33:30.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.827+0000 7f4a5f12a640 1 Processor -- start 2024-01-15T11:33:30.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.827+0000 7f4a5f12a640 1 -- start start 2024-01-15T11:33:30.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.831+0000 7f4a5f12a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4a580b5830 0x7f4a5815e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:30.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.831+0000 7f4a5f12a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4a580acd70 0x7f4a580ad1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:30.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.831+0000 7f4a5f12a640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a580af630 con 0x7f4a580ad710 2024-01-15T11:33:30.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.831+0000 7f4a5f12a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a580acb10 con 0x7f4a580b5830 2024-01-15T11:33:30.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.831+0000 7f4a5f12a640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a580ae5b0 con 0x7f4a580acd70 2024-01-15T11:33:30.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.831+0000 7f4a5cec6640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4a580b5830 0x7f4a5815e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:30.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.831+0000 7f4a5d6c7640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f4a580ad710 0x7f4a58161200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44074/0 (socket says 172.21.15.27:44074) 2024-01-15T11:33:30.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.831+0000 7f4a5d6c7640 1 -- 172.21.15.27:0/894575790 learned_addr learned my addr 172.21.15.27:0/894575790 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:30.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.831+0000 7f4a57fff640 1 --2- 172.21.15.27:0/894575790 >> v2:172.21.15.93:3300/0 conn(0x7f4a580acd70 0x7f4a580ad1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:30.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.831+0000 7f4a5cec6640 1 -- 172.21.15.27:0/894575790 >> v2:172.21.15.93:3300/0 conn(0x7f4a580acd70 msgr2=0x7f4a580ad1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:30.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.831+0000 7f4a5cec6640 1 --2- 172.21.15.27:0/894575790 >> v2:172.21.15.93:3300/0 conn(0x7f4a580acd70 0x7f4a580ad1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.831+0000 7f4a5cec6640 1 -- 172.21.15.27:0/894575790 >> v1:172.21.15.27:6789/0 conn(0x7f4a580ad710 legacy=0x7f4a58161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:30.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.831+0000 7f4a5cec6640 1 -- 172.21.15.27:0/894575790 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a580ae870 con 0x7f4a580b5830 2024-01-15T11:33:30.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.835+0000 7f4a5cec6640 1 --2- 172.21.15.27:0/894575790 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a580b5830 0x7f4a5815e690 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4a58070570 tx=0x7f4a4c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5791ff6185e4171b server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:30.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.835+0000 7f4a577fe640 1 -- 172.21.15.27:0/894575790 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c0a58f0 con 0x7f4a580b5830 2024-01-15T11:33:30.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.835+0000 7f4a577fe640 1 -- 172.21.15.27:0/894575790 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4c0a5a50 con 0x7f4a580b5830 2024-01-15T11:33:30.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.835+0000 7f4a577fe640 1 -- 172.21.15.27:0/894575790 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c0a5de0 con 0x7f4a580b5830 2024-01-15T11:33:30.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.835+0000 7f4a5f12a640 1 -- 172.21.15.27:0/894575790 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a580b5830 msgr2=0x7f4a5815e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:30.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.835+0000 7f4a5f12a640 1 --2- 172.21.15.27:0/894575790 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a580b5830 0x7f4a5815e690 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4a58070570 tx=0x7f4a4c01c910 comp rx=0 tx=0).stop 2024-01-15T11:33:30.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.835+0000 7f4a5f12a640 1 -- 172.21.15.27:0/894575790 shutdown_connections 2024-01-15T11:33:30.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.835+0000 7f4a5f12a640 1 --2- 172.21.15.27:0/894575790 >> v2:172.21.15.93:3300/0 conn(0x7f4a580acd70 0x7f4a580ad1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.835+0000 7f4a5f12a640 1 --2- 172.21.15.27:0/894575790 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a580b5830 0x7f4a5815e690 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.835+0000 7f4a5f12a640 1 -- 172.21.15.27:0/894575790 >> 172.21.15.27:0/894575790 conn(0x7f4a58071d80 msgr2=0x7f4a5806a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:30.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.835+0000 7f4a5f12a640 1 -- 172.21.15.27:0/894575790 shutdown_connections 2024-01-15T11:33:30.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.835+0000 7f4a5f12a640 1 -- 172.21.15.27:0/894575790 wait complete. 2024-01-15T11:33:30.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.835+0000 7f4a5f12a640 1 Processor -- start 2024-01-15T11:33:30.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.835+0000 7f4a5f12a640 1 -- start start 2024-01-15T11:33:30.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.839+0000 7f4a5f12a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4a580acd70 0x7f4a581553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:30.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.839+0000 7f4a5f12a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a580ad710 0x7f4a580cf170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:30.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.839+0000 7f4a5f12a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4a580b5830 0x7f4a5814f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:30.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.839+0000 7f4a5f12a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5815cea0 con 0x7f4a580ad710 2024-01-15T11:33:30.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.839+0000 7f4a5f12a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a58145da0 con 0x7f4a580acd70 2024-01-15T11:33:30.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.839+0000 7f4a5f12a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a58155900 con 0x7f4a580b5830 2024-01-15T11:33:30.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.839+0000 7f4a57fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a580ad710 0x7f4a580cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:30.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.839+0000 7f4a57fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a580ad710 0x7f4a580cf170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55666/0 (socket says 172.21.15.27:55666) 2024-01-15T11:33:30.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.839+0000 7f4a57fff640 1 -- 172.21.15.27:0/1496251826 learned_addr learned my addr 172.21.15.27:0/1496251826 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:30.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.839+0000 7f4a5cec6640 1 --2- 172.21.15.27:0/1496251826 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4a580acd70 0x7f4a581553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:30.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.839+0000 7f4a5d6c7640 1 --2- 172.21.15.27:0/1496251826 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4a580b5830 0x7f4a5814f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:30.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.839+0000 7f4a57fff640 1 -- 172.21.15.27:0/1496251826 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4a580b5830 msgr2=0x7f4a5814f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:30.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.839+0000 7f4a57fff640 1 --2- 172.21.15.27:0/1496251826 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4a580b5830 0x7f4a5814f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.839+0000 7f4a57fff640 1 -- 172.21.15.27:0/1496251826 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4a580acd70 msgr2=0x7f4a581553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:30.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.839+0000 7f4a57fff640 1 --2- 172.21.15.27:0/1496251826 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4a580acd70 0x7f4a581553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:30.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.839+0000 7f4a57fff640 1 -- 172.21.15.27:0/1496251826 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c009a70 con 0x7f4a580ad710 2024-01-15T11:33:30.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.839+0000 7f4a57fff640 1 --2- 172.21.15.27:0/1496251826 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a580ad710 0x7f4a580cf170 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4a4400e870 tx=0x7f4a4400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:30.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.839+0000 7f4a557fa640 1 -- 172.21.15.27:0/1496251826 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a44009510 con 0x7f4a580ad710 2024-01-15T11:33:30.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.839+0000 7f4a557fa640 1 -- 172.21.15.27:0/1496251826 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4400eec0 con 0x7f4a580ad710 2024-01-15T11:33:30.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.839+0000 7f4a5f12a640 1 -- 172.21.15.27:0/1496251826 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a581539a0 con 0x7f4a580ad710 2024-01-15T11:33:30.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.839+0000 7f4a557fa640 1 -- 172.21.15.27:0/1496251826 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4400cb40 con 0x7f4a580ad710 2024-01-15T11:33:30.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.839+0000 7f4a5f12a640 1 -- 172.21.15.27:0/1496251826 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5815d080 con 0x7f4a580ad710 2024-01-15T11:33:30.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.839+0000 7f4a5f12a640 1 -- 172.21.15.27:0/1496251826 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a58066ae0 con 0x7f4a580ad710 2024-01-15T11:33:30.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.843+0000 7f4a557fa640 1 -- 172.21.15.27:0/1496251826 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f4a4400cca0 con 0x7f4a580ad710 2024-01-15T11:33:30.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.843+0000 7f4a557fa640 1 --2- 172.21.15.27:0/1496251826 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4a3c0668f0 0x7f4a3c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:30.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.843+0000 7f4a557fa640 1 -- 172.21.15.27:0/1496251826 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a440844d0 con 0x7f4a580ad710 2024-01-15T11:33:30.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.843+0000 7f4a5cec6640 1 --2- 172.21.15.27:0/1496251826 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4a3c0668f0 0x7f4a3c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:30.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.843+0000 7f4a5cec6640 1 --2- 172.21.15.27:0/1496251826 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4a3c0668f0 0x7f4a3c068db0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c0af000 tx=0x7f4a4c0a7070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:30.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:30.847+0000 7f4a557fa640 1 -- 172.21.15.27:0/1496251826 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4a58066ae0 con 0x7f4a580ad710 2024-01-15T11:33:31.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.003+0000 7f4a5f12a640 1 -- 172.21.15.27:0/1496251826 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4a58066ae0 con 0x7f4a580ad710 2024-01-15T11:33:31.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.003+0000 7f4a557fa640 1 -- 172.21.15.27:0/1496251826 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4a58066ae0 con 0x7f4a580ad710 2024-01-15T11:33:31.009 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-15T11:33:31.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.007+0000 7f4a5f12a640 1 -- 172.21.15.27:0/1496251826 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4a3c0668f0 msgr2=0x7f4a3c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:31.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.007+0000 7f4a5f12a640 1 --2- 172.21.15.27:0/1496251826 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4a3c0668f0 0x7f4a3c068db0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c0af000 tx=0x7f4a4c0a7070 comp rx=0 tx=0).stop 2024-01-15T11:33:31.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.007+0000 7f4a5f12a640 1 -- 172.21.15.27:0/1496251826 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a580ad710 msgr2=0x7f4a580cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:31.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.007+0000 7f4a5f12a640 1 --2- 172.21.15.27:0/1496251826 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a580ad710 0x7f4a580cf170 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4a4400e870 tx=0x7f4a4400ec70 comp rx=0 tx=0).stop 2024-01-15T11:33:31.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.007+0000 7f4a5f12a640 1 -- 172.21.15.27:0/1496251826 shutdown_connections 2024-01-15T11:33:31.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.007+0000 7f4a5f12a640 1 --2- 172.21.15.27:0/1496251826 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4a580b5830 0x7f4a5814f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:31.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.007+0000 7f4a5f12a640 1 --2- 172.21.15.27:0/1496251826 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4a580ad710 0x7f4a580cf170 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:31.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.007+0000 7f4a5f12a640 1 --2- 172.21.15.27:0/1496251826 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4a3c0668f0 0x7f4a3c068db0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:31.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.007+0000 7f4a5f12a640 1 --2- 172.21.15.27:0/1496251826 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4a580acd70 0x7f4a581553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:31.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.007+0000 7f4a5f12a640 1 -- 172.21.15.27:0/1496251826 >> 172.21.15.27:0/1496251826 conn(0x7f4a58071d80 msgr2=0x7f4a581605b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:31.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.007+0000 7f4a5f12a640 1 -- 172.21.15.27:0/1496251826 shutdown_connections 2024-01-15T11:33:31.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.007+0000 7f4a5f12a640 1 -- 172.21.15.27:0/1496251826 wait complete. 2024-01-15T11:33:31.030 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-15T11:33:31.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.171+0000 7eff6db2a640 1 Processor -- start 2024-01-15T11:33:31.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.171+0000 7eff6db2a640 1 -- start start 2024-01-15T11:33:31.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.175+0000 7eff6db2a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7eff680cb9b0 0x7eff6806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:31.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.175+0000 7eff6db2a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7eff680ce5d0 0x7eff6815bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:31.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.175+0000 7eff6db2a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff68159630 con 0x7eff680cbd90 2024-01-15T11:33:31.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.175+0000 7eff6db2a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6815bba0 con 0x7eff680ce5d0 2024-01-15T11:33:31.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.175+0000 7eff6db2a640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff680cdd50 con 0x7eff680cb9b0 2024-01-15T11:33:31.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.175+0000 7eff67fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7eff680ce5d0 0x7eff6815bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:31.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.175+0000 7eff67fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7eff680ce5d0 0x7eff6815bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55672/0 (socket says 172.21.15.27:55672) 2024-01-15T11:33:31.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.175+0000 7eff67fff640 1 -- 172.21.15.27:0/3604384377 learned_addr learned my addr 172.21.15.27:0/3604384377 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:31.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.175+0000 7eff677fe640 1 --2- 172.21.15.27:0/3604384377 >> v2:172.21.15.93:3300/0 conn(0x7eff680cb9b0 0x7eff6806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:31.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.175+0000 7eff67fff640 1 -- 172.21.15.27:0/3604384377 >> v2:172.21.15.93:3300/0 conn(0x7eff680cb9b0 msgr2=0x7eff6806e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:31.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.175+0000 7eff67fff640 1 --2- 172.21.15.27:0/3604384377 >> v2:172.21.15.93:3300/0 conn(0x7eff680cb9b0 0x7eff6806e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:31.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.175+0000 7eff67fff640 1 -- 172.21.15.27:0/3604384377 >> v1:172.21.15.93:6789/0 conn(0x7eff680cbd90 legacy=0x7eff6815f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:31.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.175+0000 7eff67fff640 1 -- 172.21.15.27:0/3604384377 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff680cd1d0 con 0x7eff680ce5d0 2024-01-15T11:33:31.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.179+0000 7eff67fff640 1 --2- 172.21.15.27:0/3604384377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff680ce5d0 0x7eff6815bfd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7eff6806c360 tx=0x7eff6001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d949aa31816bdc2 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:31.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.179+0000 7eff667fc640 1 -- 172.21.15.27:0/3604384377 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff600a5840 con 0x7eff680ce5d0 2024-01-15T11:33:31.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.179+0000 7eff667fc640 1 -- 172.21.15.27:0/3604384377 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff600a59a0 con 0x7eff680ce5d0 2024-01-15T11:33:31.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.179+0000 7eff667fc640 1 -- 172.21.15.27:0/3604384377 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff600a5d30 con 0x7eff680ce5d0 2024-01-15T11:33:31.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.179+0000 7eff6db2a640 1 -- 172.21.15.27:0/3604384377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff680ce5d0 msgr2=0x7eff6815bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:31.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.179+0000 7eff6db2a640 1 --2- 172.21.15.27:0/3604384377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff680ce5d0 0x7eff6815bfd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7eff6806c360 tx=0x7eff6001c9a0 comp rx=0 tx=0).stop 2024-01-15T11:33:31.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.179+0000 7eff6db2a640 1 -- 172.21.15.27:0/3604384377 shutdown_connections 2024-01-15T11:33:31.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.179+0000 7eff6db2a640 1 --2- 172.21.15.27:0/3604384377 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff680ce5d0 0x7eff6815bfd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:31.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.179+0000 7eff6db2a640 1 --2- 172.21.15.27:0/3604384377 >> v2:172.21.15.93:3300/0 conn(0x7eff680cb9b0 0x7eff6806e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:31.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.179+0000 7eff6db2a640 1 -- 172.21.15.27:0/3604384377 >> 172.21.15.27:0/3604384377 conn(0x7eff680b0cb0 msgr2=0x7eff680b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:31.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.179+0000 7eff6db2a640 1 -- 172.21.15.27:0/3604384377 shutdown_connections 2024-01-15T11:33:31.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.179+0000 7eff6db2a640 1 -- 172.21.15.27:0/3604384377 wait complete. 2024-01-15T11:33:31.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.179+0000 7eff6db2a640 1 Processor -- start 2024-01-15T11:33:31.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.179+0000 7eff6db2a640 1 -- start start 2024-01-15T11:33:31.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.183+0000 7eff6db2a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff680cb9b0 0x7eff681538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:31.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.183+0000 7eff6db2a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff680cbd90 0x7eff680af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:31.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.183+0000 7eff6db2a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7eff680ce5d0 0x7eff6815a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:31.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.183+0000 7eff6db2a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff680aff30 con 0x7eff680cbd90 2024-01-15T11:33:31.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.183+0000 7eff6db2a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff680b01d0 con 0x7eff680cb9b0 2024-01-15T11:33:31.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.183+0000 7eff6db2a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff68154f70 con 0x7eff680ce5d0 2024-01-15T11:33:31.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.183+0000 7eff66ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff680cbd90 0x7eff680af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:31.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.183+0000 7eff66ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff680cbd90 0x7eff680af9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55686/0 (socket says 172.21.15.27:55686) 2024-01-15T11:33:31.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.183+0000 7eff66ffd640 1 -- 172.21.15.27:0/972781175 learned_addr learned my addr 172.21.15.27:0/972781175 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:31.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.183+0000 7eff677fe640 1 --2- 172.21.15.27:0/972781175 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff680cb9b0 0x7eff681538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:31.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.183+0000 7eff67fff640 1 --2- 172.21.15.27:0/972781175 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7eff680ce5d0 0x7eff6815a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:31.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.183+0000 7eff66ffd640 1 -- 172.21.15.27:0/972781175 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7eff680ce5d0 msgr2=0x7eff6815a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:31.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.183+0000 7eff66ffd640 1 --2- 172.21.15.27:0/972781175 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7eff680ce5d0 0x7eff6815a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:31.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.183+0000 7eff66ffd640 1 -- 172.21.15.27:0/972781175 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff680cb9b0 msgr2=0x7eff681538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:31.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.183+0000 7eff66ffd640 1 --2- 172.21.15.27:0/972781175 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff680cb9b0 0x7eff681538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:31.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.183+0000 7eff66ffd640 1 -- 172.21.15.27:0/972781175 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff60009b30 con 0x7eff680cbd90 2024-01-15T11:33:31.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.183+0000 7eff66ffd640 1 --2- 172.21.15.27:0/972781175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff680cbd90 0x7eff680af9f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00c500 tx=0x7eff5c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:31.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.183+0000 7eff4ffff640 1 -- 172.21.15.27:0/972781175 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c005220 con 0x7eff680cbd90 2024-01-15T11:33:31.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.183+0000 7eff4ffff640 1 -- 172.21.15.27:0/972781175 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c005380 con 0x7eff680cbd90 2024-01-15T11:33:31.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.183+0000 7eff6db2a640 1 -- 172.21.15.27:0/972781175 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff68155250 con 0x7eff680cbd90 2024-01-15T11:33:31.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.183+0000 7eff4ffff640 1 -- 172.21.15.27:0/972781175 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c007270 con 0x7eff680cbd90 2024-01-15T11:33:31.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.183+0000 7eff6db2a640 1 -- 172.21.15.27:0/972781175 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff68155810 con 0x7eff680cbd90 2024-01-15T11:33:31.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.183+0000 7eff6db2a640 1 -- 172.21.15.27:0/972781175 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff680671f0 con 0x7eff680cbd90 2024-01-15T11:33:31.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.183+0000 7eff4ffff640 1 -- 172.21.15.27:0/972781175 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7eff5c0073d0 con 0x7eff680cbd90 2024-01-15T11:33:31.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.187+0000 7eff4ffff640 1 --2- 172.21.15.27:0/972781175 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7eff540668f0 0x7eff54068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:31.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.187+0000 7eff4ffff640 1 -- 172.21.15.27:0/972781175 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff5c083c20 con 0x7eff680cbd90 2024-01-15T11:33:31.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.187+0000 7eff677fe640 1 --2- 172.21.15.27:0/972781175 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7eff540668f0 0x7eff54068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:31.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.187+0000 7eff677fe640 1 --2- 172.21.15.27:0/972781175 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7eff540668f0 0x7eff54068db0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7eff58007a60 tx=0x7eff58008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:31.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.191+0000 7eff4ffff640 1 -- 172.21.15.27:0/972781175 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7eff5c050e80 con 0x7eff680cbd90 2024-01-15T11:33:31.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.347+0000 7eff6db2a640 1 -- 172.21.15.27:0/972781175 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7eff6806b460 con 0x7eff680cbd90 2024-01-15T11:33:31.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.347+0000 7eff4ffff640 1 -- 172.21.15.27:0/972781175 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7eff5c0544a0 con 0x7eff680cbd90 2024-01-15T11:33:31.351 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-01-15T11:33:31.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.347+0000 7eff6db2a640 1 -- 172.21.15.27:0/972781175 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7eff540668f0 msgr2=0x7eff54068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:31.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.347+0000 7eff6db2a640 1 --2- 172.21.15.27:0/972781175 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7eff540668f0 0x7eff54068db0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7eff58007a60 tx=0x7eff58008040 comp rx=0 tx=0).stop 2024-01-15T11:33:31.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.347+0000 7eff6db2a640 1 -- 172.21.15.27:0/972781175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff680cbd90 msgr2=0x7eff680af9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:31.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.347+0000 7eff6db2a640 1 --2- 172.21.15.27:0/972781175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff680cbd90 0x7eff680af9f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00c500 tx=0x7eff5c00c9c0 comp rx=0 tx=0).stop 2024-01-15T11:33:31.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.347+0000 7eff6db2a640 1 -- 172.21.15.27:0/972781175 shutdown_connections 2024-01-15T11:33:31.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.347+0000 7eff6db2a640 1 --2- 172.21.15.27:0/972781175 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7eff680ce5d0 0x7eff6815a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:31.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.347+0000 7eff6db2a640 1 --2- 172.21.15.27:0/972781175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff680cbd90 0x7eff680af9f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:31.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.347+0000 7eff6db2a640 1 --2- 172.21.15.27:0/972781175 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7eff540668f0 0x7eff54068db0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:31.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.347+0000 7eff6db2a640 1 --2- 172.21.15.27:0/972781175 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7eff680cb9b0 0x7eff681538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:31.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.347+0000 7eff6db2a640 1 -- 172.21.15.27:0/972781175 >> 172.21.15.27:0/972781175 conn(0x7eff680b0cb0 msgr2=0x7eff680b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:31.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.351+0000 7eff6db2a640 1 -- 172.21.15.27:0/972781175 shutdown_connections 2024-01-15T11:33:31.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.351+0000 7eff6db2a640 1 -- 172.21.15.27:0/972781175 wait complete. 2024-01-15T11:33:31.372 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-15T11:33:31.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.515+0000 7f648c901640 1 Processor -- start 2024-01-15T11:33:31.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.515+0000 7f648c901640 1 -- start start 2024-01-15T11:33:31.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.515+0000 7f648c901640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f648815d8f0 0x7f648815e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:31.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.515+0000 7f648c901640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648815ecc0 con 0x7f64880ced30 2024-01-15T11:33:31.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.515+0000 7f648c901640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64880cdfb0 con 0x7f64880d0510 2024-01-15T11:33:31.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.515+0000 7f648c901640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64880d4420 con 0x7f648815d8f0 2024-01-15T11:33:31.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.515+0000 7f648659c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f648815d8f0 0x7f648815e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:31.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.515+0000 7f647ffff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f64880ced30 0x7f64880cfe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44082/0 (socket says 172.21.15.27:44082) 2024-01-15T11:33:31.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.515+0000 7f647ffff640 1 -- 172.21.15.27:0/1515677469 learned_addr learned my addr 172.21.15.27:0/1515677469 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:31.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.515+0000 7f6485d9b640 1 -- 172.21.15.27:0/1515677469 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2094666451 0 0) 0x7f648815ecc0 con 0x7f64880ced30 2024-01-15T11:33:31.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.515+0000 7f6485d9b640 1 -- 172.21.15.27:0/1515677469 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6474003530 con 0x7f64880ced30 2024-01-15T11:33:31.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.515+0000 7f6485d9b640 1 -- 172.21.15.27:0/1515677469 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1608282354 0 0) 0x7f64880cdfb0 con 0x7f64880d0510 2024-01-15T11:33:31.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.515+0000 7f6485d9b640 1 -- 172.21.15.27:0/1515677469 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f648815ecc0 con 0x7f64880d0510 2024-01-15T11:33:31.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.515+0000 7f648659c640 1 -- 172.21.15.27:0/1515677469 >> v1:172.21.15.93:6789/0 conn(0x7f64880d0510 legacy=0x7f64880d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:31.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.515+0000 7f648659c640 1 -- 172.21.15.27:0/1515677469 >> v1:172.21.15.27:6789/0 conn(0x7f64880ced30 legacy=0x7f64880cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:31.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.515+0000 7f648659c640 1 -- 172.21.15.27:0/1515677469 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64880d4140 con 0x7f648815d8f0 2024-01-15T11:33:31.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.519+0000 7f648659c640 1 --2- 172.21.15.27:0/1515677469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f648815d8f0 0x7f648815e780 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f64780097f0 tx=0x7f647801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5cec799dded4eca server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:31.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.519+0000 7f6485d9b640 1 -- 172.21.15.27:0/1515677469 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64780ab650 con 0x7f648815d8f0 2024-01-15T11:33:31.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.519+0000 7f6485d9b640 1 -- 172.21.15.27:0/1515677469 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64780ab7b0 con 0x7f648815d8f0 2024-01-15T11:33:31.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.519+0000 7f6485d9b640 1 -- 172.21.15.27:0/1515677469 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64780abb40 con 0x7f648815d8f0 2024-01-15T11:33:31.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.519+0000 7f648c901640 1 -- 172.21.15.27:0/1515677469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f648815d8f0 msgr2=0x7f648815e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:31.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.519+0000 7f648c901640 1 --2- 172.21.15.27:0/1515677469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f648815d8f0 0x7f648815e780 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f64780097f0 tx=0x7f647801c450 comp rx=0 tx=0).stop 2024-01-15T11:33:31.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.519+0000 7f648c901640 1 -- 172.21.15.27:0/1515677469 shutdown_connections 2024-01-15T11:33:31.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.519+0000 7f648c901640 1 --2- 172.21.15.27:0/1515677469 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f648815d8f0 0x7f648815e780 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:31.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.519+0000 7f648c901640 1 -- 172.21.15.27:0/1515677469 >> 172.21.15.27:0/1515677469 conn(0x7f648809c750 msgr2=0x7f64880d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:31.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.519+0000 7f648c901640 1 -- 172.21.15.27:0/1515677469 shutdown_connections 2024-01-15T11:33:31.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.519+0000 7f648c901640 1 -- 172.21.15.27:0/1515677469 wait complete. 2024-01-15T11:33:31.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.523+0000 7f648c901640 1 Processor -- start 2024-01-15T11:33:31.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.523+0000 7f648c901640 1 -- start start 2024-01-15T11:33:31.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.523+0000 7f648c901640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64880ced30 0x7f64880cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:31.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.523+0000 7f648c901640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64880d0510 0x7f64880ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:31.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.523+0000 7f648c901640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f648815d8f0 0x7f64880b7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:31.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.523+0000 7f648c901640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64880cad30 con 0x7f64880ced30 2024-01-15T11:33:31.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.523+0000 7f648c901640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64880cb010 con 0x7f648815d8f0 2024-01-15T11:33:31.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.523+0000 7f648c901640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64880cb2f0 con 0x7f64880d0510 2024-01-15T11:33:31.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.523+0000 7f648659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64880ced30 0x7f64880cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:31.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.523+0000 7f648659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64880ced30 0x7f64880cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55714/0 (socket says 172.21.15.27:55714) 2024-01-15T11:33:31.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.523+0000 7f648659c640 1 -- 172.21.15.27:0/2138547858 learned_addr learned my addr 172.21.15.27:0/2138547858 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:31.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.523+0000 7f6486d9d640 1 --2- 172.21.15.27:0/2138547858 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f648815d8f0 0x7f64880b7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:31.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.523+0000 7f647ffff640 1 --2- 172.21.15.27:0/2138547858 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64880d0510 0x7f64880ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:31.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.523+0000 7f648659c640 1 -- 172.21.15.27:0/2138547858 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64880d0510 msgr2=0x7f64880ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:31.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.523+0000 7f648659c640 1 --2- 172.21.15.27:0/2138547858 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64880d0510 0x7f64880ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:31.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.523+0000 7f648659c640 1 -- 172.21.15.27:0/2138547858 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f648815d8f0 msgr2=0x7f64880b7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:31.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.523+0000 7f648659c640 1 --2- 172.21.15.27:0/2138547858 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f648815d8f0 0x7f64880b7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:31.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.523+0000 7f648659c640 1 -- 172.21.15.27:0/2138547858 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6478009420 con 0x7f64880ced30 2024-01-15T11:33:31.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.523+0000 7f6486d9d640 1 --2- 172.21.15.27:0/2138547858 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f648815d8f0 0x7f64880b7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:31.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.523+0000 7f648659c640 1 --2- 172.21.15.27:0/2138547858 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64880ced30 0x7f64880cbdd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f64780ad040 tx=0x7f647801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:31.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.527+0000 7f647effd640 1 -- 172.21.15.27:0/2138547858 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64780bf610 con 0x7f64880ced30 2024-01-15T11:33:31.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.527+0000 7f647effd640 1 -- 172.21.15.27:0/2138547858 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64780bf790 con 0x7f64880ced30 2024-01-15T11:33:31.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.527+0000 7f647effd640 1 -- 172.21.15.27:0/2138547858 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64780bfb40 con 0x7f64880ced30 2024-01-15T11:33:31.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.527+0000 7f648c901640 1 -- 172.21.15.27:0/2138547858 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64880cb5d0 con 0x7f64880ced30 2024-01-15T11:33:31.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.527+0000 7f648c901640 1 -- 172.21.15.27:0/2138547858 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64880caa40 con 0x7f64880ced30 2024-01-15T11:33:31.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.527+0000 7f648c901640 1 -- 172.21.15.27:0/2138547858 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f648804e850 con 0x7f64880ced30 2024-01-15T11:33:31.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.527+0000 7f647effd640 1 -- 172.21.15.27:0/2138547858 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f64780b5400 con 0x7f64880ced30 2024-01-15T11:33:31.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.527+0000 7f647effd640 1 --2- 172.21.15.27:0/2138547858 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f64680668f0 0x7f6468068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:31.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.527+0000 7f647effd640 1 -- 172.21.15.27:0/2138547858 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f647811ef20 con 0x7f64880ced30 2024-01-15T11:33:31.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.527+0000 7f647ffff640 1 --2- 172.21.15.27:0/2138547858 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f64680668f0 0x7f6468068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:31.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.531+0000 7f647ffff640 1 --2- 172.21.15.27:0/2138547858 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f64680668f0 0x7f6468068db0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6488155c40 tx=0x7f6470009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:31.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.531+0000 7f647effd640 1 -- 172.21.15.27:0/2138547858 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f64780ec0d0 con 0x7f64880ced30 2024-01-15T11:33:31.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.691+0000 7f648c901640 1 -- 172.21.15.27:0/2138547858 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f64880cb430 con 0x7f64880ced30 2024-01-15T11:33:31.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.691+0000 7f647effd640 1 -- 172.21.15.27:0/2138547858 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f64880cb430 con 0x7f64880ced30 2024-01-15T11:33:31.693 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-01-15T11:33:31.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.691+0000 7f648c901640 1 -- 172.21.15.27:0/2138547858 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f64680668f0 msgr2=0x7f6468068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:31.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.691+0000 7f648c901640 1 --2- 172.21.15.27:0/2138547858 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f64680668f0 0x7f6468068db0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6488155c40 tx=0x7f6470009040 comp rx=0 tx=0).stop 2024-01-15T11:33:31.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.691+0000 7f648c901640 1 -- 172.21.15.27:0/2138547858 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64880ced30 msgr2=0x7f64880cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:31.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.691+0000 7f648c901640 1 --2- 172.21.15.27:0/2138547858 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64880ced30 0x7f64880cbdd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f64780ad040 tx=0x7f647801ac90 comp rx=0 tx=0).stop 2024-01-15T11:33:31.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.691+0000 7f648c901640 1 -- 172.21.15.27:0/2138547858 shutdown_connections 2024-01-15T11:33:31.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.691+0000 7f648c901640 1 --2- 172.21.15.27:0/2138547858 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f64680668f0 0x7f6468068db0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:31.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.691+0000 7f648c901640 1 --2- 172.21.15.27:0/2138547858 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f648815d8f0 0x7f64880b7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:31.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.691+0000 7f648c901640 1 --2- 172.21.15.27:0/2138547858 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64880d0510 0x7f64880ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:31.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.691+0000 7f648c901640 1 --2- 172.21.15.27:0/2138547858 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f64880ced30 0x7f64880cbdd0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:31.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.691+0000 7f648c901640 1 -- 172.21.15.27:0/2138547858 >> 172.21.15.27:0/2138547858 conn(0x7f648809c750 msgr2=0x7f648806c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:31.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.691+0000 7f648c901640 1 -- 172.21.15.27:0/2138547858 shutdown_connections 2024-01-15T11:33:31.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.691+0000 7f648c901640 1 -- 172.21.15.27:0/2138547858 wait complete. 2024-01-15T11:33:31.714 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-15T11:33:31.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.855+0000 7fd940205640 1 Processor -- start 2024-01-15T11:33:31.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.855+0000 7fd940205640 1 -- start start 2024-01-15T11:33:31.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.859+0000 7fd940205640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd938070730 0x7fd93806bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:31.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.859+0000 7fd940205640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd93815dba0 con 0x7fd938147040 2024-01-15T11:33:31.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.859+0000 7fd940205640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd93806c860 con 0x7fd938146c60 2024-01-15T11:33:31.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.859+0000 7fd940205640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd93806d100 con 0x7fd938070730 2024-01-15T11:33:31.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.859+0000 7fd93d7a0640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd938070730 0x7fd93806bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:31.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.859+0000 7fd93e7a2640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd938147040 0x7fd93806c050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44096/0 (socket says 172.21.15.27:44096) 2024-01-15T11:33:31.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.859+0000 7fd93e7a2640 1 -- 172.21.15.27:0/421565107 learned_addr learned my addr 172.21.15.27:0/421565107 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:31.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.859+0000 7fd93d7a0640 1 -- 172.21.15.27:0/421565107 >> v1:172.21.15.93:6789/0 conn(0x7fd938146c60 legacy=0x7fd938070020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:31.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.859+0000 7fd93d7a0640 1 -- 172.21.15.27:0/421565107 >> v1:172.21.15.27:6789/0 conn(0x7fd938147040 legacy=0x7fd93806c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:31.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.859+0000 7fd93d7a0640 1 -- 172.21.15.27:0/421565107 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93806cb40 con 0x7fd938070730 2024-01-15T11:33:31.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.863+0000 7fd93d7a0640 1 --2- 172.21.15.27:0/421565107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd938070730 0x7fd93806bb10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd9280097c0 tx=0x7fd92801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f562d6f902975cd1 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:31.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.863+0000 7fd93cf9f640 1 -- 172.21.15.27:0/421565107 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9280ab650 con 0x7fd938070730 2024-01-15T11:33:31.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.863+0000 7fd93cf9f640 1 -- 172.21.15.27:0/421565107 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9280ab7b0 con 0x7fd938070730 2024-01-15T11:33:31.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.863+0000 7fd93cf9f640 1 -- 172.21.15.27:0/421565107 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9280abb40 con 0x7fd938070730 2024-01-15T11:33:31.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.863+0000 7fd940205640 1 -- 172.21.15.27:0/421565107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd938070730 msgr2=0x7fd93806bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:31.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.863+0000 7fd940205640 1 --2- 172.21.15.27:0/421565107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd938070730 0x7fd93806bb10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd9280097c0 tx=0x7fd92801c450 comp rx=0 tx=0).stop 2024-01-15T11:33:31.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.863+0000 7fd940205640 1 -- 172.21.15.27:0/421565107 shutdown_connections 2024-01-15T11:33:31.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.863+0000 7fd940205640 1 --2- 172.21.15.27:0/421565107 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd938070730 0x7fd93806bb10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:31.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.863+0000 7fd940205640 1 -- 172.21.15.27:0/421565107 >> 172.21.15.27:0/421565107 conn(0x7fd9380b2ea0 msgr2=0x7fd9380b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:31.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.863+0000 7fd940205640 1 -- 172.21.15.27:0/421565107 shutdown_connections 2024-01-15T11:33:31.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.863+0000 7fd940205640 1 -- 172.21.15.27:0/421565107 wait complete. 2024-01-15T11:33:31.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.863+0000 7fd940205640 1 Processor -- start 2024-01-15T11:33:31.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.863+0000 7fd940205640 1 -- start start 2024-01-15T11:33:31.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.867+0000 7fd940205640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd938070730 0x7fd93815ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:31.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.867+0000 7fd940205640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd938146c60 0x7fd93813a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:31.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.867+0000 7fd940205640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd938147040 0x7fd938141740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:31.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.867+0000 7fd940205640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93813bb20 con 0x7fd938146c60 2024-01-15T11:33:31.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.867+0000 7fd940205640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93813ac70 con 0x7fd938147040 2024-01-15T11:33:31.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.867+0000 7fd940205640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93813aea0 con 0x7fd938070730 2024-01-15T11:33:31.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.867+0000 7fd93d7a0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd938146c60 0x7fd93813a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:31.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.867+0000 7fd93d7a0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd938146c60 0x7fd93813a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55728/0 (socket says 172.21.15.27:55728) 2024-01-15T11:33:31.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.867+0000 7fd93d7a0640 1 -- 172.21.15.27:0/3699882502 learned_addr learned my addr 172.21.15.27:0/3699882502 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:31.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.867+0000 7fd93e7a2640 1 --2- 172.21.15.27:0/3699882502 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd938147040 0x7fd938141740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:31.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.867+0000 7fd93dfa1640 1 --2- 172.21.15.27:0/3699882502 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd938070730 0x7fd93815ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:31.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.867+0000 7fd93d7a0640 1 -- 172.21.15.27:0/3699882502 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd938070730 msgr2=0x7fd93815ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:31.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.867+0000 7fd93d7a0640 1 --2- 172.21.15.27:0/3699882502 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd938070730 0x7fd93815ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:31.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.867+0000 7fd93d7a0640 1 -- 172.21.15.27:0/3699882502 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd938147040 msgr2=0x7fd938141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:31.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.867+0000 7fd93d7a0640 1 --2- 172.21.15.27:0/3699882502 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd938147040 0x7fd938141740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:31.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.867+0000 7fd93d7a0640 1 -- 172.21.15.27:0/3699882502 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd928009420 con 0x7fd938146c60 2024-01-15T11:33:31.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.867+0000 7fd93dfa1640 1 --2- 172.21.15.27:0/3699882502 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd938070730 0x7fd93815ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:33:31.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.867+0000 7fd93d7a0640 1 --2- 172.21.15.27:0/3699882502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd938146c60 0x7fd93813a730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd9280ad040 tx=0x7fd92801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:31.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.867+0000 7fd92e7fc640 1 -- 172.21.15.27:0/3699882502 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9280b5810 con 0x7fd938146c60 2024-01-15T11:33:31.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.867+0000 7fd92e7fc640 1 -- 172.21.15.27:0/3699882502 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9280b59b0 con 0x7fd938146c60 2024-01-15T11:33:31.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.867+0000 7fd92e7fc640 1 -- 172.21.15.27:0/3699882502 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9280b5d60 con 0x7fd938146c60 2024-01-15T11:33:31.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.867+0000 7fd940205640 1 -- 172.21.15.27:0/3699882502 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd93813b180 con 0x7fd938146c60 2024-01-15T11:33:31.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.867+0000 7fd940205640 1 -- 172.21.15.27:0/3699882502 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd93813b740 con 0x7fd938146c60 2024-01-15T11:33:31.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.867+0000 7fd940205640 1 -- 172.21.15.27:0/3699882502 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd93806d720 con 0x7fd938146c60 2024-01-15T11:33:31.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.867+0000 7fd92e7fc640 1 -- 172.21.15.27:0/3699882502 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fd9280b4390 con 0x7fd938146c60 2024-01-15T11:33:31.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.871+0000 7fd92e7fc640 1 --2- 172.21.15.27:0/3699882502 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd91c0668f0 0x7fd91c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:31.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.871+0000 7fd92e7fc640 1 -- 172.21.15.27:0/3699882502 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd92811f1d0 con 0x7fd938146c60 2024-01-15T11:33:31.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.871+0000 7fd93dfa1640 1 --2- 172.21.15.27:0/3699882502 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd91c0668f0 0x7fd91c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:31.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.871+0000 7fd93dfa1640 1 --2- 172.21.15.27:0/3699882502 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd91c0668f0 0x7fd91c068db0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd934000f70 tx=0x7fd934009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:31.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:31.871+0000 7fd92e7fc640 1 -- 172.21.15.27:0/3699882502 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd9280ec400 con 0x7fd938146c60 2024-01-15T11:33:32.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.067+0000 7fd940205640 1 -- 172.21.15.27:0/3699882502 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd93813bc60 con 0x7fd938146c60 2024-01-15T11:33:32.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.067+0000 7fd92e7fc640 1 -- 172.21.15.27:0/3699882502 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7fd93813bc60 con 0x7fd938146c60 2024-01-15T11:33:32.070 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:32.070 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3682867520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3682867520},{"type":"v1","addr":"172.21.15.93:6837","nonce":3682867520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/2849635892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2849635892},{"type":"v1","addr":"172.21.15.93:6836","nonce":2849635892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/889491859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":889491859},{"type":"v1","addr":"172.21.15.27:6833","nonce":889491859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-15T11:33:20.068559+0000","modified":"2024-01-15T11:33:23.168516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/2516765751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2516765751},{"type":"v1","addr":"172.21.15.27:6835","nonce":2516765751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-15T11:33:32.070 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 8 2024-01-15T11:33:32.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.067+0000 7fd940205640 1 -- 172.21.15.27:0/3699882502 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd91c0668f0 msgr2=0x7fd91c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:32.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.067+0000 7fd940205640 1 --2- 172.21.15.27:0/3699882502 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd91c0668f0 0x7fd91c068db0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd934000f70 tx=0x7fd934009040 comp rx=0 tx=0).stop 2024-01-15T11:33:32.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.067+0000 7fd940205640 1 -- 172.21.15.27:0/3699882502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd938146c60 msgr2=0x7fd93813a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:32.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.067+0000 7fd940205640 1 --2- 172.21.15.27:0/3699882502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd938146c60 0x7fd93813a730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd9280ad040 tx=0x7fd92801ac90 comp rx=0 tx=0).stop 2024-01-15T11:33:32.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.067+0000 7fd940205640 1 -- 172.21.15.27:0/3699882502 shutdown_connections 2024-01-15T11:33:32.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.067+0000 7fd940205640 1 --2- 172.21.15.27:0/3699882502 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd91c0668f0 0x7fd91c068db0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.067+0000 7fd940205640 1 --2- 172.21.15.27:0/3699882502 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd938147040 0x7fd938141740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.067+0000 7fd940205640 1 --2- 172.21.15.27:0/3699882502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd938146c60 0x7fd93813a730 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.067+0000 7fd940205640 1 --2- 172.21.15.27:0/3699882502 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd938070730 0x7fd93815ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.067+0000 7fd940205640 1 -- 172.21.15.27:0/3699882502 >> 172.21.15.27:0/3699882502 conn(0x7fd9380b2ea0 msgr2=0x7fd9380b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:32.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.067+0000 7fd940205640 1 -- 172.21.15.27:0/3699882502 shutdown_connections 2024-01-15T11:33:32.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.067+0000 7fd940205640 1 -- 172.21.15.27:0/3699882502 wait complete. 2024-01-15T11:33:32.091 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:33:32.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.231+0000 7f7b9c91d640 1 Processor -- start 2024-01-15T11:33:32.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.231+0000 7f7b9c91d640 1 -- start start 2024-01-15T11:33:32.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.231+0000 7f7b9c91d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7b980cead0 0x7f7b980d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:32.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.231+0000 7f7b9c91d640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b980d22c0 con 0x7f7b9815d7b0 2024-01-15T11:33:32.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.231+0000 7f7b9c91d640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b980cefd0 con 0x7f7b980d1eb0 2024-01-15T11:33:32.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.231+0000 7f7b9c91d640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b980d17e0 con 0x7f7b980cead0 2024-01-15T11:33:32.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.231+0000 7f7b8ffff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7b980cead0 0x7f7b980d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:32.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.231+0000 7f7b9659c640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7b9815d7b0 0x7f7b980d10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44102/0 (socket says 172.21.15.27:44102) 2024-01-15T11:33:32.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.231+0000 7f7b9659c640 1 -- 172.21.15.27:0/1753215033 learned_addr learned my addr 172.21.15.27:0/1753215033 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:32.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.231+0000 7f7b8ffff640 1 -- 172.21.15.27:0/1753215033 >> v1:172.21.15.93:6789/0 conn(0x7f7b980d1eb0 legacy=0x7f7b9806bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:32.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.231+0000 7f7b8ffff640 1 -- 172.21.15.27:0/1753215033 >> v1:172.21.15.27:6789/0 conn(0x7f7b9815d7b0 legacy=0x7f7b980d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:32.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.231+0000 7f7b8ffff640 1 -- 172.21.15.27:0/1753215033 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b980cf2b0 con 0x7f7b980cead0 2024-01-15T11:33:32.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.231+0000 7f7b95d9b640 1 -- 172.21.15.27:0/1753215033 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3267626592 0 0) 0x7f7b980d22c0 con 0x7f7b9815d7b0 2024-01-15T11:33:32.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.235+0000 7f7b8ffff640 1 --2- 172.21.15.27:0/1753215033 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b980cead0 0x7f7b980d1970 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7b800097c0 tx=0x7f7b8001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afcbfc34b3088630 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:32.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.235+0000 7f7b95d9b640 1 -- 172.21.15.27:0/1753215033 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b800ab600 con 0x7f7b980cead0 2024-01-15T11:33:32.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.235+0000 7f7b95d9b640 1 -- 172.21.15.27:0/1753215033 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b800a7050 con 0x7f7b980cead0 2024-01-15T11:33:32.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.235+0000 7f7b95d9b640 1 -- 172.21.15.27:0/1753215033 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b800ab980 con 0x7f7b980cead0 2024-01-15T11:33:32.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.235+0000 7f7b9c91d640 1 -- 172.21.15.27:0/1753215033 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b980cead0 msgr2=0x7f7b980d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:32.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.235+0000 7f7b9c91d640 1 --2- 172.21.15.27:0/1753215033 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b980cead0 0x7f7b980d1970 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7b800097c0 tx=0x7f7b8001c330 comp rx=0 tx=0).stop 2024-01-15T11:33:32.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.235+0000 7f7b9c91d640 1 -- 172.21.15.27:0/1753215033 shutdown_connections 2024-01-15T11:33:32.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.235+0000 7f7b9c91d640 1 --2- 172.21.15.27:0/1753215033 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b980cead0 0x7f7b980d1970 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.235+0000 7f7b9c91d640 1 -- 172.21.15.27:0/1753215033 >> 172.21.15.27:0/1753215033 conn(0x7f7b980d33b0 msgr2=0x7f7b980d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:32.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.235+0000 7f7b9c91d640 1 -- 172.21.15.27:0/1753215033 shutdown_connections 2024-01-15T11:33:32.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.235+0000 7f7b9c91d640 1 -- 172.21.15.27:0/1753215033 wait complete. 2024-01-15T11:33:32.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.239+0000 7f7b9c91d640 1 Processor -- start 2024-01-15T11:33:32.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.239+0000 7f7b9c91d640 1 -- start start 2024-01-15T11:33:32.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.239+0000 7f7b9c91d640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b980cead0 0x7f7b98151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:32.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.239+0000 7f7b9c91d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b980d1eb0 0x7f7b980c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:32.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.239+0000 7f7b9c91d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b9815d7b0 0x7f7b980b7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:32.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.239+0000 7f7b9c91d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b980c7c20 con 0x7f7b980d1eb0 2024-01-15T11:33:32.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.239+0000 7f7b9c91d640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b980c7010 con 0x7f7b9815d7b0 2024-01-15T11:33:32.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.239+0000 7f7b9c91d640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b980c72f0 con 0x7f7b980cead0 2024-01-15T11:33:32.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.239+0000 7f7b8ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b980d1eb0 0x7f7b980c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:32.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.239+0000 7f7b8ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b980d1eb0 0x7f7b980c80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55744/0 (socket says 172.21.15.27:55744) 2024-01-15T11:33:32.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.239+0000 7f7b8ffff640 1 -- 172.21.15.27:0/2232610578 learned_addr learned my addr 172.21.15.27:0/2232610578 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:32.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.239+0000 7f7b9659c640 1 --2- 172.21.15.27:0/2232610578 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b980cead0 0x7f7b98151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:32.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.239+0000 7f7b96d9d640 1 --2- 172.21.15.27:0/2232610578 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b9815d7b0 0x7f7b980b7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:32.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.239+0000 7f7b8ffff640 1 -- 172.21.15.27:0/2232610578 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b980cead0 msgr2=0x7f7b98151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:32.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.239+0000 7f7b8ffff640 1 --2- 172.21.15.27:0/2232610578 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b980cead0 0x7f7b98151580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.239+0000 7f7b8ffff640 1 -- 172.21.15.27:0/2232610578 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b9815d7b0 msgr2=0x7f7b980b7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:32.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.239+0000 7f7b8ffff640 1 --2- 172.21.15.27:0/2232610578 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b9815d7b0 0x7f7b980b7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.239+0000 7f7b8ffff640 1 -- 172.21.15.27:0/2232610578 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b80009420 con 0x7f7b980d1eb0 2024-01-15T11:33:32.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.239+0000 7f7b8ffff640 1 --2- 172.21.15.27:0/2232610578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b980d1eb0 0x7f7b980c80b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7b80019f60 tx=0x7f7b800190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:32.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.239+0000 7f7b8effd640 1 -- 172.21.15.27:0/2232610578 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b800b4600 con 0x7f7b980d1eb0 2024-01-15T11:33:32.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.239+0000 7f7b8effd640 1 -- 172.21.15.27:0/2232610578 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b800b4780 con 0x7f7b980d1eb0 2024-01-15T11:33:32.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.239+0000 7f7b8effd640 1 -- 172.21.15.27:0/2232610578 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b800b4b30 con 0x7f7b980d1eb0 2024-01-15T11:33:32.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.239+0000 7f7b9c91d640 1 -- 172.21.15.27:0/2232610578 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b980c75d0 con 0x7f7b980d1eb0 2024-01-15T11:33:32.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.239+0000 7f7b9c91d640 1 -- 172.21.15.27:0/2232610578 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b98154660 con 0x7f7b980d1eb0 2024-01-15T11:33:32.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.243+0000 7f7b9c91d640 1 -- 172.21.15.27:0/2232610578 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b980c7d90 con 0x7f7b980d1eb0 2024-01-15T11:33:32.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.243+0000 7f7b8effd640 1 -- 172.21.15.27:0/2232610578 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f7b800b2040 con 0x7f7b980d1eb0 2024-01-15T11:33:32.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.243+0000 7f7b8effd640 1 --2- 172.21.15.27:0/2232610578 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7b780668f0 0x7f7b78068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:32.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.243+0000 7f7b8effd640 1 -- 172.21.15.27:0/2232610578 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b8011e490 con 0x7f7b980d1eb0 2024-01-15T11:33:32.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.243+0000 7f7b9659c640 1 --2- 172.21.15.27:0/2232610578 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7b780668f0 0x7f7b78068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:32.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.243+0000 7f7b9659c640 1 --2- 172.21.15.27:0/2232610578 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7b780668f0 0x7f7b78068db0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7b88000f70 tx=0x7f7b88007d10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:32.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.247+0000 7f7b8effd640 1 -- 172.21.15.27:0/2232610578 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7b800eb6c0 con 0x7f7b980d1eb0 2024-01-15T11:33:32.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.403+0000 7f7b9c91d640 1 -- 172.21.15.27:0/2232610578 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b9804e850 con 0x7f7b980d1eb0 2024-01-15T11:33:32.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.407+0000 7f7b8effd640 1 -- 172.21.15.27:0/2232610578 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16425 (secure 0 0 0) 0x7f7b800eece0 con 0x7f7b980d1eb0 2024-01-15T11:33:32.410 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:32.410 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:33:21.682894+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T11:33:18.397200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T11:33:19.061383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:33:32.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.407+0000 7f7b9c91d640 1 -- 172.21.15.27:0/2232610578 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7b780668f0 msgr2=0x7f7b78068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:32.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.407+0000 7f7b9c91d640 1 --2- 172.21.15.27:0/2232610578 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7b780668f0 0x7f7b78068db0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7b88000f70 tx=0x7f7b88007d10 comp rx=0 tx=0).stop 2024-01-15T11:33:32.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.407+0000 7f7b9c91d640 1 -- 172.21.15.27:0/2232610578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b980d1eb0 msgr2=0x7f7b980c80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:32.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.407+0000 7f7b9c91d640 1 --2- 172.21.15.27:0/2232610578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b980d1eb0 0x7f7b980c80b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7b80019f60 tx=0x7f7b800190d0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.407+0000 7f7b9c91d640 1 -- 172.21.15.27:0/2232610578 shutdown_connections 2024-01-15T11:33:32.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.407+0000 7f7b9c91d640 1 --2- 172.21.15.27:0/2232610578 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7b780668f0 0x7f7b78068db0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.407+0000 7f7b9c91d640 1 --2- 172.21.15.27:0/2232610578 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b9815d7b0 0x7f7b980b7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.407+0000 7f7b9c91d640 1 --2- 172.21.15.27:0/2232610578 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7b980d1eb0 0x7f7b980c80b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.407+0000 7f7b9c91d640 1 --2- 172.21.15.27:0/2232610578 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b980cead0 0x7f7b98151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.407+0000 7f7b9c91d640 1 -- 172.21.15.27:0/2232610578 >> 172.21.15.27:0/2232610578 conn(0x7f7b980d33b0 msgr2=0x7f7b98155640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:32.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.407+0000 7f7b9c91d640 1 -- 172.21.15.27:0/2232610578 shutdown_connections 2024-01-15T11:33:32.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.407+0000 7f7b9c91d640 1 -- 172.21.15.27:0/2232610578 wait complete. 2024-01-15T11:33:32.431 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T11:33:08.134662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-15T11:33:18.397200+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-15T11:33:19.061383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T11:33:32.432 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T11:33:32.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.575+0000 7f1388bd8640 1 Processor -- start 2024-01-15T11:33:32.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.575+0000 7f1388bd8640 1 -- start start 2024-01-15T11:33:32.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.575+0000 7f1388bd8640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f13840cb9b0 0x7f138406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:32.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.575+0000 7f1388bd8640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f13840ce5d0 0x7f138415bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:32.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.575+0000 7f1388bd8640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1384159630 con 0x7f13840cbd90 2024-01-15T11:33:32.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.575+0000 7f1388bd8640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138415bba0 con 0x7f13840ce5d0 2024-01-15T11:33:32.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.575+0000 7f1388bd8640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13840cdd50 con 0x7f13840cb9b0 2024-01-15T11:33:32.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.575+0000 7f137bfff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f13840cbd90 0x7f138415f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44106/0 (socket says 172.21.15.27:44106) 2024-01-15T11:33:32.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.575+0000 7f137bfff640 1 -- 172.21.15.27:0/2447921725 learned_addr learned my addr 172.21.15.27:0/2447921725 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:32.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.575+0000 7f138259c640 1 --2- 172.21.15.27:0/2447921725 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f13840cb9b0 0x7f138406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:32.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.575+0000 7f1382d9d640 1 --2- 172.21.15.27:0/2447921725 >> v2:172.21.15.93:3300/0 conn(0x7f13840ce5d0 0x7f138415bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:32.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.575+0000 7f1381d9b640 1 -- 172.21.15.27:0/2447921725 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1460797801 0 0) 0x7f1384159630 con 0x7f13840cbd90 2024-01-15T11:33:32.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.575+0000 7f1381d9b640 1 -- 172.21.15.27:0/2447921725 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1370003530 con 0x7f13840cbd90 2024-01-15T11:33:32.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.579+0000 7f1382d9d640 1 -- 172.21.15.27:0/2447921725 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f13840cb9b0 msgr2=0x7f138406e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:32.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.579+0000 7f1382d9d640 1 --2- 172.21.15.27:0/2447921725 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f13840cb9b0 0x7f138406e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.579+0000 7f1382d9d640 1 -- 172.21.15.27:0/2447921725 >> v1:172.21.15.27:6789/0 conn(0x7f13840cbd90 legacy=0x7f138415f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:32.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.579+0000 7f1382d9d640 1 -- 172.21.15.27:0/2447921725 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13840cd1d0 con 0x7f13840ce5d0 2024-01-15T11:33:32.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.579+0000 7f1382d9d640 1 --2- 172.21.15.27:0/2447921725 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13840ce5d0 0x7f138415bfd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f137c009d90 tx=0x7f137c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87240b30822763af server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:32.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.579+0000 7f1381d9b640 1 -- 172.21.15.27:0/2447921725 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c0a59c0 con 0x7f13840ce5d0 2024-01-15T11:33:32.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.579+0000 7f1381d9b640 1 -- 172.21.15.27:0/2447921725 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c0a5b20 con 0x7f13840ce5d0 2024-01-15T11:33:32.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.579+0000 7f1381d9b640 1 -- 172.21.15.27:0/2447921725 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c0ad440 con 0x7f13840ce5d0 2024-01-15T11:33:32.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.579+0000 7f1388bd8640 1 -- 172.21.15.27:0/2447921725 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13840ce5d0 msgr2=0x7f138415bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:32.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.579+0000 7f1388bd8640 1 --2- 172.21.15.27:0/2447921725 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13840ce5d0 0x7f138415bfd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f137c009d90 tx=0x7f137c01c920 comp rx=0 tx=0).stop 2024-01-15T11:33:32.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.579+0000 7f1388bd8640 1 -- 172.21.15.27:0/2447921725 shutdown_connections 2024-01-15T11:33:32.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.579+0000 7f1388bd8640 1 --2- 172.21.15.27:0/2447921725 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13840ce5d0 0x7f138415bfd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.579+0000 7f1388bd8640 1 --2- 172.21.15.27:0/2447921725 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f13840cb9b0 0x7f138406e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.579+0000 7f1388bd8640 1 -- 172.21.15.27:0/2447921725 >> 172.21.15.27:0/2447921725 conn(0x7f13840b0cb0 msgr2=0x7f13840b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:32.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.583+0000 7f1388bd8640 1 -- 172.21.15.27:0/2447921725 shutdown_connections 2024-01-15T11:33:32.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.583+0000 7f1388bd8640 1 -- 172.21.15.27:0/2447921725 wait complete. 2024-01-15T11:33:32.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.583+0000 7f1388bd8640 1 Processor -- start 2024-01-15T11:33:32.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.583+0000 7f1388bd8640 1 -- start start 2024-01-15T11:33:32.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.583+0000 7f1388bd8640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f13840cb9b0 0x7f1384152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:32.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.583+0000 7f1388bd8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13840cbd90 0x7f1384153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:32.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.583+0000 7f1388bd8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13840ce5d0 0x7f138415d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:32.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.583+0000 7f1388bd8640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13841524c0 con 0x7f13840ce5d0 2024-01-15T11:33:32.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.583+0000 7f1388bd8640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13841515d0 con 0x7f13840cbd90 2024-01-15T11:33:32.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.583+0000 7f1388bd8640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13841518b0 con 0x7f13840cb9b0 2024-01-15T11:33:32.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.583+0000 7f1382d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13840ce5d0 0x7f138415d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:32.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.583+0000 7f1382d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13840ce5d0 0x7f138415d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55758/0 (socket says 172.21.15.27:55758) 2024-01-15T11:33:32.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.583+0000 7f1382d9d640 1 -- 172.21.15.27:0/414925188 learned_addr learned my addr 172.21.15.27:0/414925188 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:32.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.583+0000 7f138259c640 1 --2- 172.21.15.27:0/414925188 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f13840cb9b0 0x7f1384152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:32.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.583+0000 7f137bfff640 1 --2- 172.21.15.27:0/414925188 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13840cbd90 0x7f1384153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:32.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.583+0000 7f1382d9d640 1 -- 172.21.15.27:0/414925188 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f13840cb9b0 msgr2=0x7f1384152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:32.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.583+0000 7f1382d9d640 1 --2- 172.21.15.27:0/414925188 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f13840cb9b0 0x7f1384152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.583+0000 7f1382d9d640 1 -- 172.21.15.27:0/414925188 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13840cbd90 msgr2=0x7f1384153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:32.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.583+0000 7f1382d9d640 1 --2- 172.21.15.27:0/414925188 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13840cbd90 0x7f1384153450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.583+0000 7f1382d9d640 1 -- 172.21.15.27:0/414925188 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137c009a70 con 0x7f13840ce5d0 2024-01-15T11:33:32.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.583+0000 7f1382d9d640 1 --2- 172.21.15.27:0/414925188 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13840ce5d0 0x7f138415d420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f137c0b0040 tx=0x7f137c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:32.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.587+0000 7f137affd640 1 -- 172.21.15.27:0/414925188 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c0adce0 con 0x7f13840ce5d0 2024-01-15T11:33:32.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.587+0000 7f137affd640 1 -- 172.21.15.27:0/414925188 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c0ade40 con 0x7f13840ce5d0 2024-01-15T11:33:32.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.587+0000 7f1388bd8640 1 -- 172.21.15.27:0/414925188 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1384151b90 con 0x7f13840ce5d0 2024-01-15T11:33:32.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.587+0000 7f137affd640 1 -- 172.21.15.27:0/414925188 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c0b7650 con 0x7f13840ce5d0 2024-01-15T11:33:32.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.587+0000 7f1388bd8640 1 -- 172.21.15.27:0/414925188 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1384152150 con 0x7f13840ce5d0 2024-01-15T11:33:32.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.587+0000 7f1388bd8640 1 -- 172.21.15.27:0/414925188 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13840671f0 con 0x7f13840ce5d0 2024-01-15T11:33:32.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.587+0000 7f137affd640 1 -- 172.21.15.27:0/414925188 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f137c0b4050 con 0x7f13840ce5d0 2024-01-15T11:33:32.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.587+0000 7f137affd640 1 --2- 172.21.15.27:0/414925188 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f13640668f0 0x7f1364068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:32.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.587+0000 7f137affd640 1 -- 172.21.15.27:0/414925188 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f137c11f920 con 0x7f13840ce5d0 2024-01-15T11:33:32.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.587+0000 7f138259c640 1 --2- 172.21.15.27:0/414925188 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f13640668f0 0x7f1364068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:32.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.591+0000 7f138259c640 1 --2- 172.21.15.27:0/414925188 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f13640668f0 0x7f1364068db0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1374009b60 tx=0x7f1374009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:32.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.591+0000 7f137affd640 1 -- 172.21.15.27:0/414925188 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f137c0ecd20 con 0x7f13840ce5d0 2024-01-15T11:33:32.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.751+0000 7f1388bd8640 1 -- 172.21.15.27:0/414925188 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f138406b460 con 0x7f13840ce5d0 2024-01-15T11:33:32.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.751+0000 7f137affd640 1 -- 172.21.15.27:0/414925188 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f137c0c70a0 con 0x7f13840ce5d0 2024-01-15T11:33:32.754 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-15T11:33:32.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.751+0000 7f1388bd8640 1 -- 172.21.15.27:0/414925188 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f13640668f0 msgr2=0x7f1364068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:32.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.751+0000 7f1388bd8640 1 --2- 172.21.15.27:0/414925188 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f13640668f0 0x7f1364068db0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1374009b60 tx=0x7f1374009190 comp rx=0 tx=0).stop 2024-01-15T11:33:32.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.751+0000 7f1388bd8640 1 -- 172.21.15.27:0/414925188 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13840ce5d0 msgr2=0x7f138415d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:32.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.751+0000 7f1388bd8640 1 --2- 172.21.15.27:0/414925188 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13840ce5d0 0x7f138415d420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f137c0b0040 tx=0x7f137c0196c0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.751+0000 7f1388bd8640 1 -- 172.21.15.27:0/414925188 shutdown_connections 2024-01-15T11:33:32.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.751+0000 7f1388bd8640 1 --2- 172.21.15.27:0/414925188 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13840ce5d0 0x7f138415d420 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.751+0000 7f1388bd8640 1 --2- 172.21.15.27:0/414925188 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f13640668f0 0x7f1364068db0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.751+0000 7f1388bd8640 1 --2- 172.21.15.27:0/414925188 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13840cbd90 0x7f1384153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.751+0000 7f1388bd8640 1 --2- 172.21.15.27:0/414925188 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f13840cb9b0 0x7f1384152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.751+0000 7f1388bd8640 1 -- 172.21.15.27:0/414925188 >> 172.21.15.27:0/414925188 conn(0x7f13840b0cb0 msgr2=0x7f138406d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:32.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.751+0000 7f1388bd8640 1 -- 172.21.15.27:0/414925188 shutdown_connections 2024-01-15T11:33:32.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.751+0000 7f1388bd8640 1 -- 172.21.15.27:0/414925188 wait complete. 2024-01-15T11:33:32.775 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-15T11:33:32.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.919+0000 7ff7cf832640 1 Processor -- start 2024-01-15T11:33:32.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.919+0000 7ff7cf832640 1 -- start start 2024-01-15T11:33:32.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.919+0000 7ff7cf832640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff7c8160d00 0x7ff7c80d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:32.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.919+0000 7ff7cf832640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff7c80d3e40 0x7ff7c80cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:32.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.919+0000 7ff7cf832640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c80ce1f0 con 0x7ff7c81613a0 2024-01-15T11:33:32.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.919+0000 7ff7cf832640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c80cea70 con 0x7ff7c8160d00 2024-01-15T11:33:32.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.919+0000 7ff7cf832640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c80d2380 con 0x7ff7c80d3e40 2024-01-15T11:33:32.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.919+0000 7ff7ccdcd640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff7c80d3e40 0x7ff7c80cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:32.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.919+0000 7ff7cd5ce640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff7c8160d00 0x7ff7c80d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:32.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.919+0000 7ff7ccdcd640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff7c80d3e40 0x7ff7c80cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:40398/0 (socket says 172.21.15.27:40398) 2024-01-15T11:33:32.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.919+0000 7ff7ccdcd640 1 -- 172.21.15.27:0/3125568734 learned_addr learned my addr 172.21.15.27:0/3125568734 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:32.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.919+0000 7ff7ccdcd640 1 -- 172.21.15.27:0/3125568734 >> v2:172.21.15.93:3300/0 conn(0x7ff7c8160d00 msgr2=0x7ff7c80d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:32.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.919+0000 7ff7ccdcd640 1 --2- 172.21.15.27:0/3125568734 >> v2:172.21.15.93:3300/0 conn(0x7ff7c8160d00 0x7ff7c80d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.919+0000 7ff7ccdcd640 1 -- 172.21.15.27:0/3125568734 >> v1:172.21.15.93:6789/0 conn(0x7ff7c81613a0 legacy=0x7ff7c806b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:32.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.919+0000 7ff7ccdcd640 1 -- 172.21.15.27:0/3125568734 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c80ce420 con 0x7ff7c80d3e40 2024-01-15T11:33:32.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.923+0000 7ff7ccdcd640 1 --2- 172.21.15.27:0/3125568734 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff7c80d3e40 0x7ff7c80cef00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009870 tx=0x7ff7b801ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfd93d8b5f4da2ed server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:32.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.923+0000 7ff7bffff640 1 -- 172.21.15.27:0/3125568734 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b80a8a30 con 0x7ff7c80d3e40 2024-01-15T11:33:32.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.923+0000 7ff7bffff640 1 -- 172.21.15.27:0/3125568734 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b80a8b90 con 0x7ff7c80d3e40 2024-01-15T11:33:32.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.923+0000 7ff7bffff640 1 -- 172.21.15.27:0/3125568734 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b80b0440 con 0x7ff7c80d3e40 2024-01-15T11:33:32.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.923+0000 7ff7cf832640 1 -- 172.21.15.27:0/3125568734 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff7c80d3e40 msgr2=0x7ff7c80cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:32.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.923+0000 7ff7cf832640 1 --2- 172.21.15.27:0/3125568734 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff7c80d3e40 0x7ff7c80cef00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009870 tx=0x7ff7b801ed30 comp rx=0 tx=0).stop 2024-01-15T11:33:32.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.923+0000 7ff7cf832640 1 -- 172.21.15.27:0/3125568734 shutdown_connections 2024-01-15T11:33:32.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.923+0000 7ff7cf832640 1 --2- 172.21.15.27:0/3125568734 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff7c80d3e40 0x7ff7c80cef00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.923+0000 7ff7cf832640 1 --2- 172.21.15.27:0/3125568734 >> v2:172.21.15.93:3300/0 conn(0x7ff7c8160d00 0x7ff7c80d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.923+0000 7ff7cf832640 1 -- 172.21.15.27:0/3125568734 >> 172.21.15.27:0/3125568734 conn(0x7ff7c808afc0 msgr2=0x7ff7c80d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:32.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.923+0000 7ff7cf832640 1 -- 172.21.15.27:0/3125568734 shutdown_connections 2024-01-15T11:33:32.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.923+0000 7ff7cf832640 1 -- 172.21.15.27:0/3125568734 wait complete. 2024-01-15T11:33:32.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.927+0000 7ff7cf832640 1 Processor -- start 2024-01-15T11:33:32.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.927+0000 7ff7cf832640 1 -- start start 2024-01-15T11:33:32.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.927+0000 7ff7cf832640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c80d3e40 0x7ff7c80cd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:32.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.927+0000 7ff7cf832640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7c8160d00 0x7ff7c80b8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:32.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.927+0000 7ff7cf832640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff7c81613a0 0x7ff7c8159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:32.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.927+0000 7ff7cf832640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c80b3a80 con 0x7ff7c80d3e40 2024-01-15T11:33:32.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.927+0000 7ff7cf832640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c80b3d60 con 0x7ff7c8160d00 2024-01-15T11:33:32.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.927+0000 7ff7cf832640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c80b4040 con 0x7ff7c81613a0 2024-01-15T11:33:32.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.927+0000 7ff7cd5ce640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c80d3e40 0x7ff7c80cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:32.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.927+0000 7ff7cd5ce640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c80d3e40 0x7ff7c80cd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55766/0 (socket says 172.21.15.27:55766) 2024-01-15T11:33:32.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.927+0000 7ff7cd5ce640 1 -- 172.21.15.27:0/492908141 learned_addr learned my addr 172.21.15.27:0/492908141 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:32.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.927+0000 7ff7ccdcd640 1 --2- 172.21.15.27:0/492908141 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7c8160d00 0x7ff7c80b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:32.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.927+0000 7ff7cddcf640 1 --2- 172.21.15.27:0/492908141 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff7c81613a0 0x7ff7c8159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:32.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.927+0000 7ff7cd5ce640 1 -- 172.21.15.27:0/492908141 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff7c81613a0 msgr2=0x7ff7c8159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:32.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.927+0000 7ff7cd5ce640 1 --2- 172.21.15.27:0/492908141 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff7c81613a0 0x7ff7c8159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.927+0000 7ff7cd5ce640 1 -- 172.21.15.27:0/492908141 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7c8160d00 msgr2=0x7ff7c80b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:32.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.927+0000 7ff7cd5ce640 1 --2- 172.21.15.27:0/492908141 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7c8160d00 0x7ff7c80b8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:32.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.927+0000 7ff7cd5ce640 1 -- 172.21.15.27:0/492908141 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b80094d0 con 0x7ff7c80d3e40 2024-01-15T11:33:32.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.927+0000 7ff7ccdcd640 1 --2- 172.21.15.27:0/492908141 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7c8160d00 0x7ff7c80b8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:32.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.927+0000 7ff7cd5ce640 1 --2- 172.21.15.27:0/492908141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c80d3e40 0x7ff7c80cd200 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff7c400e930 tx=0x7ff7c400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:32.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.927+0000 7ff7bdffb640 1 -- 172.21.15.27:0/492908141 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c4009690 con 0x7ff7c80d3e40 2024-01-15T11:33:32.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.927+0000 7ff7bdffb640 1 -- 172.21.15.27:0/492908141 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c400ca00 con 0x7ff7c80d3e40 2024-01-15T11:33:32.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.927+0000 7ff7bdffb640 1 -- 172.21.15.27:0/492908141 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c400cd70 con 0x7ff7c80d3e40 2024-01-15T11:33:32.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.927+0000 7ff7cf832640 1 -- 172.21.15.27:0/492908141 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c80b4320 con 0x7ff7c80d3e40 2024-01-15T11:33:32.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.931+0000 7ff7cf832640 1 -- 172.21.15.27:0/492908141 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c80cd740 con 0x7ff7c80d3e40 2024-01-15T11:33:32.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.931+0000 7ff7cf832640 1 -- 172.21.15.27:0/492908141 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c804e850 con 0x7ff7c80d3e40 2024-01-15T11:33:32.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.931+0000 7ff7bdffb640 1 -- 172.21.15.27:0/492908141 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7ff7c4013470 con 0x7ff7c80d3e40 2024-01-15T11:33:32.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.931+0000 7ff7bdffb640 1 --2- 172.21.15.27:0/492908141 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff7ac0668f0 0x7ff7ac068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:32.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.931+0000 7ff7bdffb640 1 -- 172.21.15.27:0/492908141 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff7c40845f0 con 0x7ff7c80d3e40 2024-01-15T11:33:32.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.931+0000 7ff7ccdcd640 1 --2- 172.21.15.27:0/492908141 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff7ac0668f0 0x7ff7ac068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:32.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.935+0000 7ff7ccdcd640 1 --2- 172.21.15.27:0/492908141 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff7ac0668f0 0x7ff7ac068db0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff7b80b2000 tx=0x7ff7b8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:32.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:32.935+0000 7ff7bdffb640 1 -- 172.21.15.27:0/492908141 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff7c4051990 con 0x7ff7c80d3e40 2024-01-15T11:33:33.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.159+0000 7ff7cf832640 1 -- 172.21.15.27:0/492908141 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff7c80c6700 con 0x7ff7c80d3e40 2024-01-15T11:33:33.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.159+0000 7ff7bdffb640 1 -- 172.21.15.27:0/492908141 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff7c4054fb0 con 0x7ff7c80d3e40 2024-01-15T11:33:33.162 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-01-15T11:33:33.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.159+0000 7ff7cf832640 1 -- 172.21.15.27:0/492908141 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff7ac0668f0 msgr2=0x7ff7ac068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:33.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.159+0000 7ff7cf832640 1 --2- 172.21.15.27:0/492908141 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff7ac0668f0 0x7ff7ac068db0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff7b80b2000 tx=0x7ff7b8009040 comp rx=0 tx=0).stop 2024-01-15T11:33:33.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.159+0000 7ff7cf832640 1 -- 172.21.15.27:0/492908141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c80d3e40 msgr2=0x7ff7c80cd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:33.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.159+0000 7ff7cf832640 1 --2- 172.21.15.27:0/492908141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c80d3e40 0x7ff7c80cd200 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff7c400e930 tx=0x7ff7c400edf0 comp rx=0 tx=0).stop 2024-01-15T11:33:33.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.163+0000 7ff7cf832640 1 -- 172.21.15.27:0/492908141 shutdown_connections 2024-01-15T11:33:33.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.163+0000 7ff7cf832640 1 --2- 172.21.15.27:0/492908141 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff7c81613a0 0x7ff7c8159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:33.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.163+0000 7ff7cf832640 1 --2- 172.21.15.27:0/492908141 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff7ac0668f0 0x7ff7ac068db0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:33.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.163+0000 7ff7cf832640 1 --2- 172.21.15.27:0/492908141 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff7c8160d00 0x7ff7c80b8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:33.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.163+0000 7ff7cf832640 1 --2- 172.21.15.27:0/492908141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff7c80d3e40 0x7ff7c80cd200 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:33.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.163+0000 7ff7cf832640 1 -- 172.21.15.27:0/492908141 >> 172.21.15.27:0/492908141 conn(0x7ff7c808afc0 msgr2=0x7ff7c815e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:33.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.163+0000 7ff7cf832640 1 -- 172.21.15.27:0/492908141 shutdown_connections 2024-01-15T11:33:33.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.163+0000 7ff7cf832640 1 -- 172.21.15.27:0/492908141 wait complete. 2024-01-15T11:33:33.184 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-15T11:33:33.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.327+0000 7f795726b640 1 Processor -- start 2024-01-15T11:33:33.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.327+0000 7f795726b640 1 -- start start 2024-01-15T11:33:33.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.327+0000 7f795726b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f79500cb9b0 0x7f795006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:33.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.327+0000 7f795726b640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7950159630 con 0x7f79500ce5d0 2024-01-15T11:33:33.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.327+0000 7f795726b640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79500cd1d0 con 0x7f79500cbd90 2024-01-15T11:33:33.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.327+0000 7f795726b640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f795015bba0 con 0x7f79500cb9b0 2024-01-15T11:33:33.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.327+0000 7f7955808640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f79500ce5d0 0x7f795015bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44114/0 (socket says 172.21.15.27:44114) 2024-01-15T11:33:33.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.327+0000 7f7955808640 1 -- 172.21.15.27:0/3542938070 learned_addr learned my addr 172.21.15.27:0/3542938070 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:33.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.327+0000 7f7955007640 1 --2- 172.21.15.27:0/3542938070 >> v2:172.21.15.93:3300/0 conn(0x7f79500cb9b0 0x7f795006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:33.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.331+0000 7f7947fff640 1 -- 172.21.15.27:0/3542938070 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1969847682 0 0) 0x7f7950159630 con 0x7f79500ce5d0 2024-01-15T11:33:33.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.331+0000 7f7947fff640 1 -- 172.21.15.27:0/3542938070 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f793c003530 con 0x7f79500ce5d0 2024-01-15T11:33:33.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.331+0000 7f7955007640 1 -- 172.21.15.27:0/3542938070 >> v1:172.21.15.93:6789/0 conn(0x7f79500cbd90 legacy=0x7f795015f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:33.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.331+0000 7f7955007640 1 -- 172.21.15.27:0/3542938070 >> v1:172.21.15.27:6789/0 conn(0x7f79500ce5d0 legacy=0x7f795015bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:33.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.331+0000 7f7955007640 1 -- 172.21.15.27:0/3542938070 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79500cd4b0 con 0x7f79500cb9b0 2024-01-15T11:33:33.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.331+0000 7f7955007640 1 --2- 172.21.15.27:0/3542938070 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79500cb9b0 0x7f795006e3f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f794c0097c0 tx=0x7f794c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b672dcab8427b71 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:33.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.331+0000 7f7947fff640 1 -- 172.21.15.27:0/3542938070 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c0ab600 con 0x7f79500cb9b0 2024-01-15T11:33:33.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.331+0000 7f7947fff640 1 -- 172.21.15.27:0/3542938070 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c0a7050 con 0x7f79500cb9b0 2024-01-15T11:33:33.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.331+0000 7f7947fff640 1 -- 172.21.15.27:0/3542938070 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c0ab980 con 0x7f79500cb9b0 2024-01-15T11:33:33.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.335+0000 7f795726b640 1 -- 172.21.15.27:0/3542938070 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79500cb9b0 msgr2=0x7f795006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:33.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.335+0000 7f795726b640 1 --2- 172.21.15.27:0/3542938070 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79500cb9b0 0x7f795006e3f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f794c0097c0 tx=0x7f794c01c480 comp rx=0 tx=0).stop 2024-01-15T11:33:33.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.335+0000 7f795726b640 1 -- 172.21.15.27:0/3542938070 shutdown_connections 2024-01-15T11:33:33.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.335+0000 7f795726b640 1 --2- 172.21.15.27:0/3542938070 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79500cb9b0 0x7f795006e3f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:33.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.335+0000 7f795726b640 1 -- 172.21.15.27:0/3542938070 >> 172.21.15.27:0/3542938070 conn(0x7f79500b0cb0 msgr2=0x7f79500b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:33.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.335+0000 7f795726b640 1 -- 172.21.15.27:0/3542938070 shutdown_connections 2024-01-15T11:33:33.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.335+0000 7f795726b640 1 -- 172.21.15.27:0/3542938070 wait complete. 2024-01-15T11:33:33.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.335+0000 7f795726b640 1 Processor -- start 2024-01-15T11:33:33.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.335+0000 7f795726b640 1 -- start start 2024-01-15T11:33:33.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.335+0000 7f795726b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79500cb9b0 0x7f7950150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:33.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.335+0000 7f795726b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79500cbd90 0x7f79501646f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:33.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.335+0000 7f795726b640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f79500ce5d0 0x7f79500b2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:33.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.335+0000 7f795726b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79501673c0 con 0x7f79500cb9b0 2024-01-15T11:33:33.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.335+0000 7f795726b640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79500b40e0 con 0x7f79500cbd90 2024-01-15T11:33:33.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.335+0000 7f795726b640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79500b2270 con 0x7f79500ce5d0 2024-01-15T11:33:33.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.335+0000 7f7955007640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79500cb9b0 0x7f7950150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:33.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.335+0000 7f7955007640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79500cb9b0 0x7f7950150ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55782/0 (socket says 172.21.15.27:55782) 2024-01-15T11:33:33.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.335+0000 7f7955007640 1 -- 172.21.15.27:0/2981112198 learned_addr learned my addr 172.21.15.27:0/2981112198 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:33.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.335+0000 7f7954806640 1 --2- 172.21.15.27:0/2981112198 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79500cbd90 0x7f79501646f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:33.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.335+0000 7f7955808640 1 --2- 172.21.15.27:0/2981112198 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f79500ce5d0 0x7f79500b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:33.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.335+0000 7f7955007640 1 -- 172.21.15.27:0/2981112198 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f79500ce5d0 msgr2=0x7f79500b2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:33.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.335+0000 7f7955007640 1 --2- 172.21.15.27:0/2981112198 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f79500ce5d0 0x7f79500b2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:33.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.335+0000 7f7955007640 1 -- 172.21.15.27:0/2981112198 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79500cbd90 msgr2=0x7f79501646f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:33.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.335+0000 7f7955007640 1 --2- 172.21.15.27:0/2981112198 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79500cbd90 0x7f79501646f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:33.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.335+0000 7f7955007640 1 -- 172.21.15.27:0/2981112198 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c009420 con 0x7f79500cb9b0 2024-01-15T11:33:33.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.339+0000 7f7955007640 1 --2- 172.21.15.27:0/2981112198 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79500cb9b0 0x7f7950150ba0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f794c0ae040 tx=0x7f794c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:33.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.339+0000 7f7945ffb640 1 -- 172.21.15.27:0/2981112198 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c0b7450 con 0x7f79500cb9b0 2024-01-15T11:33:33.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.339+0000 7f7945ffb640 1 -- 172.21.15.27:0/2981112198 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c0b75b0 con 0x7f79500cb9b0 2024-01-15T11:33:33.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.339+0000 7f7945ffb640 1 -- 172.21.15.27:0/2981112198 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c0b7960 con 0x7f79500cb9b0 2024-01-15T11:33:33.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.339+0000 7f795726b640 1 -- 172.21.15.27:0/2981112198 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79501510e0 con 0x7f79500cb9b0 2024-01-15T11:33:33.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.339+0000 7f795726b640 1 -- 172.21.15.27:0/2981112198 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79500b3b20 con 0x7f79500cb9b0 2024-01-15T11:33:33.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.339+0000 7f795726b640 1 -- 172.21.15.27:0/2981112198 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79500671f0 con 0x7f79500cb9b0 2024-01-15T11:33:33.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.339+0000 7f7945ffb640 1 -- 172.21.15.27:0/2981112198 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f794c0b7ac0 con 0x7f79500cb9b0 2024-01-15T11:33:33.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.343+0000 7f7945ffb640 1 --2- 172.21.15.27:0/2981112198 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f79340668f0 0x7f7934068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:33.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.343+0000 7f7945ffb640 1 -- 172.21.15.27:0/2981112198 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f794c11e9a0 con 0x7f79500cb9b0 2024-01-15T11:33:33.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.343+0000 7f7954806640 1 --2- 172.21.15.27:0/2981112198 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f79340668f0 0x7f7934068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:33.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.343+0000 7f7954806640 1 --2- 172.21.15.27:0/2981112198 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f79340668f0 0x7f7934068db0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f795015e1d0 tx=0x7f7940009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:33.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.347+0000 7f7945ffb640 1 -- 172.21.15.27:0/2981112198 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f794c0ebe20 con 0x7f79500cb9b0 2024-01-15T11:33:33.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.503+0000 7f795726b640 1 -- 172.21.15.27:0/2981112198 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f795006b460 con 0x7f79500cb9b0 2024-01-15T11:33:33.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.503+0000 7f7945ffb640 1 -- 172.21.15.27:0/2981112198 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f794c0b00a0 con 0x7f79500cb9b0 2024-01-15T11:33:33.507 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-01-15T11:33:33.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.507+0000 7f795726b640 1 -- 172.21.15.27:0/2981112198 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f79340668f0 msgr2=0x7f7934068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:33.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.507+0000 7f795726b640 1 --2- 172.21.15.27:0/2981112198 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f79340668f0 0x7f7934068db0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f795015e1d0 tx=0x7f7940009040 comp rx=0 tx=0).stop 2024-01-15T11:33:33.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.507+0000 7f795726b640 1 -- 172.21.15.27:0/2981112198 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79500cb9b0 msgr2=0x7f7950150ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:33.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.507+0000 7f795726b640 1 --2- 172.21.15.27:0/2981112198 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79500cb9b0 0x7f7950150ba0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f794c0ae040 tx=0x7f794c01acc0 comp rx=0 tx=0).stop 2024-01-15T11:33:33.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.507+0000 7f795726b640 1 -- 172.21.15.27:0/2981112198 shutdown_connections 2024-01-15T11:33:33.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.507+0000 7f795726b640 1 --2- 172.21.15.27:0/2981112198 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f79500ce5d0 0x7f79500b2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:33.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.507+0000 7f795726b640 1 --2- 172.21.15.27:0/2981112198 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f79340668f0 0x7f7934068db0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:33.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.507+0000 7f795726b640 1 --2- 172.21.15.27:0/2981112198 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79500cbd90 0x7f79501646f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:33.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.507+0000 7f795726b640 1 --2- 172.21.15.27:0/2981112198 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f79500cb9b0 0x7f7950150ba0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:33.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.507+0000 7f795726b640 1 -- 172.21.15.27:0/2981112198 >> 172.21.15.27:0/2981112198 conn(0x7f79500b0cb0 msgr2=0x7f79500b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:33.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.507+0000 7f795726b640 1 -- 172.21.15.27:0/2981112198 shutdown_connections 2024-01-15T11:33:33.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.507+0000 7f795726b640 1 -- 172.21.15.27:0/2981112198 wait complete. 2024-01-15T11:33:33.529 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-15T11:33:33.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.667+0000 7fd97b772640 1 Processor -- start 2024-01-15T11:33:33.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.667+0000 7fd97b772640 1 -- start start 2024-01-15T11:33:33.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd97b772640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd97415a4c0 0x7fd9740b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:33.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd97b772640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd9740b3760 0x7fd9740d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:33.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd97b772640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9740b05d0 con 0x7fd9740cf6e0 2024-01-15T11:33:33.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd97b772640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9740af9c0 con 0x7fd9740b3760 2024-01-15T11:33:33.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd97b772640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9740b3bf0 con 0x7fd97415a4c0 2024-01-15T11:33:33.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd978d0d640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd9740cf6e0 0x7fd9740b3050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44126/0 (socket says 172.21.15.27:44126) 2024-01-15T11:33:33.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd978d0d640 1 -- 172.21.15.27:0/524685667 learned_addr learned my addr 172.21.15.27:0/524685667 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:33.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd979d0f640 1 --2- 172.21.15.27:0/524685667 >> v2:172.21.15.93:3300/0 conn(0x7fd9740b3760 0x7fd9740d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:33.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd97950e640 1 --2- 172.21.15.27:0/524685667 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd97415a4c0 0x7fd9740b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:33.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd96bfff640 1 -- 172.21.15.27:0/524685667 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684457394 0 0) 0x7fd9740b05d0 con 0x7fd9740cf6e0 2024-01-15T11:33:33.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd96bfff640 1 -- 172.21.15.27:0/524685667 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd960003530 con 0x7fd9740cf6e0 2024-01-15T11:33:33.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd96bfff640 1 -- 172.21.15.27:0/524685667 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1519320768 0 0) 0x7fd960003530 con 0x7fd9740cf6e0 2024-01-15T11:33:33.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd96bfff640 1 -- 172.21.15.27:0/524685667 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd97415a4c0 msgr2=0x7fd9740b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:33.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd96bfff640 1 --2- 172.21.15.27:0/524685667 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd97415a4c0 0x7fd9740b15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:33.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd96bfff640 1 -- 172.21.15.27:0/524685667 >> v2:172.21.15.93:3300/0 conn(0x7fd9740b3760 msgr2=0x7fd9740d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:33.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd96bfff640 1 --2- 172.21.15.27:0/524685667 >> v2:172.21.15.93:3300/0 conn(0x7fd9740b3760 0x7fd9740d00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:33.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd96bfff640 1 -- 172.21.15.27:0/524685667 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9740b1b20 con 0x7fd9740cf6e0 2024-01-15T11:33:33.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd96bfff640 1 -- 172.21.15.27:0/524685667 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1394381265 0 0) 0x7fd964001680 con 0x7fd9740cf6e0 2024-01-15T11:33:33.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd96bfff640 1 -- 172.21.15.27:0/524685667 >> v1:172.21.15.27:6789/0 conn(0x7fd9740cf6e0 legacy=0x7fd9740b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:33.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd96bfff640 1 --2- 172.21.15.27:0/524685667 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd97415a4c0 0x7fd960003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:33.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd96bfff640 1 --2- 172.21.15.27:0/524685667 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd960003f00 0x7fd9600047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:33.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd96bfff640 1 --2- 172.21.15.27:0/524685667 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd960004d10 0x7fd960005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:33.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd96bfff640 1 -- 172.21.15.27:0/524685667 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9740af9c0 con 0x7fd960004d10 2024-01-15T11:33:33.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd96bfff640 1 -- 172.21.15.27:0/524685667 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9740b3bf0 con 0x7fd960003f00 2024-01-15T11:33:33.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd96bfff640 1 -- 172.21.15.27:0/524685667 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96000dba0 con 0x7fd97415a4c0 2024-01-15T11:33:33.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd979d0f640 1 --2- 172.21.15.27:0/524685667 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd960004d10 0x7fd960005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:33.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd97950e640 1 --2- 172.21.15.27:0/524685667 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd97415a4c0 0x7fd960003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:33.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd978d0d640 1 --2- 172.21.15.27:0/524685667 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd960003f00 0x7fd9600047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:33.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd979d0f640 1 -- 172.21.15.27:0/524685667 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd97415a4c0 msgr2=0x7fd960003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:33.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd979d0f640 1 --2- 172.21.15.27:0/524685667 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd97415a4c0 0x7fd960003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:33.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd979d0f640 1 -- 172.21.15.27:0/524685667 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd960003f00 msgr2=0x7fd9600047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:33.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd979d0f640 1 --2- 172.21.15.27:0/524685667 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd960003f00 0x7fd9600047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:33.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd979d0f640 1 -- 172.21.15.27:0/524685667 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd960003530 con 0x7fd960004d10 2024-01-15T11:33:33.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.671+0000 7fd978d0d640 1 --2- 172.21.15.27:0/524685667 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd960003f00 0x7fd9600047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:33.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.675+0000 7fd979d0f640 1 --2- 172.21.15.27:0/524685667 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd960004d10 0x7fd960005190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd96c009fc0 tx=0x7fd96c01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5947d89d92d63df server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:33.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.675+0000 7fd96bfff640 1 -- 172.21.15.27:0/524685667 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c0a5cb0 con 0x7fd960004d10 2024-01-15T11:33:33.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.675+0000 7fd96bfff640 1 -- 172.21.15.27:0/524685667 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96c00f040 con 0x7fd960004d10 2024-01-15T11:33:33.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.675+0000 7fd96bfff640 1 -- 172.21.15.27:0/524685667 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c0ad680 con 0x7fd960004d10 2024-01-15T11:33:33.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.675+0000 7fd97b772640 1 -- 172.21.15.27:0/524685667 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd960004d10 msgr2=0x7fd960005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:33.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.675+0000 7fd97b772640 1 --2- 172.21.15.27:0/524685667 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd960004d10 0x7fd960005190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd96c009fc0 tx=0x7fd96c01cc40 comp rx=0 tx=0).stop 2024-01-15T11:33:33.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.675+0000 7fd979d0f640 1 -- 172.21.15.27:0/524685667 reap_dead start 2024-01-15T11:33:33.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.675+0000 7fd97b772640 1 -- 172.21.15.27:0/524685667 shutdown_connections 2024-01-15T11:33:33.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.675+0000 7fd97b772640 1 -- 172.21.15.27:0/524685667 >> 172.21.15.27:0/524685667 conn(0x7fd9740b5570 msgr2=0x7fd9740b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:33.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.675+0000 7fd97b772640 1 -- 172.21.15.27:0/524685667 shutdown_connections 2024-01-15T11:33:33.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.675+0000 7fd97b772640 1 -- 172.21.15.27:0/524685667 wait complete. 2024-01-15T11:33:33.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.675+0000 7fd97b772640 1 Processor -- start 2024-01-15T11:33:33.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.675+0000 7fd97b772640 1 -- start start 2024-01-15T11:33:33.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.679+0000 7fd97b772640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd960004d10 0x7fd974147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:33.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.679+0000 7fd97b772640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd97414a3c0 0x7fd97414a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:33.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.679+0000 7fd97b772640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9740b4340 0x7fd9740b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:33.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.679+0000 7fd97b772640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97414ad80 con 0x7fd960004d10 2024-01-15T11:33:33.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.679+0000 7fd97b772640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9740b4d00 con 0x7fd9740b4340 2024-01-15T11:33:33.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.679+0000 7fd97b772640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9741480e0 con 0x7fd97414a3c0 2024-01-15T11:33:33.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.679+0000 7fd97950e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd960004d10 0x7fd974147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:33.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.679+0000 7fd97950e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd960004d10 0x7fd974147ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55806/0 (socket says 172.21.15.27:55806) 2024-01-15T11:33:33.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.679+0000 7fd97950e640 1 -- 172.21.15.27:0/540772653 learned_addr learned my addr 172.21.15.27:0/540772653 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:33.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.679+0000 7fd979d0f640 1 --2- 172.21.15.27:0/540772653 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9740b4340 0x7fd9740b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:33.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.679+0000 7fd97950e640 1 -- 172.21.15.27:0/540772653 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd97414a3c0 msgr2=0x7fd97414a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:33.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.679+0000 7fd97950e640 1 --2- 172.21.15.27:0/540772653 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd97414a3c0 0x7fd97414a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:33.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.679+0000 7fd97950e640 1 -- 172.21.15.27:0/540772653 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9740b4340 msgr2=0x7fd9740b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:33.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.679+0000 7fd97950e640 1 --2- 172.21.15.27:0/540772653 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9740b4340 0x7fd9740b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:33.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.679+0000 7fd97950e640 1 -- 172.21.15.27:0/540772653 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9741556d0 con 0x7fd960004d10 2024-01-15T11:33:33.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.679+0000 7fd979d0f640 1 --2- 172.21.15.27:0/540772653 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9740b4340 0x7fd9740b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:33:33.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.679+0000 7fd97950e640 1 --2- 172.21.15.27:0/540772653 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd960004d10 0x7fd974147ba0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd970011a00 tx=0x7fd970011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:33.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.679+0000 7fd969ffb640 1 -- 172.21.15.27:0/540772653 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97000faf0 con 0x7fd960004d10 2024-01-15T11:33:33.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.679+0000 7fd969ffb640 1 -- 172.21.15.27:0/540772653 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97000fc50 con 0x7fd960004d10 2024-01-15T11:33:33.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.679+0000 7fd969ffb640 1 -- 172.21.15.27:0/540772653 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd970014440 con 0x7fd960004d10 2024-01-15T11:33:33.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.679+0000 7fd97b772640 1 -- 172.21.15.27:0/540772653 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd97414af80 con 0x7fd960004d10 2024-01-15T11:33:33.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.679+0000 7fd97b772640 1 -- 172.21.15.27:0/540772653 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd974148380 con 0x7fd960004d10 2024-01-15T11:33:33.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.679+0000 7fd97b772640 1 -- 172.21.15.27:0/540772653 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd97404e850 con 0x7fd960004d10 2024-01-15T11:33:33.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.679+0000 7fd969ffb640 1 -- 172.21.15.27:0/540772653 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fd9700145a0 con 0x7fd960004d10 2024-01-15T11:33:33.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.683+0000 7fd969ffb640 1 --2- 172.21.15.27:0/540772653 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd958066910 0x7fd958068dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:33.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.683+0000 7fd969ffb640 1 -- 172.21.15.27:0/540772653 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd970084d10 con 0x7fd960004d10 2024-01-15T11:33:33.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.683+0000 7fd978d0d640 1 --2- 172.21.15.27:0/540772653 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd958066910 0x7fd958068dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:33.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.683+0000 7fd978d0d640 1 --2- 172.21.15.27:0/540772653 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd958066910 0x7fd958068dd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd9741f2170 tx=0x7fd964001c30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:33.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.687+0000 7fd969ffb640 1 -- 172.21.15.27:0/540772653 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd97008a020 con 0x7fd960004d10 2024-01-15T11:33:33.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.875+0000 7fd97b772640 1 -- 172.21.15.27:0/540772653 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9740737d0 con 0x7fd960004d10 2024-01-15T11:33:33.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.879+0000 7fd969ffb640 1 -- 172.21.15.27:0/540772653 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7fd970022070 con 0x7fd960004d10 2024-01-15T11:33:33.881 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:33.882 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3682867520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3682867520},{"type":"v1","addr":"172.21.15.93:6837","nonce":3682867520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/2849635892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2849635892},{"type":"v1","addr":"172.21.15.93:6836","nonce":2849635892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/889491859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":889491859},{"type":"v1","addr":"172.21.15.27:6833","nonce":889491859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-15T11:33:20.068559+0000","modified":"2024-01-15T11:33:23.168516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/2516765751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2516765751},{"type":"v1","addr":"172.21.15.27:6835","nonce":2516765751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-15T11:33:33.882 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 8 2024-01-15T11:33:33.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.879+0000 7fd97b772640 1 -- 172.21.15.27:0/540772653 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd958066910 msgr2=0x7fd958068dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:33.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.879+0000 7fd97b772640 1 --2- 172.21.15.27:0/540772653 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd958066910 0x7fd958068dd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd9741f2170 tx=0x7fd964001c30 comp rx=0 tx=0).stop 2024-01-15T11:33:33.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.879+0000 7fd97b772640 1 -- 172.21.15.27:0/540772653 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd960004d10 msgr2=0x7fd974147ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:33.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.879+0000 7fd97b772640 1 --2- 172.21.15.27:0/540772653 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd960004d10 0x7fd974147ba0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd970011a00 tx=0x7fd970011ec0 comp rx=0 tx=0).stop 2024-01-15T11:33:33.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.879+0000 7fd97b772640 1 -- 172.21.15.27:0/540772653 shutdown_connections 2024-01-15T11:33:33.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.879+0000 7fd97b772640 1 --2- 172.21.15.27:0/540772653 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd958066910 0x7fd958068dd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:33.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.879+0000 7fd97b772640 1 --2- 172.21.15.27:0/540772653 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9740b4340 0x7fd9740b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:33.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.879+0000 7fd97b772640 1 --2- 172.21.15.27:0/540772653 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd97414a3c0 0x7fd97414a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:33.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.879+0000 7fd97b772640 1 --2- 172.21.15.27:0/540772653 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd960004d10 0x7fd974147ba0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:33.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.879+0000 7fd97b772640 1 -- 172.21.15.27:0/540772653 >> 172.21.15.27:0/540772653 conn(0x7fd9740b5570 msgr2=0x7fd9740afbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:33.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.879+0000 7fd97b772640 1 -- 172.21.15.27:0/540772653 shutdown_connections 2024-01-15T11:33:33.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:33.879+0000 7fd97b772640 1 -- 172.21.15.27:0/540772653 wait complete. 2024-01-15T11:33:33.902 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:33:34.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.043+0000 7f5124017640 1 Processor -- start 2024-01-15T11:33:34.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.043+0000 7f5124017640 1 -- start start 2024-01-15T11:33:34.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.043+0000 7f5124017640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f511c0d1b50 0x7f511c0700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:34.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.043+0000 7f5124017640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f511c15c0b0 0x7f511c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:34.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.043+0000 7f5124017640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511c15c4b0 con 0x7f511c0cfe10 2024-01-15T11:33:34.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.043+0000 7f5124017640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511c13e6f0 con 0x7f511c15c0b0 2024-01-15T11:33:34.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.043+0000 7f5124017640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511c1407e0 con 0x7f511c0d1b50 2024-01-15T11:33:34.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.043+0000 7f51225b4640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f511c15c0b0 0x7f511c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:34.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.043+0000 7f51215b2640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f511c0cfe10 0x7f511c15b9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44138/0 (socket says 172.21.15.27:44138) 2024-01-15T11:33:34.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.043+0000 7f51215b2640 1 -- 172.21.15.27:0/1207888932 learned_addr learned my addr 172.21.15.27:0/1207888932 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:34.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.043+0000 7f5121db3640 1 --2- 172.21.15.27:0/1207888932 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f511c0d1b50 0x7f511c0700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:34.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.043+0000 7f51225b4640 1 -- 172.21.15.27:0/1207888932 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f511c0d1b50 msgr2=0x7f511c0700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:34.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.043+0000 7f5120db1640 1 -- 172.21.15.27:0/1207888932 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321249234 0 0) 0x7f510c001120 con 0x7f511c0cfe10 2024-01-15T11:33:34.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.043+0000 7f51225b4640 1 --2- 172.21.15.27:0/1207888932 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f511c0d1b50 0x7f511c0700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:34.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.043+0000 7f51225b4640 1 -- 172.21.15.27:0/1207888932 >> v1:172.21.15.27:6789/0 conn(0x7f511c0cfe10 legacy=0x7f511c15b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:34.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.043+0000 7f51225b4640 1 -- 172.21.15.27:0/1207888932 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c0d1f30 con 0x7f511c15c0b0 2024-01-15T11:33:34.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.047+0000 7f51225b4640 1 --2- 172.21.15.27:0/1207888932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f511c15c0b0 0x7f511c0705f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5114009d90 tx=0x7f511401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6110867f839edf0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:34.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.047+0000 7f5120db1640 1 -- 172.21.15.27:0/1207888932 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51140a59e0 con 0x7f511c15c0b0 2024-01-15T11:33:34.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.047+0000 7f5120db1640 1 -- 172.21.15.27:0/1207888932 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51140a5b40 con 0x7f511c15c0b0 2024-01-15T11:33:34.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.047+0000 7f5120db1640 1 -- 172.21.15.27:0/1207888932 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51140ad440 con 0x7f511c15c0b0 2024-01-15T11:33:34.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.047+0000 7f5124017640 1 -- 172.21.15.27:0/1207888932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f511c15c0b0 msgr2=0x7f511c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:34.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.047+0000 7f5124017640 1 --2- 172.21.15.27:0/1207888932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f511c15c0b0 0x7f511c0705f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5114009d90 tx=0x7f511401c920 comp rx=0 tx=0).stop 2024-01-15T11:33:34.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.047+0000 7f5124017640 1 -- 172.21.15.27:0/1207888932 shutdown_connections 2024-01-15T11:33:34.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.047+0000 7f5124017640 1 --2- 172.21.15.27:0/1207888932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f511c15c0b0 0x7f511c0705f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:34.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.047+0000 7f5124017640 1 --2- 172.21.15.27:0/1207888932 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f511c0d1b50 0x7f511c0700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:34.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.047+0000 7f5124017640 1 -- 172.21.15.27:0/1207888932 >> 172.21.15.27:0/1207888932 conn(0x7f511c06e950 msgr2=0x7f511c06ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:34.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.047+0000 7f5124017640 1 -- 172.21.15.27:0/1207888932 shutdown_connections 2024-01-15T11:33:34.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.047+0000 7f5124017640 1 -- 172.21.15.27:0/1207888932 wait complete. 2024-01-15T11:33:34.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.051+0000 7f5124017640 1 Processor -- start 2024-01-15T11:33:34.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.051+0000 7f5124017640 1 -- start start 2024-01-15T11:33:34.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.051+0000 7f5124017640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f511c0cfe10 0x7f511c1f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:34.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.051+0000 7f5124017640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f511c0d1b50 0x7f511c157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:34.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.051+0000 7f5124017640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f511c15c0b0 0x7f511c15ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:34.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.051+0000 7f5124017640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c1f6920 con 0x7f511c0d1b50 2024-01-15T11:33:34.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.051+0000 7f5124017640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c143780 con 0x7f511c15c0b0 2024-01-15T11:33:34.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.051+0000 7f5124017640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511c142b70 con 0x7f511c0cfe10 2024-01-15T11:33:34.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.051+0000 7f51215b2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f511c0d1b50 0x7f511c157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:34.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.051+0000 7f51215b2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f511c0d1b50 0x7f511c157110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55826/0 (socket says 172.21.15.27:55826) 2024-01-15T11:33:34.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.051+0000 7f51215b2640 1 -- 172.21.15.27:0/2423357864 learned_addr learned my addr 172.21.15.27:0/2423357864 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:34.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.051+0000 7f5121db3640 1 --2- 172.21.15.27:0/2423357864 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f511c0cfe10 0x7f511c1f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:34.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.051+0000 7f51225b4640 1 --2- 172.21.15.27:0/2423357864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f511c15c0b0 0x7f511c15ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:34.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.051+0000 7f51215b2640 1 -- 172.21.15.27:0/2423357864 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f511c0cfe10 msgr2=0x7f511c1f63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:34.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.051+0000 7f51215b2640 1 --2- 172.21.15.27:0/2423357864 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f511c0cfe10 0x7f511c1f63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:34.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.051+0000 7f51215b2640 1 -- 172.21.15.27:0/2423357864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f511c15c0b0 msgr2=0x7f511c15ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:34.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.051+0000 7f51215b2640 1 --2- 172.21.15.27:0/2423357864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f511c15c0b0 0x7f511c15ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:34.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.051+0000 7f51215b2640 1 -- 172.21.15.27:0/2423357864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5114009a70 con 0x7f511c0d1b50 2024-01-15T11:33:34.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.051+0000 7f51215b2640 1 --2- 172.21.15.27:0/2423357864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f511c0d1b50 0x7f511c157110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f510c00c780 tx=0x7f510c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:34.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.051+0000 7f51127fc640 1 -- 172.21.15.27:0/2423357864 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c0072d0 con 0x7f511c0d1b50 2024-01-15T11:33:34.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.051+0000 7f51127fc640 1 -- 172.21.15.27:0/2423357864 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510c007430 con 0x7f511c0d1b50 2024-01-15T11:33:34.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.051+0000 7f51127fc640 1 -- 172.21.15.27:0/2423357864 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c0047f0 con 0x7f511c0d1b50 2024-01-15T11:33:34.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.051+0000 7f5124017640 1 -- 172.21.15.27:0/2423357864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511c142e50 con 0x7f511c0d1b50 2024-01-15T11:33:34.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.051+0000 7f5124017640 1 -- 172.21.15.27:0/2423357864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511c143410 con 0x7f511c0d1b50 2024-01-15T11:33:34.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.051+0000 7f5124017640 1 -- 172.21.15.27:0/2423357864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f511c143930 con 0x7f511c0d1b50 2024-01-15T11:33:34.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.055+0000 7f51127fc640 1 -- 172.21.15.27:0/2423357864 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f510c004950 con 0x7f511c0d1b50 2024-01-15T11:33:34.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.055+0000 7f51127fc640 1 --2- 172.21.15.27:0/2423357864 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5100066920 0x7f5100068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:34.058 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.055+0000 7f51127fc640 1 -- 172.21.15.27:0/2423357864 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f510c083300 con 0x7f511c0d1b50 2024-01-15T11:33:34.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.055+0000 7f5121db3640 1 --2- 172.21.15.27:0/2423357864 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5100066920 0x7f5100068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:34.059 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.055+0000 7f5121db3640 1 --2- 172.21.15.27:0/2423357864 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5100066920 0x7f5100068de0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5118007a60 tx=0x7f5118008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:34.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.059+0000 7f51127fc640 1 -- 172.21.15.27:0/2423357864 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f511c143930 con 0x7f511c0d1b50 2024-01-15T11:33:34.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.215+0000 7f5124017640 1 -- 172.21.15.27:0/2423357864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f511c15c4b0 con 0x7f511c0d1b50 2024-01-15T11:33:34.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.219+0000 7f51127fc640 1 -- 172.21.15.27:0/2423357864 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16425 (secure 0 0 0) 0x7f511c15c4b0 con 0x7f511c0d1b50 2024-01-15T11:33:34.221 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:34.221 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:33:21.682894+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T11:33:18.397200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T11:33:19.061383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:33:34.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.219+0000 7f5124017640 1 -- 172.21.15.27:0/2423357864 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5100066920 msgr2=0x7f5100068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:34.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.219+0000 7f5124017640 1 --2- 172.21.15.27:0/2423357864 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5100066920 0x7f5100068de0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5118007a60 tx=0x7f5118008040 comp rx=0 tx=0).stop 2024-01-15T11:33:34.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.219+0000 7f5124017640 1 -- 172.21.15.27:0/2423357864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f511c0d1b50 msgr2=0x7f511c157110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:34.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.219+0000 7f5124017640 1 --2- 172.21.15.27:0/2423357864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f511c0d1b50 0x7f511c157110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f510c00c780 tx=0x7f510c00cc40 comp rx=0 tx=0).stop 2024-01-15T11:33:34.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.219+0000 7f5124017640 1 -- 172.21.15.27:0/2423357864 shutdown_connections 2024-01-15T11:33:34.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.219+0000 7f5124017640 1 --2- 172.21.15.27:0/2423357864 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5100066920 0x7f5100068de0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:34.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.219+0000 7f5124017640 1 --2- 172.21.15.27:0/2423357864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f511c15c0b0 0x7f511c15ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:34.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.219+0000 7f5124017640 1 --2- 172.21.15.27:0/2423357864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f511c0d1b50 0x7f511c157110 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:34.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.219+0000 7f5124017640 1 --2- 172.21.15.27:0/2423357864 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f511c0cfe10 0x7f511c1f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:34.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.219+0000 7f5124017640 1 -- 172.21.15.27:0/2423357864 >> 172.21.15.27:0/2423357864 conn(0x7f511c06e950 msgr2=0x7f511c15e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:34.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.219+0000 7f5124017640 1 -- 172.21.15.27:0/2423357864 shutdown_connections 2024-01-15T11:33:34.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.219+0000 7f5124017640 1 -- 172.21.15.27:0/2423357864 wait complete. 2024-01-15T11:33:34.243 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-15T11:33:34.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.383+0000 7fedab879640 1 Processor -- start 2024-01-15T11:33:34.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.383+0000 7fedab879640 1 -- start start 2024-01-15T11:33:34.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.383+0000 7fedab879640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feda40ac630 0x7feda40706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:34.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.383+0000 7fedab879640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feda4070c20 0x7feda406c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:34.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.383+0000 7fedab879640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda4145060 con 0x7feda4144c80 2024-01-15T11:33:34.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.383+0000 7fedab879640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feda4071fd0 con 0x7feda4070c20 2024-01-15T11:33:34.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.383+0000 7fedab879640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda4071450 con 0x7feda40ac630 2024-01-15T11:33:34.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.383+0000 7feda9e16640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7feda4070c20 0x7feda406c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:34.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.383+0000 7feda9615640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7feda4144c80 0x7feda40abf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44142/0 (socket says 172.21.15.27:44142) 2024-01-15T11:33:34.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.383+0000 7feda9615640 1 -- 172.21.15.27:0/3724732685 learned_addr learned my addr 172.21.15.27:0/3724732685 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:34.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.383+0000 7feda8e14640 1 --2- 172.21.15.27:0/3724732685 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feda40ac630 0x7feda40706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:34.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.383+0000 7feda9e16640 1 -- 172.21.15.27:0/3724732685 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feda40ac630 msgr2=0x7feda40706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:34.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.383+0000 7feda9e16640 1 --2- 172.21.15.27:0/3724732685 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feda40ac630 0x7feda40706e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:34.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.383+0000 7feda9e16640 1 -- 172.21.15.27:0/3724732685 >> v1:172.21.15.27:6789/0 conn(0x7feda4144c80 legacy=0x7feda40abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:34.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.383+0000 7feda9e16640 1 -- 172.21.15.27:0/3724732685 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda4071730 con 0x7feda4070c20 2024-01-15T11:33:34.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.383+0000 7fed9bfff640 1 -- 172.21.15.27:0/3724732685 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3911579244 0 0) 0x7feda4145060 con 0x7feda4144c80 2024-01-15T11:33:34.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.387+0000 7feda9e16640 1 --2- 172.21.15.27:0/3724732685 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feda4070c20 0x7feda406c910 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fed9c009d90 tx=0x7fed9c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551129105efd805 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:34.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.387+0000 7fed9bfff640 1 -- 172.21.15.27:0/3724732685 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c0a59e0 con 0x7feda4070c20 2024-01-15T11:33:34.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.387+0000 7fed9bfff640 1 -- 172.21.15.27:0/3724732685 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9c0a5b40 con 0x7feda4070c20 2024-01-15T11:33:34.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.387+0000 7fed9bfff640 1 -- 172.21.15.27:0/3724732685 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c0ad440 con 0x7feda4070c20 2024-01-15T11:33:34.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.387+0000 7fedab879640 1 -- 172.21.15.27:0/3724732685 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feda4070c20 msgr2=0x7feda406c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:34.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.387+0000 7fedab879640 1 --2- 172.21.15.27:0/3724732685 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feda4070c20 0x7feda406c910 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fed9c009d90 tx=0x7fed9c01c920 comp rx=0 tx=0).stop 2024-01-15T11:33:34.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.387+0000 7fedab879640 1 -- 172.21.15.27:0/3724732685 shutdown_connections 2024-01-15T11:33:34.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.387+0000 7fedab879640 1 --2- 172.21.15.27:0/3724732685 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feda4070c20 0x7feda406c910 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:34.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.387+0000 7fedab879640 1 --2- 172.21.15.27:0/3724732685 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feda40ac630 0x7feda40706e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:34.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.387+0000 7fedab879640 1 -- 172.21.15.27:0/3724732685 >> 172.21.15.27:0/3724732685 conn(0x7feda40b0c40 msgr2=0x7feda40b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:34.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.387+0000 7fedab879640 1 -- 172.21.15.27:0/3724732685 shutdown_connections 2024-01-15T11:33:34.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.387+0000 7fedab879640 1 -- 172.21.15.27:0/3724732685 wait complete. 2024-01-15T11:33:34.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7fedab879640 1 Processor -- start 2024-01-15T11:33:34.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7fedab879640 1 -- start start 2024-01-15T11:33:34.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7fedab879640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feda4070c20 0x7feda415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:34.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7fedab879640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feda40ac630 0x7feda40b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:34.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7fedab879640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feda4144c80 0x7feda413e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:34.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7fedab879640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda4144550 con 0x7feda40ac630 2024-01-15T11:33:34.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7fedab879640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda409ba20 con 0x7feda4070c20 2024-01-15T11:33:34.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7fedab879640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda409bcc0 con 0x7feda4144c80 2024-01-15T11:33:34.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7feda8e14640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feda40ac630 0x7feda40b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:34.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7feda8e14640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feda40ac630 0x7feda40b3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55840/0 (socket says 172.21.15.27:55840) 2024-01-15T11:33:34.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7feda8e14640 1 -- 172.21.15.27:0/13237676 learned_addr learned my addr 172.21.15.27:0/13237676 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:34.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7feda9615640 1 --2- 172.21.15.27:0/13237676 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feda4070c20 0x7feda415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:34.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7feda9e16640 1 --2- 172.21.15.27:0/13237676 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feda4144c80 0x7feda413e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:34.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7feda8e14640 1 -- 172.21.15.27:0/13237676 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feda4144c80 msgr2=0x7feda413e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:34.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7feda8e14640 1 --2- 172.21.15.27:0/13237676 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feda4144c80 0x7feda413e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:34.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7feda8e14640 1 -- 172.21.15.27:0/13237676 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feda4070c20 msgr2=0x7feda415aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:34.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7feda8e14640 1 --2- 172.21.15.27:0/13237676 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feda4070c20 0x7feda415aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:34.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7feda8e14640 1 -- 172.21.15.27:0/13237676 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c009a70 con 0x7feda40ac630 2024-01-15T11:33:34.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7feda9e16640 1 --2- 172.21.15.27:0/13237676 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feda4144c80 0x7feda413e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:34.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7feda8e14640 1 --2- 172.21.15.27:0/13237676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feda40ac630 0x7feda40b3b60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fed9400d800 tx=0x7fed9400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:34.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7fed99ffb640 1 -- 172.21.15.27:0/13237676 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9400b6c0 con 0x7feda40ac630 2024-01-15T11:33:34.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7fed99ffb640 1 -- 172.21.15.27:0/13237676 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9400b820 con 0x7feda40ac630 2024-01-15T11:33:34.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7fed99ffb640 1 -- 172.21.15.27:0/13237676 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9400bb90 con 0x7feda40ac630 2024-01-15T11:33:34.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7fedab879640 1 -- 172.21.15.27:0/13237676 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda409bf60 con 0x7feda40ac630 2024-01-15T11:33:34.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7fedab879640 1 -- 172.21.15.27:0/13237676 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda409c520 con 0x7feda40ac630 2024-01-15T11:33:34.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.391+0000 7fedab879640 1 -- 172.21.15.27:0/13237676 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda404e850 con 0x7feda40ac630 2024-01-15T11:33:34.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.395+0000 7fed99ffb640 1 -- 172.21.15.27:0/13237676 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fed9400bcf0 con 0x7feda40ac630 2024-01-15T11:33:34.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.395+0000 7fed99ffb640 1 --2- 172.21.15.27:0/13237676 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fed880668f0 0x7fed88068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:34.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.395+0000 7fed99ffb640 1 -- 172.21.15.27:0/13237676 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed94084960 con 0x7feda40ac630 2024-01-15T11:33:34.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.395+0000 7feda9615640 1 --2- 172.21.15.27:0/13237676 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fed880668f0 0x7fed88068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:34.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.395+0000 7feda9615640 1 --2- 172.21.15.27:0/13237676 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fed880668f0 0x7fed88068db0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feda0007fd0 tx=0x7feda0007d60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:34.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.399+0000 7fed99ffb640 1 -- 172.21.15.27:0/13237676 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fed94051b00 con 0x7feda40ac630 2024-01-15T11:33:34.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.591+0000 7fedab879640 1 -- 172.21.15.27:0/13237676 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feda415fa90 con 0x7feda40ac630 2024-01-15T11:33:34.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.591+0000 7fed99ffb640 1 -- 172.21.15.27:0/13237676 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7fed94055120 con 0x7feda40ac630 2024-01-15T11:33:34.595 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:34.595 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3682867520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3682867520},{"type":"v1","addr":"172.21.15.93:6837","nonce":3682867520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/2849635892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2849635892},{"type":"v1","addr":"172.21.15.93:6836","nonce":2849635892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/889491859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":889491859},{"type":"v1","addr":"172.21.15.27:6833","nonce":889491859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-15T11:33:20.068559+0000","modified":"2024-01-15T11:33:23.168516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/2516765751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2516765751},{"type":"v1","addr":"172.21.15.27:6835","nonce":2516765751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-15T11:33:34.595 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 8 2024-01-15T11:33:34.596 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.595+0000 7fedab879640 1 -- 172.21.15.27:0/13237676 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fed880668f0 msgr2=0x7fed88068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:34.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.595+0000 7fedab879640 1 --2- 172.21.15.27:0/13237676 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fed880668f0 0x7fed88068db0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feda0007fd0 tx=0x7feda0007d60 comp rx=0 tx=0).stop 2024-01-15T11:33:34.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.595+0000 7fedab879640 1 -- 172.21.15.27:0/13237676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feda40ac630 msgr2=0x7feda40b3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:34.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.595+0000 7fedab879640 1 --2- 172.21.15.27:0/13237676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feda40ac630 0x7feda40b3b60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fed9400d800 tx=0x7fed9400dcc0 comp rx=0 tx=0).stop 2024-01-15T11:33:34.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.595+0000 7fedab879640 1 -- 172.21.15.27:0/13237676 shutdown_connections 2024-01-15T11:33:34.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.595+0000 7fedab879640 1 --2- 172.21.15.27:0/13237676 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feda4144c80 0x7feda413e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:34.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.595+0000 7fedab879640 1 --2- 172.21.15.27:0/13237676 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feda40ac630 0x7feda40b3b60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:34.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.595+0000 7fedab879640 1 --2- 172.21.15.27:0/13237676 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fed880668f0 0x7fed88068db0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:34.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.595+0000 7fedab879640 1 --2- 172.21.15.27:0/13237676 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feda4070c20 0x7feda415aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:34.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.595+0000 7fedab879640 1 -- 172.21.15.27:0/13237676 >> 172.21.15.27:0/13237676 conn(0x7feda40b0c40 msgr2=0x7feda413c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:34.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.595+0000 7fedab879640 1 -- 172.21.15.27:0/13237676 shutdown_connections 2024-01-15T11:33:34.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:34.595+0000 7fedab879640 1 -- 172.21.15.27:0/13237676 wait complete. 2024-01-15T11:33:35.019 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-15T11:33:20.068559+0000', 'modified': '2024-01-15T11:33:23.168516+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.27:6835/2516765751', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.27:6834', 'nonce': 2516765751}, {'type': 'v1', 'addr': '172.21.15.27:6835', 'nonce': 2516765751}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-15T11:33:35.019 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-15T11:33:35.019 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-15T11:33:35.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.159+0000 7f1e37de7640 1 Processor -- start 2024-01-15T11:33:35.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.159+0000 7f1e37de7640 1 -- start start 2024-01-15T11:33:35.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.163+0000 7f1e37de7640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1e30144d50 0x7f1e300b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.163+0000 7f1e37de7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1e300b5160 0x7f1e3015eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.163+0000 7f1e37de7640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3015fcb0 con 0x7f1e3015f420 2024-01-15T11:33:35.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.163+0000 7f1e37de7640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3015f8b0 con 0x7f1e300b5160 2024-01-15T11:33:35.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.163+0000 7f1e37de7640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e300b5790 con 0x7f1e30144d50 2024-01-15T11:33:35.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.163+0000 7f1e35382640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1e300b5160 0x7f1e3015eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.163+0000 7f1e35b83640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1e30144d50 0x7f1e300b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.163+0000 7f1e35382640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1e300b5160 0x7f1e3015eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:51644/0 (socket says 172.21.15.27:51644) 2024-01-15T11:33:35.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.163+0000 7f1e35382640 1 -- 172.21.15.27:0/1270430768 learned_addr learned my addr 172.21.15.27:0/1270430768 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:35.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.163+0000 7f1e35b83640 1 -- 172.21.15.27:0/1270430768 >> v2:172.21.15.93:3300/0 conn(0x7f1e300b5160 msgr2=0x7f1e3015eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:35.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.163+0000 7f1e35b83640 1 --2- 172.21.15.27:0/1270430768 >> v2:172.21.15.93:3300/0 conn(0x7f1e300b5160 0x7f1e3015eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.163+0000 7f1e35b83640 1 -- 172.21.15.27:0/1270430768 >> v1:172.21.15.93:6789/0 conn(0x7f1e3015f420 legacy=0x7f1e30070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:35.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.163+0000 7f1e35b83640 1 -- 172.21.15.27:0/1270430768 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e300b5a70 con 0x7f1e30144d50 2024-01-15T11:33:35.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.163+0000 7f1e35382640 1 --2- 172.21.15.27:0/1270430768 >> v2:172.21.15.93:3300/0 conn(0x7f1e300b5160 0x7f1e3015eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:35.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.167+0000 7f1e35b83640 1 --2- 172.21.15.27:0/1270430768 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1e30144d50 0x7f1e300b4c20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0097c0 tx=0x7f1e2c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ba4679abe8ab239 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:35.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.167+0000 7f1e34b81640 1 -- 172.21.15.27:0/1270430768 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c0ab600 con 0x7f1e30144d50 2024-01-15T11:33:35.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.167+0000 7f1e34b81640 1 -- 172.21.15.27:0/1270430768 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2c0a7050 con 0x7f1e30144d50 2024-01-15T11:33:35.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.167+0000 7f1e34b81640 1 -- 172.21.15.27:0/1270430768 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c0ab980 con 0x7f1e30144d50 2024-01-15T11:33:35.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.167+0000 7f1e37de7640 1 -- 172.21.15.27:0/1270430768 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1e30144d50 msgr2=0x7f1e300b4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:35.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.167+0000 7f1e37de7640 1 --2- 172.21.15.27:0/1270430768 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1e30144d50 0x7f1e300b4c20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0097c0 tx=0x7f1e2c01c480 comp rx=0 tx=0).stop 2024-01-15T11:33:35.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.167+0000 7f1e37de7640 1 -- 172.21.15.27:0/1270430768 shutdown_connections 2024-01-15T11:33:35.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.167+0000 7f1e37de7640 1 --2- 172.21.15.27:0/1270430768 >> v2:172.21.15.93:3300/0 conn(0x7f1e300b5160 0x7f1e3015eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.167+0000 7f1e37de7640 1 --2- 172.21.15.27:0/1270430768 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1e30144d50 0x7f1e300b4c20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.167+0000 7f1e37de7640 1 -- 172.21.15.27:0/1270430768 >> 172.21.15.27:0/1270430768 conn(0x7f1e300b2f10 msgr2=0x7f1e300b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:35.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.167+0000 7f1e37de7640 1 -- 172.21.15.27:0/1270430768 shutdown_connections 2024-01-15T11:33:35.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.167+0000 7f1e37de7640 1 -- 172.21.15.27:0/1270430768 wait complete. 2024-01-15T11:33:35.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.167+0000 7f1e37de7640 1 Processor -- start 2024-01-15T11:33:35.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.171+0000 7f1e37de7640 1 -- start start 2024-01-15T11:33:35.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.171+0000 7f1e37de7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e300b5160 0x7f1e30151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.171+0000 7f1e37de7640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1e30144d50 0x7f1e3013a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.171+0000 7f1e37de7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e3015f420 0x7f1e30157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.171+0000 7f1e37de7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e30151120 con 0x7f1e3015f420 2024-01-15T11:33:35.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.171+0000 7f1e37de7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e30151980 con 0x7f1e300b5160 2024-01-15T11:33:35.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.171+0000 7f1e37de7640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e30150a60 con 0x7f1e30144d50 2024-01-15T11:33:35.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.171+0000 7f1e36384640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e3015f420 0x7f1e30157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.171+0000 7f1e35382640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1e30144d50 0x7f1e3013a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.171+0000 7f1e35382640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1e30144d50 0x7f1e3013a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:45654/0 (socket says 172.21.15.27:45654) 2024-01-15T11:33:35.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.171+0000 7f1e36384640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e3015f420 0x7f1e30157dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52344/0 (socket says 172.21.15.27:52344) 2024-01-15T11:33:35.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.171+0000 7f1e35382640 1 -- 172.21.15.27:0/2154134187 learned_addr learned my addr 172.21.15.27:0/2154134187 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:35.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.171+0000 7f1e35b83640 1 --2- 172.21.15.27:0/2154134187 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e300b5160 0x7f1e30151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.171+0000 7f1e36384640 1 -- 172.21.15.27:0/2154134187 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1e30144d50 msgr2=0x7f1e3013a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:35.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.171+0000 7f1e36384640 1 --2- 172.21.15.27:0/2154134187 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1e30144d50 0x7f1e3013a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.171+0000 7f1e36384640 1 -- 172.21.15.27:0/2154134187 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e300b5160 msgr2=0x7f1e30151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:35.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.171+0000 7f1e36384640 1 --2- 172.21.15.27:0/2154134187 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e300b5160 0x7f1e30151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.171+0000 7f1e36384640 1 -- 172.21.15.27:0/2154134187 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e200094d0 con 0x7f1e3015f420 2024-01-15T11:33:35.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.171+0000 7f1e36384640 1 --2- 172.21.15.27:0/2154134187 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e3015f420 0x7f1e30157dd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1e2800c700 tx=0x7f1e2800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:35.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.171+0000 7f1e267fc640 1 -- 172.21.15.27:0/2154134187 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28003b80 con 0x7f1e3015f420 2024-01-15T11:33:35.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.171+0000 7f1e267fc640 1 -- 172.21.15.27:0/2154134187 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e28003ce0 con 0x7f1e3015f420 2024-01-15T11:33:35.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.171+0000 7f1e267fc640 1 -- 172.21.15.27:0/2154134187 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28005310 con 0x7f1e3015f420 2024-01-15T11:33:35.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.171+0000 7f1e37de7640 1 -- 172.21.15.27:0/2154134187 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2c009420 con 0x7f1e3015f420 2024-01-15T11:33:35.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.171+0000 7f1e37de7640 1 -- 172.21.15.27:0/2154134187 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e30151610 con 0x7f1e3015f420 2024-01-15T11:33:35.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.175+0000 7f1e267fc640 1 -- 172.21.15.27:0/2154134187 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f1e28005470 con 0x7f1e3015f420 2024-01-15T11:33:35.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.175+0000 7f1e267fc640 1 --2- 172.21.15.27:0/2154134187 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1e14066920 0x7f1e14068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.175+0000 7f1e267fc640 1 -- 172.21.15.27:0/2154134187 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e28083f20 con 0x7f1e3015f420 2024-01-15T11:33:35.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.175+0000 7f1e35b83640 1 --2- 172.21.15.27:0/2154134187 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1e14066920 0x7f1e14068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.175+0000 7f1e3b154000 1 Processor -- start 2024-01-15T11:33:35.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.175+0000 7f1e3b154000 1 -- start start 2024-01-15T11:33:35.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.175+0000 7f1e35b83640 1 --2- 172.21.15.27:0/2154134187 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1e14066920 0x7f1e14068de0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0ad000 tx=0x7f1e2c0a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:35.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.175+0000 7f1e3b154000 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x564ecd8cb0f0 0x564ecd8cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.175+0000 7f1e3b154000 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd8cba10 0x564ecd8811f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.175+0000 7f1e3b154000 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564ecd881730 0x564ecd881b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.175+0000 7f1e3b154000 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ecd6e7130 con 0x564ecd8cba10 2024-01-15T11:33:35.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.175+0000 7f1e3b154000 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ecd6d49a0 con 0x564ecd881730 2024-01-15T11:33:35.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.175+0000 7f1e3b154000 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ecd6d1ed0 con 0x564ecd8cb0f0 2024-01-15T11:33:35.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.175+0000 7f1e35382640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd8cba10 0x564ecd8811f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.175+0000 7f1e35382640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd8cba10 0x564ecd8811f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52358/0 (socket says 172.21.15.27:52358) 2024-01-15T11:33:35.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.175+0000 7f1e35382640 1 -- 172.21.15.27:0/1248672210 learned_addr learned my addr 172.21.15.27:0/1248672210 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:35.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.175+0000 7f1e35b83640 1 --2- 172.21.15.27:0/1248672210 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x564ecd8cb0f0 0x564ecd8cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.175+0000 7f1e36384640 1 --2- 172.21.15.27:0/1248672210 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564ecd881730 0x564ecd881b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.175+0000 7f1e35382640 1 -- 172.21.15.27:0/1248672210 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x564ecd8cb0f0 msgr2=0x564ecd8cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:35.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.175+0000 7f1e35382640 1 --2- 172.21.15.27:0/1248672210 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x564ecd8cb0f0 0x564ecd8cb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.175+0000 7f1e35382640 1 -- 172.21.15.27:0/1248672210 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564ecd881730 msgr2=0x564ecd881b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:35.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.175+0000 7f1e35382640 1 --2- 172.21.15.27:0/1248672210 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564ecd881730 0x564ecd881b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.175+0000 7f1e35382640 1 -- 172.21.15.27:0/1248672210 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ecd3c5890 con 0x564ecd8cba10 2024-01-15T11:33:35.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e35382640 1 --2- 172.21.15.27:0/1248672210 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd8cba10 0x564ecd8811f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1e301f7650 tx=0x7f1e20011690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a77ef14a6044ee1 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:35.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e137fe640 1 -- 172.21.15.27:0/1248672210 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e20011e60 con 0x564ecd8cba10 2024-01-15T11:33:35.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e137fe640 1 -- 172.21.15.27:0/1248672210 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e20014650 con 0x564ecd8cba10 2024-01-15T11:33:35.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e137fe640 1 -- 172.21.15.27:0/1248672210 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e200149c0 con 0x564ecd8cba10 2024-01-15T11:33:35.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e3b154000 1 -- 172.21.15.27:0/1248672210 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd8cba10 msgr2=0x564ecd8811f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:35.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e3b154000 1 --2- 172.21.15.27:0/1248672210 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd8cba10 0x564ecd8811f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1e301f7650 tx=0x7f1e20011690 comp rx=0 tx=0).stop 2024-01-15T11:33:35.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e3b154000 1 -- 172.21.15.27:0/1248672210 shutdown_connections 2024-01-15T11:33:35.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e3b154000 1 --2- 172.21.15.27:0/1248672210 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564ecd881730 0x564ecd881b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e3b154000 1 --2- 172.21.15.27:0/1248672210 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd8cba10 0x564ecd8811f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e3b154000 1 --2- 172.21.15.27:0/1248672210 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x564ecd8cb0f0 0x564ecd8cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e3b154000 1 -- 172.21.15.27:0/1248672210 >> 172.21.15.27:0/1248672210 conn(0x564ecd8792d0 msgr2=0x564ecd87b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:35.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e3b154000 1 -- 172.21.15.27:0/1248672210 shutdown_connections 2024-01-15T11:33:35.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e3b154000 1 -- 172.21.15.27:0/1248672210 wait complete. 2024-01-15T11:33:35.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e3b154000 1 -- start start 2024-01-15T11:33:35.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e3b154000 1 Processor -- start 2024-01-15T11:33:35.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e3b154000 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564ecd881730 0x564ecd8afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e3b154000 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x564ecd8cb0f0 0x564ecd8b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e3b154000 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd8cba10 0x564ecd8b0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e3b154000 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ecd6cd7c0 con 0x564ecd8cba10 2024-01-15T11:33:35.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e3b154000 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ecd685bf0 con 0x564ecd881730 2024-01-15T11:33:35.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e3b154000 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ecd68ba90 con 0x564ecd8cb0f0 2024-01-15T11:33:35.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e3b154000 10 client.0 _ll_register_callbacks cb 0x564ecd8683c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-15T11:33:35.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e36384640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd8cba10 0x564ecd8b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e36384640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd8cba10 0x564ecd8b0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52368/0 (socket says 172.21.15.27:52368) 2024-01-15T11:33:35.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e36384640 1 -- 172.21.15.27:0/470200913 learned_addr learned my addr 172.21.15.27:0/470200913 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:35.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e35b83640 1 --2- 172.21.15.27:0/470200913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564ecd881730 0x564ecd8afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.179+0000 7f1e35382640 1 --2- 172.21.15.27:0/470200913 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x564ecd8cb0f0 0x564ecd8b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e36384640 1 -- 172.21.15.27:0/470200913 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x564ecd8cb0f0 msgr2=0x564ecd8b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:35.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e36384640 1 --2- 172.21.15.27:0/470200913 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x564ecd8cb0f0 0x564ecd8b00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e36384640 1 -- 172.21.15.27:0/470200913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564ecd881730 msgr2=0x564ecd8afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:35.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e36384640 1 --2- 172.21.15.27:0/470200913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564ecd881730 0x564ecd8afb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e36384640 1 -- 172.21.15.27:0/470200913 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e200099e0 con 0x564ecd8cba10 2024-01-15T11:33:35.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e36384640 1 --2- 172.21.15.27:0/470200913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd8cba10 0x564ecd8b0600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1e28082440 tx=0x7f1e28054ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6479a9684cdcdf5e server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:35.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e10ff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-01-15T11:33:35.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e10ff9640 1 -- 172.21.15.27:0/470200913 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2805d110 con 0x564ecd8cba10 2024-01-15T11:33:35.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e10ff9640 1 -- 172.21.15.27:0/470200913 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e28005720 con 0x564ecd8cba10 2024-01-15T11:33:35.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e3b154000 1 -- 172.21.15.27:0/470200913 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564ecd68f470 con 0x564ecd8cba10 2024-01-15T11:33:35.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e10ff9640 1 -- 172.21.15.27:0/470200913 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e280515d0 con 0x564ecd8cba10 2024-01-15T11:33:35.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e3b154000 10 client.4638 fetch_fsmap learned FSMap version 8 2024-01-15T11:33:35.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e3b154000 1 -- 172.21.15.27:0/470200913 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x564ecd68e190 con 0x564ecd8cba10 2024-01-15T11:33:35.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e10ff9640 1 -- 172.21.15.27:0/470200913 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564ecd68f470 con 0x564ecd8cba10 2024-01-15T11:33:35.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e10ff9640 1 -- 172.21.15.27:0/470200913 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1e28019020 con 0x564ecd8cba10 2024-01-15T11:33:35.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e3b154000 10 client.4638 fetch_fsmap finished waiting for FSMap version 8 2024-01-15T11:33:35.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e3b154000 10 client.4638 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-15T11:33:35.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e3b154000 20 client.4638 populate_metadata read hostname 'smithi027' 2024-01-15T11:33:35.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e3b154000 1 --2- 172.21.15.27:0/470200913 >> [v2:172.21.15.27:6834/2516765751,v1:172.21.15.27:6835/2516765751] conn(0x564ecd8db190 0x564ecd8dd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e3b154000 4 client.4638 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-15T11:33:35.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e3b154000 1 -- 172.21.15.27:0/470200913 --> [v2:172.21.15.27:6834/2516765751,v1:172.21.15.27:6835/2516765751] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564ecd692b50 con 0x564ecd8db190 2024-01-15T11:33:35.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e35b83640 1 --2- 172.21.15.27:0/470200913 >> [v2:172.21.15.27:6834/2516765751,v1:172.21.15.27:6835/2516765751] conn(0x564ecd8db190 0x564ecd8dd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e35b83640 1 --2- 172.21.15.27:0/470200913 >> [v2:172.21.15.27:6834/2516765751,v1:172.21.15.27:6835/2516765751] conn(0x564ecd8db190 0x564ecd8dd580 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22dbf9e324760bac server_cookie=fe084b65acfed432 in_seq=0 out_seq=0 2024-01-15T11:33:35.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e10ff9640 10 client.4638 ms_handle_connect on v2:172.21.15.27:6834/2516765751 2024-01-15T11:33:35.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e10ff9640 1 -- 172.21.15.27:0/470200913 <== mds.0 v2:172.21.15.27:6834/2516765751 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564ecd692b50 con 0x564ecd8db190 2024-01-15T11:33:35.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e10ff9640 10 client.4638 handle_command_reply: tid=0 2024-01-15T11:33:35.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e3b154000 1 client.4638 shutdown 2024-01-15T11:33:35.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e3b154000 1 -- 172.21.15.27:0/470200913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd8cba10 msgr2=0x564ecd8b0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:35.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e3b154000 1 --2- 172.21.15.27:0/470200913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd8cba10 0x564ecd8b0600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1e28082440 tx=0x7f1e28054ec0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e3b154000 1 -- 172.21.15.27:0/470200913 shutdown_connections 2024-01-15T11:33:35.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e3b154000 1 --2- 172.21.15.27:0/470200913 >> [v2:172.21.15.27:6834/2516765751,v1:172.21.15.27:6835/2516765751] conn(0x564ecd8db190 0x564ecd8dd580 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e3b154000 1 --2- 172.21.15.27:0/470200913 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd8cba10 0x564ecd8b0600 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e3b154000 1 --2- 172.21.15.27:0/470200913 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x564ecd8cb0f0 0x564ecd8b00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e3b154000 1 --2- 172.21.15.27:0/470200913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564ecd881730 0x564ecd8afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e10ff9640 0 client.4638 ms_handle_reset on v2:172.21.15.27:6834/2516765751 2024-01-15T11:33:35.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e3b154000 1 -- 172.21.15.27:0/470200913 >> 172.21.15.27:0/470200913 conn(0x564ecd8792d0 msgr2=0x564ecd8825b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:35.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e3b154000 1 -- 172.21.15.27:0/470200913 shutdown_connections 2024-01-15T11:33:35.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e3b154000 1 -- 172.21.15.27:0/470200913 wait complete. 2024-01-15T11:33:35.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.183+0000 7f1e3b154000 20 client.4638 trim_cache size 0 max 16384 2024-01-15T11:33:35.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.199+0000 7f1e3b154000 1 Processor -- start 2024-01-15T11:33:35.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.199+0000 7f1e3b154000 1 -- start start 2024-01-15T11:33:35.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.199+0000 7f1e3b154000 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd881730 0x564ecd8ca830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.199+0000 7f1e3b154000 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x564ecd8cb0f0 0x564ecd8c9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.199+0000 7f1e3b154000 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564ecd8cba10 0x564ecd8c9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.199+0000 7f1e3b154000 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ecd386940 con 0x564ecd881730 2024-01-15T11:33:35.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.199+0000 7f1e3b154000 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ecd878c70 con 0x564ecd8cba10 2024-01-15T11:33:35.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e3b154000 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ecd682760 con 0x564ecd8cb0f0 2024-01-15T11:33:35.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e35b83640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd881730 0x564ecd8ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e35b83640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd881730 0x564ecd8ca830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52374/0 (socket says 172.21.15.27:52374) 2024-01-15T11:33:35.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e35b83640 1 -- 172.21.15.27:0/3882028890 learned_addr learned my addr 172.21.15.27:0/3882028890 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:35.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e36384640 1 --2- 172.21.15.27:0/3882028890 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564ecd8cba10 0x564ecd8c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e35382640 1 --2- 172.21.15.27:0/3882028890 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x564ecd8cb0f0 0x564ecd8c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e35b83640 1 -- 172.21.15.27:0/3882028890 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x564ecd8cb0f0 msgr2=0x564ecd8c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:35.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e35b83640 1 --2- 172.21.15.27:0/3882028890 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x564ecd8cb0f0 0x564ecd8c9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e35b83640 1 -- 172.21.15.27:0/3882028890 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564ecd8cba10 msgr2=0x564ecd8c9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:35.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e35b83640 1 --2- 172.21.15.27:0/3882028890 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564ecd8cba10 0x564ecd8c9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e35b83640 1 -- 172.21.15.27:0/3882028890 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ecd674490 con 0x564ecd881730 2024-01-15T11:33:35.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e35b83640 1 --2- 172.21.15.27:0/3882028890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd881730 0x564ecd8ca830 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c01ab30 tx=0x7f1e2c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a15ea7cc18cc7e server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:35.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e13fff640 1 -- 172.21.15.27:0/3882028890 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c0bc040 con 0x564ecd881730 2024-01-15T11:33:35.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e13fff640 1 -- 172.21.15.27:0/3882028890 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2c0bd040 con 0x564ecd881730 2024-01-15T11:33:35.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e13fff640 1 -- 172.21.15.27:0/3882028890 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c0abcf0 con 0x564ecd881730 2024-01-15T11:33:35.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e3b154000 1 -- 172.21.15.27:0/3882028890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd881730 msgr2=0x564ecd8ca830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:35.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e3b154000 1 --2- 172.21.15.27:0/3882028890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd881730 0x564ecd8ca830 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c01ab30 tx=0x7f1e2c004740 comp rx=0 tx=0).stop 2024-01-15T11:33:35.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e3b154000 1 -- 172.21.15.27:0/3882028890 shutdown_connections 2024-01-15T11:33:35.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e3b154000 1 --2- 172.21.15.27:0/3882028890 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564ecd8cba10 0x564ecd8c9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e3b154000 1 --2- 172.21.15.27:0/3882028890 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x564ecd8cb0f0 0x564ecd8c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e3b154000 1 --2- 172.21.15.27:0/3882028890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd881730 0x564ecd8ca830 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e3b154000 1 -- 172.21.15.27:0/3882028890 >> 172.21.15.27:0/3882028890 conn(0x564ecd8792d0 msgr2=0x564ecd8d86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:35.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e3b154000 1 -- 172.21.15.27:0/3882028890 shutdown_connections 2024-01-15T11:33:35.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e3b154000 1 -- 172.21.15.27:0/3882028890 wait complete. 2024-01-15T11:33:35.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e3b154000 1 -- start start 2024-01-15T11:33:35.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e3b154000 1 Processor -- start 2024-01-15T11:33:35.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e3b154000 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x564ecd881730 0x564ecd8ca700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e3b154000 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564ecd8cb0f0 0x564ecd8de5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e3b154000 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd8cba10 0x564ecd8deb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e3b154000 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ecd8a9dc0 con 0x564ecd8cba10 2024-01-15T11:33:35.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e3b154000 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ecd6783b0 con 0x564ecd8cb0f0 2024-01-15T11:33:35.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e3b154000 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ecd68a9b0 con 0x564ecd881730 2024-01-15T11:33:35.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.203+0000 7f1e3b154000 10 client.0 _ll_register_callbacks cb 0x564ecd71bc00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-15T11:33:35.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e36384640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd8cba10 0x564ecd8deb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e36384640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd8cba10 0x564ecd8deb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52378/0 (socket says 172.21.15.27:52378) 2024-01-15T11:33:35.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e36384640 1 -- 172.21.15.27:0/282637497 learned_addr learned my addr 172.21.15.27:0/282637497 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:35.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e35b83640 1 --2- 172.21.15.27:0/282637497 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x564ecd881730 0x564ecd8ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e35382640 1 --2- 172.21.15.27:0/282637497 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564ecd8cb0f0 0x564ecd8de5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e36384640 1 -- 172.21.15.27:0/282637497 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x564ecd881730 msgr2=0x564ecd8ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:35.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e36384640 1 --2- 172.21.15.27:0/282637497 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x564ecd881730 0x564ecd8ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e36384640 1 -- 172.21.15.27:0/282637497 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564ecd8cb0f0 msgr2=0x564ecd8de5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e36384640 1 --2- 172.21.15.27:0/282637497 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564ecd8cb0f0 0x564ecd8de5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e36384640 1 -- 172.21.15.27:0/282637497 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e300b5a70 con 0x564ecd8cba10 2024-01-15T11:33:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e36384640 1 --2- 172.21.15.27:0/282637497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd8cba10 0x564ecd8deb10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1e28054f00 tx=0x7f1e28082310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f24dd7dbe00968e server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e10ff9640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-01-15T11:33:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e10ff9640 1 -- 172.21.15.27:0/282637497 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2805d110 con 0x564ecd8cba10 2024-01-15T11:33:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e10ff9640 1 -- 172.21.15.27:0/282637497 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e28005720 con 0x564ecd8cba10 2024-01-15T11:33:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e3b154000 1 -- 172.21.15.27:0/282637497 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564ecd6cc110 con 0x564ecd8cba10 2024-01-15T11:33:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e10ff9640 1 -- 172.21.15.27:0/282637497 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e2805b0b0 con 0x564ecd8cba10 2024-01-15T11:33:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e3b154000 10 client.4644 fetch_fsmap learned FSMap version 8 2024-01-15T11:33:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e3b154000 1 -- 172.21.15.27:0/282637497 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x564ecd3c5cc0 con 0x564ecd8cba10 2024-01-15T11:33:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e10ff9640 1 -- 172.21.15.27:0/282637497 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e28066020 con 0x564ecd8cba10 2024-01-15T11:33:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e10ff9640 1 -- 172.21.15.27:0/282637497 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1e28079070 con 0x564ecd8cba10 2024-01-15T11:33:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e3b154000 10 client.4644 fetch_fsmap finished waiting for FSMap version 8 2024-01-15T11:33:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e3b154000 10 client.4644 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-15T11:33:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e3b154000 20 client.4644 populate_metadata read hostname 'smithi027' 2024-01-15T11:33:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e3b154000 1 --2- 172.21.15.27:0/282637497 >> [v2:172.21.15.27:6834/2516765751,v1:172.21.15.27:6835/2516765751] conn(0x564ecd92b430 0x564ecd92b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e3b154000 4 client.4644 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-15T11:33:35.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e3b154000 1 -- 172.21.15.27:0/282637497 --> [v2:172.21.15.27:6834/2516765751,v1:172.21.15.27:6835/2516765751] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564ecd6fb9a0 con 0x564ecd92b430 2024-01-15T11:33:35.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e35b83640 1 --2- 172.21.15.27:0/282637497 >> [v2:172.21.15.27:6834/2516765751,v1:172.21.15.27:6835/2516765751] conn(0x564ecd92b430 0x564ecd92b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e35b83640 1 --2- 172.21.15.27:0/282637497 >> [v2:172.21.15.27:6834/2516765751,v1:172.21.15.27:6835/2516765751] conn(0x564ecd92b430 0x564ecd92b810 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=725d2c903cbe90d3 server_cookie=e17f679060d65910 in_seq=0 out_seq=0 2024-01-15T11:33:35.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e10ff9640 10 client.4644 ms_handle_connect on v2:172.21.15.27:6834/2516765751 2024-01-15T11:33:35.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e10ff9640 1 -- 172.21.15.27:0/282637497 <== mds.0 v2:172.21.15.27:6834/2516765751 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x564ecd6fb9a0 con 0x564ecd92b430 2024-01-15T11:33:35.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e10ff9640 10 client.4644 handle_command_reply: tid=0 2024-01-15T11:33:35.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e3b154000 1 client.4644 shutdown 2024-01-15T11:33:35.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e3b154000 1 -- 172.21.15.27:0/282637497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd8cba10 msgr2=0x564ecd8deb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:35.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e3b154000 1 --2- 172.21.15.27:0/282637497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd8cba10 0x564ecd8deb10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1e28054f00 tx=0x7f1e28082310 comp rx=0 tx=0).stop 2024-01-15T11:33:35.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e3b154000 1 -- 172.21.15.27:0/282637497 shutdown_connections 2024-01-15T11:33:35.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e3b154000 1 --2- 172.21.15.27:0/282637497 >> [v2:172.21.15.27:6834/2516765751,v1:172.21.15.27:6835/2516765751] conn(0x564ecd92b430 0x564ecd92b810 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e3b154000 1 --2- 172.21.15.27:0/282637497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x564ecd8cba10 0x564ecd8deb10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e3b154000 1 --2- 172.21.15.27:0/282637497 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564ecd8cb0f0 0x564ecd8de5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e3b154000 1 --2- 172.21.15.27:0/282637497 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x564ecd881730 0x564ecd8ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e10ff9640 0 client.4644 ms_handle_reset on v2:172.21.15.27:6834/2516765751 2024-01-15T11:33:35.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e3b154000 1 -- 172.21.15.27:0/282637497 >> 172.21.15.27:0/282637497 conn(0x564ecd8792d0 msgr2=0x564ecd87b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:35.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e3b154000 1 -- 172.21.15.27:0/282637497 shutdown_connections 2024-01-15T11:33:35.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e3b154000 1 -- 172.21.15.27:0/282637497 wait complete. 2024-01-15T11:33:35.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e3b154000 20 client.4644 trim_cache size 0 max 16384 2024-01-15T11:33:35.215 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-01-15T11:33:35.215 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "adeed595-43d7-47b7-9d6d-c1a89f44a694", 2024-01-15T11:33:35.215 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 0, 2024-01-15T11:33:35.215 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 4278, 2024-01-15T11:33:35.215 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2024-01-15T11:33:35.215 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2024-01-15T11:33:35.215 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2024-01-15T11:33:35.215 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 14.444298979999999, 2024-01-15T11:33:35.215 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 8, 2024-01-15T11:33:35.215 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 22, 2024-01-15T11:33:35.216 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 22, 2024-01-15T11:33:35.216 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 21.575305626999999 2024-01-15T11:33:35.216 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-01-15T11:33:35.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e37de7640 1 -- 172.21.15.27:0/2154134187 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1e14066920 msgr2=0x7f1e14068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:35.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e37de7640 1 --2- 172.21.15.27:0/2154134187 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1e14066920 0x7f1e14068de0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0ad000 tx=0x7f1e2c0a6000 comp rx=0 tx=0).stop 2024-01-15T11:33:35.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e37de7640 1 -- 172.21.15.27:0/2154134187 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e3015f420 msgr2=0x7f1e30157dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:35.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e37de7640 1 --2- 172.21.15.27:0/2154134187 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e3015f420 0x7f1e30157dd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1e2800c700 tx=0x7f1e2800cbc0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e37de7640 1 -- 172.21.15.27:0/2154134187 shutdown_connections 2024-01-15T11:33:35.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e37de7640 1 --2- 172.21.15.27:0/2154134187 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1e3015f420 0x7f1e30157dd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e37de7640 1 --2- 172.21.15.27:0/2154134187 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1e30144d50 0x7f1e3013a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e37de7640 1 --2- 172.21.15.27:0/2154134187 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1e14066920 0x7f1e14068de0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e37de7640 1 --2- 172.21.15.27:0/2154134187 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e300b5160 0x7f1e30151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.207+0000 7f1e37de7640 1 -- 172.21.15.27:0/2154134187 >> 172.21.15.27:0/2154134187 conn(0x7f1e300b2f10 msgr2=0x7f1e300b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:35.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.211+0000 7f1e37de7640 1 -- 172.21.15.27:0/2154134187 shutdown_connections 2024-01-15T11:33:35.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.211+0000 7f1e37de7640 1 -- 172.21.15.27:0/2154134187 wait complete. 2024-01-15T11:33:35.231 INFO:teuthology.run_tasks:Running task kclient... 2024-01-15T11:33:35.255 INFO:tasks.kclient:Mounting kernel clients... 2024-01-15T11:33:35.255 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-01-15T11:33:35.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:35.255 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2024-01-15T11:33:35.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:35.265 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link delete ceph-brx 2024-01-15T11:33:35.331 INFO:teuthology.orchestra.run.smithi027.stderr:Cannot find device "ceph-brx" 2024-01-15T11:33:35.333 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T11:33:35.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:35.333 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2024-01-15T11:33:35.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:35.385 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link delete ceph-brx 2024-01-15T11:33:35.455 INFO:teuthology.orchestra.run.smithi027.stderr:Cannot find device "ceph-brx" 2024-01-15T11:33:35.457 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T11:33:35.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:35.457 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list 2024-01-15T11:33:35.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:35.468 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link delete ceph-brx 2024-01-15T11:33:35.535 INFO:teuthology.orchestra.run.smithi093.stderr:Cannot find device "ceph-brx" 2024-01-15T11:33:35.537 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T11:33:35.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:35.537 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list 2024-01-15T11:33:35.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:35.588 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link delete ceph-brx 2024-01-15T11:33:35.654 INFO:teuthology.orchestra.run.smithi093.stderr:Cannot find device "ceph-brx" 2024-01-15T11:33:35.656 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-15T11:33:35.657 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-01-15T11:33:35.657 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-15T11:33:35.657 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-15T11:33:35.657 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-15T11:33:35.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.799+0000 7f4c79d0f640 1 Processor -- start 2024-01-15T11:33:35.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.799+0000 7f4c79d0f640 1 -- start start 2024-01-15T11:33:35.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.799+0000 7f4c79d0f640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c7415d7b0 0x7f4c740d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.799+0000 7f4c79d0f640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4c740cead0 0x7f4c740d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.799+0000 7f4c79d0f640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c740cefd0 con 0x7f4c740d1eb0 2024-01-15T11:33:35.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.799+0000 7f4c79d0f640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c740d2340 con 0x7f4c740cead0 2024-01-15T11:33:35.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.799+0000 7f4c79d0f640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c740cf2b0 con 0x7f4c7415d7b0 2024-01-15T11:33:35.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.799+0000 7f4c72ffd640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4c740cead0 0x7f4c740d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.799+0000 7f4c72ffd640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4c740cead0 0x7f4c740d1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52390/0 (socket says 172.21.15.27:52390) 2024-01-15T11:33:35.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.799+0000 7f4c72ffd640 1 -- 172.21.15.27:0/2828055192 learned_addr learned my addr 172.21.15.27:0/2828055192 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:35.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.799+0000 7f4c737fe640 1 --2- 172.21.15.27:0/2828055192 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c7415d7b0 0x7f4c740d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.799+0000 7f4c72ffd640 1 -- 172.21.15.27:0/2828055192 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c7415d7b0 msgr2=0x7f4c740d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:35.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.799+0000 7f4c72ffd640 1 --2- 172.21.15.27:0/2828055192 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c7415d7b0 0x7f4c740d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.799+0000 7f4c72ffd640 1 -- 172.21.15.27:0/2828055192 >> v1:172.21.15.93:6789/0 conn(0x7f4c740d1eb0 legacy=0x7f4c740cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:35.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.799+0000 7f4c72ffd640 1 -- 172.21.15.27:0/2828055192 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7406b3f0 con 0x7f4c740cead0 2024-01-15T11:33:35.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.799+0000 7f4c737fe640 1 --2- 172.21.15.27:0/2828055192 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c7415d7b0 0x7f4c740d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:33:35.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.803+0000 7f4c72ffd640 1 --2- 172.21.15.27:0/2828055192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c740cead0 0x7f4c740d1970 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4c68009870 tx=0x7f4c6801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7cdc2d30c2fa76e server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:35.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.803+0000 7f4c727fc640 1 -- 172.21.15.27:0/2828055192 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c680ab600 con 0x7f4c740cead0 2024-01-15T11:33:35.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.803+0000 7f4c727fc640 1 -- 172.21.15.27:0/2828055192 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c680a7050 con 0x7f4c740cead0 2024-01-15T11:33:35.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.803+0000 7f4c727fc640 1 -- 172.21.15.27:0/2828055192 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c680ab980 con 0x7f4c740cead0 2024-01-15T11:33:35.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.803+0000 7f4c79d0f640 1 -- 172.21.15.27:0/2828055192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c740cead0 msgr2=0x7f4c740d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:35.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.803+0000 7f4c79d0f640 1 --2- 172.21.15.27:0/2828055192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c740cead0 0x7f4c740d1970 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4c68009870 tx=0x7f4c6801c3b0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.803+0000 7f4c79d0f640 1 -- 172.21.15.27:0/2828055192 shutdown_connections 2024-01-15T11:33:35.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.803+0000 7f4c79d0f640 1 --2- 172.21.15.27:0/2828055192 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c740cead0 0x7f4c740d1970 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.803+0000 7f4c79d0f640 1 --2- 172.21.15.27:0/2828055192 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c7415d7b0 0x7f4c740d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.803+0000 7f4c79d0f640 1 -- 172.21.15.27:0/2828055192 >> 172.21.15.27:0/2828055192 conn(0x7f4c740d33b0 msgr2=0x7f4c740d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:35.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.803+0000 7f4c79d0f640 1 -- 172.21.15.27:0/2828055192 shutdown_connections 2024-01-15T11:33:35.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.803+0000 7f4c79d0f640 1 -- 172.21.15.27:0/2828055192 wait complete. 2024-01-15T11:33:35.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.807+0000 7f4c79d0f640 1 Processor -- start 2024-01-15T11:33:35.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.807+0000 7f4c79d0f640 1 -- start start 2024-01-15T11:33:35.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.807+0000 7f4c79d0f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c740cead0 0x7f4c74154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.807+0000 7f4c79d0f640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c740d1eb0 0x7f4c74155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.807+0000 7f4c79d0f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c7415d7b0 0x7f4c740c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.807+0000 7f4c79d0f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c741586e0 con 0x7f4c7415d7b0 2024-01-15T11:33:35.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.807+0000 7f4c79d0f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c74155da0 con 0x7f4c740cead0 2024-01-15T11:33:35.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.807+0000 7f4c79d0f640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c741540b0 con 0x7f4c740d1eb0 2024-01-15T11:33:35.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.807+0000 7f4c73fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c7415d7b0 0x7f4c740c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.807+0000 7f4c73fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c7415d7b0 0x7f4c740c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52392/0 (socket says 172.21.15.27:52392) 2024-01-15T11:33:35.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.807+0000 7f4c73fff640 1 -- 172.21.15.27:0/2248277177 learned_addr learned my addr 172.21.15.27:0/2248277177 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:35.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.807+0000 7f4c72ffd640 1 --2- 172.21.15.27:0/2248277177 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c740d1eb0 0x7f4c74155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.807+0000 7f4c737fe640 1 --2- 172.21.15.27:0/2248277177 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c740cead0 0x7f4c74154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.807+0000 7f4c73fff640 1 -- 172.21.15.27:0/2248277177 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c740d1eb0 msgr2=0x7f4c74155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:35.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.807+0000 7f4c73fff640 1 --2- 172.21.15.27:0/2248277177 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c740d1eb0 0x7f4c74155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.807+0000 7f4c73fff640 1 -- 172.21.15.27:0/2248277177 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c740cead0 msgr2=0x7f4c74154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:35.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.807+0000 7f4c73fff640 1 --2- 172.21.15.27:0/2248277177 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c740cead0 0x7f4c74154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:35.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.807+0000 7f4c73fff640 1 -- 172.21.15.27:0/2248277177 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c680094d0 con 0x7f4c7415d7b0 2024-01-15T11:33:35.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.807+0000 7f4c737fe640 1 --2- 172.21.15.27:0/2248277177 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c740cead0 0x7f4c74154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:35.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.807+0000 7f4c73fff640 1 --2- 172.21.15.27:0/2248277177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c7415d7b0 0x7f4c740c89a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c00b9e0 tx=0x7f4c6c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:35.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.807+0000 7f4c5bfff640 1 -- 172.21.15.27:0/2248277177 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c003b80 con 0x7f4c7415d7b0 2024-01-15T11:33:35.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.807+0000 7f4c5bfff640 1 -- 172.21.15.27:0/2248277177 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6c003ce0 con 0x7f4c7415d7b0 2024-01-15T11:33:35.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.807+0000 7f4c79d0f640 1 -- 172.21.15.27:0/2248277177 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c74154390 con 0x7f4c7415d7b0 2024-01-15T11:33:35.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.807+0000 7f4c5bfff640 1 -- 172.21.15.27:0/2248277177 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c00cae0 con 0x7f4c7415d7b0 2024-01-15T11:33:35.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.807+0000 7f4c79d0f640 1 -- 172.21.15.27:0/2248277177 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c74153010 con 0x7f4c7415d7b0 2024-01-15T11:33:35.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.811+0000 7f4c79d0f640 1 -- 172.21.15.27:0/2248277177 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c74158850 con 0x7f4c7415d7b0 2024-01-15T11:33:35.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.811+0000 7f4c5bfff640 1 -- 172.21.15.27:0/2248277177 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f4c6c00cc40 con 0x7f4c7415d7b0 2024-01-15T11:33:35.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.811+0000 7f4c5bfff640 1 --2- 172.21.15.27:0/2248277177 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4c600668f0 0x7f4c60068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:35.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.811+0000 7f4c5bfff640 1 -- 172.21.15.27:0/2248277177 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c6c0840e0 con 0x7f4c7415d7b0 2024-01-15T11:33:35.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.811+0000 7f4c737fe640 1 --2- 172.21.15.27:0/2248277177 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4c600668f0 0x7f4c60068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:35.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.811+0000 7f4c737fe640 1 --2- 172.21.15.27:0/2248277177 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4c600668f0 0x7f4c60068db0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4c64006fd0 tx=0x7f4c64008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:35.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:35.815+0000 7f4c5bfff640 1 -- 172.21.15.27:0/2248277177 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4c6c051330 con 0x7f4c7415d7b0 2024-01-15T11:33:36.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:36.007+0000 7f4c79d0f640 1 -- 172.21.15.27:0/2248277177 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4c7404e850 con 0x7f4c7415d7b0 2024-01-15T11:33:36.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:36.007+0000 7f4c5bfff640 1 -- 172.21.15.27:0/2248277177 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4c6c054950 con 0x7f4c7415d7b0 2024-01-15T11:33:36.009 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-15T11:33:36.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:36.007+0000 7f4c79d0f640 1 -- 172.21.15.27:0/2248277177 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4c600668f0 msgr2=0x7f4c60068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:36.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:36.007+0000 7f4c79d0f640 1 --2- 172.21.15.27:0/2248277177 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4c600668f0 0x7f4c60068db0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4c64006fd0 tx=0x7f4c64008040 comp rx=0 tx=0).stop 2024-01-15T11:33:36.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:36.007+0000 7f4c79d0f640 1 -- 172.21.15.27:0/2248277177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c7415d7b0 msgr2=0x7f4c740c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:36.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:36.007+0000 7f4c79d0f640 1 --2- 172.21.15.27:0/2248277177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c7415d7b0 0x7f4c740c89a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c00b9e0 tx=0x7f4c6c00bea0 comp rx=0 tx=0).stop 2024-01-15T11:33:36.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:36.007+0000 7f4c79d0f640 1 -- 172.21.15.27:0/2248277177 shutdown_connections 2024-01-15T11:33:36.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:36.007+0000 7f4c79d0f640 1 --2- 172.21.15.27:0/2248277177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4c7415d7b0 0x7f4c740c89a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:36.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:36.007+0000 7f4c79d0f640 1 --2- 172.21.15.27:0/2248277177 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c740d1eb0 0x7f4c74155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:36.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:36.007+0000 7f4c79d0f640 1 --2- 172.21.15.27:0/2248277177 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4c600668f0 0x7f4c60068db0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:36.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:36.007+0000 7f4c79d0f640 1 --2- 172.21.15.27:0/2248277177 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c740cead0 0x7f4c74154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:36.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:36.007+0000 7f4c79d0f640 1 -- 172.21.15.27:0/2248277177 >> 172.21.15.27:0/2248277177 conn(0x7f4c740d33b0 msgr2=0x7f4c740b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:36.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:36.007+0000 7f4c79d0f640 1 -- 172.21.15.27:0/2248277177 shutdown_connections 2024-01-15T11:33:36.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:36.007+0000 7f4c79d0f640 1 -- 172.21.15.27:0/2248277177 wait complete. 2024-01-15T11:33:36.031 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-15T11:33:36.031 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-15T11:33:36.031 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi027.front.sepia.ceph.com 2024-01-15T11:33:36.031 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-15T11:33:36.031 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-15T11:33:36.031 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-15T11:33:36.031 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-15T11:33:36.031 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-15T11:33:36.031 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-15T11:33:36.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:36.031 DEBUG:teuthology.orchestra.run.smithi027:> ip addr 2024-01-15T11:33:36.041 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-15T11:33:36.041 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-15T11:33:36.041 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2024-01-15T11:33:36.041 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:36.041 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2024-01-15T11:33:36.041 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:36.041 INFO:teuthology.orchestra.run.smithi027.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T11:33:36.041 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c8 brd ff:ff:ff:ff:ff:ff 2024-01-15T11:33:36.041 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp7s0f0 2024-01-15T11:33:36.041 INFO:teuthology.orchestra.run.smithi027.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T11:33:36.041 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c9 brd ff:ff:ff:ff:ff:ff 2024-01-15T11:33:36.041 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp7s0f1 2024-01-15T11:33:36.042 INFO:teuthology.orchestra.run.smithi027.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-15T11:33:36.042 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5a brd ff:ff:ff:ff:ff:ff 2024-01-15T11:33:36.042 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp1s0f0 2024-01-15T11:33:36.042 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.21.15.27/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-15T11:33:36.042 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft 42465sec preferred_lft 42465sec 2024-01-15T11:33:36.042 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2024-01-15T11:33:36.042 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:36.042 INFO:teuthology.orchestra.run.smithi027.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T11:33:36.042 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5b brd ff:ff:ff:ff:ff:ff 2024-01-15T11:33:36.042 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp1s0f1 2024-01-15T11:33:36.042 INFO:teuthology.orchestra.run.smithi027.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-15T11:33:36.042 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 02:42:6f:76:e1:a1 brd ff:ff:ff:ff:ff:ff 2024-01-15T11:33:36.042 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-15T11:33:36.042 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:36.043 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-15T11:33:36.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:36.044 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2024-01-15T11:33:36.044 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2024-01-15T11:33:36.044 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link add name ceph-brx type bridge 2024-01-15T11:33:36.044 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip addr flush dev ceph-brx 2024-01-15T11:33:36.044 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set ceph-brx up 2024-01-15T11:33:36.044 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-15T11:33:36.044 DEBUG:teuthology.orchestra.run.smithi027:> ') 2024-01-15T11:33:36.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:36.156 DEBUG:teuthology.orchestra.run.smithi027:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-15T11:33:36.175 INFO:teuthology.orchestra.run.smithi027.stdout:1 2024-01-15T11:33:36.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:36.177 DEBUG:teuthology.orchestra.run.smithi027:> route 2024-01-15T11:33:36.259 INFO:teuthology.orchestra.run.smithi027.stdout:Kernel IP routing table 2024-01-15T11:33:36.259 INFO:teuthology.orchestra.run.smithi027.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-15T11:33:36.259 INFO:teuthology.orchestra.run.smithi027.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-15T11:33:36.260 INFO:teuthology.orchestra.run.smithi027.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-15T11:33:36.260 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-15T11:33:36.260 INFO:teuthology.orchestra.run.smithi027.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-15T11:33:36.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:36.260 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2024-01-15T11:33:36.260 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2024-01-15T11:33:36.260 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-15T11:33:36.260 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-15T11:33:36.260 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-15T11:33:36.260 DEBUG:teuthology.orchestra.run.smithi027:> ') 2024-01-15T11:33:36.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:36.352 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2024-01-15T11:33:36.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:36.363 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list-id 2024-01-15T11:33:36.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:36.417 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2024-01-15T11:33:36.417 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2024-01-15T11:33:36.417 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-15T11:33:36.417 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-01-15T11:33:36.417 DEBUG:teuthology.orchestra.run.smithi027:> ') 2024-01-15T11:33:36.503 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-01-15T11:33:36.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:36.503 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2024-01-15T11:33:36.503 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2024-01-15T11:33:36.503 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-01-15T11:33:36.503 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-15T11:33:36.503 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-01-15T11:33:36.504 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-01-15T11:33:36.504 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-01-15T11:33:36.504 DEBUG:teuthology.orchestra.run.smithi027:> ') 2024-01-15T11:33:36.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:36.676 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2024-01-15T11:33:36.676 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2024-01-15T11:33:36.676 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set brx.0 up 2024-01-15T11:33:36.676 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set dev brx.0 master ceph-brx 2024-01-15T11:33:36.676 DEBUG:teuthology.orchestra.run.smithi027:> ') 2024-01-15T11:33:36.721 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-15T11:33:36.721 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-15T11:33:36.773 INFO:teuthology.orchestra.run.smithi027.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-15T11:33:36.773 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-15T11:33:36.773 DEBUG:teuthology.orchestra.run.smithi027:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-15T11:33:36.828 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-01-15T11:33:36.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:36.828 DEBUG:teuthology.orchestra.run.smithi027:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T11:33:36.936 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T11:33:36.936 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-15T11:33:37.052 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T11:33:37.052 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-15T11:33:37.052 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: resolved to: "172.21.15.27:3300,172.21.15.93:3300,172.21.15.93:3301" 2024-01-15T11:33:37.052 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: trying mount with new device syntax: 0@adeed595-43d7-47b7-9d6d-c1a89f44a694.cephfs=/ 2024-01-15T11:33:37.052 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.27:3300/172.21.15.93:3300/172.21.15.93:3301" will pass to kernel 2024-01-15T11:33:37.056 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-15T11:33:37.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:37.056 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-15T11:33:37.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:37.078 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T11:33:37.148 INFO:teuthology.orchestra.run.smithi027.stdout:client4526 2024-01-15T11:33:37.148 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:33:37.148 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T11:33:37.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:37.201 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T11:33:37.263 INFO:teuthology.orchestra.run.smithi027.stdout:client4526 2024-01-15T11:33:37.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:37.264 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T11:33:37.323 INFO:teuthology.orchestra.run.smithi027.stdout:client4526 2024-01-15T11:33:37.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:37.323 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/adeed595-43d7-47b7-9d6d-c1a89f44a694.client4526/status') 2024-01-15T11:33:37.389 INFO:teuthology.orchestra.run.smithi027.stdout:instance: client.4526 (3)172.21.15.27:0/355435106 2024-01-15T11:33:37.389 INFO:teuthology.orchestra.run.smithi027.stdout:blocklisted: false 2024-01-15T11:33:37.390 INFO:teuthology.orchestra.run.smithi027.stderr:0+1 records in 2024-01-15T11:33:37.390 INFO:teuthology.orchestra.run.smithi027.stderr:0+1 records out 2024-01-15T11:33:37.390 INFO:teuthology.orchestra.run.smithi027.stderr:69 bytes copied, 5.4414e-05 s, 1.3 MB/s 2024-01-15T11:33:37.392 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-01-15T11:33:37.392 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-15T11:33:37.392 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-01-15T11:33:37.392 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-15T11:33:37.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.571+0000 7fc1d66c9640 1 Processor -- start 2024-01-15T11:33:37.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.571+0000 7fc1d66c9640 1 -- start start 2024-01-15T11:33:37.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.571+0000 7fc1d66c9640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc1d015d7b0 0x7fc1d00d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:37.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.571+0000 7fc1d66c9640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc1d00d2080 0x7fc1d006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:37.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.571+0000 7fc1d66c9640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d00cefd0 con 0x7fc1d00cead0 2024-01-15T11:33:37.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.571+0000 7fc1d66c9640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d00cf2b0 con 0x7fc1d015d7b0 2024-01-15T11:33:37.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.571+0000 7fc1d66c9640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d006b3f0 con 0x7fc1d00d2080 2024-01-15T11:33:37.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.571+0000 7fc1cffff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc1d015d7b0 0x7fc1d00d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:37.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.571+0000 7fc1cffff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc1d015d7b0 0x7fc1d00d10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52394/0 (socket says 172.21.15.27:52394) 2024-01-15T11:33:37.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.571+0000 7fc1cffff640 1 -- 172.21.15.27:0/1171029694 learned_addr learned my addr 172.21.15.27:0/1171029694 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:37.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.571+0000 7fc1d4c66640 1 --2- 172.21.15.27:0/1171029694 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc1d00d2080 0x7fc1d006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:37.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.571+0000 7fc1cffff640 1 -- 172.21.15.27:0/1171029694 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc1d00d2080 msgr2=0x7fc1d006bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:37.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.571+0000 7fc1cffff640 1 --2- 172.21.15.27:0/1171029694 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc1d00d2080 0x7fc1d006bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:37.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.571+0000 7fc1cffff640 1 -- 172.21.15.27:0/1171029694 >> v1:172.21.15.93:6789/0 conn(0x7fc1d00cead0 legacy=0x7fc1d00d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:37.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.571+0000 7fc1cffff640 1 -- 172.21.15.27:0/1171029694 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d006b6d0 con 0x7fc1d015d7b0 2024-01-15T11:33:37.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.575+0000 7fc1cffff640 1 --2- 172.21.15.27:0/1171029694 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1d015d7b0 0x7fc1d00d10d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009870 tx=0x7fc1c001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bfe97dc3f4fd4bc server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:37.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.575+0000 7fc1ceffd640 1 -- 172.21.15.27:0/1171029694 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c00ab610 con 0x7fc1d015d7b0 2024-01-15T11:33:37.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.575+0000 7fc1ceffd640 1 -- 172.21.15.27:0/1171029694 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c00ab770 con 0x7fc1d015d7b0 2024-01-15T11:33:37.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.575+0000 7fc1ceffd640 1 -- 172.21.15.27:0/1171029694 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c00abb00 con 0x7fc1d015d7b0 2024-01-15T11:33:37.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.575+0000 7fc1d66c9640 1 -- 172.21.15.27:0/1171029694 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1d015d7b0 msgr2=0x7fc1d00d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:37.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.575+0000 7fc1d66c9640 1 --2- 172.21.15.27:0/1171029694 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1d015d7b0 0x7fc1d00d10d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009870 tx=0x7fc1c001c3f0 comp rx=0 tx=0).stop 2024-01-15T11:33:37.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.575+0000 7fc1d66c9640 1 -- 172.21.15.27:0/1171029694 shutdown_connections 2024-01-15T11:33:37.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.575+0000 7fc1d66c9640 1 --2- 172.21.15.27:0/1171029694 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc1d00d2080 0x7fc1d006bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:37.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.575+0000 7fc1d66c9640 1 --2- 172.21.15.27:0/1171029694 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1d015d7b0 0x7fc1d00d10d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:37.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.575+0000 7fc1d66c9640 1 -- 172.21.15.27:0/1171029694 >> 172.21.15.27:0/1171029694 conn(0x7fc1d00d33b0 msgr2=0x7fc1d00d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:37.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.575+0000 7fc1d66c9640 1 -- 172.21.15.27:0/1171029694 shutdown_connections 2024-01-15T11:33:37.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.575+0000 7fc1d66c9640 1 -- 172.21.15.27:0/1171029694 wait complete. 2024-01-15T11:33:37.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.579+0000 7fc1d66c9640 1 Processor -- start 2024-01-15T11:33:37.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.579+0000 7fc1d66c9640 1 -- start start 2024-01-15T11:33:37.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.579+0000 7fc1d66c9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1d00cead0 0x7fc1d01525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:37.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.579+0000 7fc1d66c9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1d00d2080 0x7fc1d0152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:37.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.579+0000 7fc1d66c9640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc1d015d7b0 0x7fc1d00c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:37.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.579+0000 7fc1d66c9640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d0153050 con 0x7fc1d00d2080 2024-01-15T11:33:37.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.579+0000 7fc1d66c9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d00ccc70 con 0x7fc1d00cead0 2024-01-15T11:33:37.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.579+0000 7fc1d66c9640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d0153c00 con 0x7fc1d015d7b0 2024-01-15T11:33:37.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.579+0000 7fc1cf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1d00d2080 0x7fc1d0152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:37.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.579+0000 7fc1cffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1d00cead0 0x7fc1d01525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:37.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.579+0000 7fc1cffff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1d00cead0 0x7fc1d01525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:51714/0 (socket says 172.21.15.27:51714) 2024-01-15T11:33:37.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.579+0000 7fc1cffff640 1 -- 172.21.15.27:0/980958848 learned_addr learned my addr 172.21.15.27:0/980958848 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:37.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.579+0000 7fc1d4c66640 1 --2- 172.21.15.27:0/980958848 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc1d015d7b0 0x7fc1d00c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:37.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.579+0000 7fc1cf7fe640 1 -- 172.21.15.27:0/980958848 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc1d015d7b0 msgr2=0x7fc1d00c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:37.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.579+0000 7fc1cf7fe640 1 --2- 172.21.15.27:0/980958848 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc1d015d7b0 0x7fc1d00c89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:37.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.579+0000 7fc1cf7fe640 1 -- 172.21.15.27:0/980958848 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1d00cead0 msgr2=0x7fc1d01525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:37.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.579+0000 7fc1cf7fe640 1 --2- 172.21.15.27:0/980958848 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1d00cead0 0x7fc1d01525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:37.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.579+0000 7fc1cf7fe640 1 -- 172.21.15.27:0/980958848 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c00094d0 con 0x7fc1d00d2080 2024-01-15T11:33:37.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.579+0000 7fc1cffff640 1 --2- 172.21.15.27:0/980958848 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1d00cead0 0x7fc1d01525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:37.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.579+0000 7fc1cf7fe640 1 --2- 172.21.15.27:0/980958848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1d00d2080 0x7fc1d0152b10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4000f70 tx=0x7fc1c400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:37.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.579+0000 7fc1ccff9640 1 -- 172.21.15.27:0/980958848 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c40052d0 con 0x7fc1d00d2080 2024-01-15T11:33:37.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.579+0000 7fc1ccff9640 1 -- 172.21.15.27:0/980958848 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c4005430 con 0x7fc1d00d2080 2024-01-15T11:33:37.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.579+0000 7fc1ccff9640 1 -- 172.21.15.27:0/980958848 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4003840 con 0x7fc1d00d2080 2024-01-15T11:33:37.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.579+0000 7fc1d66c9640 1 -- 172.21.15.27:0/980958848 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d0153ee0 con 0x7fc1d00d2080 2024-01-15T11:33:37.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.579+0000 7fc1d66c9640 1 -- 172.21.15.27:0/980958848 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d01544a0 con 0x7fc1d00d2080 2024-01-15T11:33:37.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.583+0000 7fc1d66c9640 1 -- 172.21.15.27:0/980958848 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d00ca460 con 0x7fc1d00d2080 2024-01-15T11:33:37.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.583+0000 7fc1ccff9640 1 -- 172.21.15.27:0/980958848 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fc1c40039a0 con 0x7fc1d00d2080 2024-01-15T11:33:37.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.583+0000 7fc1ccff9640 1 --2- 172.21.15.27:0/980958848 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc1bc0668f0 0x7fc1bc068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:37.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.583+0000 7fc1ccff9640 1 -- 172.21.15.27:0/980958848 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1c40837a0 con 0x7fc1d00d2080 2024-01-15T11:33:37.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.583+0000 7fc1cffff640 1 --2- 172.21.15.27:0/980958848 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc1bc0668f0 0x7fc1bc068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:37.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.583+0000 7fc1cffff640 1 --2- 172.21.15.27:0/980958848 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc1bc0668f0 0x7fc1bc068db0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc1c001c430 tx=0x7fc1c00b6040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:37.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.587+0000 7fc1ccff9640 1 -- 172.21.15.27:0/980958848 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc1c4050b20 con 0x7fc1d00d2080 2024-01-15T11:33:37.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.779+0000 7fc1d66c9640 1 -- 172.21.15.27:0/980958848 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc1d004e850 con 0x7fc1d00d2080 2024-01-15T11:33:37.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.779+0000 7fc1ccff9640 1 -- 172.21.15.27:0/980958848 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc1c4017060 con 0x7fc1d00d2080 2024-01-15T11:33:37.783 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-15T11:33:37.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.783+0000 7fc1d66c9640 1 -- 172.21.15.27:0/980958848 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc1bc0668f0 msgr2=0x7fc1bc068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:37.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.783+0000 7fc1d66c9640 1 --2- 172.21.15.27:0/980958848 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc1bc0668f0 0x7fc1bc068db0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc1c001c430 tx=0x7fc1c00b6040 comp rx=0 tx=0).stop 2024-01-15T11:33:37.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.783+0000 7fc1d66c9640 1 -- 172.21.15.27:0/980958848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1d00d2080 msgr2=0x7fc1d0152b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:37.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.783+0000 7fc1d66c9640 1 --2- 172.21.15.27:0/980958848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1d00d2080 0x7fc1d0152b10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4000f70 tx=0x7fc1c400c820 comp rx=0 tx=0).stop 2024-01-15T11:33:37.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.783+0000 7fc1d66c9640 1 -- 172.21.15.27:0/980958848 shutdown_connections 2024-01-15T11:33:37.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.783+0000 7fc1d66c9640 1 --2- 172.21.15.27:0/980958848 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc1d015d7b0 0x7fc1d00c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:37.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.783+0000 7fc1d66c9640 1 --2- 172.21.15.27:0/980958848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1d00d2080 0x7fc1d0152b10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:37.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.783+0000 7fc1d66c9640 1 --2- 172.21.15.27:0/980958848 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc1bc0668f0 0x7fc1bc068db0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:37.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.783+0000 7fc1d66c9640 1 --2- 172.21.15.27:0/980958848 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc1d00cead0 0x7fc1d01525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:37.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.783+0000 7fc1d66c9640 1 -- 172.21.15.27:0/980958848 >> 172.21.15.27:0/980958848 conn(0x7fc1d00d33b0 msgr2=0x7fc1d015ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:37.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.783+0000 7fc1d66c9640 1 -- 172.21.15.27:0/980958848 shutdown_connections 2024-01-15T11:33:37.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:37.783+0000 7fc1d66c9640 1 -- 172.21.15.27:0/980958848 wait complete. 2024-01-15T11:33:37.804 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-15T11:33:37.804 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-15T11:33:37.805 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi027.front.sepia.ceph.com 2024-01-15T11:33:37.805 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-01-15T11:33:37.805 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-01-15T11:33:37.805 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-15T11:33:37.805 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-15T11:33:37.805 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-15T11:33:37.805 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-01-15T11:33:37.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:37.805 DEBUG:teuthology.orchestra.run.smithi027:> ip addr 2024-01-15T11:33:37.815 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-15T11:33:37.815 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-15T11:33:37.815 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2024-01-15T11:33:37.815 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:37.815 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2024-01-15T11:33:37.815 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:37.815 INFO:teuthology.orchestra.run.smithi027.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T11:33:37.816 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c8 brd ff:ff:ff:ff:ff:ff 2024-01-15T11:33:37.816 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp7s0f0 2024-01-15T11:33:37.816 INFO:teuthology.orchestra.run.smithi027.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T11:33:37.816 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c9 brd ff:ff:ff:ff:ff:ff 2024-01-15T11:33:37.816 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp7s0f1 2024-01-15T11:33:37.816 INFO:teuthology.orchestra.run.smithi027.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-15T11:33:37.816 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5a brd ff:ff:ff:ff:ff:ff 2024-01-15T11:33:37.816 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp1s0f0 2024-01-15T11:33:37.816 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.21.15.27/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-15T11:33:37.816 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft 42463sec preferred_lft 42463sec 2024-01-15T11:33:37.816 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2024-01-15T11:33:37.816 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:37.816 INFO:teuthology.orchestra.run.smithi027.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T11:33:37.816 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5b brd ff:ff:ff:ff:ff:ff 2024-01-15T11:33:37.816 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp1s0f1 2024-01-15T11:33:37.817 INFO:teuthology.orchestra.run.smithi027.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-15T11:33:37.817 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 02:42:6f:76:e1:a1 brd ff:ff:ff:ff:ff:ff 2024-01-15T11:33:37.817 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-15T11:33:37.817 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:37.817 INFO:teuthology.orchestra.run.smithi027.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-15T11:33:37.817 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-15T11:33:37.817 INFO:teuthology.orchestra.run.smithi027.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-15T11:33:37.817 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:37.817 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2024-01-15T11:33:37.817 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:37.817 INFO:teuthology.orchestra.run.smithi027.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-15T11:33:37.817 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-15T11:33:37.817 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-01-15T11:33:37.817 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:37.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:37.818 DEBUG:teuthology.orchestra.run.smithi027:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-15T11:33:37.879 INFO:teuthology.orchestra.run.smithi027.stdout:1 2024-01-15T11:33:37.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:37.881 DEBUG:teuthology.orchestra.run.smithi027:> route 2024-01-15T11:33:37.938 INFO:teuthology.orchestra.run.smithi027.stdout:Kernel IP routing table 2024-01-15T11:33:37.938 INFO:teuthology.orchestra.run.smithi027.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-15T11:33:37.938 INFO:teuthology.orchestra.run.smithi027.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-15T11:33:37.938 INFO:teuthology.orchestra.run.smithi027.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-15T11:33:37.938 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-15T11:33:37.938 INFO:teuthology.orchestra.run.smithi027.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-15T11:33:37.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:37.939 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2024-01-15T11:33:37.939 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2024-01-15T11:33:37.939 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-15T11:33:37.939 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-15T11:33:37.939 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-15T11:33:37.939 DEBUG:teuthology.orchestra.run.smithi027:> ') 2024-01-15T11:33:38.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:38.036 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2024-01-15T11:33:38.046 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-15T11:33:38.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:38.046 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list-id 2024-01-15T11:33:38.100 INFO:teuthology.orchestra.run.smithi027.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-01-15T11:33:38.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:38.102 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2024-01-15T11:33:38.102 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2024-01-15T11:33:38.102 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-15T11:33:38.102 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-01-15T11:33:38.102 DEBUG:teuthology.orchestra.run.smithi027:> ') 2024-01-15T11:33:38.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:38.188 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-01-15T11:33:38.257 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-15T11:33:38.257 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-15T11:33:38.257 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2024-01-15T11:33:38.258 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:38.258 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2024-01-15T11:33:38.258 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:38.258 INFO:teuthology.orchestra.run.smithi027.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-15T11:33:38.258 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 82:0a:ad:b4:34:99 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-15T11:33:38.258 INFO:teuthology.orchestra.run.smithi027.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-15T11:33:38.258 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:38.258 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::800a:adff:feb4:3499/64 scope link 2024-01-15T11:33:38.258 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:38.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:38.260 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-01-15T11:33:38.321 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-15T11:33:38.322 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-15T11:33:38.322 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2024-01-15T11:33:38.322 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:38.322 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2024-01-15T11:33:38.322 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:38.322 INFO:teuthology.orchestra.run.smithi027.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-15T11:33:38.322 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 82:0a:ad:b4:34:99 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-15T11:33:38.322 INFO:teuthology.orchestra.run.smithi027.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-15T11:33:38.322 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:38.322 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::800a:adff:feb4:3499/64 scope link 2024-01-15T11:33:38.323 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:38.324 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-01-15T11:33:38.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:38.324 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2024-01-15T11:33:38.324 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2024-01-15T11:33:38.324 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-01-15T11:33:38.324 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-01-15T11:33:38.324 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-01-15T11:33:38.324 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-01-15T11:33:38.324 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-01-15T11:33:38.325 DEBUG:teuthology.orchestra.run.smithi027:> ') 2024-01-15T11:33:38.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:38.471 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2024-01-15T11:33:38.472 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2024-01-15T11:33:38.472 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set brx.1 up 2024-01-15T11:33:38.472 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set dev brx.1 master ceph-brx 2024-01-15T11:33:38.472 DEBUG:teuthology.orchestra.run.smithi027:> ') 2024-01-15T11:33:38.512 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-15T11:33:38.512 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-01-15T11:33:38.565 INFO:teuthology.orchestra.run.smithi027.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-01-15T11:33:38.565 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-15T11:33:38.565 DEBUG:teuthology.orchestra.run.smithi027:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-01-15T11:33:38.619 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-01-15T11:33:38.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:38.620 DEBUG:teuthology.orchestra.run.smithi027:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T11:33:38.715 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T11:33:38.715 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-15T11:33:38.728 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T11:33:38.728 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-15T11:33:38.728 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: resolved to: "172.21.15.27:3300,172.21.15.93:3300,172.21.15.93:3301" 2024-01-15T11:33:38.728 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: trying mount with new device syntax: 2@adeed595-43d7-47b7-9d6d-c1a89f44a694.cephfs=/ 2024-01-15T11:33:38.728 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.27:3300/172.21.15.93:3300/172.21.15.93:3301" will pass to kernel 2024-01-15T11:33:38.731 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-15T11:33:38.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:38.732 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-01-15T11:33:38.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:38.752 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T11:33:38.807 INFO:teuthology.orchestra.run.smithi027.stdout:client4659 2024-01-15T11:33:38.807 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:33:38.807 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T11:33:38.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:38.857 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T11:33:38.911 INFO:teuthology.orchestra.run.smithi027.stdout:client4659 2024-01-15T11:33:38.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:38.911 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T11:33:38.963 INFO:teuthology.orchestra.run.smithi027.stdout:client4659 2024-01-15T11:33:38.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:38.963 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/adeed595-43d7-47b7-9d6d-c1a89f44a694.client4659/status') 2024-01-15T11:33:39.029 INFO:teuthology.orchestra.run.smithi027.stdout:instance: client.4659 (3)192.168.0.2:0/704375571 2024-01-15T11:33:39.029 INFO:teuthology.orchestra.run.smithi027.stdout:blocklisted: false 2024-01-15T11:33:39.029 INFO:teuthology.orchestra.run.smithi027.stderr:0+1 records in 2024-01-15T11:33:39.029 INFO:teuthology.orchestra.run.smithi027.stderr:0+1 records out 2024-01-15T11:33:39.029 INFO:teuthology.orchestra.run.smithi027.stderr:68 bytes copied, 5.3867e-05 s, 1.3 MB/s 2024-01-15T11:33:39.031 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-01-15T11:33:39.031 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-15T11:33:39.031 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-15T11:33:39.031 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-15T11:33:39.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.211+0000 7f5f55cbb640 1 Processor -- start 2024-01-15T11:33:39.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.211+0000 7f5f55cbb640 1 -- start start 2024-01-15T11:33:39.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.211+0000 7f5f55cbb640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5f5015d530 0x7f5f500cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:39.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.211+0000 7f5f55cbb640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5f500cf1b0 0x7f5f500cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:39.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.211+0000 7f5f55cbb640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f500d12e0 con 0x7f5f500d02f0 2024-01-15T11:33:39.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.211+0000 7f5f55cbb640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f500d07a0 con 0x7f5f5015d530 2024-01-15T11:33:39.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.211+0000 7f5f55cbb640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f500d15c0 con 0x7f5f500cf1b0 2024-01-15T11:33:39.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.215+0000 7f5f4f7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5f5015d530 0x7f5f500cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:39.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.215+0000 7f5f4ffff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f5f500d02f0 0x7f5f501611a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42394/0 (socket says 172.21.15.27:42394) 2024-01-15T11:33:39.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.215+0000 7f5f4ffff640 1 -- 172.21.15.27:0/2627613153 learned_addr learned my addr 172.21.15.27:0/2627613153 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:39.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.215+0000 7f5f4effd640 1 --2- 172.21.15.27:0/2627613153 >> v2:172.21.15.93:3300/0 conn(0x7f5f500cf1b0 0x7f5f500cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:39.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.215+0000 7f5f4f7fe640 1 -- 172.21.15.27:0/2627613153 >> v2:172.21.15.93:3300/0 conn(0x7f5f500cf1b0 msgr2=0x7f5f500cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:39.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.215+0000 7f5f4f7fe640 1 --2- 172.21.15.27:0/2627613153 >> v2:172.21.15.93:3300/0 conn(0x7f5f500cf1b0 0x7f5f500cfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:39.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.215+0000 7f5f4f7fe640 1 -- 172.21.15.27:0/2627613153 >> v1:172.21.15.27:6789/0 conn(0x7f5f500d02f0 legacy=0x7f5f501611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:39.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.215+0000 7f5f4f7fe640 1 -- 172.21.15.27:0/2627613153 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f500d18a0 con 0x7f5f5015d530 2024-01-15T11:33:39.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.215+0000 7f5f4f7fe640 1 --2- 172.21.15.27:0/2627613153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f5015d530 0x7f5f500cec70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5f400097c0 tx=0x7f5f4001ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205c24b10169d2a8 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:39.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.215+0000 7f5f4e7fc640 1 -- 172.21.15.27:0/2627613153 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f400a8930 con 0x7f5f5015d530 2024-01-15T11:33:39.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.215+0000 7f5f4e7fc640 1 -- 172.21.15.27:0/2627613153 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f400a8a90 con 0x7f5f5015d530 2024-01-15T11:33:39.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.215+0000 7f5f4e7fc640 1 -- 172.21.15.27:0/2627613153 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f400a8e20 con 0x7f5f5015d530 2024-01-15T11:33:39.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f55cbb640 1 -- 172.21.15.27:0/2627613153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f5015d530 msgr2=0x7f5f500cec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:39.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f55cbb640 1 --2- 172.21.15.27:0/2627613153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f5015d530 0x7f5f500cec70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5f400097c0 tx=0x7f5f4001ec30 comp rx=0 tx=0).stop 2024-01-15T11:33:39.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f55cbb640 1 -- 172.21.15.27:0/2627613153 shutdown_connections 2024-01-15T11:33:39.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f55cbb640 1 --2- 172.21.15.27:0/2627613153 >> v2:172.21.15.93:3300/0 conn(0x7f5f500cf1b0 0x7f5f500cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:39.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f55cbb640 1 --2- 172.21.15.27:0/2627613153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f5015d530 0x7f5f500cec70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:39.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f55cbb640 1 -- 172.21.15.27:0/2627613153 >> 172.21.15.27:0/2627613153 conn(0x7f5f5009c6d0 msgr2=0x7f5f500d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:39.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f55cbb640 1 -- 172.21.15.27:0/2627613153 shutdown_connections 2024-01-15T11:33:39.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f55cbb640 1 -- 172.21.15.27:0/2627613153 wait complete. 2024-01-15T11:33:39.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f55cbb640 1 Processor -- start 2024-01-15T11:33:39.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f55cbb640 1 -- start start 2024-01-15T11:33:39.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f55cbb640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5f500cf1b0 0x7f5f500c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:39.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f55cbb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f500d02f0 0x7f5f501f7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:39.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f55cbb640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f5015d530 0x7f5f50156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:39.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f55cbb640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5015ee00 con 0x7f5f500d02f0 2024-01-15T11:33:39.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f55cbb640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f501f79a0 con 0x7f5f5015d530 2024-01-15T11:33:39.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f55cbb640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5006c8b0 con 0x7f5f500cf1b0 2024-01-15T11:33:39.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f4effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f500d02f0 0x7f5f501f7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:39.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f4effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f500d02f0 0x7f5f501f7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52424/0 (socket says 172.21.15.27:52424) 2024-01-15T11:33:39.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f4effd640 1 -- 172.21.15.27:0/3313224116 learned_addr learned my addr 172.21.15.27:0/3313224116 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:39.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f4f7fe640 1 --2- 172.21.15.27:0/3313224116 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5f500cf1b0 0x7f5f500c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:39.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f4ffff640 1 --2- 172.21.15.27:0/3313224116 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f5015d530 0x7f5f50156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:39.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f4effd640 1 -- 172.21.15.27:0/3313224116 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5f500cf1b0 msgr2=0x7f5f500c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:39.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f4effd640 1 --2- 172.21.15.27:0/3313224116 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5f500cf1b0 0x7f5f500c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:39.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f4effd640 1 -- 172.21.15.27:0/3313224116 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f5015d530 msgr2=0x7f5f50156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:39.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f4effd640 1 --2- 172.21.15.27:0/3313224116 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f5015d530 0x7f5f50156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:39.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.219+0000 7f5f4effd640 1 -- 172.21.15.27:0/3313224116 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f40009420 con 0x7f5f500d02f0 2024-01-15T11:33:39.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.223+0000 7f5f4effd640 1 --2- 172.21.15.27:0/3313224116 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f500d02f0 0x7f5f501f7460 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400d5d0 tx=0x7f5f4400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:39.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.223+0000 7f5f37fff640 1 -- 172.21.15.27:0/3313224116 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44004240 con 0x7f5f500d02f0 2024-01-15T11:33:39.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.223+0000 7f5f37fff640 1 -- 172.21.15.27:0/3313224116 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f440043a0 con 0x7f5f500d02f0 2024-01-15T11:33:39.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.223+0000 7f5f55cbb640 1 -- 172.21.15.27:0/3313224116 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f501f7bb0 con 0x7f5f500d02f0 2024-01-15T11:33:39.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.223+0000 7f5f37fff640 1 -- 172.21.15.27:0/3313224116 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44003840 con 0x7f5f500d02f0 2024-01-15T11:33:39.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.223+0000 7f5f55cbb640 1 -- 172.21.15.27:0/3313224116 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f501f8170 con 0x7f5f500d02f0 2024-01-15T11:33:39.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.223+0000 7f5f55cbb640 1 -- 172.21.15.27:0/3313224116 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f5004e850 con 0x7f5f500d02f0 2024-01-15T11:33:39.230 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.223+0000 7f5f37fff640 1 -- 172.21.15.27:0/3313224116 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f5f440039a0 con 0x7f5f500d02f0 2024-01-15T11:33:39.230 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.223+0000 7f5f37fff640 1 --2- 172.21.15.27:0/3313224116 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5f3c0668f0 0x7f5f3c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:39.230 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.223+0000 7f5f37fff640 1 -- 172.21.15.27:0/3313224116 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f44084530 con 0x7f5f500d02f0 2024-01-15T11:33:39.230 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.223+0000 7f5f4f7fe640 1 --2- 172.21.15.27:0/3313224116 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5f3c0668f0 0x7f5f3c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:39.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.227+0000 7f5f4f7fe640 1 --2- 172.21.15.27:0/3313224116 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5f3c0668f0 0x7f5f3c068db0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5f400b2000 tx=0x7f5f40008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:39.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.227+0000 7f5f37fff640 1 -- 172.21.15.27:0/3313224116 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5f44051760 con 0x7f5f500d02f0 2024-01-15T11:33:39.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.423+0000 7f5f55cbb640 1 -- 172.21.15.27:0/3313224116 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5f500cf980 con 0x7f5f500d02f0 2024-01-15T11:33:39.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.423+0000 7f5f37fff640 1 -- 172.21.15.27:0/3313224116 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5f44054d80 con 0x7f5f500d02f0 2024-01-15T11:33:39.427 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-15T11:33:39.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.427+0000 7f5f55cbb640 1 -- 172.21.15.27:0/3313224116 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5f3c0668f0 msgr2=0x7f5f3c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:39.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.427+0000 7f5f55cbb640 1 --2- 172.21.15.27:0/3313224116 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5f3c0668f0 0x7f5f3c068db0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5f400b2000 tx=0x7f5f40008040 comp rx=0 tx=0).stop 2024-01-15T11:33:39.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.427+0000 7f5f55cbb640 1 -- 172.21.15.27:0/3313224116 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f500d02f0 msgr2=0x7f5f501f7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:39.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.427+0000 7f5f55cbb640 1 --2- 172.21.15.27:0/3313224116 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f500d02f0 0x7f5f501f7460 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400d5d0 tx=0x7f5f4400da90 comp rx=0 tx=0).stop 2024-01-15T11:33:39.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.427+0000 7f5f55cbb640 1 -- 172.21.15.27:0/3313224116 shutdown_connections 2024-01-15T11:33:39.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.427+0000 7f5f55cbb640 1 --2- 172.21.15.27:0/3313224116 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5f3c0668f0 0x7f5f3c068db0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:39.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.427+0000 7f5f55cbb640 1 --2- 172.21.15.27:0/3313224116 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5f5015d530 0x7f5f50156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:39.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.427+0000 7f5f55cbb640 1 --2- 172.21.15.27:0/3313224116 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f500d02f0 0x7f5f501f7460 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:39.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.427+0000 7f5f55cbb640 1 --2- 172.21.15.27:0/3313224116 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5f500cf1b0 0x7f5f500c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:39.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.427+0000 7f5f55cbb640 1 -- 172.21.15.27:0/3313224116 >> 172.21.15.27:0/3313224116 conn(0x7f5f5009c6d0 msgr2=0x7f5f500d3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:39.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.427+0000 7f5f55cbb640 1 -- 172.21.15.27:0/3313224116 shutdown_connections 2024-01-15T11:33:39.431 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:39.427+0000 7f5f55cbb640 1 -- 172.21.15.27:0/3313224116 wait complete. 2024-01-15T11:33:39.448 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-15T11:33:39.449 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-15T11:33:39.449 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi093.front.sepia.ceph.com 2024-01-15T11:33:39.449 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-15T11:33:39.449 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-15T11:33:39.449 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-15T11:33:39.449 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-15T11:33:39.449 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-15T11:33:39.449 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-15T11:33:39.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:39.450 DEBUG:teuthology.orchestra.run.smithi093:> ip addr 2024-01-15T11:33:39.461 INFO:teuthology.orchestra.run.smithi093.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-15T11:33:39.461 INFO:teuthology.orchestra.run.smithi093.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-15T11:33:39.461 INFO:teuthology.orchestra.run.smithi093.stdout: inet 127.0.0.1/8 scope host lo 2024-01-15T11:33:39.462 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:39.462 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 ::1/128 scope host 2024-01-15T11:33:39.462 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:39.462 INFO:teuthology.orchestra.run.smithi093.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T11:33:39.462 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1c brd ff:ff:ff:ff:ff:ff 2024-01-15T11:33:39.462 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f0 2024-01-15T11:33:39.462 INFO:teuthology.orchestra.run.smithi093.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T11:33:39.462 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1d brd ff:ff:ff:ff:ff:ff 2024-01-15T11:33:39.462 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f1 2024-01-15T11:33:39.463 INFO:teuthology.orchestra.run.smithi093.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T11:33:39.463 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:34 brd ff:ff:ff:ff:ff:ff 2024-01-15T11:33:39.463 INFO:teuthology.orchestra.run.smithi093.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-15T11:33:39.463 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:35 brd ff:ff:ff:ff:ff:ff 2024-01-15T11:33:39.463 INFO:teuthology.orchestra.run.smithi093.stdout: inet 172.21.15.93/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-15T11:33:39.463 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft 42441sec preferred_lft 42441sec 2024-01-15T11:33:39.463 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::ec4:7aff:fe8f:d635/64 scope link 2024-01-15T11:33:39.463 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:39.463 INFO:teuthology.orchestra.run.smithi093.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-15T11:33:39.464 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 02:42:04:9e:20:9c brd ff:ff:ff:ff:ff:ff 2024-01-15T11:33:39.464 INFO:teuthology.orchestra.run.smithi093.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-15T11:33:39.464 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:39.464 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-15T11:33:39.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:39.464 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2024-01-15T11:33:39.465 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2024-01-15T11:33:39.465 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link add name ceph-brx type bridge 2024-01-15T11:33:39.465 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip addr flush dev ceph-brx 2024-01-15T11:33:39.465 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set ceph-brx up 2024-01-15T11:33:39.465 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-15T11:33:39.465 DEBUG:teuthology.orchestra.run.smithi093:> ') 2024-01-15T11:33:39.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:39.577 DEBUG:teuthology.orchestra.run.smithi093:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-15T11:33:39.597 INFO:teuthology.orchestra.run.smithi093.stdout:1 2024-01-15T11:33:39.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:39.600 DEBUG:teuthology.orchestra.run.smithi093:> route 2024-01-15T11:33:39.675 INFO:teuthology.orchestra.run.smithi093.stdout:Kernel IP routing table 2024-01-15T11:33:39.675 INFO:teuthology.orchestra.run.smithi093.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-15T11:33:39.675 INFO:teuthology.orchestra.run.smithi093.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-15T11:33:39.675 INFO:teuthology.orchestra.run.smithi093.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-15T11:33:39.675 INFO:teuthology.orchestra.run.smithi093.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-15T11:33:39.675 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-15T11:33:39.675 INFO:teuthology.orchestra.run.smithi093.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T11:33:39.675 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T11:33:39.675 INFO:teuthology.orchestra.run.smithi093.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T11:33:39.675 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-15T11:33:39.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:39.676 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2024-01-15T11:33:39.676 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2024-01-15T11:33:39.676 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-15T11:33:39.676 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-15T11:33:39.676 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-15T11:33:39.676 DEBUG:teuthology.orchestra.run.smithi093:> ') 2024-01-15T11:33:39.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:39.775 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list 2024-01-15T11:33:39.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:39.785 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list-id 2024-01-15T11:33:39.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:39.839 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2024-01-15T11:33:39.839 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2024-01-15T11:33:39.839 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-15T11:33:39.839 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-01-15T11:33:39.839 DEBUG:teuthology.orchestra.run.smithi093:> ') 2024-01-15T11:33:39.925 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-01-15T11:33:39.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:39.926 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2024-01-15T11:33:39.926 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2024-01-15T11:33:39.926 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-01-15T11:33:39.926 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-15T11:33:39.926 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-01-15T11:33:39.926 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-01-15T11:33:39.926 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-01-15T11:33:39.926 DEBUG:teuthology.orchestra.run.smithi093:> ') 2024-01-15T11:33:40.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:40.087 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2024-01-15T11:33:40.087 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2024-01-15T11:33:40.087 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set brx.0 up 2024-01-15T11:33:40.087 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set dev brx.0 master ceph-brx 2024-01-15T11:33:40.087 DEBUG:teuthology.orchestra.run.smithi093:> ') 2024-01-15T11:33:40.127 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-15T11:33:40.128 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-15T11:33:40.179 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-15T11:33:40.179 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-15T11:33:40.179 DEBUG:teuthology.orchestra.run.smithi093:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-15T11:33:40.230 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-01-15T11:33:40.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:40.230 DEBUG:teuthology.orchestra.run.smithi093:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T11:33:40.325 INFO:teuthology.orchestra.run.smithi093.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T11:33:40.325 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-15T11:33:40.428 INFO:teuthology.orchestra.run.smithi093.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T11:33:40.428 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-15T11:33:40.428 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: resolved to: "172.21.15.27:3300,172.21.15.93:3300,172.21.15.93:3301" 2024-01-15T11:33:40.428 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: trying mount with new device syntax: 1@adeed595-43d7-47b7-9d6d-c1a89f44a694.cephfs=/ 2024-01-15T11:33:40.428 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.27:3300/172.21.15.93:3300/172.21.15.93:3301" will pass to kernel 2024-01-15T11:33:40.432 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-15T11:33:40.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:40.433 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-15T11:33:40.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:40.453 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T11:33:40.519 INFO:teuthology.orchestra.run.smithi093.stdout:client4538 2024-01-15T11:33:40.520 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:33:40.520 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T11:33:40.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:40.571 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T11:33:40.626 INFO:teuthology.orchestra.run.smithi093.stdout:client4538 2024-01-15T11:33:40.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:40.627 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T11:33:40.682 INFO:teuthology.orchestra.run.smithi093.stdout:client4538 2024-01-15T11:33:40.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:40.682 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/adeed595-43d7-47b7-9d6d-c1a89f44a694.client4538/status') 2024-01-15T11:33:40.746 INFO:teuthology.orchestra.run.smithi093.stdout:instance: client.4538 (3)192.168.0.1:0/2672352334 2024-01-15T11:33:40.746 INFO:teuthology.orchestra.run.smithi093.stdout:blocklisted: false 2024-01-15T11:33:40.747 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records in 2024-01-15T11:33:40.747 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records out 2024-01-15T11:33:40.747 INFO:teuthology.orchestra.run.smithi093.stderr:69 bytes copied, 7.0804e-05 s, 975 kB/s 2024-01-15T11:33:40.748 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-01-15T11:33:40.749 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-15T11:33:40.749 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-01-15T11:33:40.749 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-15T11:33:40.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.899+0000 7f1753c9a640 1 Processor -- start 2024-01-15T11:33:40.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.899+0000 7f1753c9a640 1 -- start start 2024-01-15T11:33:40.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.903+0000 7f1753c9a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f174c144c80 0x7f174c0abf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:40.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.903+0000 7f1753c9a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f174c070df0 0x7f174c06c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:40.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.903+0000 7f1753c9a640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f174c145060 con 0x7f174c0ac460 2024-01-15T11:33:40.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.903+0000 7f1753c9a640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174c071250 con 0x7f174c070df0 2024-01-15T11:33:40.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.903+0000 7f1753c9a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174c071fd0 con 0x7f174c144c80 2024-01-15T11:33:40.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.903+0000 7f1751235640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f174c0ac460 0x7f174c0706e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42400/0 (socket says 172.21.15.27:42400) 2024-01-15T11:33:40.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.903+0000 7f1751235640 1 -- 172.21.15.27:0/2949642867 learned_addr learned my addr 172.21.15.27:0/2949642867 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:40.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.903+0000 7f1751a36640 1 --2- 172.21.15.27:0/2949642867 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f174c144c80 0x7f174c0abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:40.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.903+0000 7f1752237640 1 --2- 172.21.15.27:0/2949642867 >> v2:172.21.15.93:3300/0 conn(0x7f174c070df0 0x7f174c06c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:40.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.903+0000 7f1750a34640 1 -- 172.21.15.27:0/2949642867 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092776245 0 0) 0x7f174c145060 con 0x7f174c0ac460 2024-01-15T11:33:40.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.903+0000 7f1750a34640 1 -- 172.21.15.27:0/2949642867 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1738003530 con 0x7f174c0ac460 2024-01-15T11:33:40.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.903+0000 7f1751a36640 1 -- 172.21.15.27:0/2949642867 >> v2:172.21.15.93:3300/0 conn(0x7f174c070df0 msgr2=0x7f174c06c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:40.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.903+0000 7f1751a36640 1 --2- 172.21.15.27:0/2949642867 >> v2:172.21.15.93:3300/0 conn(0x7f174c070df0 0x7f174c06c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:40.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.903+0000 7f1751a36640 1 -- 172.21.15.27:0/2949642867 >> v1:172.21.15.27:6789/0 conn(0x7f174c0ac460 legacy=0x7f174c0706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:40.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.903+0000 7f1751a36640 1 -- 172.21.15.27:0/2949642867 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174c0ac8c0 con 0x7f174c144c80 2024-01-15T11:33:40.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.903+0000 7f1752237640 1 --2- 172.21.15.27:0/2949642867 >> v2:172.21.15.93:3300/0 conn(0x7f174c070df0 0x7f174c06c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:40.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.907+0000 7f1751a36640 1 --2- 172.21.15.27:0/2949642867 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f174c144c80 0x7f174c0abf20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f17480097c0 tx=0x7f174801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9975e62630dca396 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:40.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.907+0000 7f1750a34640 1 -- 172.21.15.27:0/2949642867 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17480ab650 con 0x7f174c144c80 2024-01-15T11:33:40.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.907+0000 7f1750a34640 1 -- 172.21.15.27:0/2949642867 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17480ab7b0 con 0x7f174c144c80 2024-01-15T11:33:40.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.907+0000 7f1750a34640 1 -- 172.21.15.27:0/2949642867 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17480abb40 con 0x7f174c144c80 2024-01-15T11:33:40.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.907+0000 7f1753c9a640 1 -- 172.21.15.27:0/2949642867 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f174c144c80 msgr2=0x7f174c0abf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:40.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.907+0000 7f1753c9a640 1 --2- 172.21.15.27:0/2949642867 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f174c144c80 0x7f174c0abf20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f17480097c0 tx=0x7f174801c450 comp rx=0 tx=0).stop 2024-01-15T11:33:40.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.907+0000 7f1753c9a640 1 -- 172.21.15.27:0/2949642867 shutdown_connections 2024-01-15T11:33:40.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.907+0000 7f1753c9a640 1 --2- 172.21.15.27:0/2949642867 >> v2:172.21.15.93:3300/0 conn(0x7f174c070df0 0x7f174c06c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:40.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.907+0000 7f1753c9a640 1 --2- 172.21.15.27:0/2949642867 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f174c144c80 0x7f174c0abf20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:40.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.907+0000 7f1753c9a640 1 -- 172.21.15.27:0/2949642867 >> 172.21.15.27:0/2949642867 conn(0x7f174c0b0c40 msgr2=0x7f174c0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:40.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.907+0000 7f1753c9a640 1 -- 172.21.15.27:0/2949642867 shutdown_connections 2024-01-15T11:33:40.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.907+0000 7f1753c9a640 1 -- 172.21.15.27:0/2949642867 wait complete. 2024-01-15T11:33:40.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.907+0000 7f1753c9a640 1 Processor -- start 2024-01-15T11:33:40.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.907+0000 7f1753c9a640 1 -- start start 2024-01-15T11:33:40.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f1753c9a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f174c070df0 0x7f174c09c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:40.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f1753c9a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f174c0ac460 0x7f174c1567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:40.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f1753c9a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f174c144c80 0x7f174c13d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:40.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f1753c9a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c09aff0 con 0x7f174c0ac460 2024-01-15T11:33:40.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f1753c9a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c0b32c0 con 0x7f174c144c80 2024-01-15T11:33:40.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f1753c9a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174c1418c0 con 0x7f174c070df0 2024-01-15T11:33:40.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f1751235640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f174c0ac460 0x7f174c1567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:40.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f1751235640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f174c0ac460 0x7f174c1567d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52440/0 (socket says 172.21.15.27:52440) 2024-01-15T11:33:40.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f1751235640 1 -- 172.21.15.27:0/1596999569 learned_addr learned my addr 172.21.15.27:0/1596999569 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:40.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f1751a36640 1 --2- 172.21.15.27:0/1596999569 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f174c070df0 0x7f174c09c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:40.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f1752237640 1 --2- 172.21.15.27:0/1596999569 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f174c144c80 0x7f174c13d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:40.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f1751235640 1 -- 172.21.15.27:0/1596999569 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f174c070df0 msgr2=0x7f174c09c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:40.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f1751235640 1 --2- 172.21.15.27:0/1596999569 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f174c070df0 0x7f174c09c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:40.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f1751235640 1 -- 172.21.15.27:0/1596999569 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f174c144c80 msgr2=0x7f174c13d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:40.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f1751235640 1 --2- 172.21.15.27:0/1596999569 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f174c144c80 0x7f174c13d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:40.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f1751235640 1 -- 172.21.15.27:0/1596999569 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1744009a70 con 0x7f174c0ac460 2024-01-15T11:33:40.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f1751a36640 1 --2- 172.21.15.27:0/1596999569 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f174c070df0 0x7f174c09c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:33:40.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f1752237640 1 --2- 172.21.15.27:0/1596999569 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f174c144c80 0x7f174c13d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:33:40.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f1751235640 1 --2- 172.21.15.27:0/1596999569 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f174c0ac460 0x7f174c1567d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f173c00c4d0 tx=0x7f173c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:40.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f17427fc640 1 -- 172.21.15.27:0/1596999569 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c005cf0 con 0x7f174c0ac460 2024-01-15T11:33:40.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f17427fc640 1 -- 172.21.15.27:0/1596999569 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173c005e50 con 0x7f174c0ac460 2024-01-15T11:33:40.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f17427fc640 1 -- 172.21.15.27:0/1596999569 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c007270 con 0x7f174c0ac460 2024-01-15T11:33:40.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f1753c9a640 1 -- 172.21.15.27:0/1596999569 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1748009420 con 0x7f174c0ac460 2024-01-15T11:33:40.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f1753c9a640 1 -- 172.21.15.27:0/1596999569 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174c141df0 con 0x7f174c0ac460 2024-01-15T11:33:40.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f1753c9a640 1 -- 172.21.15.27:0/1596999569 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f174c0b3470 con 0x7f174c0ac460 2024-01-15T11:33:40.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.911+0000 7f17427fc640 1 -- 172.21.15.27:0/1596999569 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f173c0073d0 con 0x7f174c0ac460 2024-01-15T11:33:40.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.915+0000 7f17427fc640 1 --2- 172.21.15.27:0/1596999569 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f17300668f0 0x7f1730068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:40.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.915+0000 7f17427fc640 1 -- 172.21.15.27:0/1596999569 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f173c0838f0 con 0x7f174c0ac460 2024-01-15T11:33:40.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.915+0000 7f1751a36640 1 --2- 172.21.15.27:0/1596999569 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f17300668f0 0x7f1730068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:40.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.915+0000 7f1751a36640 1 --2- 172.21.15.27:0/1596999569 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f17300668f0 0x7f1730068db0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f17480af000 tx=0x7f17480b6040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:40.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:40.919+0000 7f17427fc640 1 -- 172.21.15.27:0/1596999569 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f174c0b3470 con 0x7f174c0ac460 2024-01-15T11:33:41.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:41.115+0000 7f1753c9a640 1 -- 172.21.15.27:0/1596999569 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f174c0b3470 con 0x7f174c0ac460 2024-01-15T11:33:41.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:41.115+0000 7f17427fc640 1 -- 172.21.15.27:0/1596999569 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f174c0b3470 con 0x7f174c0ac460 2024-01-15T11:33:41.119 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-15T11:33:41.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:41.115+0000 7f1753c9a640 1 -- 172.21.15.27:0/1596999569 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f17300668f0 msgr2=0x7f1730068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:41.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:41.115+0000 7f1753c9a640 1 --2- 172.21.15.27:0/1596999569 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f17300668f0 0x7f1730068db0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f17480af000 tx=0x7f17480b6040 comp rx=0 tx=0).stop 2024-01-15T11:33:41.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:41.115+0000 7f1753c9a640 1 -- 172.21.15.27:0/1596999569 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f174c0ac460 msgr2=0x7f174c1567d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:41.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:41.115+0000 7f1753c9a640 1 --2- 172.21.15.27:0/1596999569 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f174c0ac460 0x7f174c1567d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f173c00c4d0 tx=0x7f173c00c990 comp rx=0 tx=0).stop 2024-01-15T11:33:41.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:41.115+0000 7f1753c9a640 1 -- 172.21.15.27:0/1596999569 shutdown_connections 2024-01-15T11:33:41.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:41.115+0000 7f1753c9a640 1 --2- 172.21.15.27:0/1596999569 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f17300668f0 0x7f1730068db0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:41.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:41.115+0000 7f1753c9a640 1 --2- 172.21.15.27:0/1596999569 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f174c144c80 0x7f174c13d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:41.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:41.115+0000 7f1753c9a640 1 --2- 172.21.15.27:0/1596999569 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f174c0ac460 0x7f174c1567d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:41.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:41.115+0000 7f1753c9a640 1 --2- 172.21.15.27:0/1596999569 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f174c070df0 0x7f174c09c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:41.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:41.115+0000 7f1753c9a640 1 -- 172.21.15.27:0/1596999569 >> 172.21.15.27:0/1596999569 conn(0x7f174c0b0c40 msgr2=0x7f174c0add30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:41.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:41.115+0000 7f1753c9a640 1 -- 172.21.15.27:0/1596999569 shutdown_connections 2024-01-15T11:33:41.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:41.115+0000 7f1753c9a640 1 -- 172.21.15.27:0/1596999569 wait complete. 2024-01-15T11:33:41.140 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-15T11:33:41.140 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-15T11:33:41.140 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi093.front.sepia.ceph.com 2024-01-15T11:33:41.140 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-01-15T11:33:41.140 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-01-15T11:33:41.140 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-15T11:33:41.140 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-15T11:33:41.141 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-15T11:33:41.141 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-01-15T11:33:41.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:41.141 DEBUG:teuthology.orchestra.run.smithi093:> ip addr 2024-01-15T11:33:41.152 INFO:teuthology.orchestra.run.smithi093.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-15T11:33:41.152 INFO:teuthology.orchestra.run.smithi093.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-15T11:33:41.152 INFO:teuthology.orchestra.run.smithi093.stdout: inet 127.0.0.1/8 scope host lo 2024-01-15T11:33:41.152 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:41.152 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 ::1/128 scope host 2024-01-15T11:33:41.152 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:41.152 INFO:teuthology.orchestra.run.smithi093.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T11:33:41.152 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1c brd ff:ff:ff:ff:ff:ff 2024-01-15T11:33:41.153 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f0 2024-01-15T11:33:41.153 INFO:teuthology.orchestra.run.smithi093.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T11:33:41.153 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1d brd ff:ff:ff:ff:ff:ff 2024-01-15T11:33:41.153 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f1 2024-01-15T11:33:41.153 INFO:teuthology.orchestra.run.smithi093.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T11:33:41.153 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:34 brd ff:ff:ff:ff:ff:ff 2024-01-15T11:33:41.153 INFO:teuthology.orchestra.run.smithi093.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-15T11:33:41.153 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:35 brd ff:ff:ff:ff:ff:ff 2024-01-15T11:33:41.153 INFO:teuthology.orchestra.run.smithi093.stdout: inet 172.21.15.93/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-15T11:33:41.153 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft 42439sec preferred_lft 42439sec 2024-01-15T11:33:41.153 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::ec4:7aff:fe8f:d635/64 scope link 2024-01-15T11:33:41.154 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:41.154 INFO:teuthology.orchestra.run.smithi093.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-15T11:33:41.154 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 02:42:04:9e:20:9c brd ff:ff:ff:ff:ff:ff 2024-01-15T11:33:41.154 INFO:teuthology.orchestra.run.smithi093.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-15T11:33:41.154 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:41.154 INFO:teuthology.orchestra.run.smithi093.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-15T11:33:41.154 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-15T11:33:41.154 INFO:teuthology.orchestra.run.smithi093.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-15T11:33:41.154 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:41.154 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2024-01-15T11:33:41.154 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:41.155 INFO:teuthology.orchestra.run.smithi093.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-15T11:33:41.155 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-15T11:33:41.155 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-01-15T11:33:41.155 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:41.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:41.155 DEBUG:teuthology.orchestra.run.smithi093:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-15T11:33:41.214 INFO:teuthology.orchestra.run.smithi093.stdout:1 2024-01-15T11:33:41.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:41.217 DEBUG:teuthology.orchestra.run.smithi093:> route 2024-01-15T11:33:41.269 INFO:teuthology.orchestra.run.smithi093.stdout:Kernel IP routing table 2024-01-15T11:33:41.269 INFO:teuthology.orchestra.run.smithi093.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-15T11:33:41.269 INFO:teuthology.orchestra.run.smithi093.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-15T11:33:41.269 INFO:teuthology.orchestra.run.smithi093.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-15T11:33:41.269 INFO:teuthology.orchestra.run.smithi093.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-15T11:33:41.269 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-15T11:33:41.270 INFO:teuthology.orchestra.run.smithi093.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T11:33:41.270 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T11:33:41.270 INFO:teuthology.orchestra.run.smithi093.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T11:33:41.270 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-15T11:33:41.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:41.270 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2024-01-15T11:33:41.270 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2024-01-15T11:33:41.270 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-15T11:33:41.270 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-15T11:33:41.271 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-15T11:33:41.271 DEBUG:teuthology.orchestra.run.smithi093:> ') 2024-01-15T11:33:41.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:41.361 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list 2024-01-15T11:33:41.370 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-15T11:33:41.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:41.372 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list-id 2024-01-15T11:33:41.423 INFO:teuthology.orchestra.run.smithi093.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-01-15T11:33:41.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:41.424 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2024-01-15T11:33:41.424 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2024-01-15T11:33:41.424 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-01-15T11:33:41.424 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-01-15T11:33:41.424 DEBUG:teuthology.orchestra.run.smithi093:> ') 2024-01-15T11:33:41.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:41.506 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-01-15T11:33:41.572 INFO:teuthology.orchestra.run.smithi093.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-15T11:33:41.572 INFO:teuthology.orchestra.run.smithi093.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-15T11:33:41.572 INFO:teuthology.orchestra.run.smithi093.stdout: inet 127.0.0.1/8 scope host lo 2024-01-15T11:33:41.572 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:41.572 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 ::1/128 scope host 2024-01-15T11:33:41.572 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:41.572 INFO:teuthology.orchestra.run.smithi093.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-15T11:33:41.573 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 86:57:8a:b8:99:89 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-15T11:33:41.573 INFO:teuthology.orchestra.run.smithi093.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-15T11:33:41.573 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:41.573 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::8457:8aff:feb8:9989/64 scope link 2024-01-15T11:33:41.573 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:41.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:41.574 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-01-15T11:33:41.639 INFO:teuthology.orchestra.run.smithi093.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-15T11:33:41.639 INFO:teuthology.orchestra.run.smithi093.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-15T11:33:41.639 INFO:teuthology.orchestra.run.smithi093.stdout: inet 127.0.0.1/8 scope host lo 2024-01-15T11:33:41.639 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:41.639 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 ::1/128 scope host 2024-01-15T11:33:41.639 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:41.639 INFO:teuthology.orchestra.run.smithi093.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-15T11:33:41.639 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 86:57:8a:b8:99:89 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-15T11:33:41.640 INFO:teuthology.orchestra.run.smithi093.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-15T11:33:41.640 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:41.640 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::8457:8aff:feb8:9989/64 scope link 2024-01-15T11:33:41.640 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:33:41.641 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-01-15T11:33:41.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:41.641 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2024-01-15T11:33:41.642 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2024-01-15T11:33:41.642 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-01-15T11:33:41.642 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-01-15T11:33:41.642 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-01-15T11:33:41.642 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-01-15T11:33:41.642 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-01-15T11:33:41.642 DEBUG:teuthology.orchestra.run.smithi093:> ') 2024-01-15T11:33:41.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:41.777 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2024-01-15T11:33:41.777 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2024-01-15T11:33:41.777 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set brx.1 up 2024-01-15T11:33:41.777 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set dev brx.1 master ceph-brx 2024-01-15T11:33:41.777 DEBUG:teuthology.orchestra.run.smithi093:> ') 2024-01-15T11:33:41.818 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-15T11:33:41.818 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-01-15T11:33:41.874 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-01-15T11:33:41.874 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-15T11:33:41.874 DEBUG:teuthology.orchestra.run.smithi093:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-01-15T11:33:41.926 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-01-15T11:33:41.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:41.926 DEBUG:teuthology.orchestra.run.smithi093:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T11:33:42.015 INFO:teuthology.orchestra.run.smithi093.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T11:33:42.015 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-15T11:33:42.028 INFO:teuthology.orchestra.run.smithi093.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T11:33:42.028 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-15T11:33:42.028 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: resolved to: "172.21.15.27:3300,172.21.15.93:3300,172.21.15.93:3301" 2024-01-15T11:33:42.029 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: trying mount with new device syntax: 3@adeed595-43d7-47b7-9d6d-c1a89f44a694.cephfs=/ 2024-01-15T11:33:42.029 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.27:3300/172.21.15.93:3300/172.21.15.93:3301" will pass to kernel 2024-01-15T11:33:42.032 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-15T11:33:42.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:42.032 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-01-15T11:33:42.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:42.052 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T11:33:42.106 INFO:teuthology.orchestra.run.smithi093.stdout:client4544 2024-01-15T11:33:42.106 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:33:42.106 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T11:33:42.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:42.154 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T11:33:42.210 INFO:teuthology.orchestra.run.smithi093.stdout:client4544 2024-01-15T11:33:42.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:42.210 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T11:33:42.265 INFO:teuthology.orchestra.run.smithi093.stdout:client4544 2024-01-15T11:33:42.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:42.265 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/adeed595-43d7-47b7-9d6d-c1a89f44a694.client4544/status') 2024-01-15T11:33:42.325 INFO:teuthology.orchestra.run.smithi093.stdout:instance: client.4544 (3)192.168.0.2:0/1584980378 2024-01-15T11:33:42.326 INFO:teuthology.orchestra.run.smithi093.stdout:blocklisted: false 2024-01-15T11:33:42.326 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records in 2024-01-15T11:33:42.326 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records out 2024-01-15T11:33:42.326 INFO:teuthology.orchestra.run.smithi093.stderr:69 bytes copied, 5.0372e-05 s, 1.4 MB/s 2024-01-15T11:33:42.328 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-01-15T11:33:42.346 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:33:42.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.499+0000 7f8d7ea06640 1 Processor -- start 2024-01-15T11:33:42.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.499+0000 7f8d7ea06640 1 -- start start 2024-01-15T11:33:42.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.499+0000 7f8d7ea06640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8d780d0130 0x7f8d780d3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:42.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.499+0000 7f8d7ea06640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d780d15f0 con 0x7f8d780d3760 2024-01-15T11:33:42.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.499+0000 7f8d7ea06640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d780ce000 con 0x7f8d7815d880 2024-01-15T11:33:42.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.499+0000 7f8d7ea06640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d780d4110 con 0x7f8d780d0130 2024-01-15T11:33:42.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.499+0000 7f8d7e205640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8d780d0130 0x7f8d780d3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:42.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.499+0000 7f8d7e205640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f8d780d0130 0x7f8d780d3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52442/0 (socket says 172.21.15.27:52442) 2024-01-15T11:33:42.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.499+0000 7f8d7e205640 1 -- 172.21.15.27:0/3737341629 learned_addr learned my addr 172.21.15.27:0/3737341629 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:42.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.503+0000 7f8d7e205640 1 -- 172.21.15.27:0/3737341629 >> v1:172.21.15.93:6789/0 conn(0x7f8d7815d880 legacy=0x7f8d780b6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:42.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.503+0000 7f8d7e205640 1 -- 172.21.15.27:0/3737341629 >> v1:172.21.15.27:6789/0 conn(0x7f8d780d3760 legacy=0x7f8d780cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:42.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.503+0000 7f8d7e205640 1 -- 172.21.15.27:0/3737341629 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d780d0630 con 0x7f8d780d0130 2024-01-15T11:33:42.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.503+0000 7f8d7ca02640 1 -- 172.21.15.27:0/3737341629 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3824068882 0 0) 0x7f8d780d15f0 con 0x7f8d780d3760 2024-01-15T11:33:42.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.503+0000 7f8d7e205640 1 --2- 172.21.15.27:0/3737341629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d780d0130 0x7f8d780d3bd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8d70009e50 tx=0x7f8d7001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1a44b88ec60e3a server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:42.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.503+0000 7f8d7ca02640 1 -- 172.21.15.27:0/3737341629 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d700a58e0 con 0x7f8d780d0130 2024-01-15T11:33:42.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.503+0000 7f8d7ca02640 1 -- 172.21.15.27:0/3737341629 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d700a5a40 con 0x7f8d780d0130 2024-01-15T11:33:42.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.503+0000 7f8d7ca02640 1 -- 172.21.15.27:0/3737341629 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d700a5dd0 con 0x7f8d780d0130 2024-01-15T11:33:42.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.503+0000 7f8d7ea06640 1 -- 172.21.15.27:0/3737341629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d780d0130 msgr2=0x7f8d780d3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:42.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.503+0000 7f8d7ea06640 1 --2- 172.21.15.27:0/3737341629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d780d0130 0x7f8d780d3bd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8d70009e50 tx=0x7f8d7001ca10 comp rx=0 tx=0).stop 2024-01-15T11:33:42.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.503+0000 7f8d7ea06640 1 -- 172.21.15.27:0/3737341629 shutdown_connections 2024-01-15T11:33:42.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.503+0000 7f8d7ea06640 1 --2- 172.21.15.27:0/3737341629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d780d0130 0x7f8d780d3bd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:42.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.503+0000 7f8d7ea06640 1 -- 172.21.15.27:0/3737341629 >> 172.21.15.27:0/3737341629 conn(0x7f8d7806b9f0 msgr2=0x7f8d7806be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:42.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.507+0000 7f8d7ea06640 1 -- 172.21.15.27:0/3737341629 shutdown_connections 2024-01-15T11:33:42.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.507+0000 7f8d7ea06640 1 -- 172.21.15.27:0/3737341629 wait complete. 2024-01-15T11:33:42.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.507+0000 7f8d7ea06640 1 Processor -- start 2024-01-15T11:33:42.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.507+0000 7f8d7ea06640 1 -- start start 2024-01-15T11:33:42.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.507+0000 7f8d7ea06640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d780d0130 0x7f8d780c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:42.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.507+0000 7f8d7ea06640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d780d3760 0x7f8d78153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:42.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.507+0000 7f8d7ea06640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d7815d880 0x7f8d78154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:42.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.507+0000 7f8d7ea06640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d78159180 con 0x7f8d780d0130 2024-01-15T11:33:42.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.507+0000 7f8d7ea06640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d78156d30 con 0x7f8d7815d880 2024-01-15T11:33:42.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.507+0000 7f8d7ea06640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d78154890 con 0x7f8d780d3760 2024-01-15T11:33:42.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.507+0000 7f8d7da04640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d780d0130 0x7f8d780c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:42.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.507+0000 7f8d7da04640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d780d0130 0x7f8d780c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52456/0 (socket says 172.21.15.27:52456) 2024-01-15T11:33:42.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.507+0000 7f8d7da04640 1 -- 172.21.15.27:0/477266849 learned_addr learned my addr 172.21.15.27:0/477266849 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:42.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.507+0000 7f8d7e205640 1 --2- 172.21.15.27:0/477266849 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d7815d880 0x7f8d78154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:42.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.507+0000 7f8d7d203640 1 --2- 172.21.15.27:0/477266849 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d780d3760 0x7f8d78153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:42.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.507+0000 7f8d7da04640 1 -- 172.21.15.27:0/477266849 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d780d3760 msgr2=0x7f8d78153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:42.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.507+0000 7f8d7da04640 1 --2- 172.21.15.27:0/477266849 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d780d3760 0x7f8d78153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:42.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.507+0000 7f8d7da04640 1 -- 172.21.15.27:0/477266849 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d7815d880 msgr2=0x7f8d78154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:42.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.507+0000 7f8d7da04640 1 --2- 172.21.15.27:0/477266849 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d7815d880 0x7f8d78154350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:42.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.507+0000 7f8d7da04640 1 -- 172.21.15.27:0/477266849 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d70009b30 con 0x7f8d780d0130 2024-01-15T11:33:42.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.511+0000 7f8d7da04640 1 --2- 172.21.15.27:0/477266849 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d780d0130 0x7f8d780c82d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400c3c0 tx=0x7f8d7400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:42.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.511+0000 7f8d6e7fc640 1 -- 172.21.15.27:0/477266849 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d740052d0 con 0x7f8d780d0130 2024-01-15T11:33:42.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.511+0000 7f8d6e7fc640 1 -- 172.21.15.27:0/477266849 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d74005430 con 0x7f8d780d0130 2024-01-15T11:33:42.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.511+0000 7f8d6e7fc640 1 -- 172.21.15.27:0/477266849 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d74003840 con 0x7f8d780d0130 2024-01-15T11:33:42.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.511+0000 7f8d7ea06640 1 -- 172.21.15.27:0/477266849 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d78156390 con 0x7f8d780d0130 2024-01-15T11:33:42.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.511+0000 7f8d7ea06640 1 -- 172.21.15.27:0/477266849 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d78156950 con 0x7f8d780d0130 2024-01-15T11:33:42.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.511+0000 7f8d7ea06640 1 -- 172.21.15.27:0/477266849 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d78074a00 con 0x7f8d780d0130 2024-01-15T11:33:42.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.511+0000 7f8d6e7fc640 1 -- 172.21.15.27:0/477266849 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f8d740039a0 con 0x7f8d780d0130 2024-01-15T11:33:42.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.511+0000 7f8d6e7fc640 1 --2- 172.21.15.27:0/477266849 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f8d5c066920 0x7f8d5c068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:42.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.511+0000 7f8d6e7fc640 1 -- 172.21.15.27:0/477266849 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d74083910 con 0x7f8d780d0130 2024-01-15T11:33:42.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.511+0000 7f8d7d203640 1 --2- 172.21.15.27:0/477266849 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f8d5c066920 0x7f8d5c068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:42.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.515+0000 7f8d7d203640 1 --2- 172.21.15.27:0/477266849 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f8d5c066920 0x7f8d5c068de0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8d7815cf20 tx=0x7f8d68009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:42.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.515+0000 7f8d6e7fc640 1 -- 172.21.15.27:0/477266849 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8d74050b60 con 0x7f8d780d0130 2024-01-15T11:33:42.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.671+0000 7f8d7ea06640 1 -- 172.21.15.27:0/477266849 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d78160d00 con 0x7f8d780d0130 2024-01-15T11:33:42.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.675+0000 7f8d6e7fc640 1 -- 172.21.15.27:0/477266849 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16425 (secure 0 0 0) 0x7f8d74054180 con 0x7f8d780d0130 2024-01-15T11:33:42.677 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:42.677 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:33:21.682894+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T11:33:18.397200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T11:33:19.061383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:33:42.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.675+0000 7f8d7ea06640 1 -- 172.21.15.27:0/477266849 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f8d5c066920 msgr2=0x7f8d5c068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:42.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.675+0000 7f8d7ea06640 1 --2- 172.21.15.27:0/477266849 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f8d5c066920 0x7f8d5c068de0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8d7815cf20 tx=0x7f8d68009040 comp rx=0 tx=0).stop 2024-01-15T11:33:42.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.675+0000 7f8d7ea06640 1 -- 172.21.15.27:0/477266849 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d780d0130 msgr2=0x7f8d780c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:42.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.675+0000 7f8d7ea06640 1 --2- 172.21.15.27:0/477266849 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d780d0130 0x7f8d780c82d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400c3c0 tx=0x7f8d7400c880 comp rx=0 tx=0).stop 2024-01-15T11:33:42.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.675+0000 7f8d7ea06640 1 -- 172.21.15.27:0/477266849 shutdown_connections 2024-01-15T11:33:42.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.675+0000 7f8d7ea06640 1 --2- 172.21.15.27:0/477266849 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f8d5c066920 0x7f8d5c068de0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:42.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.675+0000 7f8d7ea06640 1 --2- 172.21.15.27:0/477266849 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d7815d880 0x7f8d78154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:42.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.675+0000 7f8d7ea06640 1 --2- 172.21.15.27:0/477266849 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d780d3760 0x7f8d78153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:42.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.675+0000 7f8d7ea06640 1 --2- 172.21.15.27:0/477266849 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d780d0130 0x7f8d780c82d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:42.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.675+0000 7f8d7ea06640 1 -- 172.21.15.27:0/477266849 >> 172.21.15.27:0/477266849 conn(0x7f8d7806b9f0 msgr2=0x7f8d780cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:42.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.675+0000 7f8d7ea06640 1 -- 172.21.15.27:0/477266849 shutdown_connections 2024-01-15T11:33:42.680 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.675+0000 7f8d7ea06640 1 -- 172.21.15.27:0/477266849 wait complete. 2024-01-15T11:33:42.699 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T11:33:08.134662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-15T11:33:18.397200+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-15T11:33:19.061383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T11:33:42.699 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T11:33:42.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.843+0000 7f9efe5f5640 1 Processor -- start 2024-01-15T11:33:42.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.843+0000 7f9efe5f5640 1 -- start start 2024-01-15T11:33:42.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.843+0000 7f9efe5f5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9ef8146820 0x7f9ef8070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:42.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.843+0000 7f9efe5f5640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef8147190 con 0x7f9ef815eb50 2024-01-15T11:33:42.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.843+0000 7f9efe5f5640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef806d030 con 0x7f9ef80b4210 2024-01-15T11:33:42.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.843+0000 7f9efe5f5640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef8161fa0 con 0x7f9ef8146820 2024-01-15T11:33:42.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.843+0000 7f9efcb92640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f9ef815eb50 0x7f9ef8161890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42420/0 (socket says 172.21.15.27:42420) 2024-01-15T11:33:42.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.843+0000 7f9efcb92640 1 -- 172.21.15.27:0/3584100758 learned_addr learned my addr 172.21.15.27:0/3584100758 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:42.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.843+0000 7f9ef7fff640 1 --2- 172.21.15.27:0/3584100758 >> v2:172.21.15.93:3300/0 conn(0x7f9ef8146820 0x7f9ef8070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:42.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.843+0000 7f9ef6ffd640 1 -- 172.21.15.27:0/3584100758 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2715898258 0 0) 0x7f9ef8147190 con 0x7f9ef815eb50 2024-01-15T11:33:42.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.843+0000 7f9ef6ffd640 1 -- 172.21.15.27:0/3584100758 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ee0003530 con 0x7f9ef815eb50 2024-01-15T11:33:42.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.843+0000 7f9ef7fff640 1 -- 172.21.15.27:0/3584100758 >> v1:172.21.15.93:6789/0 conn(0x7f9ef80b4210 legacy=0x7f9ef8161180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:42.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.843+0000 7f9ef7fff640 1 -- 172.21.15.27:0/3584100758 >> v1:172.21.15.27:6789/0 conn(0x7f9ef815eb50 legacy=0x7f9ef8161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:42.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.843+0000 7f9ef7fff640 1 -- 172.21.15.27:0/3584100758 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef8146c00 con 0x7f9ef8146820 2024-01-15T11:33:42.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.847+0000 7f9ef7fff640 1 --2- 172.21.15.27:0/3584100758 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ef8146820 0x7f9ef8070a50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8146df0 tx=0x7f9ee801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18bd055d6062c08e server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:42.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.847+0000 7f9ef6ffd640 1 -- 172.21.15.27:0/3584100758 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee80ab650 con 0x7f9ef8146820 2024-01-15T11:33:42.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.847+0000 7f9ef6ffd640 1 -- 172.21.15.27:0/3584100758 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee80ab7b0 con 0x7f9ef8146820 2024-01-15T11:33:42.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.847+0000 7f9ef6ffd640 1 -- 172.21.15.27:0/3584100758 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee80abb40 con 0x7f9ef8146820 2024-01-15T11:33:42.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.847+0000 7f9efe5f5640 1 -- 172.21.15.27:0/3584100758 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ef8146820 msgr2=0x7f9ef8070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:42.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.847+0000 7f9efe5f5640 1 --2- 172.21.15.27:0/3584100758 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ef8146820 0x7f9ef8070a50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8146df0 tx=0x7f9ee801c450 comp rx=0 tx=0).stop 2024-01-15T11:33:42.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.847+0000 7f9efe5f5640 1 -- 172.21.15.27:0/3584100758 shutdown_connections 2024-01-15T11:33:42.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.847+0000 7f9efe5f5640 1 --2- 172.21.15.27:0/3584100758 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ef8146820 0x7f9ef8070a50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:42.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.847+0000 7f9efe5f5640 1 -- 172.21.15.27:0/3584100758 >> 172.21.15.27:0/3584100758 conn(0x7f9ef80b2f10 msgr2=0x7f9ef80b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:42.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.847+0000 7f9efe5f5640 1 -- 172.21.15.27:0/3584100758 shutdown_connections 2024-01-15T11:33:42.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.847+0000 7f9efe5f5640 1 -- 172.21.15.27:0/3584100758 wait complete. 2024-01-15T11:33:42.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.851+0000 7f9efe5f5640 1 Processor -- start 2024-01-15T11:33:42.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.851+0000 7f9efe5f5640 1 -- start start 2024-01-15T11:33:42.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.851+0000 7f9efe5f5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ef80b4210 0x7f9ef813e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:42.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.851+0000 7f9efe5f5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ef8146820 0x7f9ef815c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:42.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.851+0000 7f9efe5f5640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9ef815eb50 0x7f9ef813bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:42.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.851+0000 7f9efe5f5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef813e890 con 0x7f9ef80b4210 2024-01-15T11:33:42.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.851+0000 7f9efe5f5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef813d550 con 0x7f9ef8146820 2024-01-15T11:33:42.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.851+0000 7f9efe5f5640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef813d830 con 0x7f9ef815eb50 2024-01-15T11:33:42.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.851+0000 7f9ef7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ef80b4210 0x7f9ef813e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:42.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.851+0000 7f9ef7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ef80b4210 0x7f9ef813e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52462/0 (socket says 172.21.15.27:52462) 2024-01-15T11:33:42.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.851+0000 7f9ef7fff640 1 -- 172.21.15.27:0/1634743691 learned_addr learned my addr 172.21.15.27:0/1634743691 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:42.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.851+0000 7f9ef77fe640 1 --2- 172.21.15.27:0/1634743691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ef8146820 0x7f9ef815c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:42.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.851+0000 7f9efcb92640 1 --2- 172.21.15.27:0/1634743691 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9ef815eb50 0x7f9ef813bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:42.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.851+0000 7f9ef7fff640 1 -- 172.21.15.27:0/1634743691 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9ef815eb50 msgr2=0x7f9ef813bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:42.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.851+0000 7f9ef7fff640 1 --2- 172.21.15.27:0/1634743691 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9ef815eb50 0x7f9ef813bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:42.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.851+0000 7f9ef7fff640 1 -- 172.21.15.27:0/1634743691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ef8146820 msgr2=0x7f9ef815c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:42.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.851+0000 7f9ef7fff640 1 --2- 172.21.15.27:0/1634743691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ef8146820 0x7f9ef815c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:42.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.851+0000 7f9ef7fff640 1 -- 172.21.15.27:0/1634743691 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee8009420 con 0x7f9ef80b4210 2024-01-15T11:33:42.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.851+0000 7f9ef7fff640 1 --2- 172.21.15.27:0/1634743691 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ef80b4210 0x7f9ef813e350 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9ee80ad040 tx=0x7f9ee801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:42.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.851+0000 7f9ef4ff9640 1 -- 172.21.15.27:0/1634743691 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee80bf610 con 0x7f9ef80b4210 2024-01-15T11:33:42.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.851+0000 7f9ef4ff9640 1 -- 172.21.15.27:0/1634743691 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee80bf790 con 0x7f9ef80b4210 2024-01-15T11:33:42.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.851+0000 7f9efe5f5640 1 -- 172.21.15.27:0/1634743691 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef813db10 con 0x7f9ef80b4210 2024-01-15T11:33:42.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.851+0000 7f9ef4ff9640 1 -- 172.21.15.27:0/1634743691 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee80bfb40 con 0x7f9ef80b4210 2024-01-15T11:33:42.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.851+0000 7f9efe5f5640 1 -- 172.21.15.27:0/1634743691 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef8137fa0 con 0x7f9ef80b4210 2024-01-15T11:33:42.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.855+0000 7f9efe5f5640 1 -- 172.21.15.27:0/1634743691 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef804e850 con 0x7f9ef80b4210 2024-01-15T11:33:42.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.855+0000 7f9ef4ff9640 1 -- 172.21.15.27:0/1634743691 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f9ee80b5400 con 0x7f9ef80b4210 2024-01-15T11:33:42.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.855+0000 7f9ef4ff9640 1 --2- 172.21.15.27:0/1634743691 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9ee40668f0 0x7f9ee4068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:42.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.855+0000 7f9ef4ff9640 1 -- 172.21.15.27:0/1634743691 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ee811f530 con 0x7f9ef80b4210 2024-01-15T11:33:42.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.855+0000 7f9ef77fe640 1 --2- 172.21.15.27:0/1634743691 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9ee40668f0 0x7f9ee4068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:42.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.855+0000 7f9ef77fe640 1 --2- 172.21.15.27:0/1634743691 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9ee40668f0 0x7f9ee4068db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8159b70 tx=0x7f9eec009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:42.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:42.859+0000 7f9ef4ff9640 1 -- 172.21.15.27:0/1634743691 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9ee80ec820 con 0x7f9ef80b4210 2024-01-15T11:33:42.918 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:33:42.923 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:33:43.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.023+0000 7f9efe5f5640 1 -- 172.21.15.27:0/1634743691 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9ef80d1600 con 0x7f9ef80b4210 2024-01-15T11:33:43.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.023+0000 7f9ef4ff9640 1 -- 172.21.15.27:0/1634743691 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9ee80efe40 con 0x7f9ef80b4210 2024-01-15T11:33:43.026 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-15T11:33:43.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.023+0000 7f9efe5f5640 1 -- 172.21.15.27:0/1634743691 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9ee40668f0 msgr2=0x7f9ee4068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:43.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.023+0000 7f9efe5f5640 1 --2- 172.21.15.27:0/1634743691 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9ee40668f0 0x7f9ee4068db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8159b70 tx=0x7f9eec009040 comp rx=0 tx=0).stop 2024-01-15T11:33:43.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.023+0000 7f9efe5f5640 1 -- 172.21.15.27:0/1634743691 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ef80b4210 msgr2=0x7f9ef813e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:43.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.023+0000 7f9efe5f5640 1 --2- 172.21.15.27:0/1634743691 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ef80b4210 0x7f9ef813e350 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9ee80ad040 tx=0x7f9ee801ac90 comp rx=0 tx=0).stop 2024-01-15T11:33:43.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.023+0000 7f9efe5f5640 1 -- 172.21.15.27:0/1634743691 shutdown_connections 2024-01-15T11:33:43.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.023+0000 7f9efe5f5640 1 --2- 172.21.15.27:0/1634743691 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9ef815eb50 0x7f9ef813bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.023+0000 7f9efe5f5640 1 --2- 172.21.15.27:0/1634743691 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9ee40668f0 0x7f9ee4068db0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.023+0000 7f9efe5f5640 1 --2- 172.21.15.27:0/1634743691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ef8146820 0x7f9ef815c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.023+0000 7f9efe5f5640 1 --2- 172.21.15.27:0/1634743691 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9ef80b4210 0x7f9ef813e350 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.023+0000 7f9efe5f5640 1 -- 172.21.15.27:0/1634743691 >> 172.21.15.27:0/1634743691 conn(0x7f9ef80b2f10 msgr2=0x7f9ef80b32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:43.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.023+0000 7f9efe5f5640 1 -- 172.21.15.27:0/1634743691 shutdown_connections 2024-01-15T11:33:43.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.023+0000 7f9efe5f5640 1 -- 172.21.15.27:0/1634743691 wait complete. 2024-01-15T11:33:43.047 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-15T11:33:43.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.191+0000 7fd99186b640 1 Processor -- start 2024-01-15T11:33:43.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.191+0000 7fd99186b640 1 -- start start 2024-01-15T11:33:43.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.191+0000 7fd99186b640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd98c15d8f0 0x7fd98c15e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:43.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.191+0000 7fd99186b640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd98c0d0510 0x7fd98c0d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:43.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.191+0000 7fd99186b640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd98c15ecc0 con 0x7fd98c0ced30 2024-01-15T11:33:43.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.191+0000 7fd99186b640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd98c0d4420 con 0x7fd98c15d8f0 2024-01-15T11:33:43.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.191+0000 7fd99186b640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c0cdfb0 con 0x7fd98c0d0510 2024-01-15T11:33:43.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.191+0000 7fd98b7fe640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd98c0d0510 0x7fd98c0d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:43.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.191+0000 7fd98affd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd98c15d8f0 0x7fd98c15e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:43.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.191+0000 7fd98b7fe640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd98c0d0510 0x7fd98c0d1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:45794/0 (socket says 172.21.15.27:45794) 2024-01-15T11:33:43.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.191+0000 7fd98affd640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd98c15d8f0 0x7fd98c15e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:51778/0 (socket says 172.21.15.27:51778) 2024-01-15T11:33:43.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.191+0000 7fd98b7fe640 1 -- 172.21.15.27:0/1198013233 learned_addr learned my addr 172.21.15.27:0/1198013233 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:43.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.191+0000 7fd98b7fe640 1 -- 172.21.15.27:0/1198013233 >> v2:172.21.15.93:3300/0 conn(0x7fd98c15d8f0 msgr2=0x7fd98c15e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:43.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.191+0000 7fd98b7fe640 1 --2- 172.21.15.27:0/1198013233 >> v2:172.21.15.93:3300/0 conn(0x7fd98c15d8f0 0x7fd98c15e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.191+0000 7fd98a7fc640 1 -- 172.21.15.27:0/1198013233 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2894663067 0 0) 0x7fd98c15ecc0 con 0x7fd98c0ced30 2024-01-15T11:33:43.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.191+0000 7fd98b7fe640 1 -- 172.21.15.27:0/1198013233 >> v1:172.21.15.93:6789/0 conn(0x7fd98c0ced30 legacy=0x7fd98c0cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:43.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.191+0000 7fd98b7fe640 1 -- 172.21.15.27:0/1198013233 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98c0d4140 con 0x7fd98c0d0510 2024-01-15T11:33:43.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.195+0000 7fd98b7fe640 1 --2- 172.21.15.27:0/1198013233 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd98c0d0510 0x7fd98c0d1000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd9840098a0 tx=0x7fd98401c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ffd0bdd7c39920e server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:43.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.195+0000 7fd98a7fc640 1 -- 172.21.15.27:0/1198013233 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9840aa650 con 0x7fd98c0d0510 2024-01-15T11:33:43.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.195+0000 7fd98a7fc640 1 -- 172.21.15.27:0/1198013233 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9840aa7b0 con 0x7fd98c0d0510 2024-01-15T11:33:43.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.195+0000 7fd98a7fc640 1 -- 172.21.15.27:0/1198013233 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9840aab40 con 0x7fd98c0d0510 2024-01-15T11:33:43.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.195+0000 7fd99186b640 1 -- 172.21.15.27:0/1198013233 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd98c0d0510 msgr2=0x7fd98c0d1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:43.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.195+0000 7fd99186b640 1 --2- 172.21.15.27:0/1198013233 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd98c0d0510 0x7fd98c0d1000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd9840098a0 tx=0x7fd98401c4f0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.195+0000 7fd99186b640 1 -- 172.21.15.27:0/1198013233 shutdown_connections 2024-01-15T11:33:43.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.195+0000 7fd99186b640 1 --2- 172.21.15.27:0/1198013233 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd98c0d0510 0x7fd98c0d1000 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.195+0000 7fd99186b640 1 --2- 172.21.15.27:0/1198013233 >> v2:172.21.15.93:3300/0 conn(0x7fd98c15d8f0 0x7fd98c15e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.195+0000 7fd99186b640 1 -- 172.21.15.27:0/1198013233 >> 172.21.15.27:0/1198013233 conn(0x7fd98c09c750 msgr2=0x7fd98c0d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:43.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.195+0000 7fd99186b640 1 -- 172.21.15.27:0/1198013233 shutdown_connections 2024-01-15T11:33:43.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.195+0000 7fd99186b640 1 -- 172.21.15.27:0/1198013233 wait complete. 2024-01-15T11:33:43.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.199+0000 7fd99186b640 1 Processor -- start 2024-01-15T11:33:43.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.199+0000 7fd99186b640 1 -- start start 2024-01-15T11:33:43.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.199+0000 7fd99186b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd98c0ced30 0x7fd98c0b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:43.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.199+0000 7fd99186b640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd98c0d0510 0x7fd98c1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:43.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.199+0000 7fd99186b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd98c15d8f0 0x7fd98c14fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:43.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.199+0000 7fd99186b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c151070 con 0x7fd98c0ced30 2024-01-15T11:33:43.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.199+0000 7fd99186b640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c151f60 con 0x7fd98c15d8f0 2024-01-15T11:33:43.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.199+0000 7fd99186b640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c0ca500 con 0x7fd98c0d0510 2024-01-15T11:33:43.205 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.199+0000 7fd98affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd98c0ced30 0x7fd98c0b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:43.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.199+0000 7fd98affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd98c0ced30 0x7fd98c0b02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52474/0 (socket says 172.21.15.27:52474) 2024-01-15T11:33:43.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.199+0000 7fd98affd640 1 -- 172.21.15.27:0/994493086 learned_addr learned my addr 172.21.15.27:0/994493086 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:43.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.199+0000 7fd98b7fe640 1 --2- 172.21.15.27:0/994493086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd98c15d8f0 0x7fd98c14fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:43.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.199+0000 7fd9827fc640 1 --2- 172.21.15.27:0/994493086 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd98c0d0510 0x7fd98c1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:43.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.199+0000 7fd98affd640 1 -- 172.21.15.27:0/994493086 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd98c0d0510 msgr2=0x7fd98c1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:43.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.199+0000 7fd98affd640 1 --2- 172.21.15.27:0/994493086 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd98c0d0510 0x7fd98c1568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.199+0000 7fd98affd640 1 -- 172.21.15.27:0/994493086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd98c15d8f0 msgr2=0x7fd98c14fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:43.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.199+0000 7fd98affd640 1 --2- 172.21.15.27:0/994493086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd98c15d8f0 0x7fd98c14fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.199+0000 7fd98affd640 1 -- 172.21.15.27:0/994493086 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9840094d0 con 0x7fd98c0ced30 2024-01-15T11:33:43.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.199+0000 7fd98affd640 1 --2- 172.21.15.27:0/994493086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd98c0ced30 0x7fd98c0b02a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00e960 tx=0x7fd97c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:43.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.199+0000 7fd988ff9640 1 -- 172.21.15.27:0/994493086 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c009690 con 0x7fd98c0ced30 2024-01-15T11:33:43.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.199+0000 7fd988ff9640 1 -- 172.21.15.27:0/994493086 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97c00c9a0 con 0x7fd98c0ced30 2024-01-15T11:33:43.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.199+0000 7fd99186b640 1 -- 172.21.15.27:0/994493086 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd98c1512b0 con 0x7fd98c0ced30 2024-01-15T11:33:43.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.199+0000 7fd988ff9640 1 -- 172.21.15.27:0/994493086 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c00cd10 con 0x7fd98c0ced30 2024-01-15T11:33:43.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.199+0000 7fd99186b640 1 -- 172.21.15.27:0/994493086 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd98c151870 con 0x7fd98c0ced30 2024-01-15T11:33:43.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.203+0000 7fd99186b640 1 -- 172.21.15.27:0/994493086 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd98c04e850 con 0x7fd98c0ced30 2024-01-15T11:33:43.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.203+0000 7fd988ff9640 1 -- 172.21.15.27:0/994493086 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fd97c013470 con 0x7fd98c0ced30 2024-01-15T11:33:43.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.203+0000 7fd988ff9640 1 --2- 172.21.15.27:0/994493086 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd96c0668f0 0x7fd96c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:43.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.203+0000 7fd988ff9640 1 -- 172.21.15.27:0/994493086 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd97c084680 con 0x7fd98c0ced30 2024-01-15T11:33:43.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.203+0000 7fd9827fc640 1 --2- 172.21.15.27:0/994493086 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd96c0668f0 0x7fd96c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:43.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.203+0000 7fd9827fc640 1 --2- 172.21.15.27:0/994493086 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd96c0668f0 0x7fd96c068db0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd98c0ca4b0 tx=0x7fd974009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:43.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.207+0000 7fd988ff9640 1 -- 172.21.15.27:0/994493086 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd97c051840 con 0x7fd98c0ced30 2024-01-15T11:33:43.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.363+0000 7fd99186b640 1 -- 172.21.15.27:0/994493086 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd98c073b60 con 0x7fd98c0ced30 2024-01-15T11:33:43.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.363+0000 7fd988ff9640 1 -- 172.21.15.27:0/994493086 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd97c054e60 con 0x7fd98c0ced30 2024-01-15T11:33:43.367 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-01-15T11:33:43.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.367+0000 7fd99186b640 1 -- 172.21.15.27:0/994493086 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd96c0668f0 msgr2=0x7fd96c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:43.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.367+0000 7fd99186b640 1 --2- 172.21.15.27:0/994493086 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd96c0668f0 0x7fd96c068db0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd98c0ca4b0 tx=0x7fd974009040 comp rx=0 tx=0).stop 2024-01-15T11:33:43.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.367+0000 7fd99186b640 1 -- 172.21.15.27:0/994493086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd98c0ced30 msgr2=0x7fd98c0b02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:43.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.367+0000 7fd99186b640 1 --2- 172.21.15.27:0/994493086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd98c0ced30 0x7fd98c0b02a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00e960 tx=0x7fd97c00ee20 comp rx=0 tx=0).stop 2024-01-15T11:33:43.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.367+0000 7fd99186b640 1 -- 172.21.15.27:0/994493086 shutdown_connections 2024-01-15T11:33:43.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.367+0000 7fd99186b640 1 --2- 172.21.15.27:0/994493086 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd96c0668f0 0x7fd96c068db0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.367+0000 7fd99186b640 1 --2- 172.21.15.27:0/994493086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd98c15d8f0 0x7fd98c14fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.367+0000 7fd99186b640 1 --2- 172.21.15.27:0/994493086 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd98c0d0510 0x7fd98c1568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.367+0000 7fd99186b640 1 --2- 172.21.15.27:0/994493086 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd98c0ced30 0x7fd98c0b02a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.367+0000 7fd99186b640 1 -- 172.21.15.27:0/994493086 >> 172.21.15.27:0/994493086 conn(0x7fd98c09c750 msgr2=0x7fd98c0b4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:43.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.367+0000 7fd99186b640 1 -- 172.21.15.27:0/994493086 shutdown_connections 2024-01-15T11:33:43.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.367+0000 7fd99186b640 1 -- 172.21.15.27:0/994493086 wait complete. 2024-01-15T11:33:43.389 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-15T11:33:43.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.531+0000 7fd873b80640 1 Processor -- start 2024-01-15T11:33:43.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.531+0000 7fd873b80640 1 -- start start 2024-01-15T11:33:43.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.531+0000 7fd873b80640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd86c0c5b00 0x7fd86c0cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:43.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.531+0000 7fd873b80640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd86c15a880 0x7fd86c0cb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:43.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.531+0000 7fd873b80640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd86c0b2ae0 con 0x7fd86c15a4a0 2024-01-15T11:33:43.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.531+0000 7fd873b80640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd86c0cf380 con 0x7fd86c15a880 2024-01-15T11:33:43.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.531+0000 7fd873b80640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c0cf660 con 0x7fd86c0c5b00 2024-01-15T11:33:43.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.535+0000 7fd87111b640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd86c0c5b00 0x7fd86c0cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:43.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.535+0000 7fd87211d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd86c15a880 0x7fd86c0cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:43.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.535+0000 7fd87211d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd86c15a880 0x7fd86c0cb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:51802/0 (socket says 172.21.15.27:51802) 2024-01-15T11:33:43.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.535+0000 7fd87111b640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd86c0c5b00 0x7fd86c0cec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:45814/0 (socket says 172.21.15.27:45814) 2024-01-15T11:33:43.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.535+0000 7fd87211d640 1 -- 172.21.15.27:0/3264593940 learned_addr learned my addr 172.21.15.27:0/3264593940 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:43.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.535+0000 7fd87211d640 1 -- 172.21.15.27:0/3264593940 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd86c0c5b00 msgr2=0x7fd86c0cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:43.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.535+0000 7fd87211d640 1 --2- 172.21.15.27:0/3264593940 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd86c0c5b00 0x7fd86c0cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.535+0000 7fd87211d640 1 -- 172.21.15.27:0/3264593940 >> v1:172.21.15.93:6789/0 conn(0x7fd86c15a4a0 legacy=0x7fd86c0c53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:43.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.535+0000 7fd87211d640 1 -- 172.21.15.27:0/3264593940 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86c0ca910 con 0x7fd86c15a880 2024-01-15T11:33:43.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.535+0000 7fd87211d640 1 --2- 172.21.15.27:0/3264593940 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd86c15a880 0x7fd86c0cb110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd864009e50 tx=0x7fd86401c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2c14389916fa6cb server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:43.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.535+0000 7fd87091a640 1 -- 172.21.15.27:0/3264593940 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8640a5860 con 0x7fd86c15a880 2024-01-15T11:33:43.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.535+0000 7fd87091a640 1 -- 172.21.15.27:0/3264593940 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8640a59c0 con 0x7fd86c15a880 2024-01-15T11:33:43.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.535+0000 7fd87091a640 1 -- 172.21.15.27:0/3264593940 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8640a5d50 con 0x7fd86c15a880 2024-01-15T11:33:43.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.539+0000 7fd873b80640 1 -- 172.21.15.27:0/3264593940 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd86c15a880 msgr2=0x7fd86c0cb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:43.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.539+0000 7fd873b80640 1 --2- 172.21.15.27:0/3264593940 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd86c15a880 0x7fd86c0cb110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd864009e50 tx=0x7fd86401c980 comp rx=0 tx=0).stop 2024-01-15T11:33:43.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.539+0000 7fd873b80640 1 -- 172.21.15.27:0/3264593940 shutdown_connections 2024-01-15T11:33:43.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.539+0000 7fd873b80640 1 --2- 172.21.15.27:0/3264593940 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd86c15a880 0x7fd86c0cb110 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.539+0000 7fd873b80640 1 --2- 172.21.15.27:0/3264593940 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd86c0c5b00 0x7fd86c0cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.539+0000 7fd873b80640 1 -- 172.21.15.27:0/3264593940 >> 172.21.15.27:0/3264593940 conn(0x7fd86c0b1d50 msgr2=0x7fd86c0b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:43.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.539+0000 7fd873b80640 1 -- 172.21.15.27:0/3264593940 shutdown_connections 2024-01-15T11:33:43.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.539+0000 7fd873b80640 1 -- 172.21.15.27:0/3264593940 wait complete. 2024-01-15T11:33:43.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.539+0000 7fd873b80640 1 Processor -- start 2024-01-15T11:33:43.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.539+0000 7fd873b80640 1 -- start start 2024-01-15T11:33:43.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.539+0000 7fd873b80640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd86c0c5b00 0x7fd86c1f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:43.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.539+0000 7fd873b80640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd86c15a4a0 0x7fd86c0b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:43.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.539+0000 7fd873b80640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd86c15a880 0x7fd86c14e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:43.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.539+0000 7fd873b80640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c1f5ff0 con 0x7fd86c15a880 2024-01-15T11:33:43.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.539+0000 7fd873b80640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c14fea0 con 0x7fd86c15a4a0 2024-01-15T11:33:43.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.539+0000 7fd873b80640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c0b4c90 con 0x7fd86c0c5b00 2024-01-15T11:33:43.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.539+0000 7fd87211d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd86c15a880 0x7fd86c14e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:43.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.539+0000 7fd87211d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd86c15a880 0x7fd86c14e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52486/0 (socket says 172.21.15.27:52486) 2024-01-15T11:33:43.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.539+0000 7fd87211d640 1 -- 172.21.15.27:0/3966899837 learned_addr learned my addr 172.21.15.27:0/3966899837 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:43.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.543+0000 7fd87111b640 1 --2- 172.21.15.27:0/3966899837 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd86c15a4a0 0x7fd86c0b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:43.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.543+0000 7fd87191c640 1 --2- 172.21.15.27:0/3966899837 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd86c0c5b00 0x7fd86c1f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:43.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.543+0000 7fd87211d640 1 -- 172.21.15.27:0/3966899837 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd86c0c5b00 msgr2=0x7fd86c1f5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:43.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.543+0000 7fd87211d640 1 --2- 172.21.15.27:0/3966899837 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd86c0c5b00 0x7fd86c1f5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.543+0000 7fd87211d640 1 -- 172.21.15.27:0/3966899837 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd86c15a4a0 msgr2=0x7fd86c0b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:43.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.543+0000 7fd87211d640 1 --2- 172.21.15.27:0/3966899837 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd86c15a4a0 0x7fd86c0b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.543+0000 7fd87211d640 1 -- 172.21.15.27:0/3966899837 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd864009b30 con 0x7fd86c15a880 2024-01-15T11:33:43.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.543+0000 7fd87211d640 1 --2- 172.21.15.27:0/3966899837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd86c15a880 0x7fd86c14e730 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd8640af040 tx=0x7fd864019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:43.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.543+0000 7fd8627fc640 1 -- 172.21.15.27:0/3966899837 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8640b8880 con 0x7fd86c15a880 2024-01-15T11:33:43.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.543+0000 7fd8627fc640 1 -- 172.21.15.27:0/3966899837 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8640b89e0 con 0x7fd86c15a880 2024-01-15T11:33:43.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.543+0000 7fd873b80640 1 -- 172.21.15.27:0/3966899837 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd86c0b3de0 con 0x7fd86c15a880 2024-01-15T11:33:43.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.543+0000 7fd8627fc640 1 -- 172.21.15.27:0/3966899837 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8640b8d90 con 0x7fd86c15a880 2024-01-15T11:33:43.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.543+0000 7fd873b80640 1 -- 172.21.15.27:0/3966899837 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd86c0b4360 con 0x7fd86c15a880 2024-01-15T11:33:43.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.543+0000 7fd873b80640 1 -- 172.21.15.27:0/3966899837 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd86c0b4e00 con 0x7fd86c15a880 2024-01-15T11:33:43.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.543+0000 7fd8627fc640 1 -- 172.21.15.27:0/3966899837 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fd8640b6440 con 0x7fd86c15a880 2024-01-15T11:33:43.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.543+0000 7fd8627fc640 1 --2- 172.21.15.27:0/3966899837 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd8500668f0 0x7fd850068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:43.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.543+0000 7fd8627fc640 1 -- 172.21.15.27:0/3966899837 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd86411fbc0 con 0x7fd86c15a880 2024-01-15T11:33:43.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.547+0000 7fd87191c640 1 --2- 172.21.15.27:0/3966899837 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd8500668f0 0x7fd850068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:43.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.547+0000 7fd87191c640 1 --2- 172.21.15.27:0/3966899837 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd8500668f0 0x7fd850068db0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd868000f70 tx=0x7fd868009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:43.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.547+0000 7fd8627fc640 1 -- 172.21.15.27:0/3966899837 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd8640ece20 con 0x7fd86c15a880 2024-01-15T11:33:43.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.707+0000 7fd873b80640 1 -- 172.21.15.27:0/3966899837 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd86c04e850 con 0x7fd86c15a880 2024-01-15T11:33:43.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.707+0000 7fd8627fc640 1 -- 172.21.15.27:0/3966899837 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd8640bc020 con 0x7fd86c15a880 2024-01-15T11:33:43.712 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-01-15T11:33:43.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.711+0000 7fd873b80640 1 -- 172.21.15.27:0/3966899837 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd8500668f0 msgr2=0x7fd850068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:43.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.711+0000 7fd873b80640 1 --2- 172.21.15.27:0/3966899837 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd8500668f0 0x7fd850068db0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd868000f70 tx=0x7fd868009040 comp rx=0 tx=0).stop 2024-01-15T11:33:43.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.711+0000 7fd873b80640 1 -- 172.21.15.27:0/3966899837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd86c15a880 msgr2=0x7fd86c14e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:43.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.711+0000 7fd873b80640 1 --2- 172.21.15.27:0/3966899837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd86c15a880 0x7fd86c14e730 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd8640af040 tx=0x7fd864019720 comp rx=0 tx=0).stop 2024-01-15T11:33:43.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.711+0000 7fd873b80640 1 -- 172.21.15.27:0/3966899837 shutdown_connections 2024-01-15T11:33:43.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.711+0000 7fd873b80640 1 --2- 172.21.15.27:0/3966899837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd86c15a880 0x7fd86c14e730 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.711+0000 7fd873b80640 1 --2- 172.21.15.27:0/3966899837 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd8500668f0 0x7fd850068db0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.711+0000 7fd873b80640 1 --2- 172.21.15.27:0/3966899837 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd86c15a4a0 0x7fd86c0b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.711+0000 7fd873b80640 1 --2- 172.21.15.27:0/3966899837 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd86c0c5b00 0x7fd86c1f5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.711+0000 7fd873b80640 1 -- 172.21.15.27:0/3966899837 >> 172.21.15.27:0/3966899837 conn(0x7fd86c0b1d50 msgr2=0x7fd86c0b2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:43.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.711+0000 7fd873b80640 1 -- 172.21.15.27:0/3966899837 shutdown_connections 2024-01-15T11:33:43.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.711+0000 7fd873b80640 1 -- 172.21.15.27:0/3966899837 wait complete. 2024-01-15T11:33:43.733 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:33:43.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.875+0000 7f103e4c9640 1 Processor -- start 2024-01-15T11:33:43.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.875+0000 7f103e4c9640 1 -- start start 2024-01-15T11:33:43.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.875+0000 7f103e4c9640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f103806dfd0 0x7f103806e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:43.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.875+0000 7f103e4c9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f10380adcc0 0x7f10380ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:43.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.875+0000 7f103e4c9640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f103806e980 con 0x7f1038143ae0 2024-01-15T11:33:43.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.875+0000 7f103e4c9640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1038070670 con 0x7f103806dfd0 2024-01-15T11:33:43.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.875+0000 7f103e4c9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1038070950 con 0x7f10380adcc0 2024-01-15T11:33:43.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.875+0000 7f1037fff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f1038143ae0 0x7f10380b1f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42426/0 (socket says 172.21.15.27:42426) 2024-01-15T11:33:43.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.875+0000 7f1037fff640 1 -- 172.21.15.27:0/2718080827 learned_addr learned my addr 172.21.15.27:0/2718080827 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:43.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.875+0000 7f10377fe640 1 --2- 172.21.15.27:0/2718080827 >> v2:172.21.15.27:3300/0 conn(0x7f103806dfd0 0x7f103806e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:43.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.875+0000 7f103ca66640 1 --2- 172.21.15.27:0/2718080827 >> v2:172.21.15.93:3300/0 conn(0x7f10380adcc0 0x7f10380ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:43.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.875+0000 7f1036ffd640 1 -- 172.21.15.27:0/2718080827 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194919479 0 0) 0x7f103806e980 con 0x7f1038143ae0 2024-01-15T11:33:43.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.875+0000 7f10377fe640 1 -- 172.21.15.27:0/2718080827 >> v2:172.21.15.93:3300/0 conn(0x7f10380adcc0 msgr2=0x7f10380ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:43.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.875+0000 7f10377fe640 1 --2- 172.21.15.27:0/2718080827 >> v2:172.21.15.93:3300/0 conn(0x7f10380adcc0 0x7f10380ae0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.875+0000 7f10377fe640 1 -- 172.21.15.27:0/2718080827 >> v1:172.21.15.27:6789/0 conn(0x7f1038143ae0 legacy=0x7f10380b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:43.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.875+0000 7f10377fe640 1 -- 172.21.15.27:0/2718080827 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1038070c30 con 0x7f103806dfd0 2024-01-15T11:33:43.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.879+0000 7f10377fe640 1 --2- 172.21.15.27:0/2718080827 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f103806dfd0 0x7f103806e440 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1038072ad0 tx=0x7f102c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f87a767880bd16 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:43.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.879+0000 7f1036ffd640 1 -- 172.21.15.27:0/2718080827 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c0a7070 con 0x7f103806dfd0 2024-01-15T11:33:43.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.879+0000 7f1036ffd640 1 -- 172.21.15.27:0/2718080827 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102c0ab430 con 0x7f103806dfd0 2024-01-15T11:33:43.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.879+0000 7f1036ffd640 1 -- 172.21.15.27:0/2718080827 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c0ab7c0 con 0x7f103806dfd0 2024-01-15T11:33:43.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.879+0000 7f103e4c9640 1 -- 172.21.15.27:0/2718080827 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f103806dfd0 msgr2=0x7f103806e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:43.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.879+0000 7f103e4c9640 1 --2- 172.21.15.27:0/2718080827 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f103806dfd0 0x7f103806e440 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1038072ad0 tx=0x7f102c01c430 comp rx=0 tx=0).stop 2024-01-15T11:33:43.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.879+0000 7f103e4c9640 1 -- 172.21.15.27:0/2718080827 shutdown_connections 2024-01-15T11:33:43.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.879+0000 7f103e4c9640 1 --2- 172.21.15.27:0/2718080827 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f103806dfd0 0x7f103806e440 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.879+0000 7f103e4c9640 1 --2- 172.21.15.27:0/2718080827 >> v2:172.21.15.93:3300/0 conn(0x7f10380adcc0 0x7f10380ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.879+0000 7f103e4c9640 1 -- 172.21.15.27:0/2718080827 >> 172.21.15.27:0/2718080827 conn(0x7f10380b0c40 msgr2=0x7f10380b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:43.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.879+0000 7f103e4c9640 1 -- 172.21.15.27:0/2718080827 shutdown_connections 2024-01-15T11:33:43.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.879+0000 7f103e4c9640 1 -- 172.21.15.27:0/2718080827 wait complete. 2024-01-15T11:33:43.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f103e4c9640 1 Processor -- start 2024-01-15T11:33:43.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f103e4c9640 1 -- start start 2024-01-15T11:33:43.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f103e4c9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f103806dfd0 0x7f1038137770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:43.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f103e4c9640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f10380adcc0 0x7f103809bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:43.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f103e4c9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1038143ae0 0x7f103809ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:43.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f103e4c9640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103809c070 con 0x7f1038143ae0 2024-01-15T11:33:43.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f103e4c9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10381387a0 con 0x7f103806dfd0 2024-01-15T11:33:43.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f103e4c9640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10381372e0 con 0x7f10380adcc0 2024-01-15T11:33:43.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f103ca66640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1038143ae0 0x7f103809ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:43.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f103ca66640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1038143ae0 0x7f103809ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52502/0 (socket says 172.21.15.27:52502) 2024-01-15T11:33:43.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f103ca66640 1 -- 172.21.15.27:0/3706167719 learned_addr learned my addr 172.21.15.27:0/3706167719 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:43.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f1037fff640 1 --2- 172.21.15.27:0/3706167719 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f103806dfd0 0x7f1038137770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:43.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f10377fe640 1 --2- 172.21.15.27:0/3706167719 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f10380adcc0 0x7f103809bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:43.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f103ca66640 1 -- 172.21.15.27:0/3706167719 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f10380adcc0 msgr2=0x7f103809bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:43.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f103ca66640 1 --2- 172.21.15.27:0/3706167719 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f10380adcc0 0x7f103809bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f103ca66640 1 -- 172.21.15.27:0/3706167719 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f103806dfd0 msgr2=0x7f1038137770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:43.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f103ca66640 1 --2- 172.21.15.27:0/3706167719 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f103806dfd0 0x7f1038137770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:43.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f103ca66640 1 -- 172.21.15.27:0/3706167719 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102c009420 con 0x7f1038143ae0 2024-01-15T11:33:43.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f10377fe640 1 --2- 172.21.15.27:0/3706167719 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f10380adcc0 0x7f103809bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:43.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f103ca66640 1 --2- 172.21.15.27:0/3706167719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1038143ae0 0x7f103809ac50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1030007e70 tx=0x7f103000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:43.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f1034ff9640 1 -- 172.21.15.27:0/3706167719 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1030014620 con 0x7f1038143ae0 2024-01-15T11:33:43.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f1034ff9640 1 -- 172.21.15.27:0/3706167719 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10300147a0 con 0x7f1038143ae0 2024-01-15T11:33:43.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f1034ff9640 1 -- 172.21.15.27:0/3706167719 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1030014b50 con 0x7f1038143ae0 2024-01-15T11:33:43.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f103e4c9640 1 -- 172.21.15.27:0/3706167719 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10381384c0 con 0x7f1038143ae0 2024-01-15T11:33:43.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f103e4c9640 1 -- 172.21.15.27:0/3706167719 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1038136f70 con 0x7f1038143ae0 2024-01-15T11:33:43.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.883+0000 7f103e4c9640 1 -- 172.21.15.27:0/3706167719 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f103804e850 con 0x7f1038143ae0 2024-01-15T11:33:43.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.887+0000 7f1034ff9640 1 -- 172.21.15.27:0/3706167719 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f1030014cb0 con 0x7f1038143ae0 2024-01-15T11:33:43.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.887+0000 7f1034ff9640 1 --2- 172.21.15.27:0/3706167719 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f10240668f0 0x7f1024068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:43.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.887+0000 7f1034ff9640 1 -- 172.21.15.27:0/3706167719 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1030084dc0 con 0x7f1038143ae0 2024-01-15T11:33:43.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.887+0000 7f1037fff640 1 --2- 172.21.15.27:0/3706167719 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f10240668f0 0x7f1024068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:43.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.887+0000 7f1037fff640 1 --2- 172.21.15.27:0/3706167719 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f10240668f0 0x7f1024068db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1028000f70 tx=0x7f1028007c10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:43.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:43.891+0000 7f1034ff9640 1 -- 172.21.15.27:0/3706167719 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1030052070 con 0x7f1038143ae0 2024-01-15T11:33:44.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.051+0000 7f103e4c9640 1 -- 172.21.15.27:0/3706167719 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1038137420 con 0x7f1038143ae0 2024-01-15T11:33:44.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.051+0000 7f1034ff9640 1 -- 172.21.15.27:0/3706167719 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16425 (secure 0 0 0) 0x7f1030055690 con 0x7f1038143ae0 2024-01-15T11:33:44.054 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:44.055 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:33:21.682894+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T11:33:18.397200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T11:33:19.061383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:33:44.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.051+0000 7f103e4c9640 1 -- 172.21.15.27:0/3706167719 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f10240668f0 msgr2=0x7f1024068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:44.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.051+0000 7f103e4c9640 1 --2- 172.21.15.27:0/3706167719 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f10240668f0 0x7f1024068db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1028000f70 tx=0x7f1028007c10 comp rx=0 tx=0).stop 2024-01-15T11:33:44.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.051+0000 7f103e4c9640 1 -- 172.21.15.27:0/3706167719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1038143ae0 msgr2=0x7f103809ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:44.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.051+0000 7f103e4c9640 1 --2- 172.21.15.27:0/3706167719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1038143ae0 0x7f103809ac50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1030007e70 tx=0x7f103000e4b0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.051+0000 7f103e4c9640 1 -- 172.21.15.27:0/3706167719 shutdown_connections 2024-01-15T11:33:44.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.051+0000 7f103e4c9640 1 --2- 172.21.15.27:0/3706167719 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1038143ae0 0x7f103809ac50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.051+0000 7f103e4c9640 1 --2- 172.21.15.27:0/3706167719 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f10380adcc0 0x7f103809bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.051+0000 7f103e4c9640 1 --2- 172.21.15.27:0/3706167719 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f10240668f0 0x7f1024068db0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.051+0000 7f103e4c9640 1 --2- 172.21.15.27:0/3706167719 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f103806dfd0 0x7f1038137770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.055+0000 7f103e4c9640 1 -- 172.21.15.27:0/3706167719 >> 172.21.15.27:0/3706167719 conn(0x7f10380b0c40 msgr2=0x7f10380ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:44.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.055+0000 7f103e4c9640 1 -- 172.21.15.27:0/3706167719 shutdown_connections 2024-01-15T11:33:44.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.055+0000 7f103e4c9640 1 -- 172.21.15.27:0/3706167719 wait complete. 2024-01-15T11:33:44.076 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T11:33:08.134662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-15T11:33:18.397200+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-15T11:33:19.061383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T11:33:44.076 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T11:33:44.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.219+0000 7f0b357c1640 1 Processor -- start 2024-01-15T11:33:44.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.219+0000 7f0b357c1640 1 -- start start 2024-01-15T11:33:44.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.219+0000 7f0b357c1640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0b3015d8f0 0x7f0b3015e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:44.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.219+0000 7f0b357c1640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0b300d0510 0x7f0b300d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:44.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.219+0000 7f0b357c1640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3015ecc0 con 0x7f0b300ced30 2024-01-15T11:33:44.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.219+0000 7f0b357c1640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b300d4420 con 0x7f0b3015d8f0 2024-01-15T11:33:44.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.219+0000 7f0b357c1640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b300cdfb0 con 0x7f0b300d0510 2024-01-15T11:33:44.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.219+0000 7f0b2effd640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0b3015d8f0 0x7f0b3015e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:44.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.219+0000 7f0b2effd640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0b3015d8f0 0x7f0b3015e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52506/0 (socket says 172.21.15.27:52506) 2024-01-15T11:33:44.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.219+0000 7f0b2effd640 1 -- 172.21.15.27:0/3351772284 learned_addr learned my addr 172.21.15.27:0/3351772284 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:44.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.223+0000 7f0b2f7fe640 1 --2- 172.21.15.27:0/3351772284 >> v2:172.21.15.93:3300/0 conn(0x7f0b300d0510 0x7f0b300d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:44.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.223+0000 7f0b2effd640 1 -- 172.21.15.27:0/3351772284 >> v2:172.21.15.93:3300/0 conn(0x7f0b300d0510 msgr2=0x7f0b300d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:44.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.223+0000 7f0b2effd640 1 --2- 172.21.15.27:0/3351772284 >> v2:172.21.15.93:3300/0 conn(0x7f0b300d0510 0x7f0b300d1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.223+0000 7f0b2effd640 1 -- 172.21.15.27:0/3351772284 >> v1:172.21.15.93:6789/0 conn(0x7f0b300ced30 legacy=0x7f0b300cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:44.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.223+0000 7f0b2effd640 1 -- 172.21.15.27:0/3351772284 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b300d4140 con 0x7f0b3015d8f0 2024-01-15T11:33:44.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.223+0000 7f0b2effd640 1 --2- 172.21.15.27:0/3351772284 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b3015d8f0 0x7f0b3015e780 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0b20009870 tx=0x7f0b2001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd65f9746e27a4 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:44.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.223+0000 7f0b2e7fc640 1 -- 172.21.15.27:0/3351772284 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b200aa5f0 con 0x7f0b3015d8f0 2024-01-15T11:33:44.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.223+0000 7f0b2e7fc640 1 -- 172.21.15.27:0/3351772284 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b200aa750 con 0x7f0b3015d8f0 2024-01-15T11:33:44.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.223+0000 7f0b2e7fc640 1 -- 172.21.15.27:0/3351772284 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b200aaae0 con 0x7f0b3015d8f0 2024-01-15T11:33:44.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.227+0000 7f0b357c1640 1 -- 172.21.15.27:0/3351772284 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b3015d8f0 msgr2=0x7f0b3015e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:44.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.227+0000 7f0b357c1640 1 --2- 172.21.15.27:0/3351772284 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b3015d8f0 0x7f0b3015e780 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0b20009870 tx=0x7f0b2001c490 comp rx=0 tx=0).stop 2024-01-15T11:33:44.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.227+0000 7f0b357c1640 1 -- 172.21.15.27:0/3351772284 shutdown_connections 2024-01-15T11:33:44.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.227+0000 7f0b357c1640 1 --2- 172.21.15.27:0/3351772284 >> v2:172.21.15.93:3300/0 conn(0x7f0b300d0510 0x7f0b300d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.227+0000 7f0b357c1640 1 --2- 172.21.15.27:0/3351772284 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b3015d8f0 0x7f0b3015e780 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.227+0000 7f0b357c1640 1 -- 172.21.15.27:0/3351772284 >> 172.21.15.27:0/3351772284 conn(0x7f0b3009c750 msgr2=0x7f0b300d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:44.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.227+0000 7f0b357c1640 1 -- 172.21.15.27:0/3351772284 shutdown_connections 2024-01-15T11:33:44.229 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.227+0000 7f0b357c1640 1 -- 172.21.15.27:0/3351772284 wait complete. 2024-01-15T11:33:44.230 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.227+0000 7f0b357c1640 1 Processor -- start 2024-01-15T11:33:44.230 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.227+0000 7f0b357c1640 1 -- start start 2024-01-15T11:33:44.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.227+0000 7f0b357c1640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0b300ced30 0x7f0b30150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:44.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.227+0000 7f0b357c1640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0b300d0510 0x7f0b300b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:44.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.227+0000 7f0b357c1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b3015d8f0 0x7f0b3014f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:44.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.227+0000 7f0b357c1640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b30150e10 con 0x7f0b3015d8f0 2024-01-15T11:33:44.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.227+0000 7f0b357c1640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b301510f0 con 0x7f0b300d0510 2024-01-15T11:33:44.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.227+0000 7f0b357c1640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b301513d0 con 0x7f0b300ced30 2024-01-15T11:33:44.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.227+0000 7f0b2f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b3015d8f0 0x7f0b3014f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:44.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.227+0000 7f0b2f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b3015d8f0 0x7f0b3014f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52512/0 (socket says 172.21.15.27:52512) 2024-01-15T11:33:44.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.227+0000 7f0b2f7fe640 1 -- 172.21.15.27:0/3240420864 learned_addr learned my addr 172.21.15.27:0/3240420864 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:44.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.227+0000 7f0b2effd640 1 --2- 172.21.15.27:0/3240420864 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0b300ced30 0x7f0b30150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:44.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.227+0000 7f0b27fff640 1 --2- 172.21.15.27:0/3240420864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0b300d0510 0x7f0b300b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:44.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.227+0000 7f0b2f7fe640 1 -- 172.21.15.27:0/3240420864 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0b300ced30 msgr2=0x7f0b30150550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:44.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.227+0000 7f0b2f7fe640 1 --2- 172.21.15.27:0/3240420864 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0b300ced30 0x7f0b30150550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.227+0000 7f0b2f7fe640 1 -- 172.21.15.27:0/3240420864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0b300d0510 msgr2=0x7f0b300b6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:44.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.231+0000 7f0b2f7fe640 1 --2- 172.21.15.27:0/3240420864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0b300d0510 0x7f0b300b6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.231+0000 7f0b2f7fe640 1 -- 172.21.15.27:0/3240420864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b200094d0 con 0x7f0b3015d8f0 2024-01-15T11:33:44.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.231+0000 7f0b2f7fe640 1 --2- 172.21.15.27:0/3240420864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b3015d8f0 0x7f0b3014f9d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0b28007d40 tx=0x7f0b2800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:44.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.231+0000 7f0b277fe640 1 -- 172.21.15.27:0/3240420864 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b28014420 con 0x7f0b3015d8f0 2024-01-15T11:33:44.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.231+0000 7f0b277fe640 1 -- 172.21.15.27:0/3240420864 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b280145a0 con 0x7f0b3015d8f0 2024-01-15T11:33:44.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.231+0000 7f0b277fe640 1 -- 172.21.15.27:0/3240420864 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b28014950 con 0x7f0b3015d8f0 2024-01-15T11:33:44.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.231+0000 7f0b357c1640 1 -- 172.21.15.27:0/3240420864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b301516b0 con 0x7f0b3015d8f0 2024-01-15T11:33:44.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.231+0000 7f0b357c1640 1 -- 172.21.15.27:0/3240420864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b300b7260 con 0x7f0b3015d8f0 2024-01-15T11:33:44.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.231+0000 7f0b357c1640 1 -- 172.21.15.27:0/3240420864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b301518d0 con 0x7f0b3015d8f0 2024-01-15T11:33:44.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.231+0000 7f0b277fe640 1 -- 172.21.15.27:0/3240420864 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f0b28014ab0 con 0x7f0b3015d8f0 2024-01-15T11:33:44.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.231+0000 7f0b277fe640 1 --2- 172.21.15.27:0/3240420864 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f0b10066920 0x7f0b10068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:44.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.231+0000 7f0b277fe640 1 -- 172.21.15.27:0/3240420864 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b28084c30 con 0x7f0b3015d8f0 2024-01-15T11:33:44.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.235+0000 7f0b2effd640 1 --2- 172.21.15.27:0/3240420864 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f0b10066920 0x7f0b10068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:44.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.235+0000 7f0b2effd640 1 --2- 172.21.15.27:0/3240420864 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f0b10066920 0x7f0b10068de0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0b200ae000 tx=0x7f0b200b5040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:44.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.235+0000 7f0b277fe640 1 -- 172.21.15.27:0/3240420864 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0b28051e70 con 0x7f0b3015d8f0 2024-01-15T11:33:44.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.395+0000 7f0b357c1640 1 -- 172.21.15.27:0/3240420864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0b3004e850 con 0x7f0b3015d8f0 2024-01-15T11:33:44.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.395+0000 7f0b277fe640 1 -- 172.21.15.27:0/3240420864 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0b28055490 con 0x7f0b3015d8f0 2024-01-15T11:33:44.397 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-15T11:33:44.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.395+0000 7f0b357c1640 1 -- 172.21.15.27:0/3240420864 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f0b10066920 msgr2=0x7f0b10068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:44.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.395+0000 7f0b357c1640 1 --2- 172.21.15.27:0/3240420864 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f0b10066920 0x7f0b10068de0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0b200ae000 tx=0x7f0b200b5040 comp rx=0 tx=0).stop 2024-01-15T11:33:44.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.395+0000 7f0b357c1640 1 -- 172.21.15.27:0/3240420864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b3015d8f0 msgr2=0x7f0b3014f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:44.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.395+0000 7f0b357c1640 1 --2- 172.21.15.27:0/3240420864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b3015d8f0 0x7f0b3014f9d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0b28007d40 tx=0x7f0b2800e4b0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.395+0000 7f0b357c1640 1 -- 172.21.15.27:0/3240420864 shutdown_connections 2024-01-15T11:33:44.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.395+0000 7f0b357c1640 1 --2- 172.21.15.27:0/3240420864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b3015d8f0 0x7f0b3014f9d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.395+0000 7f0b357c1640 1 --2- 172.21.15.27:0/3240420864 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f0b10066920 0x7f0b10068de0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.395+0000 7f0b357c1640 1 --2- 172.21.15.27:0/3240420864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0b300d0510 0x7f0b300b6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.395+0000 7f0b357c1640 1 --2- 172.21.15.27:0/3240420864 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0b300ced30 0x7f0b30150550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.395+0000 7f0b357c1640 1 -- 172.21.15.27:0/3240420864 >> 172.21.15.27:0/3240420864 conn(0x7f0b3009c750 msgr2=0x7f0b300cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:44.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.395+0000 7f0b357c1640 1 -- 172.21.15.27:0/3240420864 shutdown_connections 2024-01-15T11:33:44.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.395+0000 7f0b357c1640 1 -- 172.21.15.27:0/3240420864 wait complete. 2024-01-15T11:33:44.418 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-15T11:33:44.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.559+0000 7f91367f5640 1 Processor -- start 2024-01-15T11:33:44.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.559+0000 7f91367f5640 1 -- start start 2024-01-15T11:33:44.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.563+0000 7f91367f5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f91300b4210 0x7f91300b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:44.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.563+0000 7f91367f5640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f913015db40 0x7f913015df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:44.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.563+0000 7f91367f5640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9130147190 con 0x7f9130146820 2024-01-15T11:33:44.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.563+0000 7f91367f5640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91300b4be0 con 0x7f913015db40 2024-01-15T11:33:44.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.563+0000 7f91367f5640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9130146c00 con 0x7f91300b4210 2024-01-15T11:33:44.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.563+0000 7f912ffff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f9130146820 0x7f9130070a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42440/0 (socket says 172.21.15.27:42440) 2024-01-15T11:33:44.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.563+0000 7f912ffff640 1 -- 172.21.15.27:0/3471690556 learned_addr learned my addr 172.21.15.27:0/3471690556 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:44.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.563+0000 7f9134d92640 1 --2- 172.21.15.27:0/3471690556 >> v2:172.21.15.27:3300/0 conn(0x7f913015db40 0x7f913015df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:44.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.563+0000 7f912effd640 1 -- 172.21.15.27:0/3471690556 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3097674302 0 0) 0x7f9130147190 con 0x7f9130146820 2024-01-15T11:33:44.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.563+0000 7f912f7fe640 1 --2- 172.21.15.27:0/3471690556 >> v2:172.21.15.93:3300/0 conn(0x7f91300b4210 0x7f91300b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:44.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.563+0000 7f912effd640 1 -- 172.21.15.27:0/3471690556 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9118003530 con 0x7f9130146820 2024-01-15T11:33:44.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.563+0000 7f9134d92640 1 -- 172.21.15.27:0/3471690556 >> v2:172.21.15.93:3300/0 conn(0x7f91300b4210 msgr2=0x7f91300b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:44.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.563+0000 7f9134d92640 1 --2- 172.21.15.27:0/3471690556 >> v2:172.21.15.93:3300/0 conn(0x7f91300b4210 0x7f91300b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.563+0000 7f9134d92640 1 -- 172.21.15.27:0/3471690556 >> v1:172.21.15.27:6789/0 conn(0x7f9130146820 legacy=0x7f9130070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:44.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.563+0000 7f9134d92640 1 -- 172.21.15.27:0/3471690556 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913006d030 con 0x7f913015db40 2024-01-15T11:33:44.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.563+0000 7f912f7fe640 1 --2- 172.21.15.27:0/3471690556 >> v2:172.21.15.93:3300/0 conn(0x7f91300b4210 0x7f91300b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:33:44.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.563+0000 7f9134d92640 1 --2- 172.21.15.27:0/3471690556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f913015db40 0x7f913015df50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f91300b5ad0 tx=0x7f912801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217b39b4bc26b151 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:44.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.563+0000 7f912effd640 1 -- 172.21.15.27:0/3471690556 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91280a59a0 con 0x7f913015db40 2024-01-15T11:33:44.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.567+0000 7f912effd640 1 -- 172.21.15.27:0/3471690556 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91280a5b00 con 0x7f913015db40 2024-01-15T11:33:44.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.567+0000 7f912effd640 1 -- 172.21.15.27:0/3471690556 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91280a5e90 con 0x7f913015db40 2024-01-15T11:33:44.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.567+0000 7f91367f5640 1 -- 172.21.15.27:0/3471690556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f913015db40 msgr2=0x7f913015df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:44.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.567+0000 7f91367f5640 1 --2- 172.21.15.27:0/3471690556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f913015db40 0x7f913015df50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f91300b5ad0 tx=0x7f912801c8e0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.567+0000 7f91367f5640 1 -- 172.21.15.27:0/3471690556 shutdown_connections 2024-01-15T11:33:44.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.567+0000 7f91367f5640 1 --2- 172.21.15.27:0/3471690556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f913015db40 0x7f913015df50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.567+0000 7f91367f5640 1 --2- 172.21.15.27:0/3471690556 >> v2:172.21.15.93:3300/0 conn(0x7f91300b4210 0x7f91300b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.567+0000 7f91367f5640 1 -- 172.21.15.27:0/3471690556 >> 172.21.15.27:0/3471690556 conn(0x7f91300b2f10 msgr2=0x7f91300b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:44.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.567+0000 7f91367f5640 1 -- 172.21.15.27:0/3471690556 shutdown_connections 2024-01-15T11:33:44.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.567+0000 7f91367f5640 1 -- 172.21.15.27:0/3471690556 wait complete. 2024-01-15T11:33:44.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.567+0000 7f91367f5640 1 Processor -- start 2024-01-15T11:33:44.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.567+0000 7f91367f5640 1 -- start start 2024-01-15T11:33:44.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.567+0000 7f91367f5640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f91300b4210 0x7f91300b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:44.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.567+0000 7f91367f5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9130146820 0x7f9130140b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:44.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.567+0000 7f91367f5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f913015db40 0x7f913015c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:44.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.567+0000 7f91367f5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9130138b30 con 0x7f9130146820 2024-01-15T11:33:44.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.567+0000 7f91367f5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91300b20a0 con 0x7f913015db40 2024-01-15T11:33:44.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.567+0000 7f91367f5640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91300b2380 con 0x7f91300b4210 2024-01-15T11:33:44.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.567+0000 7f912f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9130146820 0x7f9130140b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:44.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.567+0000 7f912f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9130146820 0x7f9130140b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52524/0 (socket says 172.21.15.27:52524) 2024-01-15T11:33:44.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.567+0000 7f912f7fe640 1 -- 172.21.15.27:0/154052004 learned_addr learned my addr 172.21.15.27:0/154052004 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:44.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.571+0000 7f912ffff640 1 --2- 172.21.15.27:0/154052004 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f91300b4210 0x7f91300b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:44.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.571+0000 7f9134d92640 1 --2- 172.21.15.27:0/154052004 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f913015db40 0x7f913015c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:44.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.571+0000 7f912f7fe640 1 -- 172.21.15.27:0/154052004 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f91300b4210 msgr2=0x7f91300b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:44.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.571+0000 7f912f7fe640 1 --2- 172.21.15.27:0/154052004 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f91300b4210 0x7f91300b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.571+0000 7f912f7fe640 1 -- 172.21.15.27:0/154052004 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f913015db40 msgr2=0x7f913015c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:44.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.571+0000 7f912f7fe640 1 --2- 172.21.15.27:0/154052004 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f913015db40 0x7f913015c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.571+0000 7f912f7fe640 1 -- 172.21.15.27:0/154052004 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9128009a70 con 0x7f9130146820 2024-01-15T11:33:44.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.571+0000 7f912f7fe640 1 --2- 172.21.15.27:0/154052004 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9130146820 0x7f9130140b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f912400c7c0 tx=0x7f912400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:44.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.571+0000 7f912cff9640 1 -- 172.21.15.27:0/154052004 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9124007a30 con 0x7f9130146820 2024-01-15T11:33:44.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.571+0000 7f912cff9640 1 -- 172.21.15.27:0/154052004 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9124007b90 con 0x7f9130146820 2024-01-15T11:33:44.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.571+0000 7f912cff9640 1 -- 172.21.15.27:0/154052004 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912400ce70 con 0x7f9130146820 2024-01-15T11:33:44.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.571+0000 7f91367f5640 1 -- 172.21.15.27:0/154052004 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91301387c0 con 0x7f9130146820 2024-01-15T11:33:44.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.571+0000 7f91367f5640 1 -- 172.21.15.27:0/154052004 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91300b1c90 con 0x7f9130146820 2024-01-15T11:33:44.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.571+0000 7f91367f5640 1 -- 172.21.15.27:0/154052004 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f913006bb10 con 0x7f9130146820 2024-01-15T11:33:44.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.571+0000 7f912cff9640 1 -- 172.21.15.27:0/154052004 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f91240113f0 con 0x7f9130146820 2024-01-15T11:33:44.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.571+0000 7f912cff9640 1 --2- 172.21.15.27:0/154052004 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f911c0668f0 0x7f911c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:44.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.571+0000 7f912cff9640 1 -- 172.21.15.27:0/154052004 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91240848c0 con 0x7f9130146820 2024-01-15T11:33:44.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.571+0000 7f912ffff640 1 --2- 172.21.15.27:0/154052004 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f911c0668f0 0x7f911c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:44.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.575+0000 7f912ffff640 1 --2- 172.21.15.27:0/154052004 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f911c0668f0 0x7f911c068db0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f91200011f0 tx=0x7f9120009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:44.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.575+0000 7f912cff9640 1 -- 172.21.15.27:0/154052004 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9124051b00 con 0x7f9130146820 2024-01-15T11:33:44.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.735+0000 7f91367f5640 1 -- 172.21.15.27:0/154052004 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f913004e850 con 0x7f9130146820 2024-01-15T11:33:44.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.735+0000 7f912cff9640 1 -- 172.21.15.27:0/154052004 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9124055120 con 0x7f9130146820 2024-01-15T11:33:44.740 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-01-15T11:33:44.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.739+0000 7f91367f5640 1 -- 172.21.15.27:0/154052004 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f911c0668f0 msgr2=0x7f911c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:44.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.739+0000 7f91367f5640 1 --2- 172.21.15.27:0/154052004 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f911c0668f0 0x7f911c068db0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f91200011f0 tx=0x7f9120009040 comp rx=0 tx=0).stop 2024-01-15T11:33:44.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.739+0000 7f91367f5640 1 -- 172.21.15.27:0/154052004 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9130146820 msgr2=0x7f9130140b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:44.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.739+0000 7f91367f5640 1 --2- 172.21.15.27:0/154052004 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9130146820 0x7f9130140b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f912400c7c0 tx=0x7f912400cc80 comp rx=0 tx=0).stop 2024-01-15T11:33:44.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.739+0000 7f91367f5640 1 -- 172.21.15.27:0/154052004 shutdown_connections 2024-01-15T11:33:44.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.739+0000 7f91367f5640 1 --2- 172.21.15.27:0/154052004 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f911c0668f0 0x7f911c068db0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.739+0000 7f91367f5640 1 --2- 172.21.15.27:0/154052004 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f913015db40 0x7f913015c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.739+0000 7f91367f5640 1 --2- 172.21.15.27:0/154052004 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9130146820 0x7f9130140b00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.739+0000 7f91367f5640 1 --2- 172.21.15.27:0/154052004 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f91300b4210 0x7f91300b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.739+0000 7f91367f5640 1 -- 172.21.15.27:0/154052004 >> 172.21.15.27:0/154052004 conn(0x7f91300b2f10 msgr2=0x7f9130070a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:44.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.739+0000 7f91367f5640 1 -- 172.21.15.27:0/154052004 shutdown_connections 2024-01-15T11:33:44.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.739+0000 7f91367f5640 1 -- 172.21.15.27:0/154052004 wait complete. 2024-01-15T11:33:44.761 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-15T11:33:44.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.907+0000 7f25e16d6640 1 Processor -- start 2024-01-15T11:33:44.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.907+0000 7f25e16d6640 1 -- start start 2024-01-15T11:33:44.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.907+0000 7f25e16d6640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f25dc0ced30 0x7f25dc0cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:44.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.907+0000 7f25e16d6640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25dc0cdfb0 con 0x7f25dc0cf1e0 2024-01-15T11:33:44.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.907+0000 7f25e16d6640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25dc0d4140 con 0x7f25dc15d8f0 2024-01-15T11:33:44.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.907+0000 7f25e16d6640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25dc0d4420 con 0x7f25dc0ced30 2024-01-15T11:33:44.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.907+0000 7f25db7fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f25dc0cf1e0 0x7f25dc0d1000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42456/0 (socket says 172.21.15.27:42456) 2024-01-15T11:33:44.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.907+0000 7f25db7fe640 1 -- 172.21.15.27:0/3170437916 learned_addr learned my addr 172.21.15.27:0/3170437916 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:44.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.907+0000 7f25d27fc640 1 --2- 172.21.15.27:0/3170437916 >> v2:172.21.15.93:3300/0 conn(0x7f25dc0ced30 0x7f25dc0cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:44.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.907+0000 7f25da7fc640 1 -- 172.21.15.27:0/3170437916 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378373039 0 0) 0x7f25dc0cdfb0 con 0x7f25dc0cf1e0 2024-01-15T11:33:44.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.907+0000 7f25da7fc640 1 -- 172.21.15.27:0/3170437916 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25c8003530 con 0x7f25dc0cf1e0 2024-01-15T11:33:44.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.907+0000 7f25da7fc640 1 -- 172.21.15.27:0/3170437916 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1370122098 0 0) 0x7f25dc0d4140 con 0x7f25dc15d8f0 2024-01-15T11:33:44.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.907+0000 7f25da7fc640 1 -- 172.21.15.27:0/3170437916 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25dc0cdfb0 con 0x7f25dc15d8f0 2024-01-15T11:33:44.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.907+0000 7f25d27fc640 1 -- 172.21.15.27:0/3170437916 >> v1:172.21.15.93:6789/0 conn(0x7f25dc15d8f0 legacy=0x7f25dc15e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:44.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.907+0000 7f25da7fc640 1 -- 172.21.15.27:0/3170437916 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 299945599 0 0) 0x7f25c8003530 con 0x7f25dc0cf1e0 2024-01-15T11:33:44.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.907+0000 7f25d27fc640 1 -- 172.21.15.27:0/3170437916 >> v1:172.21.15.27:6789/0 conn(0x7f25dc0cf1e0 legacy=0x7f25dc0d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:44.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.907+0000 7f25d27fc640 1 -- 172.21.15.27:0/3170437916 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc0ce250 con 0x7f25dc0ced30 2024-01-15T11:33:44.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.911+0000 7f25d27fc640 1 --2- 172.21.15.27:0/3170437916 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25dc0ced30 0x7f25dc0cfe00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f25c40097c0 tx=0x7f25c401c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e40ae86600171b89 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:44.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.911+0000 7f25da7fc640 1 -- 172.21.15.27:0/3170437916 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d4001a00 con 0x7f25dc0ced30 2024-01-15T11:33:44.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.911+0000 7f25da7fc640 1 -- 172.21.15.27:0/3170437916 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c40a7050 con 0x7f25dc0ced30 2024-01-15T11:33:44.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.911+0000 7f25da7fc640 1 -- 172.21.15.27:0/3170437916 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c40ab620 con 0x7f25dc0ced30 2024-01-15T11:33:44.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.911+0000 7f25e16d6640 1 -- 172.21.15.27:0/3170437916 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25dc0ced30 msgr2=0x7f25dc0cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:44.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.911+0000 7f25e16d6640 1 --2- 172.21.15.27:0/3170437916 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25dc0ced30 0x7f25dc0cfe00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f25c40097c0 tx=0x7f25c401c370 comp rx=0 tx=0).stop 2024-01-15T11:33:44.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.911+0000 7f25e16d6640 1 -- 172.21.15.27:0/3170437916 shutdown_connections 2024-01-15T11:33:44.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.911+0000 7f25e16d6640 1 --2- 172.21.15.27:0/3170437916 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25dc0ced30 0x7f25dc0cfe00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.911+0000 7f25e16d6640 1 -- 172.21.15.27:0/3170437916 >> 172.21.15.27:0/3170437916 conn(0x7f25dc09c750 msgr2=0x7f25dc0d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:44.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.911+0000 7f25e16d6640 1 -- 172.21.15.27:0/3170437916 shutdown_connections 2024-01-15T11:33:44.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.911+0000 7f25e16d6640 1 -- 172.21.15.27:0/3170437916 wait complete. 2024-01-15T11:33:44.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.915+0000 7f25e16d6640 1 Processor -- start 2024-01-15T11:33:44.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.915+0000 7f25e16d6640 1 -- start start 2024-01-15T11:33:44.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.915+0000 7f25e16d6640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25dc0ced30 0x7f25dc154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:44.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.915+0000 7f25e16d6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25dc0cf1e0 0x7f25dc159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:44.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.915+0000 7f25e16d6640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25dc15d8f0 0x7f25dc0b85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:44.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.915+0000 7f25e16d6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc15a2c0 con 0x7f25dc0cf1e0 2024-01-15T11:33:44.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.915+0000 7f25e16d6640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc15a5a0 con 0x7f25dc0ced30 2024-01-15T11:33:44.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.915+0000 7f25e16d6640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc15a880 con 0x7f25dc15d8f0 2024-01-15T11:33:44.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.915+0000 7f25d27fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25dc0cf1e0 0x7f25dc159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:44.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.915+0000 7f25d27fc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25dc0cf1e0 0x7f25dc159c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52534/0 (socket says 172.21.15.27:52534) 2024-01-15T11:33:44.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.915+0000 7f25d27fc640 1 -- 172.21.15.27:0/1566143592 learned_addr learned my addr 172.21.15.27:0/1566143592 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:44.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.915+0000 7f25daffd640 1 --2- 172.21.15.27:0/1566143592 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25dc0ced30 0x7f25dc154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:44.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.915+0000 7f25db7fe640 1 --2- 172.21.15.27:0/1566143592 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25dc15d8f0 0x7f25dc0b85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:44.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.915+0000 7f25d27fc640 1 -- 172.21.15.27:0/1566143592 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25dc15d8f0 msgr2=0x7f25dc0b85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:44.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.915+0000 7f25d27fc640 1 --2- 172.21.15.27:0/1566143592 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25dc15d8f0 0x7f25dc0b85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.915+0000 7f25d27fc640 1 -- 172.21.15.27:0/1566143592 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25dc0ced30 msgr2=0x7f25dc154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:44.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.915+0000 7f25d27fc640 1 --2- 172.21.15.27:0/1566143592 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25dc0ced30 0x7f25dc154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:44.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.915+0000 7f25d27fc640 1 -- 172.21.15.27:0/1566143592 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c4009420 con 0x7f25dc0cf1e0 2024-01-15T11:33:44.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.915+0000 7f25daffd640 1 --2- 172.21.15.27:0/1566143592 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25dc0ced30 0x7f25dc154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:44.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.915+0000 7f25d27fc640 1 --2- 172.21.15.27:0/1566143592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25dc0cf1e0 0x7f25dc159c00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f25c40097c0 tx=0x7f25c4019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:44.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.915+0000 7f25d3fff640 1 -- 172.21.15.27:0/1566143592 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c40abe70 con 0x7f25dc0cf1e0 2024-01-15T11:33:44.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.915+0000 7f25d3fff640 1 -- 172.21.15.27:0/1566143592 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c4004020 con 0x7f25dc0cf1e0 2024-01-15T11:33:44.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.915+0000 7f25d3fff640 1 -- 172.21.15.27:0/1566143592 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c40043b0 con 0x7f25dc0cf1e0 2024-01-15T11:33:44.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.915+0000 7f25e16d6640 1 -- 172.21.15.27:0/1566143592 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25dc15c270 con 0x7f25dc0cf1e0 2024-01-15T11:33:44.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.915+0000 7f25e16d6640 1 -- 172.21.15.27:0/1566143592 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25dc15be90 con 0x7f25dc0cf1e0 2024-01-15T11:33:44.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.919+0000 7f25e16d6640 1 -- 172.21.15.27:0/1566143592 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25dc15c0e0 con 0x7f25dc0cf1e0 2024-01-15T11:33:44.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.919+0000 7f25d3fff640 1 -- 172.21.15.27:0/1566143592 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f25c40b2040 con 0x7f25dc0cf1e0 2024-01-15T11:33:44.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.919+0000 7f25d3fff640 1 --2- 172.21.15.27:0/1566143592 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f25bc0668f0 0x7f25bc068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:44.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.919+0000 7f25d3fff640 1 -- 172.21.15.27:0/1566143592 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25c411d640 con 0x7f25dc0cf1e0 2024-01-15T11:33:44.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.919+0000 7f25daffd640 1 --2- 172.21.15.27:0/1566143592 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f25bc0668f0 0x7f25bc068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:44.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.919+0000 7f25daffd640 1 --2- 172.21.15.27:0/1566143592 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f25bc0668f0 0x7f25bc068db0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0011f0 tx=0x7f25cc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:44.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:44.923+0000 7f25d3fff640 1 -- 172.21.15.27:0/1566143592 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f25c40ea7e0 con 0x7f25dc0cf1e0 2024-01-15T11:33:45.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.083+0000 7f25e16d6640 1 -- 172.21.15.27:0/1566143592 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f25dc15a400 con 0x7f25dc0cf1e0 2024-01-15T11:33:45.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.083+0000 7f25d3fff640 1 -- 172.21.15.27:0/1566143592 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f25dc15a400 con 0x7f25dc0cf1e0 2024-01-15T11:33:45.086 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-01-15T11:33:45.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.083+0000 7f25e16d6640 1 -- 172.21.15.27:0/1566143592 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f25bc0668f0 msgr2=0x7f25bc068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:45.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.083+0000 7f25e16d6640 1 --2- 172.21.15.27:0/1566143592 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f25bc0668f0 0x7f25bc068db0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0011f0 tx=0x7f25cc009040 comp rx=0 tx=0).stop 2024-01-15T11:33:45.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.083+0000 7f25e16d6640 1 -- 172.21.15.27:0/1566143592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25dc0cf1e0 msgr2=0x7f25dc159c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:45.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.083+0000 7f25e16d6640 1 --2- 172.21.15.27:0/1566143592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25dc0cf1e0 0x7f25dc159c00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f25c40097c0 tx=0x7f25c4019110 comp rx=0 tx=0).stop 2024-01-15T11:33:45.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.083+0000 7f25e16d6640 1 -- 172.21.15.27:0/1566143592 shutdown_connections 2024-01-15T11:33:45.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.083+0000 7f25e16d6640 1 --2- 172.21.15.27:0/1566143592 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25dc15d8f0 0x7f25dc0b85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.088 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.083+0000 7f25e16d6640 1 --2- 172.21.15.27:0/1566143592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25dc0cf1e0 0x7f25dc159c00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.083+0000 7f25e16d6640 1 --2- 172.21.15.27:0/1566143592 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f25bc0668f0 0x7f25bc068db0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.083+0000 7f25e16d6640 1 --2- 172.21.15.27:0/1566143592 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25dc0ced30 0x7f25dc154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.083+0000 7f25e16d6640 1 -- 172.21.15.27:0/1566143592 >> 172.21.15.27:0/1566143592 conn(0x7f25dc09c750 msgr2=0x7f25dc168740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:45.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.087+0000 7f25e16d6640 1 -- 172.21.15.27:0/1566143592 shutdown_connections 2024-01-15T11:33:45.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.087+0000 7f25e16d6640 1 -- 172.21.15.27:0/1566143592 wait complete. 2024-01-15T11:33:45.108 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:33:45.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.247+0000 7f299ee05640 1 Processor -- start 2024-01-15T11:33:45.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.247+0000 7f299ee05640 1 -- start start 2024-01-15T11:33:45.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.247+0000 7f299ee05640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f29980ae3d0 0x7f299806e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:45.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.247+0000 7f299ee05640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29980ae7f0 con 0x7f299806dfd0 2024-01-15T11:33:45.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.247+0000 7f299ee05640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299806e980 con 0x7f2998143ae0 2024-01-15T11:33:45.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.247+0000 7f299ee05640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2998070670 con 0x7f29980ae3d0 2024-01-15T11:33:45.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.247+0000 7f2997fff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f299806dfd0 0x7f29980adcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:57900/0 (socket says 172.21.15.27:57900) 2024-01-15T11:33:45.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.247+0000 7f2997fff640 1 -- 172.21.15.27:0/3272182885 learned_addr learned my addr 172.21.15.27:0/3272182885 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:45.253 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.247+0000 7f299d3a2640 1 --2- 172.21.15.27:0/3272182885 >> v2:172.21.15.93:3300/0 conn(0x7f29980ae3d0 0x7f299806e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:45.253 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.247+0000 7f29977fe640 1 -- 172.21.15.27:0/3272182885 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1091236656 0 0) 0x7f29980ae7f0 con 0x7f299806dfd0 2024-01-15T11:33:45.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.247+0000 7f29977fe640 1 -- 172.21.15.27:0/3272182885 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2988003530 con 0x7f299806dfd0 2024-01-15T11:33:45.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.251+0000 7f29977fe640 1 -- 172.21.15.27:0/3272182885 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4033880010 0 0) 0x7f2988003530 con 0x7f299806dfd0 2024-01-15T11:33:45.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.251+0000 7f29977fe640 1 -- 172.21.15.27:0/3272182885 >> v2:172.21.15.93:3300/0 conn(0x7f29980ae3d0 msgr2=0x7f299806e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:45.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.251+0000 7f29977fe640 1 --2- 172.21.15.27:0/3272182885 >> v2:172.21.15.93:3300/0 conn(0x7f29980ae3d0 0x7f299806e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.251+0000 7f29977fe640 1 -- 172.21.15.27:0/3272182885 >> v1:172.21.15.93:6789/0 conn(0x7f2998143ae0 legacy=0x7f29980b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:45.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.251+0000 7f29977fe640 1 -- 172.21.15.27:0/3272182885 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2998070950 con 0x7f299806dfd0 2024-01-15T11:33:45.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.251+0000 7f29977fe640 1 -- 172.21.15.27:0/3272182885 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1394381265 0 0) 0x7f2984001680 con 0x7f299806dfd0 2024-01-15T11:33:45.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.251+0000 7f29977fe640 1 -- 172.21.15.27:0/3272182885 >> v1:172.21.15.27:6789/0 conn(0x7f299806dfd0 legacy=0x7f29980adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:45.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.251+0000 7f29977fe640 1 --2- 172.21.15.27:0/3272182885 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f29880039d0 0x7f2988003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:45.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.251+0000 7f29977fe640 1 --2- 172.21.15.27:0/3272182885 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f29880047d0 0x7f2988004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:45.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.251+0000 7f29977fe640 1 --2- 172.21.15.27:0/3272182885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2988005190 0x7f298800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:45.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.251+0000 7f29977fe640 1 -- 172.21.15.27:0/3272182885 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2998070670 con 0x7f2988005190 2024-01-15T11:33:45.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.251+0000 7f29977fe640 1 -- 172.21.15.27:0/3272182885 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298800c090 con 0x7f29880039d0 2024-01-15T11:33:45.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.251+0000 7f29977fe640 1 -- 172.21.15.27:0/3272182885 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298800c250 con 0x7f29880047d0 2024-01-15T11:33:45.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.251+0000 7f299d3a2640 1 --2- 172.21.15.27:0/3272182885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2988005190 0x7f298800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:45.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.251+0000 7f2997fff640 1 --2- 172.21.15.27:0/3272182885 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f29880047d0 0x7f2988004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:45.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.251+0000 7f299cba1640 1 --2- 172.21.15.27:0/3272182885 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f29880039d0 0x7f2988003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:45.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.251+0000 7f299d3a2640 1 -- 172.21.15.27:0/3272182885 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f29880047d0 msgr2=0x7f2988004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:45.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.251+0000 7f299d3a2640 1 --2- 172.21.15.27:0/3272182885 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f29880047d0 0x7f2988004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.251+0000 7f299d3a2640 1 -- 172.21.15.27:0/3272182885 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f29880039d0 msgr2=0x7f2988003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:45.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.251+0000 7f299d3a2640 1 --2- 172.21.15.27:0/3272182885 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f29880039d0 0x7f2988003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.251+0000 7f299d3a2640 1 -- 172.21.15.27:0/3272182885 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2988003530 con 0x7f2988005190 2024-01-15T11:33:45.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.251+0000 7f299d3a2640 1 -- 172.21.15.27:0/3272182885 reap_dead start 2024-01-15T11:33:45.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.251+0000 7f299d3a2640 1 --2- 172.21.15.27:0/3272182885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2988005190 0x7f298800b990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2990009fc0 tx=0x7f299001eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc3004f978779c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:45.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.255+0000 7f29977fe640 1 -- 172.21.15.27:0/3272182885 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29900039a0 con 0x7f2988005190 2024-01-15T11:33:45.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.255+0000 7f29977fe640 1 -- 172.21.15.27:0/3272182885 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299000f040 con 0x7f2988005190 2024-01-15T11:33:45.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.255+0000 7f29977fe640 1 -- 172.21.15.27:0/3272182885 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2990003d80 con 0x7f2988005190 2024-01-15T11:33:45.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.255+0000 7f299ee05640 1 -- 172.21.15.27:0/3272182885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2988005190 msgr2=0x7f298800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:45.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.255+0000 7f299ee05640 1 --2- 172.21.15.27:0/3272182885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2988005190 0x7f298800b990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2990009fc0 tx=0x7f299001eeb0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.255+0000 7f299ee05640 1 -- 172.21.15.27:0/3272182885 shutdown_connections 2024-01-15T11:33:45.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.255+0000 7f299ee05640 1 --2- 172.21.15.27:0/3272182885 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2988005190 0x7f298800b990 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.255+0000 7f299ee05640 1 -- 172.21.15.27:0/3272182885 >> 172.21.15.27:0/3272182885 conn(0x7f29980b0c40 msgr2=0x7f29980b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:45.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.255+0000 7f299ee05640 1 -- 172.21.15.27:0/3272182885 shutdown_connections 2024-01-15T11:33:45.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.255+0000 7f299ee05640 1 -- 172.21.15.27:0/3272182885 wait complete. 2024-01-15T11:33:45.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.255+0000 7f299ee05640 1 Processor -- start 2024-01-15T11:33:45.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.255+0000 7f299ee05640 1 -- start start 2024-01-15T11:33:45.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.255+0000 7f299ee05640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2988005190 0x7f29981ec410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:45.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.255+0000 7f299ee05640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f29981ef250 0x7f29981ee030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:45.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.255+0000 7f299ee05640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f299809c200 0x7f299809c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:45.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.255+0000 7f299ee05640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299809cbf0 con 0x7f299809c200 2024-01-15T11:33:45.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.255+0000 7f299ee05640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29981efd10 con 0x7f29981ef250 2024-01-15T11:33:45.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.255+0000 7f299ee05640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29981efff0 con 0x7f2988005190 2024-01-15T11:33:45.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.255+0000 7f299d3a2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f299809c200 0x7f299809c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:45.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.255+0000 7f299d3a2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f299809c200 0x7f299809c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58476/0 (socket says 172.21.15.27:58476) 2024-01-15T11:33:45.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.255+0000 7f299d3a2640 1 -- 172.21.15.27:0/751212036 learned_addr learned my addr 172.21.15.27:0/751212036 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:45.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.255+0000 7f299cba1640 1 --2- 172.21.15.27:0/751212036 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2988005190 0x7f29981ec410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:45.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.255+0000 7f2997fff640 1 --2- 172.21.15.27:0/751212036 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f29981ef250 0x7f29981ee030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:45.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.259+0000 7f299d3a2640 1 -- 172.21.15.27:0/751212036 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2988005190 msgr2=0x7f29981ec410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:45.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.259+0000 7f299d3a2640 1 --2- 172.21.15.27:0/751212036 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2988005190 0x7f29981ec410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.259+0000 7f299d3a2640 1 -- 172.21.15.27:0/751212036 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f29981ef250 msgr2=0x7f29981ee030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:45.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.259+0000 7f299d3a2640 1 --2- 172.21.15.27:0/751212036 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f29981ef250 0x7f29981ee030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.259+0000 7f299d3a2640 1 -- 172.21.15.27:0/751212036 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29981f02d0 con 0x7f299809c200 2024-01-15T11:33:45.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.259+0000 7f299d3a2640 1 --2- 172.21.15.27:0/751212036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f299809c200 0x7f299809c6b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f29900253e0 tx=0x7f2990009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:45.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.259+0000 7f29957fa640 1 -- 172.21.15.27:0/751212036 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29900ba470 con 0x7f299809c200 2024-01-15T11:33:45.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.259+0000 7f29957fa640 1 -- 172.21.15.27:0/751212036 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29900ba5d0 con 0x7f299809c200 2024-01-15T11:33:45.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.259+0000 7f299ee05640 1 -- 172.21.15.27:0/751212036 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29981f05b0 con 0x7f299809c200 2024-01-15T11:33:45.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.259+0000 7f29957fa640 1 -- 172.21.15.27:0/751212036 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29900ba9a0 con 0x7f299809c200 2024-01-15T11:33:45.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.259+0000 7f299ee05640 1 -- 172.21.15.27:0/751212036 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2998141680 con 0x7f299809c200 2024-01-15T11:33:45.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.259+0000 7f299ee05640 1 -- 172.21.15.27:0/751212036 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29981f0ad0 con 0x7f299809c200 2024-01-15T11:33:45.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.259+0000 7f29957fa640 1 -- 172.21.15.27:0/751212036 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f29900bab00 con 0x7f299809c200 2024-01-15T11:33:45.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.259+0000 7f29957fa640 1 --2- 172.21.15.27:0/751212036 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f297c066920 0x7f297c068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:45.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.263+0000 7f29957fa640 1 -- 172.21.15.27:0/751212036 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29901221c0 con 0x7f299809c200 2024-01-15T11:33:45.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.263+0000 7f299cba1640 1 --2- 172.21.15.27:0/751212036 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f297c066920 0x7f297c068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:45.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.263+0000 7f299cba1640 1 --2- 172.21.15.27:0/751212036 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f297c066920 0x7f297c068de0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f298c0015e0 tx=0x7f298c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:45.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.263+0000 7f29957fa640 1 -- 172.21.15.27:0/751212036 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f29981f0ad0 con 0x7f299809c200 2024-01-15T11:33:45.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.423+0000 7f299ee05640 1 -- 172.21.15.27:0/751212036 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29981f0ad0 con 0x7f299809c200 2024-01-15T11:33:45.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.423+0000 7f29957fa640 1 -- 172.21.15.27:0/751212036 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16425 (secure 0 0 0) 0x7f29981f0ad0 con 0x7f299809c200 2024-01-15T11:33:45.426 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:45.426 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:33:21.682894+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T11:33:18.397200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T11:33:19.061383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:33:45.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.423+0000 7f299ee05640 1 -- 172.21.15.27:0/751212036 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f297c066920 msgr2=0x7f297c068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:45.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.423+0000 7f299ee05640 1 --2- 172.21.15.27:0/751212036 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f297c066920 0x7f297c068de0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f298c0015e0 tx=0x7f298c009040 comp rx=0 tx=0).stop 2024-01-15T11:33:45.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.423+0000 7f299ee05640 1 -- 172.21.15.27:0/751212036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f299809c200 msgr2=0x7f299809c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:45.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.423+0000 7f299ee05640 1 --2- 172.21.15.27:0/751212036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f299809c200 0x7f299809c6b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f29900253e0 tx=0x7f2990009750 comp rx=0 tx=0).stop 2024-01-15T11:33:45.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.423+0000 7f299ee05640 1 -- 172.21.15.27:0/751212036 shutdown_connections 2024-01-15T11:33:45.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.423+0000 7f299ee05640 1 --2- 172.21.15.27:0/751212036 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f299809c200 0x7f299809c6b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.423+0000 7f299ee05640 1 --2- 172.21.15.27:0/751212036 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f297c066920 0x7f297c068de0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.423+0000 7f299ee05640 1 --2- 172.21.15.27:0/751212036 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f29981ef250 0x7f29981ee030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.423+0000 7f299ee05640 1 --2- 172.21.15.27:0/751212036 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2988005190 0x7f29981ec410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.423+0000 7f299ee05640 1 -- 172.21.15.27:0/751212036 >> 172.21.15.27:0/751212036 conn(0x7f29980b0c40 msgr2=0x7f2998140b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:45.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.423+0000 7f299ee05640 1 -- 172.21.15.27:0/751212036 shutdown_connections 2024-01-15T11:33:45.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.423+0000 7f299ee05640 1 -- 172.21.15.27:0/751212036 wait complete. 2024-01-15T11:33:45.447 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T11:33:08.134662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-15T11:33:18.397200+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-15T11:33:19.061383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T11:33:45.448 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T11:33:45.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.591+0000 7fb8791aa640 1 Processor -- start 2024-01-15T11:33:45.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.591+0000 7fb8791aa640 1 -- start start 2024-01-15T11:33:45.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.591+0000 7fb8791aa640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb87415eee0 0x7fb87415f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:45.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.591+0000 7fb8791aa640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb87415f880 con 0x7fb8740d0950 2024-01-15T11:33:45.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.591+0000 7fb8791aa640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb87415fcb0 con 0x7fb874144d50 2024-01-15T11:33:45.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.591+0000 7fb8791aa640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8740b5790 con 0x7fb87415eee0 2024-01-15T11:33:45.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.591+0000 7fb87359e640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb8740d0950 0x7fb8740d0de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:57906/0 (socket says 172.21.15.27:57906) 2024-01-15T11:33:45.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.591+0000 7fb87359e640 1 -- 172.21.15.27:0/3940961526 learned_addr learned my addr 172.21.15.27:0/3940961526 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:45.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.591+0000 7fb87259c640 1 --2- 172.21.15.27:0/3940961526 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb87415eee0 0x7fb87415f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:45.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.591+0000 7fb871d9b640 1 -- 172.21.15.27:0/3940961526 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1146246640 0 0) 0x7fb87415f880 con 0x7fb8740d0950 2024-01-15T11:33:45.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.591+0000 7fb871d9b640 1 -- 172.21.15.27:0/3940961526 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb85c003530 con 0x7fb8740d0950 2024-01-15T11:33:45.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.591+0000 7fb871d9b640 1 -- 172.21.15.27:0/3940961526 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074298727 0 0) 0x7fb87415fcb0 con 0x7fb874144d50 2024-01-15T11:33:45.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.591+0000 7fb871d9b640 1 -- 172.21.15.27:0/3940961526 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb87415f880 con 0x7fb874144d50 2024-01-15T11:33:45.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.591+0000 7fb87259c640 1 -- 172.21.15.27:0/3940961526 >> v1:172.21.15.93:6789/0 conn(0x7fb874144d50 legacy=0x7fb8740b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:45.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.591+0000 7fb87259c640 1 -- 172.21.15.27:0/3940961526 >> v1:172.21.15.27:6789/0 conn(0x7fb8740d0950 legacy=0x7fb8740d0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:45.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.591+0000 7fb87259c640 1 -- 172.21.15.27:0/3940961526 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8740b5a70 con 0x7fb87415eee0 2024-01-15T11:33:45.597 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.595+0000 7fb87259c640 1 --2- 172.21.15.27:0/3940961526 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb87415eee0 0x7fb87415f340 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb8680097f0 tx=0x7fb86801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97dc6f00b288009b server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:45.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.595+0000 7fb871d9b640 1 -- 172.21.15.27:0/3940961526 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8680aa5f0 con 0x7fb87415eee0 2024-01-15T11:33:45.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.595+0000 7fb871d9b640 1 -- 172.21.15.27:0/3940961526 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8680aa750 con 0x7fb87415eee0 2024-01-15T11:33:45.598 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.595+0000 7fb871d9b640 1 -- 172.21.15.27:0/3940961526 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8680aaae0 con 0x7fb87415eee0 2024-01-15T11:33:45.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.595+0000 7fb8791aa640 1 -- 172.21.15.27:0/3940961526 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb87415eee0 msgr2=0x7fb87415f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:45.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.595+0000 7fb8791aa640 1 --2- 172.21.15.27:0/3940961526 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb87415eee0 0x7fb87415f340 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb8680097f0 tx=0x7fb86801c490 comp rx=0 tx=0).stop 2024-01-15T11:33:45.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.595+0000 7fb8791aa640 1 -- 172.21.15.27:0/3940961526 shutdown_connections 2024-01-15T11:33:45.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.595+0000 7fb8791aa640 1 --2- 172.21.15.27:0/3940961526 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb87415eee0 0x7fb87415f340 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.595+0000 7fb8791aa640 1 -- 172.21.15.27:0/3940961526 >> 172.21.15.27:0/3940961526 conn(0x7fb8740b2f10 msgr2=0x7fb8740b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:45.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.595+0000 7fb8791aa640 1 -- 172.21.15.27:0/3940961526 shutdown_connections 2024-01-15T11:33:45.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.595+0000 7fb8791aa640 1 -- 172.21.15.27:0/3940961526 wait complete. 2024-01-15T11:33:45.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.599+0000 7fb8791aa640 1 Processor -- start 2024-01-15T11:33:45.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.599+0000 7fb8791aa640 1 -- start start 2024-01-15T11:33:45.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.599+0000 7fb8791aa640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8740d0950 0x7fb87413fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:45.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.599+0000 7fb8791aa640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb874144d50 0x7fb87415c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:45.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.599+0000 7fb8791aa640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb87415eee0 0x7fb87415c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:45.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.599+0000 7fb8791aa640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87413c180 con 0x7fb8740d0950 2024-01-15T11:33:45.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.599+0000 7fb8791aa640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87415d1f0 con 0x7fb87415eee0 2024-01-15T11:33:45.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.599+0000 7fb8791aa640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87415d4d0 con 0x7fb874144d50 2024-01-15T11:33:45.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.599+0000 7fb872d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8740d0950 0x7fb87413fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:45.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.599+0000 7fb872d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8740d0950 0x7fb87413fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58492/0 (socket says 172.21.15.27:58492) 2024-01-15T11:33:45.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.599+0000 7fb872d9d640 1 -- 172.21.15.27:0/740117043 learned_addr learned my addr 172.21.15.27:0/740117043 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:45.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.599+0000 7fb87359e640 1 --2- 172.21.15.27:0/740117043 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb87415eee0 0x7fb87415c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:45.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.599+0000 7fb87259c640 1 --2- 172.21.15.27:0/740117043 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb874144d50 0x7fb87415c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:45.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.599+0000 7fb872d9d640 1 -- 172.21.15.27:0/740117043 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb874144d50 msgr2=0x7fb87415c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:45.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.599+0000 7fb872d9d640 1 --2- 172.21.15.27:0/740117043 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb874144d50 0x7fb87415c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.599+0000 7fb872d9d640 1 -- 172.21.15.27:0/740117043 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb87415eee0 msgr2=0x7fb87415c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:45.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.599+0000 7fb872d9d640 1 --2- 172.21.15.27:0/740117043 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb87415eee0 0x7fb87415c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.599+0000 7fb872d9d640 1 -- 172.21.15.27:0/740117043 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb868009420 con 0x7fb8740d0950 2024-01-15T11:33:45.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.599+0000 7fb87259c640 1 --2- 172.21.15.27:0/740117043 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb874144d50 0x7fb87415c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:45.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.599+0000 7fb872d9d640 1 --2- 172.21.15.27:0/740117043 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8740d0950 0x7fb87413fc90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb86400c490 tx=0x7fb86400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:45.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.599+0000 7fb85b7fe640 1 -- 172.21.15.27:0/740117043 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8640052d0 con 0x7fb8740d0950 2024-01-15T11:33:45.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.599+0000 7fb85b7fe640 1 -- 172.21.15.27:0/740117043 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb864005430 con 0x7fb8740d0950 2024-01-15T11:33:45.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.599+0000 7fb85b7fe640 1 -- 172.21.15.27:0/740117043 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb864012870 con 0x7fb8740d0950 2024-01-15T11:33:45.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.599+0000 7fb8791aa640 1 -- 172.21.15.27:0/740117043 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb87415d7b0 con 0x7fb8740d0950 2024-01-15T11:33:45.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.599+0000 7fb8791aa640 1 -- 172.21.15.27:0/740117043 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87415da90 con 0x7fb8740d0950 2024-01-15T11:33:45.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.603+0000 7fb8791aa640 1 -- 172.21.15.27:0/740117043 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb87404e850 con 0x7fb8740d0950 2024-01-15T11:33:45.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.603+0000 7fb85b7fe640 1 -- 172.21.15.27:0/740117043 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fb8640129d0 con 0x7fb8740d0950 2024-01-15T11:33:45.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.603+0000 7fb85b7fe640 1 --2- 172.21.15.27:0/740117043 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb8600668f0 0x7fb860068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:45.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.603+0000 7fb85b7fe640 1 -- 172.21.15.27:0/740117043 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb864083e70 con 0x7fb8740d0950 2024-01-15T11:33:45.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.603+0000 7fb87259c640 1 --2- 172.21.15.27:0/740117043 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb8600668f0 0x7fb860068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:45.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.603+0000 7fb87259c640 1 --2- 172.21.15.27:0/740117043 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb8600668f0 0x7fb860068db0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb8680ae000 tx=0x7fb8680a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:45.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.607+0000 7fb85b7fe640 1 -- 172.21.15.27:0/740117043 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb864051150 con 0x7fb8740d0950 2024-01-15T11:33:45.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.767+0000 7fb8791aa640 1 -- 172.21.15.27:0/740117043 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb8740d1f00 con 0x7fb8740d0950 2024-01-15T11:33:45.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.767+0000 7fb85b7fe640 1 -- 172.21.15.27:0/740117043 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb864054770 con 0x7fb8740d0950 2024-01-15T11:33:45.770 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-15T11:33:45.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.767+0000 7fb8791aa640 1 -- 172.21.15.27:0/740117043 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb8600668f0 msgr2=0x7fb860068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:45.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.767+0000 7fb8791aa640 1 --2- 172.21.15.27:0/740117043 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb8600668f0 0x7fb860068db0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb8680ae000 tx=0x7fb8680a7000 comp rx=0 tx=0).stop 2024-01-15T11:33:45.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.767+0000 7fb8791aa640 1 -- 172.21.15.27:0/740117043 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8740d0950 msgr2=0x7fb87413fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:45.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.767+0000 7fb8791aa640 1 --2- 172.21.15.27:0/740117043 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8740d0950 0x7fb87413fc90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb86400c490 tx=0x7fb86400c950 comp rx=0 tx=0).stop 2024-01-15T11:33:45.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.767+0000 7fb8791aa640 1 -- 172.21.15.27:0/740117043 shutdown_connections 2024-01-15T11:33:45.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.771+0000 7fb8791aa640 1 --2- 172.21.15.27:0/740117043 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb8600668f0 0x7fb860068db0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.771+0000 7fb8791aa640 1 --2- 172.21.15.27:0/740117043 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb87415eee0 0x7fb87415c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.771+0000 7fb8791aa640 1 --2- 172.21.15.27:0/740117043 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb874144d50 0x7fb87415c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.771+0000 7fb8791aa640 1 --2- 172.21.15.27:0/740117043 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8740d0950 0x7fb87413fc90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.771+0000 7fb8791aa640 1 -- 172.21.15.27:0/740117043 >> 172.21.15.27:0/740117043 conn(0x7fb8740b2f10 msgr2=0x7fb874143c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:45.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.771+0000 7fb8791aa640 1 -- 172.21.15.27:0/740117043 shutdown_connections 2024-01-15T11:33:45.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.771+0000 7fb8791aa640 1 -- 172.21.15.27:0/740117043 wait complete. 2024-01-15T11:33:45.791 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-15T11:33:45.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.935+0000 7f2db00c9640 1 Processor -- start 2024-01-15T11:33:45.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.935+0000 7f2db00c9640 1 -- start start 2024-01-15T11:33:45.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.935+0000 7f2db00c9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2da80cb9b0 0x7f2da806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:45.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.935+0000 7f2db00c9640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2da80ce5d0 0x7f2da815bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:45.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.935+0000 7f2db00c9640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da8159630 con 0x7f2da80cbd90 2024-01-15T11:33:45.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.935+0000 7f2db00c9640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da815bba0 con 0x7f2da80ce5d0 2024-01-15T11:33:45.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.935+0000 7f2db00c9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da80cdd50 con 0x7f2da80cb9b0 2024-01-15T11:33:45.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.935+0000 7f2dae666640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2da80ce5d0 0x7f2da815bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:45.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.935+0000 7f2dad664640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f2da80cbd90 0x7f2da815f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:57908/0 (socket says 172.21.15.27:57908) 2024-01-15T11:33:45.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.935+0000 7f2dad664640 1 -- 172.21.15.27:0/623702528 learned_addr learned my addr 172.21.15.27:0/623702528 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:45.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.935+0000 7f2dade65640 1 --2- 172.21.15.27:0/623702528 >> v2:172.21.15.93:3300/0 conn(0x7f2da80cb9b0 0x7f2da806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:45.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.935+0000 7f2dae666640 1 -- 172.21.15.27:0/623702528 >> v2:172.21.15.93:3300/0 conn(0x7f2da80cb9b0 msgr2=0x7f2da806e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:45.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.935+0000 7f2dae666640 1 --2- 172.21.15.27:0/623702528 >> v2:172.21.15.93:3300/0 conn(0x7f2da80cb9b0 0x7f2da806e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.935+0000 7f2dae666640 1 -- 172.21.15.27:0/623702528 >> v1:172.21.15.27:6789/0 conn(0x7f2da80cbd90 legacy=0x7f2da815f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:45.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.935+0000 7f2dae666640 1 -- 172.21.15.27:0/623702528 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da80cd1d0 con 0x7f2da80ce5d0 2024-01-15T11:33:45.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.935+0000 7f2dace63640 1 -- 172.21.15.27:0/623702528 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670456782 0 0) 0x7f2da8159630 con 0x7f2da80cbd90 2024-01-15T11:33:45.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.939+0000 7f2dae666640 1 --2- 172.21.15.27:0/623702528 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da80ce5d0 0x7f2da815bfd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2da806c360 tx=0x7f2da001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1652f921e978c261 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:45.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.939+0000 7f2dace63640 1 -- 172.21.15.27:0/623702528 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da00a5980 con 0x7f2da80ce5d0 2024-01-15T11:33:45.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.939+0000 7f2dace63640 1 -- 172.21.15.27:0/623702528 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da00a5ae0 con 0x7f2da80ce5d0 2024-01-15T11:33:45.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.939+0000 7f2dace63640 1 -- 172.21.15.27:0/623702528 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da00a5e70 con 0x7f2da80ce5d0 2024-01-15T11:33:45.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.939+0000 7f2db00c9640 1 -- 172.21.15.27:0/623702528 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da80ce5d0 msgr2=0x7f2da815bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:45.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.939+0000 7f2db00c9640 1 --2- 172.21.15.27:0/623702528 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da80ce5d0 0x7f2da815bfd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2da806c360 tx=0x7f2da001c8e0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.939+0000 7f2db00c9640 1 -- 172.21.15.27:0/623702528 shutdown_connections 2024-01-15T11:33:45.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.939+0000 7f2db00c9640 1 --2- 172.21.15.27:0/623702528 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da80ce5d0 0x7f2da815bfd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.939+0000 7f2db00c9640 1 --2- 172.21.15.27:0/623702528 >> v2:172.21.15.93:3300/0 conn(0x7f2da80cb9b0 0x7f2da806e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.939+0000 7f2db00c9640 1 -- 172.21.15.27:0/623702528 >> 172.21.15.27:0/623702528 conn(0x7f2da80b0cb0 msgr2=0x7f2da80b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:45.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.939+0000 7f2db00c9640 1 -- 172.21.15.27:0/623702528 shutdown_connections 2024-01-15T11:33:45.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.939+0000 7f2db00c9640 1 -- 172.21.15.27:0/623702528 wait complete. 2024-01-15T11:33:45.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.943+0000 7f2db00c9640 1 Processor -- start 2024-01-15T11:33:45.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.943+0000 7f2db00c9640 1 -- start start 2024-01-15T11:33:45.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.943+0000 7f2db00c9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da80cb9b0 0x7f2da8155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:45.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.943+0000 7f2db00c9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2da80cbd90 0x7f2da8151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:45.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.943+0000 7f2db00c9640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2da80ce5d0 0x7f2da81525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:45.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.943+0000 7f2db00c9640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da8157910 con 0x7f2da80cb9b0 2024-01-15T11:33:45.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.943+0000 7f2db00c9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da8154b50 con 0x7f2da80cbd90 2024-01-15T11:33:45.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.943+0000 7f2db00c9640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da8157350 con 0x7f2da80ce5d0 2024-01-15T11:33:45.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.943+0000 7f2dade65640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da80cb9b0 0x7f2da8155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:45.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.943+0000 7f2dade65640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da80cb9b0 0x7f2da8155310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58512/0 (socket says 172.21.15.27:58512) 2024-01-15T11:33:45.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.943+0000 7f2dade65640 1 -- 172.21.15.27:0/1767054424 learned_addr learned my addr 172.21.15.27:0/1767054424 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:45.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.943+0000 7f2dad664640 1 --2- 172.21.15.27:0/1767054424 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2da80cbd90 0x7f2da8151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:45.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.943+0000 7f2dae666640 1 --2- 172.21.15.27:0/1767054424 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2da80ce5d0 0x7f2da81525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:45.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.943+0000 7f2dade65640 1 -- 172.21.15.27:0/1767054424 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2da80ce5d0 msgr2=0x7f2da81525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:45.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.943+0000 7f2dade65640 1 --2- 172.21.15.27:0/1767054424 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2da80ce5d0 0x7f2da81525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.943+0000 7f2dade65640 1 -- 172.21.15.27:0/1767054424 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2da80cbd90 msgr2=0x7f2da8151df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:45.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.943+0000 7f2dade65640 1 --2- 172.21.15.27:0/1767054424 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2da80cbd90 0x7f2da8151df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:45.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.943+0000 7f2dade65640 1 -- 172.21.15.27:0/1767054424 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da0009a70 con 0x7f2da80cb9b0 2024-01-15T11:33:45.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.943+0000 7f2dae666640 1 --2- 172.21.15.27:0/1767054424 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2da80ce5d0 0x7f2da81525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:45.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.943+0000 7f2dade65640 1 --2- 172.21.15.27:0/1767054424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da80cb9b0 0x7f2da8155310 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2da400d800 tx=0x7f2da400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:45.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.943+0000 7f2d9e7fc640 1 -- 172.21.15.27:0/1767054424 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da400b6c0 con 0x7f2da80cb9b0 2024-01-15T11:33:45.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.943+0000 7f2d9e7fc640 1 -- 172.21.15.27:0/1767054424 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da400b820 con 0x7f2da80cb9b0 2024-01-15T11:33:45.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.943+0000 7f2db00c9640 1 -- 172.21.15.27:0/1767054424 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da8157630 con 0x7f2da80cb9b0 2024-01-15T11:33:45.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.943+0000 7f2d9e7fc640 1 -- 172.21.15.27:0/1767054424 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da400bb90 con 0x7f2da80cb9b0 2024-01-15T11:33:45.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.943+0000 7f2db00c9640 1 -- 172.21.15.27:0/1767054424 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da81532a0 con 0x7f2da80cb9b0 2024-01-15T11:33:45.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.947+0000 7f2db00c9640 1 -- 172.21.15.27:0/1767054424 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da80671f0 con 0x7f2da80cb9b0 2024-01-15T11:33:45.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.947+0000 7f2d9e7fc640 1 -- 172.21.15.27:0/1767054424 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f2da400bcf0 con 0x7f2da80cb9b0 2024-01-15T11:33:45.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.947+0000 7f2d9e7fc640 1 --2- 172.21.15.27:0/1767054424 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f2d8c0668f0 0x7f2d8c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:45.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.947+0000 7f2d9e7fc640 1 -- 172.21.15.27:0/1767054424 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2da40848f0 con 0x7f2da80cb9b0 2024-01-15T11:33:45.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.947+0000 7f2dad664640 1 --2- 172.21.15.27:0/1767054424 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f2d8c0668f0 0x7f2d8c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:45.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.947+0000 7f2dad664640 1 --2- 172.21.15.27:0/1767054424 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f2d8c0668f0 0x7f2d8c068db0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2da815d7f0 tx=0x7f2d98007d60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:45.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:45.951+0000 7f2d9e7fc640 1 -- 172.21.15.27:0/1767054424 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2da4051b20 con 0x7f2da80cb9b0 2024-01-15T11:33:46.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.107+0000 7f2db00c9640 1 -- 172.21.15.27:0/1767054424 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2da806b460 con 0x7f2da80cb9b0 2024-01-15T11:33:46.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.107+0000 7f2d9e7fc640 1 -- 172.21.15.27:0/1767054424 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2da4055140 con 0x7f2da80cb9b0 2024-01-15T11:33:46.112 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-01-15T11:33:46.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.111+0000 7f2db00c9640 1 -- 172.21.15.27:0/1767054424 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f2d8c0668f0 msgr2=0x7f2d8c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:46.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.111+0000 7f2db00c9640 1 --2- 172.21.15.27:0/1767054424 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f2d8c0668f0 0x7f2d8c068db0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2da815d7f0 tx=0x7f2d98007d60 comp rx=0 tx=0).stop 2024-01-15T11:33:46.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.111+0000 7f2db00c9640 1 -- 172.21.15.27:0/1767054424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da80cb9b0 msgr2=0x7f2da8155310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:46.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.111+0000 7f2db00c9640 1 --2- 172.21.15.27:0/1767054424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da80cb9b0 0x7f2da8155310 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2da400d800 tx=0x7f2da400dcc0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.111+0000 7f2db00c9640 1 -- 172.21.15.27:0/1767054424 shutdown_connections 2024-01-15T11:33:46.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.111+0000 7f2db00c9640 1 --2- 172.21.15.27:0/1767054424 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2da80ce5d0 0x7f2da81525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.111+0000 7f2db00c9640 1 --2- 172.21.15.27:0/1767054424 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f2d8c0668f0 0x7f2d8c068db0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.111+0000 7f2db00c9640 1 --2- 172.21.15.27:0/1767054424 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2da80cbd90 0x7f2da8151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.111+0000 7f2db00c9640 1 --2- 172.21.15.27:0/1767054424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2da80cb9b0 0x7f2da8155310 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.111+0000 7f2db00c9640 1 -- 172.21.15.27:0/1767054424 >> 172.21.15.27:0/1767054424 conn(0x7f2da80b0cb0 msgr2=0x7f2da8165b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:46.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.111+0000 7f2db00c9640 1 -- 172.21.15.27:0/1767054424 shutdown_connections 2024-01-15T11:33:46.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.111+0000 7f2db00c9640 1 -- 172.21.15.27:0/1767054424 wait complete. 2024-01-15T11:33:46.133 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-15T11:33:46.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.275+0000 7fbc03c05640 1 Processor -- start 2024-01-15T11:33:46.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.275+0000 7fbc03c05640 1 -- start start 2024-01-15T11:33:46.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.279+0000 7fbc03c05640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbbfc0cb9b0 0x7fbbfc06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:46.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.279+0000 7fbc03c05640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbbfc0ce5d0 0x7fbbfc15bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:46.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.279+0000 7fbc03c05640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbfc159630 con 0x7fbbfc0cbd90 2024-01-15T11:33:46.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.279+0000 7fbc03c05640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbfc15bba0 con 0x7fbbfc0cb9b0 2024-01-15T11:33:46.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.279+0000 7fbc03c05640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc0cdd50 con 0x7fbbfc0ce5d0 2024-01-15T11:33:46.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.279+0000 7fbc019a1640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbbfc0cb9b0 0x7fbbfc06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:46.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.279+0000 7fbc019a1640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbbfc0cb9b0 0x7fbbfc06e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58518/0 (socket says 172.21.15.27:58518) 2024-01-15T11:33:46.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.279+0000 7fbc019a1640 1 -- 172.21.15.27:0/3049175678 learned_addr learned my addr 172.21.15.27:0/3049175678 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:46.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.279+0000 7fbc021a2640 1 --2- 172.21.15.27:0/3049175678 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbbfc0ce5d0 0x7fbbfc15bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:46.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.279+0000 7fbc019a1640 1 -- 172.21.15.27:0/3049175678 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbbfc0ce5d0 msgr2=0x7fbbfc15bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:46.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.279+0000 7fbc019a1640 1 --2- 172.21.15.27:0/3049175678 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbbfc0ce5d0 0x7fbbfc15bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.279+0000 7fbc019a1640 1 -- 172.21.15.27:0/3049175678 >> v1:172.21.15.27:6789/0 conn(0x7fbbfc0cbd90 legacy=0x7fbbfc15f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:46.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.279+0000 7fbc019a1640 1 -- 172.21.15.27:0/3049175678 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbfc0cd1d0 con 0x7fbbfc0cb9b0 2024-01-15T11:33:46.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.279+0000 7fbc019a1640 1 --2- 172.21.15.27:0/3049175678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbfc0cb9b0 0x7fbbfc06e3f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009870 tx=0x7fbbf801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9438e463f58512b server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:46.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.283+0000 7fbc0099f640 1 -- 172.21.15.27:0/3049175678 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf80aa650 con 0x7fbbfc0cb9b0 2024-01-15T11:33:46.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.283+0000 7fbc0099f640 1 -- 172.21.15.27:0/3049175678 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf80aa7b0 con 0x7fbbfc0cb9b0 2024-01-15T11:33:46.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.283+0000 7fbc0099f640 1 -- 172.21.15.27:0/3049175678 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf80aab40 con 0x7fbbfc0cb9b0 2024-01-15T11:33:46.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.283+0000 7fbc03c05640 1 -- 172.21.15.27:0/3049175678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbfc0cb9b0 msgr2=0x7fbbfc06e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:46.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.283+0000 7fbc03c05640 1 --2- 172.21.15.27:0/3049175678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbfc0cb9b0 0x7fbbfc06e3f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009870 tx=0x7fbbf801c510 comp rx=0 tx=0).stop 2024-01-15T11:33:46.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.283+0000 7fbc03c05640 1 -- 172.21.15.27:0/3049175678 shutdown_connections 2024-01-15T11:33:46.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.283+0000 7fbc03c05640 1 --2- 172.21.15.27:0/3049175678 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbbfc0ce5d0 0x7fbbfc15bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.283+0000 7fbc03c05640 1 --2- 172.21.15.27:0/3049175678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbfc0cb9b0 0x7fbbfc06e3f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.283+0000 7fbc03c05640 1 -- 172.21.15.27:0/3049175678 >> 172.21.15.27:0/3049175678 conn(0x7fbbfc0b0cb0 msgr2=0x7fbbfc0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:46.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.283+0000 7fbc03c05640 1 -- 172.21.15.27:0/3049175678 shutdown_connections 2024-01-15T11:33:46.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.283+0000 7fbc03c05640 1 -- 172.21.15.27:0/3049175678 wait complete. 2024-01-15T11:33:46.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.283+0000 7fbc03c05640 1 Processor -- start 2024-01-15T11:33:46.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.283+0000 7fbc03c05640 1 -- start start 2024-01-15T11:33:46.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.283+0000 7fbc03c05640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbfc0cb9b0 0x7fbbfc153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:46.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.283+0000 7fbc03c05640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbbfc0cbd90 0x7fbbfc0af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:46.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.283+0000 7fbc03c05640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbfc0ce5d0 0x7fbbfc1565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:46.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.283+0000 7fbc03c05640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc0afdc0 con 0x7fbbfc0ce5d0 2024-01-15T11:33:46.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.283+0000 7fbc03c05640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc0b00a0 con 0x7fbbfc0cb9b0 2024-01-15T11:33:46.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.283+0000 7fbc03c05640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc0b0380 con 0x7fbbfc0cbd90 2024-01-15T11:33:46.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.283+0000 7fbc021a2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbfc0ce5d0 0x7fbbfc1565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:46.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.283+0000 7fbc021a2640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbfc0ce5d0 0x7fbbfc1565a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58522/0 (socket says 172.21.15.27:58522) 2024-01-15T11:33:46.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.283+0000 7fbc021a2640 1 -- 172.21.15.27:0/725061193 learned_addr learned my addr 172.21.15.27:0/725061193 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:46.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.287+0000 7fbc011a0640 1 --2- 172.21.15.27:0/725061193 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbbfc0cbd90 0x7fbbfc0af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:46.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.287+0000 7fbc019a1640 1 --2- 172.21.15.27:0/725061193 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbfc0cb9b0 0x7fbbfc153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:46.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.287+0000 7fbc021a2640 1 -- 172.21.15.27:0/725061193 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbbfc0cbd90 msgr2=0x7fbbfc0af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:46.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.287+0000 7fbc021a2640 1 --2- 172.21.15.27:0/725061193 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbbfc0cbd90 0x7fbbfc0af3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.287+0000 7fbc021a2640 1 -- 172.21.15.27:0/725061193 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbfc0cb9b0 msgr2=0x7fbbfc153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:46.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.287+0000 7fbc021a2640 1 --2- 172.21.15.27:0/725061193 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbfc0cb9b0 0x7fbbfc153450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.287+0000 7fbc021a2640 1 -- 172.21.15.27:0/725061193 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf80094d0 con 0x7fbbfc0ce5d0 2024-01-15T11:33:46.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.287+0000 7fbc011a0640 1 --2- 172.21.15.27:0/725061193 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbbfc0cbd90 0x7fbbfc0af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:46.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.287+0000 7fbc019a1640 1 --2- 172.21.15.27:0/725061193 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbfc0cb9b0 0x7fbbfc153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:46.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.287+0000 7fbc021a2640 1 --2- 172.21.15.27:0/725061193 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbfc0ce5d0 0x7fbbfc1565a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4007e60 tx=0x7fbbf400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:46.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.287+0000 7fbbf27fc640 1 -- 172.21.15.27:0/725061193 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4014420 con 0x7fbbfc0ce5d0 2024-01-15T11:33:46.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.287+0000 7fbbf27fc640 1 -- 172.21.15.27:0/725061193 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf40145a0 con 0x7fbbfc0ce5d0 2024-01-15T11:33:46.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.287+0000 7fbc03c05640 1 -- 172.21.15.27:0/725061193 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbfc09b700 con 0x7fbbfc0ce5d0 2024-01-15T11:33:46.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.287+0000 7fbbf27fc640 1 -- 172.21.15.27:0/725061193 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4014950 con 0x7fbbfc0ce5d0 2024-01-15T11:33:46.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.287+0000 7fbc03c05640 1 -- 172.21.15.27:0/725061193 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbfc153990 con 0x7fbbfc0ce5d0 2024-01-15T11:33:46.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.287+0000 7fbc03c05640 1 -- 172.21.15.27:0/725061193 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbfc0671f0 con 0x7fbbfc0ce5d0 2024-01-15T11:33:46.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.287+0000 7fbbf27fc640 1 -- 172.21.15.27:0/725061193 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fbbf4014ab0 con 0x7fbbfc0ce5d0 2024-01-15T11:33:46.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.287+0000 7fbbf27fc640 1 --2- 172.21.15.27:0/725061193 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbbe00668f0 0x7fbbe0068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:46.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.287+0000 7fbbf27fc640 1 -- 172.21.15.27:0/725061193 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbf4084e00 con 0x7fbbfc0ce5d0 2024-01-15T11:33:46.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.291+0000 7fbc019a1640 1 --2- 172.21.15.27:0/725061193 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbbe00668f0 0x7fbbe0068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:46.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.291+0000 7fbc019a1640 1 --2- 172.21.15.27:0/725061193 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbbe00668f0 0x7fbbe0068db0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbbf80ae000 tx=0x7fbbf80a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:46.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.291+0000 7fbbf27fc640 1 -- 172.21.15.27:0/725061193 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbbf4051fa0 con 0x7fbbfc0ce5d0 2024-01-15T11:33:46.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.447+0000 7fbc03c05640 1 -- 172.21.15.27:0/725061193 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbbfc09b940 con 0x7fbbfc0ce5d0 2024-01-15T11:33:46.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.447+0000 7fbbf27fc640 1 -- 172.21.15.27:0/725061193 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbbfc09b940 con 0x7fbbfc0ce5d0 2024-01-15T11:33:46.451 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-01-15T11:33:46.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.451+0000 7fbc03c05640 1 -- 172.21.15.27:0/725061193 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbbe00668f0 msgr2=0x7fbbe0068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:46.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.451+0000 7fbc03c05640 1 --2- 172.21.15.27:0/725061193 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbbe00668f0 0x7fbbe0068db0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbbf80ae000 tx=0x7fbbf80a7000 comp rx=0 tx=0).stop 2024-01-15T11:33:46.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.451+0000 7fbc03c05640 1 -- 172.21.15.27:0/725061193 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbfc0ce5d0 msgr2=0x7fbbfc1565a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:46.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.451+0000 7fbc03c05640 1 --2- 172.21.15.27:0/725061193 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbfc0ce5d0 0x7fbbfc1565a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4007e60 tx=0x7fbbf400e4b0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.451+0000 7fbc03c05640 1 -- 172.21.15.27:0/725061193 shutdown_connections 2024-01-15T11:33:46.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.451+0000 7fbc03c05640 1 --2- 172.21.15.27:0/725061193 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbfc0ce5d0 0x7fbbfc1565a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.451+0000 7fbc03c05640 1 --2- 172.21.15.27:0/725061193 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbbfc0cbd90 0x7fbbfc0af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.451+0000 7fbc03c05640 1 --2- 172.21.15.27:0/725061193 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbbe00668f0 0x7fbbe0068db0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.451+0000 7fbc03c05640 1 --2- 172.21.15.27:0/725061193 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbfc0cb9b0 0x7fbbfc153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.451+0000 7fbc03c05640 1 -- 172.21.15.27:0/725061193 >> 172.21.15.27:0/725061193 conn(0x7fbbfc0b0cb0 msgr2=0x7fbbfc158240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:46.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.451+0000 7fbc03c05640 1 -- 172.21.15.27:0/725061193 shutdown_connections 2024-01-15T11:33:46.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.451+0000 7fbc03c05640 1 -- 172.21.15.27:0/725061193 wait complete. 2024-01-15T11:33:46.473 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:33:46.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.611+0000 7f4761f2a640 1 Processor -- start 2024-01-15T11:33:46.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f4761f2a640 1 -- start start 2024-01-15T11:33:46.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f4761f2a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f475c0ce5c0 0x7f475c0cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:46.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f4761f2a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f475c06a5b0 0x7f475c06aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:46.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f4761f2a640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f475c0b0a70 con 0x7f475c15d8b0 2024-01-15T11:33:46.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f4761f2a640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f475c0cddb0 con 0x7f475c0ce5c0 2024-01-15T11:33:46.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f4761f2a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475c0b4100 con 0x7f475c06a5b0 2024-01-15T11:33:46.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475b7fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f475c15d8b0 0x7f475c0b4be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:57918/0 (socket says 172.21.15.27:57918) 2024-01-15T11:33:46.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475b7fe640 1 -- 172.21.15.27:0/3025595480 learned_addr learned my addr 172.21.15.27:0/3025595480 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:46.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475affd640 1 --2- 172.21.15.27:0/3025595480 >> v2:172.21.15.93:3300/0 conn(0x7f475c0ce5c0 0x7f475c0cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:46.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475bfff640 1 --2- 172.21.15.27:0/3025595480 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f475c06a5b0 0x7f475c06aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:46.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475a7fc640 1 -- 172.21.15.27:0/3025595480 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3580029009 0 0) 0x7f475c0b0a70 con 0x7f475c15d8b0 2024-01-15T11:33:46.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475a7fc640 1 -- 172.21.15.27:0/3025595480 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4744003530 con 0x7f475c15d8b0 2024-01-15T11:33:46.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475a7fc640 1 -- 172.21.15.27:0/3025595480 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4157803269 0 0) 0x7f4744003530 con 0x7f475c15d8b0 2024-01-15T11:33:46.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475a7fc640 1 -- 172.21.15.27:0/3025595480 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f475c06a5b0 msgr2=0x7f475c06aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:46.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475a7fc640 1 --2- 172.21.15.27:0/3025595480 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f475c06a5b0 0x7f475c06aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475a7fc640 1 -- 172.21.15.27:0/3025595480 >> v2:172.21.15.93:3300/0 conn(0x7f475c0ce5c0 msgr2=0x7f475c0cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:46.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475a7fc640 1 --2- 172.21.15.27:0/3025595480 >> v2:172.21.15.93:3300/0 conn(0x7f475c0ce5c0 0x7f475c0cea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475a7fc640 1 -- 172.21.15.27:0/3025595480 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475c0b43e0 con 0x7f475c15d8b0 2024-01-15T11:33:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475a7fc640 1 -- 172.21.15.27:0/3025595480 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1394381265 0 0) 0x7f474c001680 con 0x7f475c15d8b0 2024-01-15T11:33:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475a7fc640 1 -- 172.21.15.27:0/3025595480 >> v1:172.21.15.27:6789/0 conn(0x7f475c15d8b0 legacy=0x7f475c0b4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475a7fc640 1 --2- 172.21.15.27:0/3025595480 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4744003980 0x7f4744003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475a7fc640 1 --2- 172.21.15.27:0/3025595480 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f475c06a5b0 0x7f47440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475a7fc640 1 --2- 172.21.15.27:0/3025595480 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4744004d10 0x7f4744005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475a7fc640 1 -- 172.21.15.27:0/3025595480 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c0cddb0 con 0x7f4744003980 2024-01-15T11:33:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475a7fc640 1 -- 172.21.15.27:0/3025595480 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c0b4100 con 0x7f4744004d10 2024-01-15T11:33:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475a7fc640 1 -- 172.21.15.27:0/3025595480 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474400b990 con 0x7f475c06a5b0 2024-01-15T11:33:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475b7fe640 1 --2- 172.21.15.27:0/3025595480 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4744003980 0x7f4744003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475affd640 1 --2- 172.21.15.27:0/3025595480 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f475c06a5b0 0x7f47440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475bfff640 1 --2- 172.21.15.27:0/3025595480 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4744004d10 0x7f4744005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475b7fe640 1 -- 172.21.15.27:0/3025595480 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f475c06a5b0 msgr2=0x7f47440047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475b7fe640 1 --2- 172.21.15.27:0/3025595480 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f475c06a5b0 0x7f47440047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475b7fe640 1 -- 172.21.15.27:0/3025595480 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4744004d10 msgr2=0x7f4744005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475b7fe640 1 --2- 172.21.15.27:0/3025595480 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4744004d10 0x7f4744005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.615+0000 7f475b7fe640 1 -- 172.21.15.27:0/3025595480 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4744003530 con 0x7f4744003980 2024-01-15T11:33:46.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.619+0000 7f475b7fe640 1 --2- 172.21.15.27:0/3025595480 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4744003980 0x7f4744003da0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f474c00c240 tx=0x7f474c01f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdbbbc8e69c43c80 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:46.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.619+0000 7f475a7fc640 1 -- 172.21.15.27:0/3025595480 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c005ae0 con 0x7f4744003980 2024-01-15T11:33:46.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.619+0000 7f475a7fc640 1 -- 172.21.15.27:0/3025595480 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c0ab070 con 0x7f4744003980 2024-01-15T11:33:46.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.619+0000 7f475a7fc640 1 -- 172.21.15.27:0/3025595480 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c005ea0 con 0x7f4744003980 2024-01-15T11:33:46.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.619+0000 7f4761f2a640 1 -- 172.21.15.27:0/3025595480 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4744003980 msgr2=0x7f4744003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:46.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.619+0000 7f4761f2a640 1 --2- 172.21.15.27:0/3025595480 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4744003980 0x7f4744003da0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f474c00c240 tx=0x7f474c01f3d0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.619+0000 7f475bfff640 1 -- 172.21.15.27:0/3025595480 reap_dead start 2024-01-15T11:33:46.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.619+0000 7f4761f2a640 1 -- 172.21.15.27:0/3025595480 shutdown_connections 2024-01-15T11:33:46.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.619+0000 7f4761f2a640 1 -- 172.21.15.27:0/3025595480 >> 172.21.15.27:0/3025595480 conn(0x7f475c0b5570 msgr2=0x7f475c0b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:46.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.619+0000 7f4761f2a640 1 -- 172.21.15.27:0/3025595480 shutdown_connections 2024-01-15T11:33:46.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.619+0000 7f4761f2a640 1 -- 172.21.15.27:0/3025595480 wait complete. 2024-01-15T11:33:46.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.623+0000 7f4761f2a640 1 Processor -- start 2024-01-15T11:33:46.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.623+0000 7f4761f2a640 1 -- start start 2024-01-15T11:33:46.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.623+0000 7f4761f2a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4744003980 0x7f475c1606c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:46.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.623+0000 7f4761f2a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f475c15dc90 0x7f475c1f61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:46.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.623+0000 7f4761f2a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f475c1f6710 0x7f475c1f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:46.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.623+0000 7f4761f2a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c15efd0 con 0x7f4744003980 2024-01-15T11:33:46.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.623+0000 7f4761f2a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c15e110 con 0x7f475c15dc90 2024-01-15T11:33:46.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.623+0000 7f4761f2a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475c15e3c0 con 0x7f475c1f6710 2024-01-15T11:33:46.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.623+0000 7f475b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4744003980 0x7f475c1606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:46.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.623+0000 7f475b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4744003980 0x7f475c1606c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58542/0 (socket says 172.21.15.27:58542) 2024-01-15T11:33:46.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.623+0000 7f475b7fe640 1 -- 172.21.15.27:0/494823716 learned_addr learned my addr 172.21.15.27:0/494823716 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:46.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.623+0000 7f475affd640 1 --2- 172.21.15.27:0/494823716 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f475c15dc90 0x7f475c1f61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:46.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.623+0000 7f475bfff640 1 --2- 172.21.15.27:0/494823716 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f475c1f6710 0x7f475c1f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:46.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.623+0000 7f475b7fe640 1 -- 172.21.15.27:0/494823716 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f475c1f6710 msgr2=0x7f475c1f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:46.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.623+0000 7f475b7fe640 1 --2- 172.21.15.27:0/494823716 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f475c1f6710 0x7f475c1f6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.623+0000 7f475b7fe640 1 -- 172.21.15.27:0/494823716 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f475c15dc90 msgr2=0x7f475c1f61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:46.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.623+0000 7f475b7fe640 1 --2- 172.21.15.27:0/494823716 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f475c15dc90 0x7f475c1f61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.623+0000 7f475b7fe640 1 -- 172.21.15.27:0/494823716 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475c15e6a0 con 0x7f4744003980 2024-01-15T11:33:46.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.623+0000 7f475bfff640 1 --2- 172.21.15.27:0/494823716 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f475c1f6710 0x7f475c1f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:46.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.623+0000 7f475b7fe640 1 --2- 172.21.15.27:0/494823716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4744003980 0x7f475c1606c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f474c01f200 tx=0x7f4744005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:46.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.623+0000 7f4743fff640 1 -- 172.21.15.27:0/494823716 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c0b7070 con 0x7f4744003980 2024-01-15T11:33:46.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.623+0000 7f4743fff640 1 -- 172.21.15.27:0/494823716 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c0047f0 con 0x7f4744003980 2024-01-15T11:33:46.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.623+0000 7f4743fff640 1 -- 172.21.15.27:0/494823716 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c004b60 con 0x7f4744003980 2024-01-15T11:33:46.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.623+0000 7f4761f2a640 1 -- 172.21.15.27:0/494823716 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475c15e980 con 0x7f4744003980 2024-01-15T11:33:46.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.627+0000 7f4761f2a640 1 -- 172.21.15.27:0/494823716 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f475c15f460 con 0x7f4744003980 2024-01-15T11:33:46.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.627+0000 7f4761f2a640 1 -- 172.21.15.27:0/494823716 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f475c15f680 con 0x7f4744003980 2024-01-15T11:33:46.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.627+0000 7f4743fff640 1 -- 172.21.15.27:0/494823716 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f474c0ad020 con 0x7f4744003980 2024-01-15T11:33:46.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.627+0000 7f4743fff640 1 --2- 172.21.15.27:0/494823716 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f47480668f0 0x7f4748068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:46.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.627+0000 7f4743fff640 1 -- 172.21.15.27:0/494823716 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f474c120bb0 con 0x7f4744003980 2024-01-15T11:33:46.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.627+0000 7f475affd640 1 --2- 172.21.15.27:0/494823716 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f47480668f0 0x7f4748068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:46.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.631+0000 7f475affd640 1 --2- 172.21.15.27:0/494823716 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f47480668f0 0x7f4748068db0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f475c066990 tx=0x7f4750009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:46.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.631+0000 7f4743fff640 1 -- 172.21.15.27:0/494823716 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f474c0f1870 con 0x7f4744003980 2024-01-15T11:33:46.795 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.791+0000 7f4761f2a640 1 -- 172.21.15.27:0/494823716 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f475c04e850 con 0x7f4744003980 2024-01-15T11:33:46.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.795+0000 7f4743fff640 1 -- 172.21.15.27:0/494823716 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16425 (secure 0 0 0) 0x7f474c0f1400 con 0x7f4744003980 2024-01-15T11:33:46.797 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:46.797 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:33:21.682894+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T11:33:18.397200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T11:33:19.061383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:33:46.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.795+0000 7f4761f2a640 1 -- 172.21.15.27:0/494823716 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f47480668f0 msgr2=0x7f4748068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:46.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.795+0000 7f4761f2a640 1 --2- 172.21.15.27:0/494823716 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f47480668f0 0x7f4748068db0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f475c066990 tx=0x7f4750009190 comp rx=0 tx=0).stop 2024-01-15T11:33:46.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.795+0000 7f4761f2a640 1 -- 172.21.15.27:0/494823716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4744003980 msgr2=0x7f475c1606c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:46.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.795+0000 7f4761f2a640 1 --2- 172.21.15.27:0/494823716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4744003980 0x7f475c1606c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f474c01f200 tx=0x7f4744005800 comp rx=0 tx=0).stop 2024-01-15T11:33:46.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.795+0000 7f4761f2a640 1 -- 172.21.15.27:0/494823716 shutdown_connections 2024-01-15T11:33:46.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.795+0000 7f4761f2a640 1 --2- 172.21.15.27:0/494823716 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f475c1f6710 0x7f475c1f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.795+0000 7f4761f2a640 1 --2- 172.21.15.27:0/494823716 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f47480668f0 0x7f4748068db0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.795+0000 7f4761f2a640 1 --2- 172.21.15.27:0/494823716 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f475c15dc90 0x7f475c1f61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.795+0000 7f4761f2a640 1 --2- 172.21.15.27:0/494823716 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4744003980 0x7f475c1606c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.795+0000 7f4761f2a640 1 -- 172.21.15.27:0/494823716 >> 172.21.15.27:0/494823716 conn(0x7f475c0b5570 msgr2=0x7f475c15ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:46.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.795+0000 7f4761f2a640 1 -- 172.21.15.27:0/494823716 shutdown_connections 2024-01-15T11:33:46.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.795+0000 7f4761f2a640 1 -- 172.21.15.27:0/494823716 wait complete. 2024-01-15T11:33:46.818 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T11:33:08.134662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-15T11:33:18.397200+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-15T11:33:19.061383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T11:33:46.818 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T11:33:46.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.963+0000 7f8394079640 1 Processor -- start 2024-01-15T11:33:46.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.963+0000 7f8394079640 1 -- start start 2024-01-15T11:33:46.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.963+0000 7f8394079640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f838c0cb9b0 0x7f838c06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:46.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.963+0000 7f8394079640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f838c0cbd90 0x7f838c15f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:46.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.963+0000 7f8394079640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f838c0ce5d0 0x7f838c15bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:46.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.963+0000 7f8394079640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f838c15bba0 con 0x7f838c0cbd90 2024-01-15T11:33:46.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.963+0000 7f8394079640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f838c0cdd50 con 0x7f838c0cb9b0 2024-01-15T11:33:46.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.963+0000 7f8394079640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838c159630 con 0x7f838c0ce5d0 2024-01-15T11:33:46.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.963+0000 7f8391614640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f838c0cbd90 0x7f838c15f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:46.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.963+0000 7f8391614640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f838c0cbd90 0x7f838c15f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58558/0 (socket says 172.21.15.27:58558) 2024-01-15T11:33:46.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.963+0000 7f8391614640 1 -- 172.21.15.27:0/4112552502 learned_addr learned my addr 172.21.15.27:0/4112552502 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:46.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.963+0000 7f8391614640 1 -- 172.21.15.27:0/4112552502 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f838c0ce5d0 msgr2=0x7f838c15bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:46.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.963+0000 7f8391614640 1 --2- 172.21.15.27:0/4112552502 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f838c0ce5d0 0x7f838c15bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.963+0000 7f8391614640 1 -- 172.21.15.27:0/4112552502 >> v2:172.21.15.93:3300/0 conn(0x7f838c0cb9b0 msgr2=0x7f838c06e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:46.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.963+0000 7f8391614640 1 --2- 172.21.15.27:0/4112552502 >> v2:172.21.15.93:3300/0 conn(0x7f838c0cb9b0 0x7f838c06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.963+0000 7f8391614640 1 -- 172.21.15.27:0/4112552502 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838c15f6d0 con 0x7f838c0cbd90 2024-01-15T11:33:46.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.967+0000 7f8391614640 1 --2- 172.21.15.27:0/4112552502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f838c0cbd90 0x7f838c15f190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f838c06c360 tx=0x7f837c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516a0f184e6340b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:46.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.967+0000 7f8390e13640 1 -- 172.21.15.27:0/4112552502 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c0ab670 con 0x7f838c0cbd90 2024-01-15T11:33:46.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.967+0000 7f8390e13640 1 -- 172.21.15.27:0/4112552502 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c0ab7d0 con 0x7f838c0cbd90 2024-01-15T11:33:46.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.967+0000 7f8390e13640 1 -- 172.21.15.27:0/4112552502 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c0abb60 con 0x7f838c0cbd90 2024-01-15T11:33:46.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.967+0000 7f8394079640 1 -- 172.21.15.27:0/4112552502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f838c0cbd90 msgr2=0x7f838c15f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:46.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.967+0000 7f8394079640 1 --2- 172.21.15.27:0/4112552502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f838c0cbd90 0x7f838c15f190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f838c06c360 tx=0x7f837c01c4d0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.967+0000 7f8394079640 1 -- 172.21.15.27:0/4112552502 shutdown_connections 2024-01-15T11:33:46.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.967+0000 7f8394079640 1 --2- 172.21.15.27:0/4112552502 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f838c0ce5d0 0x7f838c15bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.967+0000 7f8394079640 1 --2- 172.21.15.27:0/4112552502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f838c0cbd90 0x7f838c15f190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.967+0000 7f8394079640 1 --2- 172.21.15.27:0/4112552502 >> v2:172.21.15.93:3300/0 conn(0x7f838c0cb9b0 0x7f838c06e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.967+0000 7f8394079640 1 -- 172.21.15.27:0/4112552502 >> 172.21.15.27:0/4112552502 conn(0x7f838c0b0cb0 msgr2=0x7f838c0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:46.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.967+0000 7f8394079640 1 -- 172.21.15.27:0/4112552502 shutdown_connections 2024-01-15T11:33:46.971 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.967+0000 7f8394079640 1 -- 172.21.15.27:0/4112552502 wait complete. 2024-01-15T11:33:46.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f8394079640 1 Processor -- start 2024-01-15T11:33:46.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f8394079640 1 -- start start 2024-01-15T11:33:46.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f8394079640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f838c0cb9b0 0x7f838c14d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:46.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f8394079640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f838c0cbd90 0x7f838c0ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:46.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f8394079640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f838c0ce5d0 0x7f838c165960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:46.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f8394079640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838c14db80 con 0x7f838c0cbd90 2024-01-15T11:33:46.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f8394079640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838c0b2ac0 con 0x7f838c0cb9b0 2024-01-15T11:33:46.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f8394079640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838c0b2d10 con 0x7f838c0ce5d0 2024-01-15T11:33:46.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f8391614640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f838c0cbd90 0x7f838c0ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:46.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f8391614640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f838c0cbd90 0x7f838c0ae9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58574/0 (socket says 172.21.15.27:58574) 2024-01-15T11:33:46.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f8391614640 1 -- 172.21.15.27:0/2781589926 learned_addr learned my addr 172.21.15.27:0/2781589926 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:46.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f8392616640 1 --2- 172.21.15.27:0/2781589926 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f838c0ce5d0 0x7f838c165960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:46.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f8391e15640 1 --2- 172.21.15.27:0/2781589926 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f838c0cb9b0 0x7f838c14d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:46.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f8391614640 1 -- 172.21.15.27:0/2781589926 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f838c0ce5d0 msgr2=0x7f838c165960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:46.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f8391614640 1 --2- 172.21.15.27:0/2781589926 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f838c0ce5d0 0x7f838c165960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f8391614640 1 -- 172.21.15.27:0/2781589926 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f838c0cb9b0 msgr2=0x7f838c14d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:46.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f8391614640 1 --2- 172.21.15.27:0/2781589926 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f838c0cb9b0 0x7f838c14d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:46.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f8391614640 1 -- 172.21.15.27:0/2781589926 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c0094d0 con 0x7f838c0cbd90 2024-01-15T11:33:46.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f8392616640 1 --2- 172.21.15.27:0/2781589926 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f838c0ce5d0 0x7f838c165960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:33:46.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f8391e15640 1 --2- 172.21.15.27:0/2781589926 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f838c0cb9b0 0x7f838c14d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:33:46.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f8391614640 1 --2- 172.21.15.27:0/2781589926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f838c0cbd90 0x7f838c0ae9d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f837c01ab80 tx=0x7f837c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:46.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f83827fc640 1 -- 172.21.15.27:0/2781589926 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c0b48c0 con 0x7f838c0cbd90 2024-01-15T11:33:46.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f83827fc640 1 -- 172.21.15.27:0/2781589926 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c0b4a20 con 0x7f838c0cbd90 2024-01-15T11:33:46.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f8394079640 1 -- 172.21.15.27:0/2781589926 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f838c0b2ff0 con 0x7f838c0cbd90 2024-01-15T11:33:46.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f83827fc640 1 -- 172.21.15.27:0/2781589926 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c0b4db0 con 0x7f838c0cbd90 2024-01-15T11:33:46.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f8394079640 1 -- 172.21.15.27:0/2781589926 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f838c0b35b0 con 0x7f838c0cbd90 2024-01-15T11:33:46.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.971+0000 7f8394079640 1 -- 172.21.15.27:0/2781589926 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f838c0671f0 con 0x7f838c0cbd90 2024-01-15T11:33:46.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.975+0000 7f83827fc640 1 -- 172.21.15.27:0/2781589926 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f837c0b3380 con 0x7f838c0cbd90 2024-01-15T11:33:46.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.975+0000 7f83827fc640 1 --2- 172.21.15.27:0/2781589926 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f83700668f0 0x7f8370068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:46.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.975+0000 7f83827fc640 1 -- 172.21.15.27:0/2781589926 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f837c11e940 con 0x7f838c0cbd90 2024-01-15T11:33:46.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.975+0000 7f8391e15640 1 --2- 172.21.15.27:0/2781589926 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f83700668f0 0x7f8370068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:46.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.975+0000 7f8391e15640 1 --2- 172.21.15.27:0/2781589926 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f83700668f0 0x7f8370068db0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f838800a870 tx=0x7f8388008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:46.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:46.979+0000 7f83827fc640 1 -- 172.21.15.27:0/2781589926 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f837c0ebcc0 con 0x7f838c0cbd90 2024-01-15T11:33:47.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.139+0000 7f8394079640 1 -- 172.21.15.27:0/2781589926 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f838c06b460 con 0x7f838c0cbd90 2024-01-15T11:33:47.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.139+0000 7f83827fc640 1 -- 172.21.15.27:0/2781589926 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f837c0c40a0 con 0x7f838c0cbd90 2024-01-15T11:33:47.142 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-15T11:33:47.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.139+0000 7f8394079640 1 -- 172.21.15.27:0/2781589926 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f83700668f0 msgr2=0x7f8370068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:47.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.139+0000 7f8394079640 1 --2- 172.21.15.27:0/2781589926 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f83700668f0 0x7f8370068db0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f838800a870 tx=0x7f8388008040 comp rx=0 tx=0).stop 2024-01-15T11:33:47.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.139+0000 7f8394079640 1 -- 172.21.15.27:0/2781589926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f838c0cbd90 msgr2=0x7f838c0ae9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:47.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.139+0000 7f8394079640 1 --2- 172.21.15.27:0/2781589926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f838c0cbd90 0x7f838c0ae9d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f837c01ab80 tx=0x7f837c01ad10 comp rx=0 tx=0).stop 2024-01-15T11:33:47.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.139+0000 7f8394079640 1 -- 172.21.15.27:0/2781589926 shutdown_connections 2024-01-15T11:33:47.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.139+0000 7f8394079640 1 --2- 172.21.15.27:0/2781589926 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f838c0ce5d0 0x7f838c165960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:47.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.139+0000 7f8394079640 1 --2- 172.21.15.27:0/2781589926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f838c0cbd90 0x7f838c0ae9d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:47.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.139+0000 7f8394079640 1 --2- 172.21.15.27:0/2781589926 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f83700668f0 0x7f8370068db0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:47.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.139+0000 7f8394079640 1 --2- 172.21.15.27:0/2781589926 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f838c0cb9b0 0x7f838c14d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:47.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.139+0000 7f8394079640 1 -- 172.21.15.27:0/2781589926 >> 172.21.15.27:0/2781589926 conn(0x7f838c0b0cb0 msgr2=0x7f838c158460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:47.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.139+0000 7f8394079640 1 -- 172.21.15.27:0/2781589926 shutdown_connections 2024-01-15T11:33:47.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.139+0000 7f8394079640 1 -- 172.21.15.27:0/2781589926 wait complete. 2024-01-15T11:33:47.163 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-15T11:33:47.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.307+0000 7f847579d640 1 Processor -- start 2024-01-15T11:33:47.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.307+0000 7f847579d640 1 -- start start 2024-01-15T11:33:47.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.307+0000 7f847579d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f84700d1f20 0x7f84701614b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:47.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.307+0000 7f847579d640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8470161010 0x7f84701619f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:47.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.307+0000 7f847579d640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84700cfc90 con 0x7f8470160c30 2024-01-15T11:33:47.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.307+0000 7f847579d640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84700d0530 con 0x7f84700d1f20 2024-01-15T11:33:47.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.307+0000 7f847579d640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847006cc30 con 0x7f8470161010 2024-01-15T11:33:47.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.307+0000 7f846effd640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f8470160c30 0x7f84700d1810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:57924/0 (socket says 172.21.15.27:57924) 2024-01-15T11:33:47.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.307+0000 7f846effd640 1 -- 172.21.15.27:0/1936997529 learned_addr learned my addr 172.21.15.27:0/1936997529 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:47.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.307+0000 7f846f7fe640 1 --2- 172.21.15.27:0/1936997529 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8470161010 0x7f84701619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:47.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.307+0000 7f8467fff640 1 --2- 172.21.15.27:0/1936997529 >> v2:172.21.15.93:3300/0 conn(0x7f84700d1f20 0x7f84701614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:47.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.307+0000 7f846e7fc640 1 -- 172.21.15.27:0/1936997529 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757008122 0 0) 0x7f84700cfc90 con 0x7f8470160c30 2024-01-15T11:33:47.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.307+0000 7f846e7fc640 1 -- 172.21.15.27:0/1936997529 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f845c003530 con 0x7f8470160c30 2024-01-15T11:33:47.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.307+0000 7f846f7fe640 1 -- 172.21.15.27:0/1936997529 >> v2:172.21.15.93:3300/0 conn(0x7f84700d1f20 msgr2=0x7f84701614b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:47.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.307+0000 7f846f7fe640 1 --2- 172.21.15.27:0/1936997529 >> v2:172.21.15.93:3300/0 conn(0x7f84700d1f20 0x7f84701614b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:47.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.307+0000 7f846f7fe640 1 -- 172.21.15.27:0/1936997529 >> v1:172.21.15.27:6789/0 conn(0x7f8470160c30 legacy=0x7f84700d1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:47.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.307+0000 7f846f7fe640 1 -- 172.21.15.27:0/1936997529 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84700cfee0 con 0x7f8470161010 2024-01-15T11:33:47.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.307+0000 7f8467fff640 1 --2- 172.21.15.27:0/1936997529 >> v2:172.21.15.93:3300/0 conn(0x7f84700d1f20 0x7f84701614b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:47.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.311+0000 7f846f7fe640 1 --2- 172.21.15.27:0/1936997529 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8470161010 0x7f84701619f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8468009d90 tx=0x7f846801c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=441729c80914b841 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:47.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.311+0000 7f846e7fc640 1 -- 172.21.15.27:0/1936997529 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84680a5970 con 0x7f8470161010 2024-01-15T11:33:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.311+0000 7f846e7fc640 1 -- 172.21.15.27:0/1936997529 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84680a5ad0 con 0x7f8470161010 2024-01-15T11:33:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.311+0000 7f846e7fc640 1 -- 172.21.15.27:0/1936997529 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84680a5e60 con 0x7f8470161010 2024-01-15T11:33:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.311+0000 7f847579d640 1 -- 172.21.15.27:0/1936997529 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8470161010 msgr2=0x7f84701619f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.311+0000 7f847579d640 1 --2- 172.21.15.27:0/1936997529 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8470161010 0x7f84701619f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8468009d90 tx=0x7f846801c890 comp rx=0 tx=0).stop 2024-01-15T11:33:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.311+0000 7f847579d640 1 -- 172.21.15.27:0/1936997529 shutdown_connections 2024-01-15T11:33:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.311+0000 7f847579d640 1 --2- 172.21.15.27:0/1936997529 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8470161010 0x7f84701619f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.311+0000 7f847579d640 1 --2- 172.21.15.27:0/1936997529 >> v2:172.21.15.93:3300/0 conn(0x7f84700d1f20 0x7f84701614b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.311+0000 7f847579d640 1 -- 172.21.15.27:0/1936997529 >> 172.21.15.27:0/1936997529 conn(0x7f847008afc0 msgr2=0x7f84700d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.311+0000 7f847579d640 1 -- 172.21.15.27:0/1936997529 shutdown_connections 2024-01-15T11:33:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.311+0000 7f847579d640 1 -- 172.21.15.27:0/1936997529 wait complete. 2024-01-15T11:33:47.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f847579d640 1 Processor -- start 2024-01-15T11:33:47.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f847579d640 1 -- start start 2024-01-15T11:33:47.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f847579d640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f84700d1f20 0x7f8470158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:47.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f847579d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8470160c30 0x7f8470158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:47.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f847579d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8470161010 0x7f84700ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:47.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f847579d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847015f380 con 0x7f8470160c30 2024-01-15T11:33:47.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f847579d640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84700cb0e0 con 0x7f8470161010 2024-01-15T11:33:47.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f847579d640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84700cb3c0 con 0x7f84700d1f20 2024-01-15T11:33:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f8467fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8470160c30 0x7f8470158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f8467fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8470160c30 0x7f8470158760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58584/0 (socket says 172.21.15.27:58584) 2024-01-15T11:33:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f8467fff640 1 -- 172.21.15.27:0/982251045 learned_addr learned my addr 172.21.15.27:0/982251045 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f846effd640 1 --2- 172.21.15.27:0/982251045 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f84700d1f20 0x7f8470158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f846f7fe640 1 --2- 172.21.15.27:0/982251045 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8470161010 0x7f84700ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f8467fff640 1 -- 172.21.15.27:0/982251045 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f84700d1f20 msgr2=0x7f8470158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f8467fff640 1 --2- 172.21.15.27:0/982251045 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f84700d1f20 0x7f8470158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f8467fff640 1 -- 172.21.15.27:0/982251045 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8470161010 msgr2=0x7f84700ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f8467fff640 1 --2- 172.21.15.27:0/982251045 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8470161010 0x7f84700ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f8467fff640 1 -- 172.21.15.27:0/982251045 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8458009420 con 0x7f8470160c30 2024-01-15T11:33:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f846effd640 1 --2- 172.21.15.27:0/982251045 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f84700d1f20 0x7f8470158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f8467fff640 1 --2- 172.21.15.27:0/982251045 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8470160c30 0x7f8470158760 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f845800ebe0 tx=0x7f845800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f84677fe640 1 -- 172.21.15.27:0/982251045 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845800eee0 con 0x7f8470160c30 2024-01-15T11:33:47.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f84677fe640 1 -- 172.21.15.27:0/982251045 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845800cc30 con 0x7f8470160c30 2024-01-15T11:33:47.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f847579d640 1 -- 172.21.15.27:0/982251045 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8468009a70 con 0x7f8470160c30 2024-01-15T11:33:47.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f84677fe640 1 -- 172.21.15.27:0/982251045 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8458013470 con 0x7f8470160c30 2024-01-15T11:33:47.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f847579d640 1 -- 172.21.15.27:0/982251045 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84700cb980 con 0x7f8470160c30 2024-01-15T11:33:47.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.315+0000 7f847579d640 1 -- 172.21.15.27:0/982251045 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f847004e850 con 0x7f8470160c30 2024-01-15T11:33:47.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.319+0000 7f84677fe640 1 -- 172.21.15.27:0/982251045 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f84580135d0 con 0x7f8470160c30 2024-01-15T11:33:47.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.319+0000 7f84677fe640 1 --2- 172.21.15.27:0/982251045 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f84500668f0 0x7f8450068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:47.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.319+0000 7f84677fe640 1 -- 172.21.15.27:0/982251045 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8458084780 con 0x7f8470160c30 2024-01-15T11:33:47.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.319+0000 7f846effd640 1 --2- 172.21.15.27:0/982251045 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f84500668f0 0x7f8450068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:47.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.319+0000 7f846effd640 1 --2- 172.21.15.27:0/982251045 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f84500668f0 0x7f8450068db0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f84600011f0 tx=0x7f8460009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:47.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.323+0000 7f84677fe640 1 -- 172.21.15.27:0/982251045 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f84580519d0 con 0x7f8470160c30 2024-01-15T11:33:47.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.479+0000 7f847579d640 1 -- 172.21.15.27:0/982251045 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f84700d2df0 con 0x7f8470160c30 2024-01-15T11:33:47.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.479+0000 7f84677fe640 1 -- 172.21.15.27:0/982251045 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8458054ff0 con 0x7f8470160c30 2024-01-15T11:33:47.482 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-01-15T11:33:47.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.479+0000 7f847579d640 1 -- 172.21.15.27:0/982251045 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f84500668f0 msgr2=0x7f8450068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:47.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.479+0000 7f847579d640 1 --2- 172.21.15.27:0/982251045 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f84500668f0 0x7f8450068db0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f84600011f0 tx=0x7f8460009040 comp rx=0 tx=0).stop 2024-01-15T11:33:47.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.479+0000 7f847579d640 1 -- 172.21.15.27:0/982251045 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8470160c30 msgr2=0x7f8470158760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:47.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.479+0000 7f847579d640 1 --2- 172.21.15.27:0/982251045 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8470160c30 0x7f8470158760 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f845800ebe0 tx=0x7f845800c520 comp rx=0 tx=0).stop 2024-01-15T11:33:47.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.479+0000 7f847579d640 1 -- 172.21.15.27:0/982251045 shutdown_connections 2024-01-15T11:33:47.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.479+0000 7f847579d640 1 --2- 172.21.15.27:0/982251045 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f84500668f0 0x7f8450068db0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:47.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.479+0000 7f847579d640 1 --2- 172.21.15.27:0/982251045 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8470161010 0x7f84700ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:47.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.479+0000 7f847579d640 1 --2- 172.21.15.27:0/982251045 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8470160c30 0x7f8470158760 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:47.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.479+0000 7f847579d640 1 --2- 172.21.15.27:0/982251045 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f84700d1f20 0x7f8470158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:47.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.479+0000 7f847579d640 1 -- 172.21.15.27:0/982251045 >> 172.21.15.27:0/982251045 conn(0x7f847008afc0 msgr2=0x7f84700b3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:47.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.479+0000 7f847579d640 1 -- 172.21.15.27:0/982251045 shutdown_connections 2024-01-15T11:33:47.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.479+0000 7f847579d640 1 -- 172.21.15.27:0/982251045 wait complete. 2024-01-15T11:33:47.503 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-15T11:33:47.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.647+0000 7fc443e5a640 1 Processor -- start 2024-01-15T11:33:47.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.647+0000 7fc443e5a640 1 -- start start 2024-01-15T11:33:47.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.647+0000 7fc443e5a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc43c0b3c60 0x7fc43c0b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:47.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.647+0000 7fc443e5a640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43c0b2590 con 0x7fc43c162190 2024-01-15T11:33:47.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.647+0000 7fc443e5a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43c0b2870 con 0x7fc43c0b4040 2024-01-15T11:33:47.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.647+0000 7fc443e5a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc43c0b2b50 con 0x7fc43c0b3c60 2024-01-15T11:33:47.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.647+0000 7fc441bf6640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc43c0b3c60 0x7fc43c0b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:47.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.647+0000 7fc4423f7640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc43c162190 0x7fc43c165d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:57928/0 (socket says 172.21.15.27:57928) 2024-01-15T11:33:47.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.647+0000 7fc4423f7640 1 -- 172.21.15.27:0/3042822209 learned_addr learned my addr 172.21.15.27:0/3042822209 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:47.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.647+0000 7fc441bf6640 1 -- 172.21.15.27:0/3042822209 >> v1:172.21.15.93:6789/0 conn(0x7fc43c0b4040 legacy=0x7fc43c0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:47.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.647+0000 7fc441bf6640 1 -- 172.21.15.27:0/3042822209 >> v1:172.21.15.27:6789/0 conn(0x7fc43c162190 legacy=0x7fc43c165d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:47.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.647+0000 7fc441bf6640 1 -- 172.21.15.27:0/3042822209 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c0b2e30 con 0x7fc43c0b3c60 2024-01-15T11:33:47.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.651+0000 7fc441bf6640 1 --2- 172.21.15.27:0/3042822209 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc43c0b3c60 0x7fc43c0b1fb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc4380097c0 tx=0x7fc43801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea79903e7bf77037 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:47.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.651+0000 7fc440bf4640 1 -- 172.21.15.27:0/3042822209 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4380ab670 con 0x7fc43c0b3c60 2024-01-15T11:33:47.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.651+0000 7fc440bf4640 1 -- 172.21.15.27:0/3042822209 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4380ab7d0 con 0x7fc43c0b3c60 2024-01-15T11:33:47.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.651+0000 7fc440bf4640 1 -- 172.21.15.27:0/3042822209 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4380abb60 con 0x7fc43c0b3c60 2024-01-15T11:33:47.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.651+0000 7fc443e5a640 1 -- 172.21.15.27:0/3042822209 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc43c0b3c60 msgr2=0x7fc43c0b1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:47.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.651+0000 7fc443e5a640 1 --2- 172.21.15.27:0/3042822209 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc43c0b3c60 0x7fc43c0b1fb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc4380097c0 tx=0x7fc43801c450 comp rx=0 tx=0).stop 2024-01-15T11:33:47.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.651+0000 7fc443e5a640 1 -- 172.21.15.27:0/3042822209 shutdown_connections 2024-01-15T11:33:47.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.651+0000 7fc443e5a640 1 --2- 172.21.15.27:0/3042822209 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc43c0b3c60 0x7fc43c0b1fb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:47.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.651+0000 7fc443e5a640 1 -- 172.21.15.27:0/3042822209 >> 172.21.15.27:0/3042822209 conn(0x7fc43c0b0cb0 msgr2=0x7fc43c0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:47.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.651+0000 7fc443e5a640 1 -- 172.21.15.27:0/3042822209 shutdown_connections 2024-01-15T11:33:47.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.651+0000 7fc443e5a640 1 -- 172.21.15.27:0/3042822209 wait complete. 2024-01-15T11:33:47.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.655+0000 7fc443e5a640 1 Processor -- start 2024-01-15T11:33:47.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.655+0000 7fc443e5a640 1 -- start start 2024-01-15T11:33:47.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.655+0000 7fc443e5a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc43c0b3c60 0x7fc43c09bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:47.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.655+0000 7fc443e5a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc43c162190 0x7fc43c15b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:47.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.655+0000 7fc443e5a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc43c143170 0x7fc43c06da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:47.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.655+0000 7fc443e5a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c15b8b0 con 0x7fc43c162190 2024-01-15T11:33:47.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.655+0000 7fc443e5a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c158d10 con 0x7fc43c143170 2024-01-15T11:33:47.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.655+0000 7fc443e5a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c1592d0 con 0x7fc43c0b3c60 2024-01-15T11:33:47.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.655+0000 7fc4413f5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc43c162190 0x7fc43c15b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:47.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.655+0000 7fc4413f5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc43c162190 0x7fc43c15b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58600/0 (socket says 172.21.15.27:58600) 2024-01-15T11:33:47.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.655+0000 7fc4413f5640 1 -- 172.21.15.27:0/2747851151 learned_addr learned my addr 172.21.15.27:0/2747851151 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:47.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.655+0000 7fc441bf6640 1 --2- 172.21.15.27:0/2747851151 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc43c0b3c60 0x7fc43c09bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:47.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.655+0000 7fc4423f7640 1 --2- 172.21.15.27:0/2747851151 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc43c143170 0x7fc43c06da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:47.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.655+0000 7fc4413f5640 1 -- 172.21.15.27:0/2747851151 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc43c0b3c60 msgr2=0x7fc43c09bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:47.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.655+0000 7fc4413f5640 1 --2- 172.21.15.27:0/2747851151 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc43c0b3c60 0x7fc43c09bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:47.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.655+0000 7fc4413f5640 1 -- 172.21.15.27:0/2747851151 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc43c143170 msgr2=0x7fc43c06da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:47.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.655+0000 7fc4413f5640 1 --2- 172.21.15.27:0/2747851151 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc43c143170 0x7fc43c06da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:47.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.655+0000 7fc4413f5640 1 -- 172.21.15.27:0/2747851151 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc438009420 con 0x7fc43c162190 2024-01-15T11:33:47.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.655+0000 7fc4423f7640 1 --2- 172.21.15.27:0/2747851151 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc43c143170 0x7fc43c06da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:47.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.655+0000 7fc4413f5640 1 --2- 172.21.15.27:0/2747851151 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc43c162190 0x7fc43c15b370 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc42c00c500 tx=0x7fc42c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:47.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.655+0000 7fc4327fc640 1 -- 172.21.15.27:0/2747851151 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c005220 con 0x7fc43c162190 2024-01-15T11:33:47.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.655+0000 7fc4327fc640 1 -- 172.21.15.27:0/2747851151 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42c005380 con 0x7fc43c162190 2024-01-15T11:33:47.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.655+0000 7fc4327fc640 1 -- 172.21.15.27:0/2747851151 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c007270 con 0x7fc43c162190 2024-01-15T11:33:47.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.655+0000 7fc443e5a640 1 -- 172.21.15.27:0/2747851151 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43c09c420 con 0x7fc43c162190 2024-01-15T11:33:47.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.655+0000 7fc443e5a640 1 -- 172.21.15.27:0/2747851151 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43c158f60 con 0x7fc43c162190 2024-01-15T11:33:47.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.659+0000 7fc443e5a640 1 -- 172.21.15.27:0/2747851151 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43c09c940 con 0x7fc43c162190 2024-01-15T11:33:47.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.659+0000 7fc4327fc640 1 -- 172.21.15.27:0/2747851151 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fc42c0073d0 con 0x7fc43c162190 2024-01-15T11:33:47.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.659+0000 7fc4327fc640 1 --2- 172.21.15.27:0/2747851151 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc4200668f0 0x7fc420068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:47.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.659+0000 7fc4327fc640 1 -- 172.21.15.27:0/2747851151 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc42c0839f0 con 0x7fc43c162190 2024-01-15T11:33:47.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.659+0000 7fc441bf6640 1 --2- 172.21.15.27:0/2747851151 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc4200668f0 0x7fc420068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:47.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.659+0000 7fc441bf6640 1 --2- 172.21.15.27:0/2747851151 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc4200668f0 0x7fc420068db0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc4380af000 tx=0x7fc4380a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:47.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.663+0000 7fc4327fc640 1 -- 172.21.15.27:0/2747851151 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc42c050ba0 con 0x7fc43c162190 2024-01-15T11:33:47.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.823+0000 7fc443e5a640 1 -- 172.21.15.27:0/2747851151 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc43c0671f0 con 0x7fc43c162190 2024-01-15T11:33:47.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.823+0000 7fc4327fc640 1 -- 172.21.15.27:0/2747851151 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc42c0541c0 con 0x7fc43c162190 2024-01-15T11:33:47.826 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-01-15T11:33:47.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.827+0000 7fc443e5a640 1 -- 172.21.15.27:0/2747851151 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc4200668f0 msgr2=0x7fc420068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:47.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.827+0000 7fc443e5a640 1 --2- 172.21.15.27:0/2747851151 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc4200668f0 0x7fc420068db0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc4380af000 tx=0x7fc4380a7000 comp rx=0 tx=0).stop 2024-01-15T11:33:47.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.827+0000 7fc443e5a640 1 -- 172.21.15.27:0/2747851151 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc43c162190 msgr2=0x7fc43c15b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:47.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.827+0000 7fc443e5a640 1 --2- 172.21.15.27:0/2747851151 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc43c162190 0x7fc43c15b370 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc42c00c500 tx=0x7fc42c00c9c0 comp rx=0 tx=0).stop 2024-01-15T11:33:47.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.827+0000 7fc443e5a640 1 -- 172.21.15.27:0/2747851151 shutdown_connections 2024-01-15T11:33:47.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.827+0000 7fc443e5a640 1 --2- 172.21.15.27:0/2747851151 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc4200668f0 0x7fc420068db0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:47.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.827+0000 7fc443e5a640 1 --2- 172.21.15.27:0/2747851151 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc43c143170 0x7fc43c06da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:47.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.827+0000 7fc443e5a640 1 --2- 172.21.15.27:0/2747851151 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc43c162190 0x7fc43c15b370 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:47.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.827+0000 7fc443e5a640 1 --2- 172.21.15.27:0/2747851151 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc43c0b3c60 0x7fc43c09bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:47.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.827+0000 7fc443e5a640 1 -- 172.21.15.27:0/2747851151 >> 172.21.15.27:0/2747851151 conn(0x7fc43c0b0cb0 msgr2=0x7fc43c070c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:47.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.827+0000 7fc443e5a640 1 -- 172.21.15.27:0/2747851151 shutdown_connections 2024-01-15T11:33:47.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:47.827+0000 7fc443e5a640 1 -- 172.21.15.27:0/2747851151 wait complete. 2024-01-15T11:33:47.918 INFO:tasks.cephfs_test_runner:Starting test: test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgress) Test that when one clone is in progress, one progress bar is printed 2024-01-15T11:33:47.919 INFO:tasks.cephfs_test_runner:test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgress) 2024-01-15T11:33:47.919 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:33:48.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.059+0000 7f27faf0f640 1 Processor -- start 2024-01-15T11:33:48.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.059+0000 7f27faf0f640 1 -- start start 2024-01-15T11:33:48.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.059+0000 7f27faf0f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f27f415d7b0 0x7f27f40d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:48.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.059+0000 7f27faf0f640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f40cefd0 con 0x7f27f40cead0 2024-01-15T11:33:48.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.059+0000 7f27faf0f640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f40cf2b0 con 0x7f27f40d2080 2024-01-15T11:33:48.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.059+0000 7f27faf0f640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f406b3f0 con 0x7f27f415d7b0 2024-01-15T11:33:48.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.059+0000 7f27f3fff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f27f40cead0 0x7f27f40d1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:57932/0 (socket says 172.21.15.27:57932) 2024-01-15T11:33:48.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.059+0000 7f27f3fff640 1 -- 172.21.15.27:0/867801251 learned_addr learned my addr 172.21.15.27:0/867801251 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:48.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.059+0000 7f27f8cab640 1 --2- 172.21.15.27:0/867801251 >> v2:172.21.15.93:3300/0 conn(0x7f27f415d7b0 0x7f27f40d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:48.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.059+0000 7f27f37fe640 1 -- 172.21.15.27:0/867801251 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301174068 0 0) 0x7f27f40cefd0 con 0x7f27f40cead0 2024-01-15T11:33:48.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.059+0000 7f27f37fe640 1 -- 172.21.15.27:0/867801251 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27e4003530 con 0x7f27f40cead0 2024-01-15T11:33:48.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.059+0000 7f27f37fe640 1 -- 172.21.15.27:0/867801251 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3266020063 0 0) 0x7f27e4003530 con 0x7f27f40cead0 2024-01-15T11:33:48.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.059+0000 7f27f37fe640 1 -- 172.21.15.27:0/867801251 >> v2:172.21.15.93:3300/0 conn(0x7f27f415d7b0 msgr2=0x7f27f40d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:48.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.059+0000 7f27f37fe640 1 --2- 172.21.15.27:0/867801251 >> v2:172.21.15.93:3300/0 conn(0x7f27f415d7b0 0x7f27f40d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.059+0000 7f27f37fe640 1 -- 172.21.15.27:0/867801251 >> v1:172.21.15.93:6789/0 conn(0x7f27f40d2080 legacy=0x7f27f406bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:48.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.059+0000 7f27f37fe640 1 -- 172.21.15.27:0/867801251 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f406b6d0 con 0x7f27f40cead0 2024-01-15T11:33:48.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.059+0000 7f27f37fe640 1 -- 172.21.15.27:0/867801251 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1394381265 0 0) 0x7f27e0001680 con 0x7f27f40cead0 2024-01-15T11:33:48.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.059+0000 7f27f37fe640 1 -- 172.21.15.27:0/867801251 >> v1:172.21.15.27:6789/0 conn(0x7f27f40cead0 legacy=0x7f27f40d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:48.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.059+0000 7f27f37fe640 1 --2- 172.21.15.27:0/867801251 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27e4003980 0x7f27e4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:48.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.063+0000 7f27f37fe640 1 --2- 172.21.15.27:0/867801251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27e40047d0 0x7f27e4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:48.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.063+0000 7f27f37fe640 1 --2- 172.21.15.27:0/867801251 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f27e40052b0 0x7f27e400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:48.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.063+0000 7f27f37fe640 1 -- 172.21.15.27:0/867801251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f406b3f0 con 0x7f27e40047d0 2024-01-15T11:33:48.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.063+0000 7f27f37fe640 1 -- 172.21.15.27:0/867801251 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e400c180 con 0x7f27e4003980 2024-01-15T11:33:48.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.063+0000 7f27f37fe640 1 -- 172.21.15.27:0/867801251 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e400c340 con 0x7f27e40052b0 2024-01-15T11:33:48.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.063+0000 7f27f3fff640 1 --2- 172.21.15.27:0/867801251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27e40047d0 0x7f27e4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:48.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.063+0000 7f27f8cab640 1 --2- 172.21.15.27:0/867801251 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27e4003980 0x7f27e4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:48.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.063+0000 7f27f94ac640 1 --2- 172.21.15.27:0/867801251 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f27e40052b0 0x7f27e400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:48.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.063+0000 7f27f3fff640 1 -- 172.21.15.27:0/867801251 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f27e40052b0 msgr2=0x7f27e400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:48.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.063+0000 7f27f3fff640 1 --2- 172.21.15.27:0/867801251 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f27e40052b0 0x7f27e400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.063+0000 7f27f3fff640 1 -- 172.21.15.27:0/867801251 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27e4003980 msgr2=0x7f27e4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:48.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.063+0000 7f27f3fff640 1 --2- 172.21.15.27:0/867801251 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27e4003980 0x7f27e4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.063+0000 7f27f94ac640 1 -- 172.21.15.27:0/867801251 reap_dead start 2024-01-15T11:33:48.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.063+0000 7f27f3fff640 1 -- 172.21.15.27:0/867801251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e4003530 con 0x7f27e40047d0 2024-01-15T11:33:48.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.063+0000 7f27f8cab640 1 --2- 172.21.15.27:0/867801251 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27e4003980 0x7f27e4003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:48.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.063+0000 7f27f3fff640 1 --2- 172.21.15.27:0/867801251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27e40047d0 0x7f27e4004c50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f27f40cef00 tx=0x7f27e001cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d521f402fbb17cfa server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:48.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.063+0000 7f27f37fe640 1 -- 172.21.15.27:0/867801251 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0005ae0 con 0x7f27e40047d0 2024-01-15T11:33:48.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.063+0000 7f27f37fe640 1 -- 172.21.15.27:0/867801251 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e0005c40 con 0x7f27e40047d0 2024-01-15T11:33:48.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.063+0000 7f27f37fe640 1 -- 172.21.15.27:0/867801251 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e00072b0 con 0x7f27e40047d0 2024-01-15T11:33:48.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.067+0000 7f27faf0f640 1 -- 172.21.15.27:0/867801251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27e40047d0 msgr2=0x7f27e4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:48.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.067+0000 7f27faf0f640 1 --2- 172.21.15.27:0/867801251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27e40047d0 0x7f27e4004c50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f27f40cef00 tx=0x7f27e001cb50 comp rx=0 tx=0).stop 2024-01-15T11:33:48.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.067+0000 7f27faf0f640 1 -- 172.21.15.27:0/867801251 shutdown_connections 2024-01-15T11:33:48.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.067+0000 7f27faf0f640 1 --2- 172.21.15.27:0/867801251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27e40047d0 0x7f27e4004c50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.067+0000 7f27faf0f640 1 -- 172.21.15.27:0/867801251 >> 172.21.15.27:0/867801251 conn(0x7f27f40d33b0 msgr2=0x7f27f40d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:48.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.067+0000 7f27faf0f640 1 -- 172.21.15.27:0/867801251 shutdown_connections 2024-01-15T11:33:48.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.067+0000 7f27faf0f640 1 -- 172.21.15.27:0/867801251 wait complete. 2024-01-15T11:33:48.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.067+0000 7f27faf0f640 1 Processor -- start 2024-01-15T11:33:48.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.067+0000 7f27faf0f640 1 -- start start 2024-01-15T11:33:48.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.067+0000 7f27faf0f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27e40047d0 0x7f27f4152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:48.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.067+0000 7f27faf0f640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f27f41f6fe0 0x7f27f40c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:48.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.067+0000 7f27faf0f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27f40b8140 0x7f27f40b85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:48.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.067+0000 7f27faf0f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f40c9770 con 0x7f27e40047d0 2024-01-15T11:33:48.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.067+0000 7f27faf0f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f40b8b00 con 0x7f27f40b8140 2024-01-15T11:33:48.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.067+0000 7f27faf0f640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f40c8e40 con 0x7f27f41f6fe0 2024-01-15T11:33:48.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.067+0000 7f27f8cab640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27e40047d0 0x7f27f4152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:48.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.067+0000 7f27f8cab640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27e40047d0 0x7f27f4152590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58620/0 (socket says 172.21.15.27:58620) 2024-01-15T11:33:48.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.067+0000 7f27f8cab640 1 -- 172.21.15.27:0/182710680 learned_addr learned my addr 172.21.15.27:0/182710680 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:48.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.071+0000 7f27f3fff640 1 --2- 172.21.15.27:0/182710680 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f27f41f6fe0 0x7f27f40c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:48.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.071+0000 7f27f94ac640 1 --2- 172.21.15.27:0/182710680 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27f40b8140 0x7f27f40b85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:48.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.071+0000 7f27f8cab640 1 -- 172.21.15.27:0/182710680 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f27f41f6fe0 msgr2=0x7f27f40c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:48.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.071+0000 7f27f8cab640 1 --2- 172.21.15.27:0/182710680 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f27f41f6fe0 0x7f27f40c9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.071+0000 7f27f8cab640 1 -- 172.21.15.27:0/182710680 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27f40b8140 msgr2=0x7f27f40b85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:48.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.071+0000 7f27f8cab640 1 --2- 172.21.15.27:0/182710680 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27f40b8140 0x7f27f40b85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.071+0000 7f27f8cab640 1 -- 172.21.15.27:0/182710680 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f40c8b60 con 0x7f27e40047d0 2024-01-15T11:33:48.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.071+0000 7f27f94ac640 1 --2- 172.21.15.27:0/182710680 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27f40b8140 0x7f27f40b85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:48.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.071+0000 7f27f8cab640 1 --2- 172.21.15.27:0/182710680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27e40047d0 0x7f27f4152590 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f27e8011bd0 tx=0x7f27e800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:48.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.071+0000 7f27f17fa640 1 -- 172.21.15.27:0/182710680 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e8011cc0 con 0x7f27e40047d0 2024-01-15T11:33:48.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.071+0000 7f27f17fa640 1 -- 172.21.15.27:0/182710680 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e8011e20 con 0x7f27e40047d0 2024-01-15T11:33:48.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.071+0000 7f27f17fa640 1 -- 172.21.15.27:0/182710680 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e8004240 con 0x7f27e40047d0 2024-01-15T11:33:48.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.071+0000 7f27faf0f640 1 -- 172.21.15.27:0/182710680 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f40c9120 con 0x7f27e40047d0 2024-01-15T11:33:48.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.071+0000 7f27faf0f640 1 -- 172.21.15.27:0/182710680 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f4152ea0 con 0x7f27e40047d0 2024-01-15T11:33:48.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.071+0000 7f27faf0f640 1 -- 172.21.15.27:0/182710680 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f406cb80 con 0x7f27e40047d0 2024-01-15T11:33:48.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.071+0000 7f27f17fa640 1 -- 172.21.15.27:0/182710680 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f27e80043a0 con 0x7f27e40047d0 2024-01-15T11:33:48.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.071+0000 7f27f17fa640 1 --2- 172.21.15.27:0/182710680 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f27d8066920 0x7f27d8068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:48.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.071+0000 7f27f17fa640 1 -- 172.21.15.27:0/182710680 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27e8084860 con 0x7f27e40047d0 2024-01-15T11:33:48.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.075+0000 7f27f3fff640 1 --2- 172.21.15.27:0/182710680 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f27d8066920 0x7f27d8068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:48.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.075+0000 7f27f3fff640 1 --2- 172.21.15.27:0/182710680 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f27d8066920 0x7f27d8068de0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f27e00ab000 tx=0x7f27e00b1040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:48.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.075+0000 7f27f17fa640 1 -- 172.21.15.27:0/182710680 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f27e8051b50 con 0x7f27e40047d0 2024-01-15T11:33:48.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.239+0000 7f27faf0f640 1 -- 172.21.15.27:0/182710680 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27f404e850 con 0x7f27e40047d0 2024-01-15T11:33:48.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.239+0000 7f27f17fa640 1 -- 172.21.15.27:0/182710680 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16425 (secure 0 0 0) 0x7f27e8022070 con 0x7f27e40047d0 2024-01-15T11:33:48.241 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:48.242 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:33:21.682894+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T11:33:18.397200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T11:33:19.061383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:33:48.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.239+0000 7f27faf0f640 1 -- 172.21.15.27:0/182710680 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f27d8066920 msgr2=0x7f27d8068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:48.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.239+0000 7f27faf0f640 1 --2- 172.21.15.27:0/182710680 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f27d8066920 0x7f27d8068de0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f27e00ab000 tx=0x7f27e00b1040 comp rx=0 tx=0).stop 2024-01-15T11:33:48.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.239+0000 7f27faf0f640 1 -- 172.21.15.27:0/182710680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27e40047d0 msgr2=0x7f27f4152590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:48.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.239+0000 7f27faf0f640 1 --2- 172.21.15.27:0/182710680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27e40047d0 0x7f27f4152590 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f27e8011bd0 tx=0x7f27e800f610 comp rx=0 tx=0).stop 2024-01-15T11:33:48.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.239+0000 7f27faf0f640 1 -- 172.21.15.27:0/182710680 shutdown_connections 2024-01-15T11:33:48.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.239+0000 7f27faf0f640 1 --2- 172.21.15.27:0/182710680 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f27d8066920 0x7f27d8068de0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.239+0000 7f27faf0f640 1 --2- 172.21.15.27:0/182710680 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27f40b8140 0x7f27f40b85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.239+0000 7f27faf0f640 1 --2- 172.21.15.27:0/182710680 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f27f41f6fe0 0x7f27f40c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.239+0000 7f27faf0f640 1 --2- 172.21.15.27:0/182710680 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27e40047d0 0x7f27f4152590 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.239+0000 7f27faf0f640 1 -- 172.21.15.27:0/182710680 >> 172.21.15.27:0/182710680 conn(0x7f27f40d33b0 msgr2=0x7f27f406bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:48.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.239+0000 7f27faf0f640 1 -- 172.21.15.27:0/182710680 shutdown_connections 2024-01-15T11:33:48.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.239+0000 7f27faf0f640 1 -- 172.21.15.27:0/182710680 wait complete. 2024-01-15T11:33:48.263 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T11:33:08.134662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-15T11:33:18.397200+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-15T11:33:19.061383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T11:33:48.264 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T11:33:48.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.407+0000 7fa5bd4aa640 1 Processor -- start 2024-01-15T11:33:48.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.407+0000 7fa5bd4aa640 1 -- start start 2024-01-15T11:33:48.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.407+0000 7fa5bd4aa640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa5b8161f20 0x7fa5b80cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:48.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.407+0000 7fa5bd4aa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa5b80d02f0 0x7fa5b80cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:48.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.407+0000 7fa5bd4aa640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b80d0740 con 0x7fa5b815d7c0 2024-01-15T11:33:48.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.407+0000 7fa5bd4aa640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b80d0f90 con 0x7fa5b80d02f0 2024-01-15T11:33:48.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.407+0000 7fa5bd4aa640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b80d11a0 con 0x7fa5b8161f20 2024-01-15T11:33:48.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.411+0000 7fa5b77fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa5b80d02f0 0x7fa5b80cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:48.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.411+0000 7fa5affff640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa5b8161f20 0x7fa5b80cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:48.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.411+0000 7fa5b77fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa5b80d02f0 0x7fa5b80cdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:54856/0 (socket says 172.21.15.27:54856) 2024-01-15T11:33:48.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.411+0000 7fa5b77fe640 1 -- 172.21.15.27:0/2333632080 learned_addr learned my addr 172.21.15.27:0/2333632080 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:48.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.411+0000 7fa5b6ffd640 1 --1- 172.21.15.27:0/2333632080 >> v1:172.21.15.93:6789/0 conn(0x7fa5b815d7c0 0x7fa5b80d3d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.27:56784/0 (socket says 172.21.15.27:56784) 2024-01-15T11:33:48.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.411+0000 7fa5b77fe640 1 -- 172.21.15.27:0/2333632080 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa5b8161f20 msgr2=0x7fa5b80cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:48.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.411+0000 7fa5b77fe640 1 --2- 172.21.15.27:0/2333632080 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa5b8161f20 0x7fa5b80cfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.411+0000 7fa5b77fe640 1 -- 172.21.15.27:0/2333632080 >> v1:172.21.15.93:6789/0 conn(0x7fa5b815d7c0 legacy=0x7fa5b80d3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:48.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.411+0000 7fa5b77fe640 1 -- 172.21.15.27:0/2333632080 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b80d1480 con 0x7fa5b80d02f0 2024-01-15T11:33:48.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.411+0000 7fa5b77fe640 1 --2- 172.21.15.27:0/2333632080 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5b80d02f0 0x7fa5b80cdf60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009e50 tx=0x7fa5b001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b83bb72dd0024777 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:48.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.411+0000 7fa5b67fc640 1 -- 172.21.15.27:0/2333632080 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b00a5810 con 0x7fa5b80d02f0 2024-01-15T11:33:48.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.411+0000 7fa5b67fc640 1 -- 172.21.15.27:0/2333632080 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b00a5970 con 0x7fa5b80d02f0 2024-01-15T11:33:48.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.411+0000 7fa5b67fc640 1 -- 172.21.15.27:0/2333632080 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b00a5d00 con 0x7fa5b80d02f0 2024-01-15T11:33:48.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.415+0000 7fa5bd4aa640 1 -- 172.21.15.27:0/2333632080 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5b80d02f0 msgr2=0x7fa5b80cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:48.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.415+0000 7fa5bd4aa640 1 --2- 172.21.15.27:0/2333632080 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5b80d02f0 0x7fa5b80cdf60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009e50 tx=0x7fa5b001c950 comp rx=0 tx=0).stop 2024-01-15T11:33:48.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.415+0000 7fa5bd4aa640 1 -- 172.21.15.27:0/2333632080 shutdown_connections 2024-01-15T11:33:48.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.415+0000 7fa5bd4aa640 1 --2- 172.21.15.27:0/2333632080 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5b80d02f0 0x7fa5b80cdf60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.415+0000 7fa5bd4aa640 1 --2- 172.21.15.27:0/2333632080 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa5b8161f20 0x7fa5b80cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.415+0000 7fa5bd4aa640 1 -- 172.21.15.27:0/2333632080 >> 172.21.15.27:0/2333632080 conn(0x7fa5b808afc0 msgr2=0x7fa5b80d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:48.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.415+0000 7fa5bd4aa640 1 -- 172.21.15.27:0/2333632080 shutdown_connections 2024-01-15T11:33:48.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.415+0000 7fa5bd4aa640 1 -- 172.21.15.27:0/2333632080 wait complete. 2024-01-15T11:33:48.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.415+0000 7fa5bd4aa640 1 Processor -- start 2024-01-15T11:33:48.418 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.415+0000 7fa5bd4aa640 1 -- start start 2024-01-15T11:33:48.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.415+0000 7fa5bd4aa640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5b80d02f0 0x7fa5b81565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:48.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.415+0000 7fa5bd4aa640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5b815d7c0 0x7fa5b8154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:48.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.415+0000 7fa5bd4aa640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa5b80b5fe0 0x7fa5b80b6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:48.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.415+0000 7fa5bd4aa640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b80b7f10 con 0x7fa5b80d02f0 2024-01-15T11:33:48.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.415+0000 7fa5bd4aa640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b80b8d90 con 0x7fa5b815d7c0 2024-01-15T11:33:48.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.415+0000 7fa5bd4aa640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b80b84f0 con 0x7fa5b80b5fe0 2024-01-15T11:33:48.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.415+0000 7fa5b6ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5b80d02f0 0x7fa5b81565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:48.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.415+0000 7fa5b6ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5b80d02f0 0x7fa5b81565a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58624/0 (socket says 172.21.15.27:58624) 2024-01-15T11:33:48.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.415+0000 7fa5b6ffd640 1 -- 172.21.15.27:0/713994950 learned_addr learned my addr 172.21.15.27:0/713994950 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:48.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.415+0000 7fa5affff640 1 --2- 172.21.15.27:0/713994950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5b815d7c0 0x7fa5b8154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:48.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.415+0000 7fa5b77fe640 1 --2- 172.21.15.27:0/713994950 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa5b80b5fe0 0x7fa5b80b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:48.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.419+0000 7fa5b6ffd640 1 -- 172.21.15.27:0/713994950 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa5b80b5fe0 msgr2=0x7fa5b80b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:48.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.419+0000 7fa5b6ffd640 1 --2- 172.21.15.27:0/713994950 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa5b80b5fe0 0x7fa5b80b6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.419+0000 7fa5b6ffd640 1 -- 172.21.15.27:0/713994950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5b815d7c0 msgr2=0x7fa5b8154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:48.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.419+0000 7fa5b6ffd640 1 --2- 172.21.15.27:0/713994950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5b815d7c0 0x7fa5b8154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.419+0000 7fa5b6ffd640 1 -- 172.21.15.27:0/713994950 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b0009b30 con 0x7fa5b80d02f0 2024-01-15T11:33:48.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.419+0000 7fa5affff640 1 --2- 172.21.15.27:0/713994950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5b815d7c0 0x7fa5b8154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:48.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.419+0000 7fa5b6ffd640 1 --2- 172.21.15.27:0/713994950 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5b80d02f0 0x7fa5b81565a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800c490 tx=0x7fa5a800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:48.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.419+0000 7fa5af7fe640 1 -- 172.21.15.27:0/713994950 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8007480 con 0x7fa5b80d02f0 2024-01-15T11:33:48.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.419+0000 7fa5af7fe640 1 -- 172.21.15.27:0/713994950 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a80075e0 con 0x7fa5b80d02f0 2024-01-15T11:33:48.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.419+0000 7fa5af7fe640 1 -- 172.21.15.27:0/713994950 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8004a10 con 0x7fa5b80d02f0 2024-01-15T11:33:48.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.419+0000 7fa5bd4aa640 1 -- 172.21.15.27:0/713994950 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b806c950 con 0x7fa5b80d02f0 2024-01-15T11:33:48.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.419+0000 7fa5bd4aa640 1 -- 172.21.15.27:0/713994950 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b80b80f0 con 0x7fa5b80d02f0 2024-01-15T11:33:48.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.419+0000 7fa5bd4aa640 1 -- 172.21.15.27:0/713994950 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b804e850 con 0x7fa5b80d02f0 2024-01-15T11:33:48.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.419+0000 7fa5af7fe640 1 -- 172.21.15.27:0/713994950 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fa5a8004b70 con 0x7fa5b80d02f0 2024-01-15T11:33:48.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.419+0000 7fa5af7fe640 1 --2- 172.21.15.27:0/713994950 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa5980668f0 0x7fa598068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:48.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.419+0000 7fa5af7fe640 1 -- 172.21.15.27:0/713994950 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5a8083240 con 0x7fa5b80d02f0 2024-01-15T11:33:48.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.423+0000 7fa5affff640 1 --2- 172.21.15.27:0/713994950 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa5980668f0 0x7fa598068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:48.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.423+0000 7fa5affff640 1 --2- 172.21.15.27:0/713994950 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa5980668f0 0x7fa598068db0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80d00f0 tx=0x7fa5a0006f90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:48.428 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.423+0000 7fa5af7fe640 1 -- 172.21.15.27:0/713994950 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa5a8050490 con 0x7fa5b80d02f0 2024-01-15T11:33:48.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.583+0000 7fa5bd4aa640 1 -- 172.21.15.27:0/713994950 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5b80d0740 con 0x7fa5b80d02f0 2024-01-15T11:33:48.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.583+0000 7fa5af7fe640 1 -- 172.21.15.27:0/713994950 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5b80d0740 con 0x7fa5b80d02f0 2024-01-15T11:33:48.587 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-15T11:33:48.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.587+0000 7fa5bd4aa640 1 -- 172.21.15.27:0/713994950 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa5980668f0 msgr2=0x7fa598068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:48.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.587+0000 7fa5bd4aa640 1 --2- 172.21.15.27:0/713994950 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa5980668f0 0x7fa598068db0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80d00f0 tx=0x7fa5a0006f90 comp rx=0 tx=0).stop 2024-01-15T11:33:48.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.587+0000 7fa5bd4aa640 1 -- 172.21.15.27:0/713994950 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5b80d02f0 msgr2=0x7fa5b81565a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:48.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.587+0000 7fa5bd4aa640 1 --2- 172.21.15.27:0/713994950 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5b80d02f0 0x7fa5b81565a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800c490 tx=0x7fa5a800c950 comp rx=0 tx=0).stop 2024-01-15T11:33:48.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.587+0000 7fa5bd4aa640 1 -- 172.21.15.27:0/713994950 shutdown_connections 2024-01-15T11:33:48.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.587+0000 7fa5bd4aa640 1 --2- 172.21.15.27:0/713994950 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa5b80b5fe0 0x7fa5b80b6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.587+0000 7fa5bd4aa640 1 --2- 172.21.15.27:0/713994950 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa5980668f0 0x7fa598068db0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.587+0000 7fa5bd4aa640 1 --2- 172.21.15.27:0/713994950 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5b815d7c0 0x7fa5b8154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.587+0000 7fa5bd4aa640 1 --2- 172.21.15.27:0/713994950 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5b80d02f0 0x7fa5b81565a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.587+0000 7fa5bd4aa640 1 -- 172.21.15.27:0/713994950 >> 172.21.15.27:0/713994950 conn(0x7fa5b808afc0 msgr2=0x7fa5b80cf5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:48.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.587+0000 7fa5bd4aa640 1 -- 172.21.15.27:0/713994950 shutdown_connections 2024-01-15T11:33:48.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.587+0000 7fa5bd4aa640 1 -- 172.21.15.27:0/713994950 wait complete. 2024-01-15T11:33:48.608 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-15T11:33:48.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.751+0000 7fa8ea89c640 1 Processor -- start 2024-01-15T11:33:48.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.751+0000 7fa8ea89c640 1 -- start start 2024-01-15T11:33:48.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.751+0000 7fa8ea89c640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8e40cdfb0 0x7fa8e40abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:48.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.751+0000 7fa8ea89c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa8e415a710 0x7fa8e40ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:48.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.751+0000 7fa8ea89c640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e40ce8d0 con 0x7fa8e40cbd50 2024-01-15T11:33:48.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.751+0000 7fa8ea89c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e40cca80 con 0x7fa8e415a710 2024-01-15T11:33:48.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.751+0000 7fa8ea89c640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e40b2710 con 0x7fa8e40cdfb0 2024-01-15T11:33:48.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.751+0000 7fa8e3fff640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8e40cdfb0 0x7fa8e40abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:48.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.751+0000 7fa8e3fff640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8e40cdfb0 0x7fa8e40abf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:58124/0 (socket says 172.21.15.27:58124) 2024-01-15T11:33:48.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.751+0000 7fa8e3fff640 1 -- 172.21.15.27:0/1303772534 learned_addr learned my addr 172.21.15.27:0/1303772534 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:48.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.751+0000 7fa8e37fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa8e415a710 0x7fa8e40ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:48.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.751+0000 7fa8e3fff640 1 -- 172.21.15.27:0/1303772534 >> v2:172.21.15.93:3300/0 conn(0x7fa8e415a710 msgr2=0x7fa8e40ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:48.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.751+0000 7fa8e3fff640 1 --2- 172.21.15.27:0/1303772534 >> v2:172.21.15.93:3300/0 conn(0x7fa8e415a710 0x7fa8e40ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.751+0000 7fa8e3fff640 1 -- 172.21.15.27:0/1303772534 >> v1:172.21.15.93:6789/0 conn(0x7fa8e40cbd50 legacy=0x7fa8e40cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:48.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.751+0000 7fa8e3fff640 1 -- 172.21.15.27:0/1303772534 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e40b29f0 con 0x7fa8e40cdfb0 2024-01-15T11:33:48.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.755+0000 7fa8e3fff640 1 --2- 172.21.15.27:0/1303772534 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8e40cdfb0 0x7fa8e40abf90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4009870 tx=0x7fa8d401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce45cd08d81c43ad server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:48.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.755+0000 7fa8e2ffd640 1 -- 172.21.15.27:0/1303772534 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d40aa670 con 0x7fa8e40cdfb0 2024-01-15T11:33:48.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.755+0000 7fa8e2ffd640 1 -- 172.21.15.27:0/1303772534 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d40aa7d0 con 0x7fa8e40cdfb0 2024-01-15T11:33:48.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.755+0000 7fa8e2ffd640 1 -- 172.21.15.27:0/1303772534 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d40aab60 con 0x7fa8e40cdfb0 2024-01-15T11:33:48.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.755+0000 7fa8ea89c640 1 -- 172.21.15.27:0/1303772534 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8e40cdfb0 msgr2=0x7fa8e40abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:48.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.755+0000 7fa8ea89c640 1 --2- 172.21.15.27:0/1303772534 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8e40cdfb0 0x7fa8e40abf90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4009870 tx=0x7fa8d401c510 comp rx=0 tx=0).stop 2024-01-15T11:33:48.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.755+0000 7fa8ea89c640 1 -- 172.21.15.27:0/1303772534 shutdown_connections 2024-01-15T11:33:48.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.755+0000 7fa8ea89c640 1 --2- 172.21.15.27:0/1303772534 >> v2:172.21.15.93:3300/0 conn(0x7fa8e415a710 0x7fa8e40ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.755+0000 7fa8ea89c640 1 --2- 172.21.15.27:0/1303772534 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8e40cdfb0 0x7fa8e40abf90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.755+0000 7fa8ea89c640 1 -- 172.21.15.27:0/1303772534 >> 172.21.15.27:0/1303772534 conn(0x7fa8e40b0cb0 msgr2=0x7fa8e40b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:48.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.755+0000 7fa8ea89c640 1 -- 172.21.15.27:0/1303772534 shutdown_connections 2024-01-15T11:33:48.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.755+0000 7fa8ea89c640 1 -- 172.21.15.27:0/1303772534 wait complete. 2024-01-15T11:33:48.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.759+0000 7fa8ea89c640 1 Processor -- start 2024-01-15T11:33:48.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.759+0000 7fa8ea89c640 1 -- start start 2024-01-15T11:33:48.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.759+0000 7fa8ea89c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8e40cbd50 0x7fa8e4152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:48.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.759+0000 7fa8ea89c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8e40cdfb0 0x7fa8e4070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:48.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.759+0000 7fa8ea89c640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8e415a710 0x7fa8e409acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:48.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.759+0000 7fa8ea89c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e41531b0 con 0x7fa8e40cbd50 2024-01-15T11:33:48.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.759+0000 7fa8ea89c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e4153660 con 0x7fa8e40cdfb0 2024-01-15T11:33:48.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.759+0000 7fa8ea89c640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e4070bd0 con 0x7fa8e415a710 2024-01-15T11:33:48.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.759+0000 7fa8e3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8e40cbd50 0x7fa8e4152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:48.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.759+0000 7fa8e3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8e40cbd50 0x7fa8e4152c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58640/0 (socket says 172.21.15.27:58640) 2024-01-15T11:33:48.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.759+0000 7fa8e3fff640 1 -- 172.21.15.27:0/2241179232 learned_addr learned my addr 172.21.15.27:0/2241179232 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:48.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.759+0000 7fa8e8e39640 1 --2- 172.21.15.27:0/2241179232 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8e415a710 0x7fa8e409acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:48.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.759+0000 7fa8e37fe640 1 --2- 172.21.15.27:0/2241179232 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8e40cdfb0 0x7fa8e4070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:48.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.759+0000 7fa8e3fff640 1 -- 172.21.15.27:0/2241179232 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8e415a710 msgr2=0x7fa8e409acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:48.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.759+0000 7fa8e3fff640 1 --2- 172.21.15.27:0/2241179232 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8e415a710 0x7fa8e409acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.759+0000 7fa8e3fff640 1 -- 172.21.15.27:0/2241179232 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8e40cdfb0 msgr2=0x7fa8e4070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:48.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.759+0000 7fa8e3fff640 1 --2- 172.21.15.27:0/2241179232 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8e40cdfb0 0x7fa8e4070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.759+0000 7fa8e3fff640 1 -- 172.21.15.27:0/2241179232 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d40094d0 con 0x7fa8e40cbd50 2024-01-15T11:33:48.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.759+0000 7fa8e3fff640 1 --2- 172.21.15.27:0/2241179232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8e40cbd50 0x7fa8e4152c70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa8d40ac040 tx=0x7fa8d401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:48.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.759+0000 7fa8e0ff9640 1 -- 172.21.15.27:0/2241179232 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d40b3800 con 0x7fa8e40cbd50 2024-01-15T11:33:48.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.759+0000 7fa8e0ff9640 1 -- 172.21.15.27:0/2241179232 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d40b3960 con 0x7fa8e40cbd50 2024-01-15T11:33:48.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.759+0000 7fa8ea89c640 1 -- 172.21.15.27:0/2241179232 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e40716f0 con 0x7fa8e40cbd50 2024-01-15T11:33:48.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.763+0000 7fa8e0ff9640 1 -- 172.21.15.27:0/2241179232 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d40b3d10 con 0x7fa8e40cbd50 2024-01-15T11:33:48.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.763+0000 7fa8ea89c640 1 -- 172.21.15.27:0/2241179232 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e4070e50 con 0x7fa8e40cbd50 2024-01-15T11:33:48.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.763+0000 7fa8ea89c640 1 -- 172.21.15.27:0/2241179232 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e40671f0 con 0x7fa8e40cbd50 2024-01-15T11:33:48.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.763+0000 7fa8e0ff9640 1 -- 172.21.15.27:0/2241179232 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fa8d40c6390 con 0x7fa8e40cbd50 2024-01-15T11:33:48.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.763+0000 7fa8e0ff9640 1 --2- 172.21.15.27:0/2241179232 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa8d0066920 0x7fa8d0068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:48.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.763+0000 7fa8e0ff9640 1 -- 172.21.15.27:0/2241179232 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8d411ee90 con 0x7fa8e40cbd50 2024-01-15T11:33:48.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.763+0000 7fa8e37fe640 1 --2- 172.21.15.27:0/2241179232 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa8d0066920 0x7fa8d0068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:48.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.767+0000 7fa8e37fe640 1 --2- 172.21.15.27:0/2241179232 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa8d0066920 0x7fa8d0068de0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa8e40cb4d0 tx=0x7fa8d8009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:48.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.767+0000 7fa8e0ff9640 1 -- 172.21.15.27:0/2241179232 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa8d40ec210 con 0x7fa8e40cbd50 2024-01-15T11:33:48.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.927+0000 7fa8ea89c640 1 -- 172.21.15.27:0/2241179232 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8e406b460 con 0x7fa8e40cbd50 2024-01-15T11:33:48.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.927+0000 7fa8e0ff9640 1 -- 172.21.15.27:0/2241179232 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa8d40ef830 con 0x7fa8e40cbd50 2024-01-15T11:33:48.931 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-01-15T11:33:48.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.931+0000 7fa8ea89c640 1 -- 172.21.15.27:0/2241179232 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa8d0066920 msgr2=0x7fa8d0068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.931+0000 7fa8ea89c640 1 --2- 172.21.15.27:0/2241179232 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa8d0066920 0x7fa8d0068de0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa8e40cb4d0 tx=0x7fa8d8009190 comp rx=0 tx=0).stop 2024-01-15T11:33:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.931+0000 7fa8ea89c640 1 -- 172.21.15.27:0/2241179232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8e40cbd50 msgr2=0x7fa8e4152c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.931+0000 7fa8ea89c640 1 --2- 172.21.15.27:0/2241179232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8e40cbd50 0x7fa8e4152c70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa8d40ac040 tx=0x7fa8d401ad50 comp rx=0 tx=0).stop 2024-01-15T11:33:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.931+0000 7fa8ea89c640 1 -- 172.21.15.27:0/2241179232 shutdown_connections 2024-01-15T11:33:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.931+0000 7fa8ea89c640 1 --2- 172.21.15.27:0/2241179232 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8e415a710 0x7fa8e409acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.931+0000 7fa8ea89c640 1 --2- 172.21.15.27:0/2241179232 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa8d0066920 0x7fa8d0068de0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.931+0000 7fa8ea89c640 1 --2- 172.21.15.27:0/2241179232 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8e40cdfb0 0x7fa8e4070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.931+0000 7fa8ea89c640 1 --2- 172.21.15.27:0/2241179232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8e40cbd50 0x7fa8e4152c70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.931+0000 7fa8ea89c640 1 -- 172.21.15.27:0/2241179232 >> 172.21.15.27:0/2241179232 conn(0x7fa8e40b0cb0 msgr2=0x7fa8e4164a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.931+0000 7fa8ea89c640 1 -- 172.21.15.27:0/2241179232 shutdown_connections 2024-01-15T11:33:48.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:48.931+0000 7fa8ea89c640 1 -- 172.21.15.27:0/2241179232 wait complete. 2024-01-15T11:33:48.952 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-15T11:33:49.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.095+0000 7f50bebe7640 1 Processor -- start 2024-01-15T11:33:49.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.095+0000 7f50bebe7640 1 -- start start 2024-01-15T11:33:49.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.099+0000 7f50bebe7640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f50b80cb9b0 0x7f50b806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:49.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.099+0000 7f50bebe7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f50b80ce5d0 0x7f50b815bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:49.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.099+0000 7f50bebe7640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b8159630 con 0x7f50b80cbd90 2024-01-15T11:33:49.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.099+0000 7f50bebe7640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b815bba0 con 0x7f50b80ce5d0 2024-01-15T11:33:49.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.099+0000 7f50bebe7640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b80cdd50 con 0x7f50b80cb9b0 2024-01-15T11:33:49.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.099+0000 7f50bd184640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f50b80ce5d0 0x7f50b815bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:49.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.099+0000 7f50bc983640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f50b80cb9b0 0x7f50b806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:49.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.099+0000 7f50bd184640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f50b80ce5d0 0x7f50b815bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:54896/0 (socket says 172.21.15.27:54896) 2024-01-15T11:33:49.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.099+0000 7f50bd184640 1 -- 172.21.15.27:0/71574583 learned_addr learned my addr 172.21.15.27:0/71574583 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:49.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.099+0000 7f50bd184640 1 -- 172.21.15.27:0/71574583 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f50b80cb9b0 msgr2=0x7f50b806e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:49.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.099+0000 7f50bd184640 1 --2- 172.21.15.27:0/71574583 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f50b80cb9b0 0x7f50b806e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:49.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.099+0000 7f50bd184640 1 -- 172.21.15.27:0/71574583 >> v1:172.21.15.93:6789/0 conn(0x7f50b80cbd90 legacy=0x7f50b815f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:49.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.099+0000 7f50bd184640 1 -- 172.21.15.27:0/71574583 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b80cd1d0 con 0x7f50b80ce5d0 2024-01-15T11:33:49.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.099+0000 7f50bc983640 1 --2- 172.21.15.27:0/71574583 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f50b80cb9b0 0x7f50b806e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:49.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.103+0000 7f50bd184640 1 --2- 172.21.15.27:0/71574583 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50b80ce5d0 0x7f50b815bfd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009e50 tx=0x7f50b001c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fa4917adc066dda server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:49.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.103+0000 7f50b77fe640 1 -- 172.21.15.27:0/71574583 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b00a5880 con 0x7f50b80ce5d0 2024-01-15T11:33:49.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.103+0000 7f50b77fe640 1 -- 172.21.15.27:0/71574583 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b00a59e0 con 0x7f50b80ce5d0 2024-01-15T11:33:49.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.103+0000 7f50b77fe640 1 -- 172.21.15.27:0/71574583 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b00a5d70 con 0x7f50b80ce5d0 2024-01-15T11:33:49.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.103+0000 7f50bebe7640 1 -- 172.21.15.27:0/71574583 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50b80ce5d0 msgr2=0x7f50b815bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:49.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.103+0000 7f50bebe7640 1 --2- 172.21.15.27:0/71574583 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50b80ce5d0 0x7f50b815bfd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009e50 tx=0x7f50b001c9e0 comp rx=0 tx=0).stop 2024-01-15T11:33:49.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.103+0000 7f50bebe7640 1 -- 172.21.15.27:0/71574583 shutdown_connections 2024-01-15T11:33:49.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.103+0000 7f50bebe7640 1 --2- 172.21.15.27:0/71574583 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50b80ce5d0 0x7f50b815bfd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:49.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.103+0000 7f50bebe7640 1 --2- 172.21.15.27:0/71574583 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f50b80cb9b0 0x7f50b806e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:49.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.103+0000 7f50bebe7640 1 -- 172.21.15.27:0/71574583 >> 172.21.15.27:0/71574583 conn(0x7f50b80b0cb0 msgr2=0x7f50b80b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:49.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.103+0000 7f50bebe7640 1 -- 172.21.15.27:0/71574583 shutdown_connections 2024-01-15T11:33:49.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.103+0000 7f50bebe7640 1 -- 172.21.15.27:0/71574583 wait complete. 2024-01-15T11:33:49.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.103+0000 7f50bebe7640 1 Processor -- start 2024-01-15T11:33:49.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.103+0000 7f50bebe7640 1 -- start start 2024-01-15T11:33:49.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.107+0000 7f50bebe7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50b80cb9b0 0x7f50b8150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:49.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.107+0000 7f50bebe7640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f50b80cbd90 0x7f50b8152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:49.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.107+0000 7f50bebe7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50b80ce5d0 0x7f50b81581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:49.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.107+0000 7f50bebe7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b8163da0 con 0x7f50b80cb9b0 2024-01-15T11:33:49.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.107+0000 7f50bebe7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b8164080 con 0x7f50b80ce5d0 2024-01-15T11:33:49.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.107+0000 7f50bebe7640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b8164360 con 0x7f50b80cbd90 2024-01-15T11:33:49.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.107+0000 7f50bc983640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50b80cb9b0 0x7f50b8150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:49.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.107+0000 7f50bc983640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50b80cb9b0 0x7f50b8150900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58642/0 (socket says 172.21.15.27:58642) 2024-01-15T11:33:49.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.107+0000 7f50bc983640 1 -- 172.21.15.27:0/55450093 learned_addr learned my addr 172.21.15.27:0/55450093 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:49.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.107+0000 7f50bd184640 1 --2- 172.21.15.27:0/55450093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50b80ce5d0 0x7f50b81581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:49.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.107+0000 7f50b7fff640 1 --2- 172.21.15.27:0/55450093 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f50b80cbd90 0x7f50b8152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:49.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.107+0000 7f50bc983640 1 -- 172.21.15.27:0/55450093 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f50b80cbd90 msgr2=0x7f50b8152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:49.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.107+0000 7f50bc983640 1 --2- 172.21.15.27:0/55450093 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f50b80cbd90 0x7f50b8152850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:49.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.107+0000 7f50bc983640 1 -- 172.21.15.27:0/55450093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50b80ce5d0 msgr2=0x7f50b81581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:49.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.107+0000 7f50bc983640 1 --2- 172.21.15.27:0/55450093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50b80ce5d0 0x7f50b81581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:49.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.107+0000 7f50bc983640 1 -- 172.21.15.27:0/55450093 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ac009420 con 0x7f50b80cb9b0 2024-01-15T11:33:49.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.107+0000 7f50bc983640 1 --2- 172.21.15.27:0/55450093 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50b80cb9b0 0x7f50b8150900 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00ebe0 tx=0x7f50ac00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:49.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.107+0000 7f50b57fa640 1 -- 172.21.15.27:0/55450093 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac00eee0 con 0x7f50b80cb9b0 2024-01-15T11:33:49.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.107+0000 7f50b57fa640 1 -- 172.21.15.27:0/55450093 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ac00cc30 con 0x7f50b80cb9b0 2024-01-15T11:33:49.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.107+0000 7f50b57fa640 1 -- 172.21.15.27:0/55450093 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac013470 con 0x7f50b80cb9b0 2024-01-15T11:33:49.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.107+0000 7f50bebe7640 1 -- 172.21.15.27:0/55450093 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b0009b30 con 0x7f50b80cb9b0 2024-01-15T11:33:49.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.107+0000 7f50bebe7640 1 -- 172.21.15.27:0/55450093 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b8150e40 con 0x7f50b80cb9b0 2024-01-15T11:33:49.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.107+0000 7f50bebe7640 1 -- 172.21.15.27:0/55450093 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b80671f0 con 0x7f50b80cb9b0 2024-01-15T11:33:49.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.107+0000 7f50b57fa640 1 -- 172.21.15.27:0/55450093 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f50ac0135d0 con 0x7f50b80cb9b0 2024-01-15T11:33:49.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.111+0000 7f50b57fa640 1 --2- 172.21.15.27:0/55450093 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f509c0668f0 0x7f509c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:49.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.111+0000 7f50b57fa640 1 -- 172.21.15.27:0/55450093 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50ac0847d0 con 0x7f50b80cb9b0 2024-01-15T11:33:49.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.111+0000 7f50b7fff640 1 --2- 172.21.15.27:0/55450093 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f509c0668f0 0x7f509c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:49.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.111+0000 7f50b7fff640 1 --2- 172.21.15.27:0/55450093 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f509c0668f0 0x7f509c068db0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f50b815e3f0 tx=0x7f50a4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:49.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.115+0000 7f50b57fa640 1 -- 172.21.15.27:0/55450093 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f50ac051970 con 0x7f50b80cb9b0 2024-01-15T11:33:49.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.271+0000 7f50bebe7640 1 -- 172.21.15.27:0/55450093 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f50b8163ee0 con 0x7f50b80cb9b0 2024-01-15T11:33:49.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.271+0000 7f50b57fa640 1 -- 172.21.15.27:0/55450093 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f50b8163ee0 con 0x7f50b80cb9b0 2024-01-15T11:33:49.275 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-01-15T11:33:49.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.275+0000 7f50bebe7640 1 -- 172.21.15.27:0/55450093 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f509c0668f0 msgr2=0x7f509c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:49.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.275+0000 7f50bebe7640 1 --2- 172.21.15.27:0/55450093 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f509c0668f0 0x7f509c068db0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f50b815e3f0 tx=0x7f50a4009040 comp rx=0 tx=0).stop 2024-01-15T11:33:49.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.275+0000 7f50bebe7640 1 -- 172.21.15.27:0/55450093 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50b80cb9b0 msgr2=0x7f50b8150900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:49.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.275+0000 7f50bebe7640 1 --2- 172.21.15.27:0/55450093 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50b80cb9b0 0x7f50b8150900 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00ebe0 tx=0x7f50ac00c520 comp rx=0 tx=0).stop 2024-01-15T11:33:49.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.275+0000 7f50bebe7640 1 -- 172.21.15.27:0/55450093 shutdown_connections 2024-01-15T11:33:49.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.275+0000 7f50bebe7640 1 --2- 172.21.15.27:0/55450093 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f509c0668f0 0x7f509c068db0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:49.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.275+0000 7f50bebe7640 1 --2- 172.21.15.27:0/55450093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f50b80ce5d0 0x7f50b81581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:49.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.275+0000 7f50bebe7640 1 --2- 172.21.15.27:0/55450093 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f50b80cbd90 0x7f50b8152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:49.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.275+0000 7f50bebe7640 1 --2- 172.21.15.27:0/55450093 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f50b80cb9b0 0x7f50b8150900 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:49.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.275+0000 7f50bebe7640 1 -- 172.21.15.27:0/55450093 >> 172.21.15.27:0/55450093 conn(0x7f50b80b0cb0 msgr2=0x7f50b8159880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:49.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.275+0000 7f50bebe7640 1 -- 172.21.15.27:0/55450093 shutdown_connections 2024-01-15T11:33:49.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.275+0000 7f50bebe7640 1 -- 172.21.15.27:0/55450093 wait complete. 2024-01-15T11:33:49.297 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgress.test_progress_bar_for_1_clone' 2024-01-15T11:33:49.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.435+0000 7fee7ff55640 1 Processor -- start 2024-01-15T11:33:49.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.435+0000 7fee7ff55640 1 -- start start 2024-01-15T11:33:49.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.439+0000 7fee7ff55640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fee78146c60 0x7fee78070020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:49.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.439+0000 7fee7ff55640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fee7806c220 0x7fee78070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:49.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.439+0000 7fee7ff55640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7815dba0 con 0x7fee78147040 2024-01-15T11:33:49.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.439+0000 7fee7ff55640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee7806c670 con 0x7fee78146c60 2024-01-15T11:33:49.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.439+0000 7fee7ff55640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7806d100 con 0x7fee7806c220 2024-01-15T11:33:49.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.439+0000 7fee7dcf1640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fee78146c60 0x7fee78070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:49.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.439+0000 7fee7d4f0640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fee78147040 0x7fee7806bb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:57946/0 (socket says 172.21.15.27:57946) 2024-01-15T11:33:49.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.439+0000 7fee7d4f0640 1 -- 172.21.15.27:0/2165033257 learned_addr learned my addr 172.21.15.27:0/2165033257 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:49.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.439+0000 7fee7e4f2640 1 --2- 172.21.15.27:0/2165033257 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fee7806c220 0x7fee78070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:49.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.439+0000 7fee7dcf1640 1 -- 172.21.15.27:0/2165033257 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fee7806c220 msgr2=0x7fee78070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:49.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.439+0000 7fee7dcf1640 1 --2- 172.21.15.27:0/2165033257 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fee7806c220 0x7fee78070560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:49.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.439+0000 7fee7dcf1640 1 -- 172.21.15.27:0/2165033257 >> v1:172.21.15.27:6789/0 conn(0x7fee78147040 legacy=0x7fee7806bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:49.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.439+0000 7fee7dcf1640 1 -- 172.21.15.27:0/2165033257 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7806c860 con 0x7fee78146c60 2024-01-15T11:33:49.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.439+0000 7fee7e4f2640 1 --2- 172.21.15.27:0/2165033257 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fee7806c220 0x7fee78070560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:49.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.443+0000 7fee7dcf1640 1 --2- 172.21.15.27:0/2165033257 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee78146c60 0x7fee78070020 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fee740097c0 tx=0x7fee7401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a40ff8fb991a0be server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:49.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.443+0000 7fee7ccef640 1 -- 172.21.15.27:0/2165033257 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee740ab650 con 0x7fee78146c60 2024-01-15T11:33:49.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.443+0000 7fee7ccef640 1 -- 172.21.15.27:0/2165033257 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee740ab7b0 con 0x7fee78146c60 2024-01-15T11:33:49.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.443+0000 7fee7ccef640 1 -- 172.21.15.27:0/2165033257 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee740abb40 con 0x7fee78146c60 2024-01-15T11:33:49.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.443+0000 7fee7ff55640 1 -- 172.21.15.27:0/2165033257 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee78146c60 msgr2=0x7fee78070020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:49.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.443+0000 7fee7ff55640 1 --2- 172.21.15.27:0/2165033257 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee78146c60 0x7fee78070020 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fee740097c0 tx=0x7fee7401c450 comp rx=0 tx=0).stop 2024-01-15T11:33:49.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.443+0000 7fee7ff55640 1 -- 172.21.15.27:0/2165033257 shutdown_connections 2024-01-15T11:33:49.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.443+0000 7fee7ff55640 1 --2- 172.21.15.27:0/2165033257 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fee7806c220 0x7fee78070560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:49.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.443+0000 7fee7ff55640 1 --2- 172.21.15.27:0/2165033257 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee78146c60 0x7fee78070020 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:49.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.443+0000 7fee7ff55640 1 -- 172.21.15.27:0/2165033257 >> 172.21.15.27:0/2165033257 conn(0x7fee780b2ea0 msgr2=0x7fee780b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:49.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.443+0000 7fee7ff55640 1 -- 172.21.15.27:0/2165033257 shutdown_connections 2024-01-15T11:33:49.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.443+0000 7fee7ff55640 1 -- 172.21.15.27:0/2165033257 wait complete. 2024-01-15T11:33:49.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.443+0000 7fee7ff55640 1 Processor -- start 2024-01-15T11:33:49.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.443+0000 7fee7ff55640 1 -- start start 2024-01-15T11:33:49.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee7ff55640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee7806c220 0x7fee7813d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:49.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee7ff55640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fee78146c60 0x7fee7813c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:49.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee7ff55640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fee78147040 0x7fee7813ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:49.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee7ff55640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7813beb0 con 0x7fee7806c220 2024-01-15T11:33:49.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee7ff55640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7813c880 con 0x7fee78147040 2024-01-15T11:33:49.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee7ff55640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee781407e0 con 0x7fee78146c60 2024-01-15T11:33:49.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee7dcf1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee7806c220 0x7fee7813d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:49.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee7dcf1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee7806c220 0x7fee7813d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58660/0 (socket says 172.21.15.27:58660) 2024-01-15T11:33:49.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee7dcf1640 1 -- 172.21.15.27:0/2592520723 learned_addr learned my addr 172.21.15.27:0/2592520723 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:49.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee7d4f0640 1 --2- 172.21.15.27:0/2592520723 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fee78146c60 0x7fee7813c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:49.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee7e4f2640 1 --2- 172.21.15.27:0/2592520723 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fee78147040 0x7fee7813ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:49.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee7dcf1640 1 -- 172.21.15.27:0/2592520723 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fee78146c60 msgr2=0x7fee7813c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:49.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee7dcf1640 1 --2- 172.21.15.27:0/2592520723 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fee78146c60 0x7fee7813c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:49.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee7dcf1640 1 -- 172.21.15.27:0/2592520723 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fee78147040 msgr2=0x7fee7813ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:49.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee7dcf1640 1 --2- 172.21.15.27:0/2592520723 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fee78147040 0x7fee7813ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:49.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee7dcf1640 1 -- 172.21.15.27:0/2592520723 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee74009420 con 0x7fee7806c220 2024-01-15T11:33:49.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee7e4f2640 1 --2- 172.21.15.27:0/2592520723 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fee78147040 0x7fee7813ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:33:49.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee7d4f0640 1 --2- 172.21.15.27:0/2592520723 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fee78146c60 0x7fee7813c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:33:49.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee7dcf1640 1 --2- 172.21.15.27:0/2592520723 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee7806c220 0x7fee7813d760 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fee740ad040 tx=0x7fee7401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:49.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee6e7fc640 1 -- 172.21.15.27:0/2592520723 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee740b5810 con 0x7fee7806c220 2024-01-15T11:33:49.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee6e7fc640 1 -- 172.21.15.27:0/2592520723 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee740b5990 con 0x7fee7806c220 2024-01-15T11:33:49.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee6e7fc640 1 -- 172.21.15.27:0/2592520723 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee740b5d40 con 0x7fee7806c220 2024-01-15T11:33:49.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee7ff55640 1 -- 172.21.15.27:0/2592520723 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7813b580 con 0x7fee7806c220 2024-01-15T11:33:49.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee7ff55640 1 -- 172.21.15.27:0/2592520723 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7813bb40 con 0x7fee7806c220 2024-01-15T11:33:49.454 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee7ff55640 1 -- 172.21.15.27:0/2592520723 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7804e850 con 0x7fee7806c220 2024-01-15T11:33:49.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.447+0000 7fee6e7fc640 1 -- 172.21.15.27:0/2592520723 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fee740bf410 con 0x7fee7806c220 2024-01-15T11:33:49.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.451+0000 7fee6e7fc640 1 --2- 172.21.15.27:0/2592520723 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fee5c0668f0 0x7fee5c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:49.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.451+0000 7fee6e7fc640 1 -- 172.21.15.27:0/2592520723 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee7411eff0 con 0x7fee7806c220 2024-01-15T11:33:49.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.451+0000 7fee7d4f0640 1 --2- 172.21.15.27:0/2592520723 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fee5c0668f0 0x7fee5c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:49.455 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.451+0000 7fee7d4f0640 1 --2- 172.21.15.27:0/2592520723 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fee5c0668f0 0x7fee5c068db0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fee7815d840 tx=0x7fee68009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:49.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.455+0000 7fee6e7fc640 1 -- 172.21.15.27:0/2592520723 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fee740ec2d0 con 0x7fee7806c220 2024-01-15T11:33:49.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.671+0000 7fee7ff55640 1 -- 172.21.15.27:0/2592520723 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgress.test_progress_bar_for_1_clone"]} v 0) v1 -- 0x7fee780d1f60 con 0x7fee7806c220 2024-01-15T11:33:49.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.887+0000 7fee6e7fc640 1 -- 172.21.15.27:0/2592520723 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgress.test_progress_bar_for_1_clone"]}]=0 v50) v1 ==== 155+0+0 (secure 0 0 0) 0x7fee740ef8f0 con 0x7fee7806c220 2024-01-15T11:33:49.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.891+0000 7fee7ff55640 1 -- 172.21.15.27:0/2592520723 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fee5c0668f0 msgr2=0x7fee5c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:49.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.891+0000 7fee7ff55640 1 --2- 172.21.15.27:0/2592520723 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fee5c0668f0 0x7fee5c068db0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fee7815d840 tx=0x7fee68009040 comp rx=0 tx=0).stop 2024-01-15T11:33:49.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.891+0000 7fee7ff55640 1 -- 172.21.15.27:0/2592520723 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee7806c220 msgr2=0x7fee7813d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:49.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.891+0000 7fee7ff55640 1 --2- 172.21.15.27:0/2592520723 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee7806c220 0x7fee7813d760 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fee740ad040 tx=0x7fee7401ac90 comp rx=0 tx=0).stop 2024-01-15T11:33:49.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.891+0000 7fee7ff55640 1 -- 172.21.15.27:0/2592520723 shutdown_connections 2024-01-15T11:33:49.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.891+0000 7fee7ff55640 1 --2- 172.21.15.27:0/2592520723 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fee5c0668f0 0x7fee5c068db0 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fee7815d840 tx=0x7fee68009040 comp rx=0 tx=0).stop 2024-01-15T11:33:49.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.891+0000 7fee7ff55640 1 --2- 172.21.15.27:0/2592520723 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fee78147040 0x7fee7813ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:49.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.891+0000 7fee7ff55640 1 --2- 172.21.15.27:0/2592520723 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fee78146c60 0x7fee7813c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:49.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.891+0000 7fee7ff55640 1 --2- 172.21.15.27:0/2592520723 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fee7806c220 0x7fee7813d760 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:49.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.891+0000 7fee7ff55640 1 -- 172.21.15.27:0/2592520723 >> 172.21.15.27:0/2592520723 conn(0x7fee780b2ea0 msgr2=0x7fee780d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:49.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.891+0000 7fee7ff55640 1 -- 172.21.15.27:0/2592520723 shutdown_connections 2024-01-15T11:33:49.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:49.891+0000 7fee7ff55640 1 -- 172.21.15.27:0/2592520723 wait complete. 2024-01-15T11:33:49.915 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-15T11:33:50.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.095+0000 7f58c9501640 1 Processor -- start 2024-01-15T11:33:50.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.095+0000 7f58c9501640 1 -- start start 2024-01-15T11:33:50.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.095+0000 7f58c9501640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f58c415d8f0 0x7f58c415e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:50.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.095+0000 7f58c9501640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f58c40ced30 0x7f58c40cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:50.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.095+0000 7f58c9501640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f58c40cf1b0 0x7f58c40d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:50.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.095+0000 7f58c9501640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c40d4420 con 0x7f58c415d8f0 2024-01-15T11:33:50.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.095+0000 7f58c9501640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c415ecc0 con 0x7f58c40cf1b0 2024-01-15T11:33:50.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.095+0000 7f58c9501640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40cdfb0 con 0x7f58c40ced30 2024-01-15T11:33:50.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.095+0000 7f58c2ffd640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f58c415d8f0 0x7f58c415e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:50.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.095+0000 7f58c2ffd640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f58c415d8f0 0x7f58c415e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58664/0 (socket says 172.21.15.27:58664) 2024-01-15T11:33:50.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.095+0000 7f58c2ffd640 1 -- 172.21.15.27:0/3913076540 learned_addr learned my addr 172.21.15.27:0/3913076540 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:50.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.095+0000 7f58c37fe640 1 --2- 172.21.15.27:0/3913076540 >> v2:172.21.15.93:3300/0 conn(0x7f58c40cf1b0 0x7f58c40d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:50.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.095+0000 7f58bbfff640 1 --2- 172.21.15.27:0/3913076540 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f58c40ced30 0x7f58c40cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:50.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.095+0000 7f58c2ffd640 1 -- 172.21.15.27:0/3913076540 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f58c40ced30 msgr2=0x7f58c40cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:50.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.095+0000 7f58c2ffd640 1 --2- 172.21.15.27:0/3913076540 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f58c40ced30 0x7f58c40cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:50.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.095+0000 7f58c2ffd640 1 -- 172.21.15.27:0/3913076540 >> v2:172.21.15.93:3300/0 conn(0x7f58c40cf1b0 msgr2=0x7f58c40d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:50.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.095+0000 7f58c2ffd640 1 --2- 172.21.15.27:0/3913076540 >> v2:172.21.15.93:3300/0 conn(0x7f58c40cf1b0 0x7f58c40d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:50.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.095+0000 7f58c2ffd640 1 -- 172.21.15.27:0/3913076540 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c40d4140 con 0x7f58c415d8f0 2024-01-15T11:33:50.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.095+0000 7f58c37fe640 1 --2- 172.21.15.27:0/3913076540 >> v2:172.21.15.93:3300/0 conn(0x7f58c40cf1b0 0x7f58c40d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:50.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.099+0000 7f58c2ffd640 1 --2- 172.21.15.27:0/3913076540 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58c415d8f0 0x7f58c415e780 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f58c40b21f0 tx=0x7f58b401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9516c70bc07311f1 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:50.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.099+0000 7f58c27fc640 1 -- 172.21.15.27:0/3913076540 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b40aa5f0 con 0x7f58c415d8f0 2024-01-15T11:33:50.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.099+0000 7f58c27fc640 1 -- 172.21.15.27:0/3913076540 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b40aa750 con 0x7f58c415d8f0 2024-01-15T11:33:50.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.099+0000 7f58c27fc640 1 -- 172.21.15.27:0/3913076540 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b40aaae0 con 0x7f58c415d8f0 2024-01-15T11:33:50.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.099+0000 7f58c9501640 1 -- 172.21.15.27:0/3913076540 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58c415d8f0 msgr2=0x7f58c415e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:50.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.099+0000 7f58c9501640 1 --2- 172.21.15.27:0/3913076540 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58c415d8f0 0x7f58c415e780 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f58c40b21f0 tx=0x7f58b401c4d0 comp rx=0 tx=0).stop 2024-01-15T11:33:50.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.099+0000 7f58c9501640 1 -- 172.21.15.27:0/3913076540 shutdown_connections 2024-01-15T11:33:50.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.099+0000 7f58c9501640 1 --2- 172.21.15.27:0/3913076540 >> v2:172.21.15.93:3300/0 conn(0x7f58c40cf1b0 0x7f58c40d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:50.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.099+0000 7f58c9501640 1 --2- 172.21.15.27:0/3913076540 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f58c40ced30 0x7f58c40cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:50.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.099+0000 7f58c9501640 1 --2- 172.21.15.27:0/3913076540 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58c415d8f0 0x7f58c415e780 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:50.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.099+0000 7f58c9501640 1 -- 172.21.15.27:0/3913076540 >> 172.21.15.27:0/3913076540 conn(0x7f58c409c750 msgr2=0x7f58c40d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:50.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.099+0000 7f58c9501640 1 -- 172.21.15.27:0/3913076540 shutdown_connections 2024-01-15T11:33:50.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.099+0000 7f58c9501640 1 -- 172.21.15.27:0/3913076540 wait complete. 2024-01-15T11:33:50.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.103+0000 7f58c9501640 1 Processor -- start 2024-01-15T11:33:50.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.103+0000 7f58c9501640 1 -- start start 2024-01-15T11:33:50.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.107+0000 7f58c9501640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58c40ced30 0x7f58c4151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:50.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.107+0000 7f58c9501640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f58c40cf1b0 0x7f58c41537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:50.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.107+0000 7f58c9501640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f58c415d8f0 0x7f58c4153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:50.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.107+0000 7f58c9501640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c415bc50 con 0x7f58c40ced30 2024-01-15T11:33:50.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.107+0000 7f58c9501640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c415bf30 con 0x7f58c415d8f0 2024-01-15T11:33:50.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.107+0000 7f58c9501640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c415c210 con 0x7f58c40cf1b0 2024-01-15T11:33:50.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.107+0000 7f58c2ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58c40ced30 0x7f58c4151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:50.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.107+0000 7f58c2ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58c40ced30 0x7f58c4151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58680/0 (socket says 172.21.15.27:58680) 2024-01-15T11:33:50.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.107+0000 7f58c2ffd640 1 -- 172.21.15.27:0/958735475 learned_addr learned my addr 172.21.15.27:0/958735475 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:50.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.107+0000 7f58bbfff640 1 --2- 172.21.15.27:0/958735475 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f58c40cf1b0 0x7f58c41537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:50.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.107+0000 7f58c37fe640 1 --2- 172.21.15.27:0/958735475 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f58c415d8f0 0x7f58c4153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:50.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.107+0000 7f58c2ffd640 1 -- 172.21.15.27:0/958735475 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f58c40cf1b0 msgr2=0x7f58c41537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:50.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.107+0000 7f58c2ffd640 1 --2- 172.21.15.27:0/958735475 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f58c40cf1b0 0x7f58c41537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:50.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.107+0000 7f58c2ffd640 1 -- 172.21.15.27:0/958735475 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f58c415d8f0 msgr2=0x7f58c4153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:50.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.107+0000 7f58c2ffd640 1 --2- 172.21.15.27:0/958735475 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f58c415d8f0 0x7f58c4153d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:50.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.107+0000 7f58c2ffd640 1 -- 172.21.15.27:0/958735475 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b40094d0 con 0x7f58c40ced30 2024-01-15T11:33:50.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.107+0000 7f58c2ffd640 1 --2- 172.21.15.27:0/958735475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58c40ced30 0x7f58c4151c50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f58b401ab80 tx=0x7f58b401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:50.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.107+0000 7f58bb7fe640 1 -- 172.21.15.27:0/958735475 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b40b3800 con 0x7f58c40ced30 2024-01-15T11:33:50.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.107+0000 7f58bb7fe640 1 -- 172.21.15.27:0/958735475 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b40b3980 con 0x7f58c40ced30 2024-01-15T11:33:50.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.107+0000 7f58c9501640 1 -- 172.21.15.27:0/958735475 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c415c4f0 con 0x7f58c40ced30 2024-01-15T11:33:50.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.107+0000 7f58bb7fe640 1 -- 172.21.15.27:0/958735475 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b40b3d30 con 0x7f58c40ced30 2024-01-15T11:33:50.111 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.107+0000 7f58c9501640 1 -- 172.21.15.27:0/958735475 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c40cab70 con 0x7f58c40ced30 2024-01-15T11:33:50.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.107+0000 7f58c9501640 1 -- 172.21.15.27:0/958735475 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c4157a70 con 0x7f58c40ced30 2024-01-15T11:33:50.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.107+0000 7f58bb7fe640 1 -- 172.21.15.27:0/958735475 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f58b40b2380 con 0x7f58c40ced30 2024-01-15T11:33:50.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.111+0000 7f58bb7fe640 1 --2- 172.21.15.27:0/958735475 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f58a40668f0 0x7f58a4068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:50.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.111+0000 7f58bb7fe640 1 -- 172.21.15.27:0/958735475 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58b40a7070 con 0x7f58c40ced30 2024-01-15T11:33:50.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.111+0000 7f58bbfff640 1 --2- 172.21.15.27:0/958735475 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f58a40668f0 0x7f58a4068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:50.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.111+0000 7f58bbfff640 1 --2- 172.21.15.27:0/958735475 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f58a40668f0 0x7f58a4068db0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f58c40b11b0 tx=0x7f58ac008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:50.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.115+0000 7f58bb7fe640 1 -- 172.21.15.27:0/958735475 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f58c4157a70 con 0x7f58c40ced30 2024-01-15T11:33:50.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.271+0000 7f58c9501640 1 -- 172.21.15.27:0/958735475 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f58c4157a70 con 0x7f58c40ced30 2024-01-15T11:33:50.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.279+0000 7f58bb7fe640 1 -- 172.21.15.27:0/958735475 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f58c4157a70 con 0x7f58c40ced30 2024-01-15T11:33:50.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.279+0000 7f58c9501640 1 -- 172.21.15.27:0/958735475 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f58a40668f0 msgr2=0x7f58a4068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:50.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.279+0000 7f58c9501640 1 --2- 172.21.15.27:0/958735475 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f58a40668f0 0x7f58a4068db0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f58c40b11b0 tx=0x7f58ac008040 comp rx=0 tx=0).stop 2024-01-15T11:33:50.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.279+0000 7f58c9501640 1 -- 172.21.15.27:0/958735475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58c40ced30 msgr2=0x7f58c4151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:50.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.279+0000 7f58c9501640 1 --2- 172.21.15.27:0/958735475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58c40ced30 0x7f58c4151c50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f58b401ab80 tx=0x7f58b401ad10 comp rx=0 tx=0).stop 2024-01-15T11:33:50.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.279+0000 7f58c9501640 1 -- 172.21.15.27:0/958735475 shutdown_connections 2024-01-15T11:33:50.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.279+0000 7f58c9501640 1 --2- 172.21.15.27:0/958735475 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f58a40668f0 0x7f58a4068db0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:50.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.279+0000 7f58c9501640 1 --2- 172.21.15.27:0/958735475 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f58c415d8f0 0x7f58c4153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:50.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.279+0000 7f58c9501640 1 --2- 172.21.15.27:0/958735475 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f58c40cf1b0 0x7f58c41537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:50.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.279+0000 7f58c9501640 1 --2- 172.21.15.27:0/958735475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f58c40ced30 0x7f58c4151c50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:50.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.279+0000 7f58c9501640 1 -- 172.21.15.27:0/958735475 >> 172.21.15.27:0/958735475 conn(0x7f58c409c750 msgr2=0x7f58c40b38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:50.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.279+0000 7f58c9501640 1 -- 172.21.15.27:0/958735475 shutdown_connections 2024-01-15T11:33:50.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.279+0000 7f58c9501640 1 -- 172.21.15.27:0/958735475 wait complete. 2024-01-15T11:33:50.310 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-15T11:33:50.310 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-15T11:33:50.359 DEBUG:teuthology.orchestra.run.smithi093:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-15T11:33:50.401 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-15T11:33:50.401 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:33:50.401 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T11:33:50.411 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:33:50.411 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T11:33:50.460 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:33:50.460 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T11:33:50.512 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:33:50.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.695+0000 7fc462879640 1 Processor -- start 2024-01-15T11:33:50.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.695+0000 7fc462879640 1 -- start start 2024-01-15T11:33:50.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.695+0000 7fc462879640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc45c1662f0 0x7fc45c1686e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:50.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.695+0000 7fc462879640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc45c0b0a70 con 0x7fc45c0ce5c0 2024-01-15T11:33:50.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.695+0000 7fc462879640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc45c0b4100 con 0x7fc45c15d8b0 2024-01-15T11:33:50.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.695+0000 7fc462879640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc45c0cddb0 con 0x7fc45c1662f0 2024-01-15T11:33:50.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.695+0000 7fc45b7fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc45c0ce5c0 0x7fc45c0cea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:57952/0 (socket says 172.21.15.27:57952) 2024-01-15T11:33:50.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.695+0000 7fc45b7fe640 1 -- 172.21.15.27:0/982986906 learned_addr learned my addr 172.21.15.27:0/982986906 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:50.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.695+0000 7fc460e16640 1 --2- 172.21.15.27:0/982986906 >> v2:172.21.15.93:3300/0 conn(0x7fc45c1662f0 0x7fc45c1686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:50.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.695+0000 7fc45affd640 1 -- 172.21.15.27:0/982986906 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68272019 0 0) 0x7fc45c0b0a70 con 0x7fc45c0ce5c0 2024-01-15T11:33:50.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.695+0000 7fc45affd640 1 -- 172.21.15.27:0/982986906 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc444003530 con 0x7fc45c0ce5c0 2024-01-15T11:33:50.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.699+0000 7fc460e16640 1 -- 172.21.15.27:0/982986906 >> v1:172.21.15.93:6789/0 conn(0x7fc45c15d8b0 legacy=0x7fc45c0b4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:50.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.699+0000 7fc460e16640 1 -- 172.21.15.27:0/982986906 >> v1:172.21.15.27:6789/0 conn(0x7fc45c0ce5c0 legacy=0x7fc45c0cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:50.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.699+0000 7fc460e16640 1 -- 172.21.15.27:0/982986906 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45c0b43e0 con 0x7fc45c1662f0 2024-01-15T11:33:50.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.699+0000 7fc460e16640 1 --2- 172.21.15.27:0/982986906 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc45c1662f0 0x7fc45c1686e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc454009d90 tx=0x7fc45401f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45070bb40f07cb6f server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:50.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.699+0000 7fc45affd640 1 -- 172.21.15.27:0/982986906 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4540af600 con 0x7fc45c1662f0 2024-01-15T11:33:50.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.699+0000 7fc45affd640 1 -- 172.21.15.27:0/982986906 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4540ab050 con 0x7fc45c1662f0 2024-01-15T11:33:50.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.699+0000 7fc45affd640 1 -- 172.21.15.27:0/982986906 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4540af980 con 0x7fc45c1662f0 2024-01-15T11:33:50.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.699+0000 7fc462879640 1 -- 172.21.15.27:0/982986906 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc45c1662f0 msgr2=0x7fc45c1686e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:50.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.699+0000 7fc462879640 1 --2- 172.21.15.27:0/982986906 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc45c1662f0 0x7fc45c1686e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc454009d90 tx=0x7fc45401f130 comp rx=0 tx=0).stop 2024-01-15T11:33:50.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.699+0000 7fc462879640 1 -- 172.21.15.27:0/982986906 shutdown_connections 2024-01-15T11:33:50.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.699+0000 7fc462879640 1 --2- 172.21.15.27:0/982986906 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc45c1662f0 0x7fc45c1686e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:50.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.699+0000 7fc462879640 1 -- 172.21.15.27:0/982986906 >> 172.21.15.27:0/982986906 conn(0x7fc45c0b5570 msgr2=0x7fc45c0b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:50.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.703+0000 7fc462879640 1 -- 172.21.15.27:0/982986906 shutdown_connections 2024-01-15T11:33:50.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.703+0000 7fc462879640 1 -- 172.21.15.27:0/982986906 wait complete. 2024-01-15T11:33:50.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.703+0000 7fc462879640 1 Processor -- start 2024-01-15T11:33:50.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.703+0000 7fc462879640 1 -- start start 2024-01-15T11:33:50.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.703+0000 7fc462879640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc45c0ce5c0 0x7fc45c151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:50.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.703+0000 7fc462879640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc45c15d8b0 0x7fc45c06e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:50.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.703+0000 7fc462879640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc45c1662f0 0x7fc45c06e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:50.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.703+0000 7fc462879640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c1586b0 con 0x7fc45c1662f0 2024-01-15T11:33:50.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.703+0000 7fc462879640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c158b40 con 0x7fc45c15d8b0 2024-01-15T11:33:50.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.703+0000 7fc462879640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c157aa0 con 0x7fc45c0ce5c0 2024-01-15T11:33:50.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.703+0000 7fc460e16640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc45c1662f0 0x7fc45c06e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:50.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.703+0000 7fc460e16640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc45c1662f0 0x7fc45c06e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58684/0 (socket says 172.21.15.27:58684) 2024-01-15T11:33:50.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.703+0000 7fc460e16640 1 -- 172.21.15.27:0/3338935236 learned_addr learned my addr 172.21.15.27:0/3338935236 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:50.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.703+0000 7fc45b7fe640 1 --2- 172.21.15.27:0/3338935236 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc45c15d8b0 0x7fc45c06e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:50.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.703+0000 7fc45bfff640 1 --2- 172.21.15.27:0/3338935236 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc45c0ce5c0 0x7fc45c151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:50.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.703+0000 7fc460e16640 1 -- 172.21.15.27:0/3338935236 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc45c0ce5c0 msgr2=0x7fc45c151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:50.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.703+0000 7fc460e16640 1 --2- 172.21.15.27:0/3338935236 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc45c0ce5c0 0x7fc45c151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:50.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.703+0000 7fc460e16640 1 -- 172.21.15.27:0/3338935236 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc45c15d8b0 msgr2=0x7fc45c06e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:50.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.703+0000 7fc460e16640 1 --2- 172.21.15.27:0/3338935236 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc45c15d8b0 0x7fc45c06e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:50.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.703+0000 7fc460e16640 1 -- 172.21.15.27:0/3338935236 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc454009a70 con 0x7fc45c1662f0 2024-01-15T11:33:50.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.703+0000 7fc45bfff640 1 --2- 172.21.15.27:0/3338935236 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc45c0ce5c0 0x7fc45c151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:50.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.703+0000 7fc460e16640 1 --2- 172.21.15.27:0/3338935236 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc45c1662f0 0x7fc45c06e5b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc45401bd40 tx=0x7fc45401bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:50.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.707+0000 7fc458ff9640 1 -- 172.21.15.27:0/3338935236 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454009450 con 0x7fc45c1662f0 2024-01-15T11:33:50.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.707+0000 7fc458ff9640 1 -- 172.21.15.27:0/3338935236 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4540039a0 con 0x7fc45c1662f0 2024-01-15T11:33:50.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.707+0000 7fc458ff9640 1 -- 172.21.15.27:0/3338935236 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454003d10 con 0x7fc45c1662f0 2024-01-15T11:33:50.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.707+0000 7fc462879640 1 -- 172.21.15.27:0/3338935236 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc45c157d80 con 0x7fc45c1662f0 2024-01-15T11:33:50.710 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.707+0000 7fc462879640 1 -- 172.21.15.27:0/3338935236 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45c158340 con 0x7fc45c1662f0 2024-01-15T11:33:50.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.707+0000 7fc462879640 1 -- 172.21.15.27:0/3338935236 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc45c0b0650 con 0x7fc45c1662f0 2024-01-15T11:33:50.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.707+0000 7fc458ff9640 1 -- 172.21.15.27:0/3338935236 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fc454004030 con 0x7fc45c1662f0 2024-01-15T11:33:50.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.707+0000 7fc458ff9640 1 --2- 172.21.15.27:0/3338935236 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc4480668f0 0x7fc448068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:50.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.707+0000 7fc458ff9640 1 -- 172.21.15.27:0/3338935236 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc454122c90 con 0x7fc45c1662f0 2024-01-15T11:33:50.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.707+0000 7fc45bfff640 1 --2- 172.21.15.27:0/3338935236 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc4480668f0 0x7fc448068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:50.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.711+0000 7fc45bfff640 1 --2- 172.21.15.27:0/3338935236 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc4480668f0 0x7fc448068db0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc45c0cc370 tx=0x7fc44c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:50.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.711+0000 7fc458ff9640 1 -- 172.21.15.27:0/3338935236 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc4540f3a90 con 0x7fc45c1662f0 2024-01-15T11:33:50.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.875+0000 7fc462879640 1 -- 172.21.15.27:0/3338935236 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc45c04e850 con 0x7fc45c1662f0 2024-01-15T11:33:50.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.879+0000 7fc458ff9640 1 -- 172.21.15.27:0/3338935236 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16425 (secure 0 0 0) 0x7fc4540b4090 con 0x7fc45c1662f0 2024-01-15T11:33:50.881 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:50.881 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:33:21.682894+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T11:33:18.397200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T11:33:19.061383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:33:50.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.879+0000 7fc462879640 1 -- 172.21.15.27:0/3338935236 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc4480668f0 msgr2=0x7fc448068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:50.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.879+0000 7fc462879640 1 --2- 172.21.15.27:0/3338935236 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc4480668f0 0x7fc448068db0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc45c0cc370 tx=0x7fc44c009040 comp rx=0 tx=0).stop 2024-01-15T11:33:50.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.879+0000 7fc462879640 1 -- 172.21.15.27:0/3338935236 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc45c1662f0 msgr2=0x7fc45c06e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:50.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.879+0000 7fc462879640 1 --2- 172.21.15.27:0/3338935236 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc45c1662f0 0x7fc45c06e5b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc45401bd40 tx=0x7fc45401bed0 comp rx=0 tx=0).stop 2024-01-15T11:33:50.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.879+0000 7fc462879640 1 -- 172.21.15.27:0/3338935236 shutdown_connections 2024-01-15T11:33:50.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.879+0000 7fc462879640 1 --2- 172.21.15.27:0/3338935236 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc45c1662f0 0x7fc45c06e5b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:50.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.879+0000 7fc462879640 1 --2- 172.21.15.27:0/3338935236 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc4480668f0 0x7fc448068db0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:50.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.879+0000 7fc462879640 1 --2- 172.21.15.27:0/3338935236 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc45c15d8b0 0x7fc45c06e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:50.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.879+0000 7fc462879640 1 --2- 172.21.15.27:0/3338935236 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc45c0ce5c0 0x7fc45c151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:50.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.879+0000 7fc462879640 1 -- 172.21.15.27:0/3338935236 >> 172.21.15.27:0/3338935236 conn(0x7fc45c0b5570 msgr2=0x7fc45c0cf630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:50.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.879+0000 7fc462879640 1 -- 172.21.15.27:0/3338935236 shutdown_connections 2024-01-15T11:33:50.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:50.879+0000 7fc462879640 1 -- 172.21.15.27:0/3338935236 wait complete. 2024-01-15T11:33:50.904 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T11:33:08.134662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-15T11:33:18.397200+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-15T11:33:19.061383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T11:33:50.904 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T11:33:51.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.047+0000 7fab74d01640 1 Processor -- start 2024-01-15T11:33:51.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.047+0000 7fab74d01640 1 -- start start 2024-01-15T11:33:51.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.047+0000 7fab74d01640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fab70146820 0x7fab70070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:51.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.047+0000 7fab74d01640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab70147190 con 0x7fab700b4210 2024-01-15T11:33:51.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.047+0000 7fab74d01640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab7006d030 con 0x7fab7015eb50 2024-01-15T11:33:51.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.047+0000 7fab74d01640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab70161fa0 con 0x7fab70146820 2024-01-15T11:33:51.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.047+0000 7fab67fff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fab700b4210 0x7fab70161180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:57964/0 (socket says 172.21.15.27:57964) 2024-01-15T11:33:51.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.047+0000 7fab67fff640 1 -- 172.21.15.27:0/23636853 learned_addr learned my addr 172.21.15.27:0/23636853 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:51.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.047+0000 7fab6e59c640 1 --2- 172.21.15.27:0/23636853 >> v2:172.21.15.93:3300/0 conn(0x7fab70146820 0x7fab70070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:51.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.047+0000 7fab6dd9b640 1 -- 172.21.15.27:0/23636853 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005542343 0 0) 0x7fab70147190 con 0x7fab700b4210 2024-01-15T11:33:51.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.047+0000 7fab6dd9b640 1 -- 172.21.15.27:0/23636853 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab5c003530 con 0x7fab700b4210 2024-01-15T11:33:51.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.047+0000 7fab6e59c640 1 -- 172.21.15.27:0/23636853 >> v1:172.21.15.93:6789/0 conn(0x7fab7015eb50 legacy=0x7fab70161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:51.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.047+0000 7fab6e59c640 1 -- 172.21.15.27:0/23636853 >> v1:172.21.15.27:6789/0 conn(0x7fab700b4210 legacy=0x7fab70161180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:51.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.047+0000 7fab6e59c640 1 -- 172.21.15.27:0/23636853 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab70146c00 con 0x7fab70146820 2024-01-15T11:33:51.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.051+0000 7fab6e59c640 1 --2- 172.21.15.27:0/23636853 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab70146820 0x7fab70070a50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fab70146df0 tx=0x7fab6001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0a54c3d85cf3ad8 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:51.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.051+0000 7fab6dd9b640 1 -- 172.21.15.27:0/23636853 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab600ab650 con 0x7fab70146820 2024-01-15T11:33:51.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.051+0000 7fab6dd9b640 1 -- 172.21.15.27:0/23636853 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab600ab7b0 con 0x7fab70146820 2024-01-15T11:33:51.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.051+0000 7fab6dd9b640 1 -- 172.21.15.27:0/23636853 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab600abb40 con 0x7fab70146820 2024-01-15T11:33:51.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.051+0000 7fab74d01640 1 -- 172.21.15.27:0/23636853 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab70146820 msgr2=0x7fab70070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:51.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.051+0000 7fab74d01640 1 --2- 172.21.15.27:0/23636853 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab70146820 0x7fab70070a50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fab70146df0 tx=0x7fab6001c450 comp rx=0 tx=0).stop 2024-01-15T11:33:51.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.051+0000 7fab74d01640 1 -- 172.21.15.27:0/23636853 shutdown_connections 2024-01-15T11:33:51.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.051+0000 7fab74d01640 1 --2- 172.21.15.27:0/23636853 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab70146820 0x7fab70070a50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.051+0000 7fab74d01640 1 -- 172.21.15.27:0/23636853 >> 172.21.15.27:0/23636853 conn(0x7fab700b2f10 msgr2=0x7fab700b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:51.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.051+0000 7fab74d01640 1 -- 172.21.15.27:0/23636853 shutdown_connections 2024-01-15T11:33:51.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.051+0000 7fab74d01640 1 -- 172.21.15.27:0/23636853 wait complete. 2024-01-15T11:33:51.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.055+0000 7fab74d01640 1 Processor -- start 2024-01-15T11:33:51.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.055+0000 7fab74d01640 1 -- start start 2024-01-15T11:33:51.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.055+0000 7fab74d01640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fab700b4210 0x7fab7013d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:51.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.055+0000 7fab74d01640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab70146820 0x7fab70156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:51.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.055+0000 7fab74d01640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab7015eb50 0x7fab7015add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:51.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.055+0000 7fab74d01640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7015cee0 con 0x7fab70146820 2024-01-15T11:33:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.055+0000 7fab74d01640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7015bff0 con 0x7fab7015eb50 2024-01-15T11:33:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.055+0000 7fab74d01640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7015c2d0 con 0x7fab700b4210 2024-01-15T11:33:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.055+0000 7fab67fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab70146820 0x7fab70156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.055+0000 7fab67fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab70146820 0x7fab70156f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58696/0 (socket says 172.21.15.27:58696) 2024-01-15T11:33:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.055+0000 7fab67fff640 1 -- 172.21.15.27:0/367512440 learned_addr learned my addr 172.21.15.27:0/367512440 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.055+0000 7fab67fff640 1 -- 172.21.15.27:0/367512440 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fab700b4210 msgr2=0x7fab7013d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.055+0000 7fab67fff640 1 --2- 172.21.15.27:0/367512440 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fab700b4210 0x7fab7013d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.055+0000 7fab6ed9d640 1 --2- 172.21.15.27:0/367512440 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab7015eb50 0x7fab7015add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.055+0000 7fab67fff640 1 -- 172.21.15.27:0/367512440 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab7015eb50 msgr2=0x7fab7015add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.055+0000 7fab67fff640 1 --2- 172.21.15.27:0/367512440 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab7015eb50 0x7fab7015add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.055+0000 7fab67fff640 1 -- 172.21.15.27:0/367512440 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab60009420 con 0x7fab70146820 2024-01-15T11:33:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.055+0000 7fab6ed9d640 1 --2- 172.21.15.27:0/367512440 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab7015eb50 0x7fab7015add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:33:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.055+0000 7fab67fff640 1 --2- 172.21.15.27:0/367512440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab70146820 0x7fab70156f00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fab5800c420 tx=0x7fab5800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:51.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.055+0000 7fab66ffd640 1 -- 172.21.15.27:0/367512440 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab58005cf0 con 0x7fab70146820 2024-01-15T11:33:51.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.055+0000 7fab66ffd640 1 -- 172.21.15.27:0/367512440 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab58005e50 con 0x7fab70146820 2024-01-15T11:33:51.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.055+0000 7fab66ffd640 1 -- 172.21.15.27:0/367512440 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab580072d0 con 0x7fab70146820 2024-01-15T11:33:51.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.055+0000 7fab74d01640 1 -- 172.21.15.27:0/367512440 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab7015c5b0 con 0x7fab70146820 2024-01-15T11:33:51.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.055+0000 7fab74d01640 1 -- 172.21.15.27:0/367512440 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7015cb70 con 0x7fab70146820 2024-01-15T11:33:51.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.059+0000 7fab74d01640 1 -- 172.21.15.27:0/367512440 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab7006c7f0 con 0x7fab70146820 2024-01-15T11:33:51.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.059+0000 7fab66ffd640 1 -- 172.21.15.27:0/367512440 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fab58007430 con 0x7fab70146820 2024-01-15T11:33:51.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.059+0000 7fab66ffd640 1 --2- 172.21.15.27:0/367512440 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fab50066920 0x7fab50068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:51.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.059+0000 7fab66ffd640 1 -- 172.21.15.27:0/367512440 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab58083970 con 0x7fab70146820 2024-01-15T11:33:51.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.059+0000 7fab6e59c640 1 --2- 172.21.15.27:0/367512440 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fab50066920 0x7fab50068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:51.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.059+0000 7fab6e59c640 1 --2- 172.21.15.27:0/367512440 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fab50066920 0x7fab50068de0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fab600af000 tx=0x7fab60008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:51.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.063+0000 7fab66ffd640 1 -- 172.21.15.27:0/367512440 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fab58050bc0 con 0x7fab70146820 2024-01-15T11:33:51.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.219+0000 7fab74d01640 1 -- 172.21.15.27:0/367512440 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fab7004e850 con 0x7fab70146820 2024-01-15T11:33:51.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.223+0000 7fab66ffd640 1 -- 172.21.15.27:0/367512440 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fab58017020 con 0x7fab70146820 2024-01-15T11:33:51.225 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-15T11:33:51.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.223+0000 7fab74d01640 1 -- 172.21.15.27:0/367512440 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fab50066920 msgr2=0x7fab50068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:51.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.223+0000 7fab74d01640 1 --2- 172.21.15.27:0/367512440 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fab50066920 0x7fab50068de0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fab600af000 tx=0x7fab60008040 comp rx=0 tx=0).stop 2024-01-15T11:33:51.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.223+0000 7fab74d01640 1 -- 172.21.15.27:0/367512440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab70146820 msgr2=0x7fab70156f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:51.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.223+0000 7fab74d01640 1 --2- 172.21.15.27:0/367512440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab70146820 0x7fab70156f00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fab5800c420 tx=0x7fab5800c8e0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.223+0000 7fab74d01640 1 -- 172.21.15.27:0/367512440 shutdown_connections 2024-01-15T11:33:51.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.223+0000 7fab74d01640 1 --2- 172.21.15.27:0/367512440 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fab50066920 0x7fab50068de0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.223+0000 7fab74d01640 1 --2- 172.21.15.27:0/367512440 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab7015eb50 0x7fab7015add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.223+0000 7fab74d01640 1 --2- 172.21.15.27:0/367512440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fab70146820 0x7fab70156f00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.223+0000 7fab74d01640 1 --2- 172.21.15.27:0/367512440 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fab700b4210 0x7fab7013d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.223+0000 7fab74d01640 1 -- 172.21.15.27:0/367512440 >> 172.21.15.27:0/367512440 conn(0x7fab700b2f10 msgr2=0x7fab7015f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:51.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.223+0000 7fab74d01640 1 -- 172.21.15.27:0/367512440 shutdown_connections 2024-01-15T11:33:51.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.223+0000 7fab74d01640 1 -- 172.21.15.27:0/367512440 wait complete. 2024-01-15T11:33:51.246 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-15T11:33:51.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.387+0000 7f044ee5a640 1 Processor -- start 2024-01-15T11:33:51.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.387+0000 7f044ee5a640 1 -- start start 2024-01-15T11:33:51.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.391+0000 7f044ee5a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f04480cdfb0 0x7f04480abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:51.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.391+0000 7f044ee5a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f044815a710 0x7f04480ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:51.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.391+0000 7f044ee5a640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04480ce8d0 con 0x7f04480cbd50 2024-01-15T11:33:51.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.391+0000 7f044ee5a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04480cca80 con 0x7f04480cdfb0 2024-01-15T11:33:51.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.391+0000 7f044ee5a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04480b2710 con 0x7f044815a710 2024-01-15T11:33:51.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.391+0000 7f044cbf6640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f04480cdfb0 0x7f04480abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:51.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.391+0000 7f044d3f7640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f04480cbd50 0x7f04480cc1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:57966/0 (socket says 172.21.15.27:57966) 2024-01-15T11:33:51.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.391+0000 7f044d3f7640 1 -- 172.21.15.27:0/3178892477 learned_addr learned my addr 172.21.15.27:0/3178892477 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:51.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.391+0000 7f0447fff640 1 --2- 172.21.15.27:0/3178892477 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f044815a710 0x7f04480ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:51.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.391+0000 7f044cbf6640 1 -- 172.21.15.27:0/3178892477 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f044815a710 msgr2=0x7f04480ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:51.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.391+0000 7f044cbf6640 1 --2- 172.21.15.27:0/3178892477 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f044815a710 0x7f04480ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.391+0000 7f044cbf6640 1 -- 172.21.15.27:0/3178892477 >> v1:172.21.15.27:6789/0 conn(0x7f04480cbd50 legacy=0x7f04480cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:51.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.391+0000 7f044cbf6640 1 -- 172.21.15.27:0/3178892477 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04480b29f0 con 0x7f04480cdfb0 2024-01-15T11:33:51.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.391+0000 7f04477fe640 1 -- 172.21.15.27:0/3178892477 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775163834 0 0) 0x7f04480ce8d0 con 0x7f04480cbd50 2024-01-15T11:33:51.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.395+0000 7f044cbf6640 1 --2- 172.21.15.27:0/3178892477 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04480cdfb0 0x7f04480abf90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f043c0097c0 tx=0x7f043c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f42345d89efaf4d server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:51.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.395+0000 7f04477fe640 1 -- 172.21.15.27:0/3178892477 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c0ab650 con 0x7f04480cdfb0 2024-01-15T11:33:51.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.395+0000 7f04477fe640 1 -- 172.21.15.27:0/3178892477 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043c0ab7b0 con 0x7f04480cdfb0 2024-01-15T11:33:51.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.395+0000 7f04477fe640 1 -- 172.21.15.27:0/3178892477 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c0abb40 con 0x7f04480cdfb0 2024-01-15T11:33:51.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.395+0000 7f044ee5a640 1 -- 172.21.15.27:0/3178892477 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04480cdfb0 msgr2=0x7f04480abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:51.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.395+0000 7f044ee5a640 1 --2- 172.21.15.27:0/3178892477 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04480cdfb0 0x7f04480abf90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f043c0097c0 tx=0x7f043c01c450 comp rx=0 tx=0).stop 2024-01-15T11:33:51.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.395+0000 7f044ee5a640 1 -- 172.21.15.27:0/3178892477 shutdown_connections 2024-01-15T11:33:51.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.395+0000 7f044ee5a640 1 --2- 172.21.15.27:0/3178892477 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f044815a710 0x7f04480ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.395+0000 7f044ee5a640 1 --2- 172.21.15.27:0/3178892477 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04480cdfb0 0x7f04480abf90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.395+0000 7f044ee5a640 1 -- 172.21.15.27:0/3178892477 >> 172.21.15.27:0/3178892477 conn(0x7f04480b0cb0 msgr2=0x7f04480b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:51.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.395+0000 7f044ee5a640 1 -- 172.21.15.27:0/3178892477 shutdown_connections 2024-01-15T11:33:51.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.395+0000 7f044ee5a640 1 -- 172.21.15.27:0/3178892477 wait complete. 2024-01-15T11:33:51.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.395+0000 7f044ee5a640 1 Processor -- start 2024-01-15T11:33:51.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.395+0000 7f044ee5a640 1 -- start start 2024-01-15T11:33:51.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.399+0000 7f044ee5a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04480cbd50 0x7f0448154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:51.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.399+0000 7f044ee5a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04480cdfb0 0x7f0448158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:51.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.399+0000 7f044ee5a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f044815a710 0x7f044809ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:51.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.399+0000 7f044ee5a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0448158bd0 con 0x7f04480cdfb0 2024-01-15T11:33:51.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.399+0000 7f044ee5a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0448156ec0 con 0x7f04480cbd50 2024-01-15T11:33:51.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.399+0000 7f044ee5a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0448154a40 con 0x7f044815a710 2024-01-15T11:33:51.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.399+0000 7f0447fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04480cdfb0 0x7f0448158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:51.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.399+0000 7f0447fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04480cdfb0 0x7f0448158360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58712/0 (socket says 172.21.15.27:58712) 2024-01-15T11:33:51.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.399+0000 7f0447fff640 1 -- 172.21.15.27:0/3454035973 learned_addr learned my addr 172.21.15.27:0/3454035973 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:51.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.399+0000 7f044cbf6640 1 --2- 172.21.15.27:0/3454035973 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04480cbd50 0x7f0448154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:51.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.399+0000 7f044d3f7640 1 --2- 172.21.15.27:0/3454035973 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f044815a710 0x7f044809ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:51.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.399+0000 7f0447fff640 1 -- 172.21.15.27:0/3454035973 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f044815a710 msgr2=0x7f044809ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:51.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.399+0000 7f0447fff640 1 --2- 172.21.15.27:0/3454035973 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f044815a710 0x7f044809ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.399+0000 7f0447fff640 1 -- 172.21.15.27:0/3454035973 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04480cbd50 msgr2=0x7f0448154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:51.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.399+0000 7f0447fff640 1 --2- 172.21.15.27:0/3454035973 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04480cbd50 0x7f0448154500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.399+0000 7f0447fff640 1 -- 172.21.15.27:0/3454035973 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c009420 con 0x7f04480cdfb0 2024-01-15T11:33:51.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.399+0000 7f044cbf6640 1 --2- 172.21.15.27:0/3454035973 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04480cbd50 0x7f0448154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:51.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.399+0000 7f0447fff640 1 --2- 172.21.15.27:0/3454035973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04480cdfb0 0x7f0448158360 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0434006e90 tx=0x7f043400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:51.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.399+0000 7f04457fa640 1 -- 172.21.15.27:0/3454035973 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043400b6c0 con 0x7f04480cdfb0 2024-01-15T11:33:51.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.399+0000 7f04457fa640 1 -- 172.21.15.27:0/3454035973 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043400b840 con 0x7f04480cdfb0 2024-01-15T11:33:51.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.399+0000 7f04457fa640 1 -- 172.21.15.27:0/3454035973 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043400bbf0 con 0x7f04480cdfb0 2024-01-15T11:33:51.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.399+0000 7f044ee5a640 1 -- 172.21.15.27:0/3454035973 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f044815beb0 con 0x7f04480cdfb0 2024-01-15T11:33:51.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.399+0000 7f044ee5a640 1 -- 172.21.15.27:0/3454035973 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f044815c470 con 0x7f04480cdfb0 2024-01-15T11:33:51.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.399+0000 7f044ee5a640 1 -- 172.21.15.27:0/3454035973 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04480671f0 con 0x7f04480cdfb0 2024-01-15T11:33:51.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.399+0000 7f04457fa640 1 -- 172.21.15.27:0/3454035973 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f043400bd50 con 0x7f04480cdfb0 2024-01-15T11:33:51.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.403+0000 7f04457fa640 1 --2- 172.21.15.27:0/3454035973 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f042c0668f0 0x7f042c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:51.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.403+0000 7f04457fa640 1 -- 172.21.15.27:0/3454035973 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0434084920 con 0x7f04480cdfb0 2024-01-15T11:33:51.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.403+0000 7f044cbf6640 1 --2- 172.21.15.27:0/3454035973 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f042c0668f0 0x7f042c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:51.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.403+0000 7f044cbf6640 1 --2- 172.21.15.27:0/3454035973 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f042c0668f0 0x7f042c068db0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f043c0af000 tx=0x7f043c0a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:51.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.407+0000 7f04457fa640 1 -- 172.21.15.27:0/3454035973 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0434051b50 con 0x7f04480cdfb0 2024-01-15T11:33:51.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.563+0000 7f044ee5a640 1 -- 172.21.15.27:0/3454035973 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f044806b460 con 0x7f04480cdfb0 2024-01-15T11:33:51.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.563+0000 7f04457fa640 1 -- 172.21.15.27:0/3454035973 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0434055170 con 0x7f04480cdfb0 2024-01-15T11:33:51.568 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-01-15T11:33:51.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.567+0000 7f044ee5a640 1 -- 172.21.15.27:0/3454035973 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f042c0668f0 msgr2=0x7f042c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:51.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.567+0000 7f044ee5a640 1 --2- 172.21.15.27:0/3454035973 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f042c0668f0 0x7f042c068db0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f043c0af000 tx=0x7f043c0a7000 comp rx=0 tx=0).stop 2024-01-15T11:33:51.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.567+0000 7f044ee5a640 1 -- 172.21.15.27:0/3454035973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04480cdfb0 msgr2=0x7f0448158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:51.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.567+0000 7f044ee5a640 1 --2- 172.21.15.27:0/3454035973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04480cdfb0 0x7f0448158360 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0434006e90 tx=0x7f043400dc60 comp rx=0 tx=0).stop 2024-01-15T11:33:51.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.567+0000 7f044ee5a640 1 -- 172.21.15.27:0/3454035973 shutdown_connections 2024-01-15T11:33:51.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.567+0000 7f044ee5a640 1 --2- 172.21.15.27:0/3454035973 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f044815a710 0x7f044809ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.567+0000 7f044ee5a640 1 --2- 172.21.15.27:0/3454035973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f04480cdfb0 0x7f0448158360 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.567+0000 7f044ee5a640 1 --2- 172.21.15.27:0/3454035973 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f042c0668f0 0x7f042c068db0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.567+0000 7f044ee5a640 1 --2- 172.21.15.27:0/3454035973 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f04480cbd50 0x7f0448154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.567+0000 7f044ee5a640 1 -- 172.21.15.27:0/3454035973 >> 172.21.15.27:0/3454035973 conn(0x7f04480b0cb0 msgr2=0x7f04480b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:51.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.567+0000 7f044ee5a640 1 -- 172.21.15.27:0/3454035973 shutdown_connections 2024-01-15T11:33:51.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.567+0000 7f044ee5a640 1 -- 172.21.15.27:0/3454035973 wait complete. 2024-01-15T11:33:51.589 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-15T11:33:51.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa911180640 1 Processor -- start 2024-01-15T11:33:51.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa911180640 1 -- start start 2024-01-15T11:33:51.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa911180640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa90c0cb9b0 0x7fa90c06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:51.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa911180640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa90c159630 con 0x7fa90c0ce5d0 2024-01-15T11:33:51.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa911180640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa90c0cd1d0 con 0x7fa90c0cbd90 2024-01-15T11:33:51.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa911180640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa90c15bba0 con 0x7fa90c0cb9b0 2024-01-15T11:33:51.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90b59e640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fa90c0ce5d0 0x7fa90c15bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:57972/0 (socket says 172.21.15.27:57972) 2024-01-15T11:33:51.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90b59e640 1 -- 172.21.15.27:0/2749256385 learned_addr learned my addr 172.21.15.27:0/2749256385 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:51.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90ad9d640 1 --2- 172.21.15.27:0/2749256385 >> v2:172.21.15.93:3300/0 conn(0x7fa90c0cb9b0 0x7fa90c06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:51.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90a59c640 1 -- 172.21.15.27:0/2749256385 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2164285414 0 0) 0x7fa90c159630 con 0x7fa90c0ce5d0 2024-01-15T11:33:51.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90a59c640 1 -- 172.21.15.27:0/2749256385 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8f8003530 con 0x7fa90c0ce5d0 2024-01-15T11:33:51.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90a59c640 1 -- 172.21.15.27:0/2749256385 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1290942894 0 0) 0x7fa8f8003530 con 0x7fa90c0ce5d0 2024-01-15T11:33:51.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90a59c640 1 -- 172.21.15.27:0/2749256385 >> v2:172.21.15.93:3300/0 conn(0x7fa90c0cb9b0 msgr2=0x7fa90c06e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:51.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90a59c640 1 --2- 172.21.15.27:0/2749256385 >> v2:172.21.15.93:3300/0 conn(0x7fa90c0cb9b0 0x7fa90c06e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90a59c640 1 -- 172.21.15.27:0/2749256385 >> v1:172.21.15.93:6789/0 conn(0x7fa90c0cbd90 legacy=0x7fa90c15f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:51.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90a59c640 1 -- 172.21.15.27:0/2749256385 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa90c0cd4b0 con 0x7fa90c0ce5d0 2024-01-15T11:33:51.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90a59c640 1 -- 172.21.15.27:0/2749256385 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1394381265 0 0) 0x7fa904001a00 con 0x7fa90c0ce5d0 2024-01-15T11:33:51.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90a59c640 1 -- 172.21.15.27:0/2749256385 >> v1:172.21.15.27:6789/0 conn(0x7fa90c0ce5d0 legacy=0x7fa90c15bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:51.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90a59c640 1 --2- 172.21.15.27:0/2749256385 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8f80039d0 0x7fa8f8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:51.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90a59c640 1 --2- 172.21.15.27:0/2749256385 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8f80047d0 0x7fa8f8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:51.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90a59c640 1 --2- 172.21.15.27:0/2749256385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8f8005190 0x7fa8f800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:51.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90a59c640 1 -- 172.21.15.27:0/2749256385 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f800c060 con 0x7fa8f8005190 2024-01-15T11:33:51.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90a59c640 1 -- 172.21.15.27:0/2749256385 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f800c1d0 con 0x7fa8f80039d0 2024-01-15T11:33:51.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90a59c640 1 -- 172.21.15.27:0/2749256385 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f800c390 con 0x7fa8f80047d0 2024-01-15T11:33:51.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90b59e640 1 --2- 172.21.15.27:0/2749256385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8f8005190 0x7fa8f800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:51.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90ad9d640 1 --2- 172.21.15.27:0/2749256385 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8f80039d0 0x7fa8f8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:51.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa903fff640 1 --2- 172.21.15.27:0/2749256385 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8f80047d0 0x7fa8f8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:51.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90ad9d640 1 -- 172.21.15.27:0/2749256385 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8f80047d0 msgr2=0x7fa8f8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:51.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90ad9d640 1 --2- 172.21.15.27:0/2749256385 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8f80047d0 0x7fa8f8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90ad9d640 1 -- 172.21.15.27:0/2749256385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8f8005190 msgr2=0x7fa8f800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:51.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90ad9d640 1 --2- 172.21.15.27:0/2749256385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8f8005190 0x7fa8f800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90ad9d640 1 -- 172.21.15.27:0/2749256385 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f8003530 con 0x7fa8f80039d0 2024-01-15T11:33:51.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90b59e640 1 --2- 172.21.15.27:0/2749256385 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8f8005190 0x7fa8f800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:51.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.735+0000 7fa90b59e640 1 -- 172.21.15.27:0/2749256385 reap_dead start 2024-01-15T11:33:51.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.739+0000 7fa90ad9d640 1 --2- 172.21.15.27:0/2749256385 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8f80039d0 0x7fa8f8003df0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc009ae0 tx=0x7fa8fc01ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57212be4290dfd86 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:51.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.739+0000 7fa90a59c640 1 -- 172.21.15.27:0/2749256385 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc0a5640 con 0x7fa8f80039d0 2024-01-15T11:33:51.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.739+0000 7fa90a59c640 1 -- 172.21.15.27:0/2749256385 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8fc0a57a0 con 0x7fa8f80039d0 2024-01-15T11:33:51.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.739+0000 7fa90a59c640 1 -- 172.21.15.27:0/2749256385 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc0a5b50 con 0x7fa8f80039d0 2024-01-15T11:33:51.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.739+0000 7fa911180640 1 -- 172.21.15.27:0/2749256385 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8f80039d0 msgr2=0x7fa8f8003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:51.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.739+0000 7fa911180640 1 --2- 172.21.15.27:0/2749256385 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8f80039d0 0x7fa8f8003df0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc009ae0 tx=0x7fa8fc01ca50 comp rx=0 tx=0).stop 2024-01-15T11:33:51.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.739+0000 7fa911180640 1 -- 172.21.15.27:0/2749256385 shutdown_connections 2024-01-15T11:33:51.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.739+0000 7fa911180640 1 --2- 172.21.15.27:0/2749256385 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8f80039d0 0x7fa8f8003df0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.739+0000 7fa911180640 1 -- 172.21.15.27:0/2749256385 >> 172.21.15.27:0/2749256385 conn(0x7fa90c0b0cb0 msgr2=0x7fa90c0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:51.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.739+0000 7fa911180640 1 -- 172.21.15.27:0/2749256385 shutdown_connections 2024-01-15T11:33:51.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.739+0000 7fa911180640 1 -- 172.21.15.27:0/2749256385 wait complete. 2024-01-15T11:33:51.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.743+0000 7fa911180640 1 Processor -- start 2024-01-15T11:33:51.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.743+0000 7fa911180640 1 -- start start 2024-01-15T11:33:51.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.743+0000 7fa911180640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8f80039d0 0x7fa90c0b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:51.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.743+0000 7fa911180640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa90c14f290 0x7fa90c09b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:51.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.743+0000 7fa911180640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa90c09bd00 0x7fa90c09c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:51.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.743+0000 7fa911180640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c0b3560 con 0x7fa8f80039d0 2024-01-15T11:33:51.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.743+0000 7fa911180640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c09c6c0 con 0x7fa90c09bd00 2024-01-15T11:33:51.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.743+0000 7fa911180640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c0b28e0 con 0x7fa90c14f290 2024-01-15T11:33:51.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.743+0000 7fa90ad9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8f80039d0 0x7fa90c0b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:51.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.743+0000 7fa90ad9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8f80039d0 0x7fa90c0b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58724/0 (socket says 172.21.15.27:58724) 2024-01-15T11:33:51.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.743+0000 7fa90ad9d640 1 -- 172.21.15.27:0/682602058 learned_addr learned my addr 172.21.15.27:0/682602058 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:51.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.743+0000 7fa903fff640 1 --2- 172.21.15.27:0/682602058 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa90c14f290 0x7fa90c09b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:51.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.743+0000 7fa90b59e640 1 --2- 172.21.15.27:0/682602058 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa90c09bd00 0x7fa90c09c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:51.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.743+0000 7fa90ad9d640 1 -- 172.21.15.27:0/682602058 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa90c14f290 msgr2=0x7fa90c09b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:51.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.743+0000 7fa90ad9d640 1 --2- 172.21.15.27:0/682602058 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa90c14f290 0x7fa90c09b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.743+0000 7fa90ad9d640 1 -- 172.21.15.27:0/682602058 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa90c09bd00 msgr2=0x7fa90c09c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:51.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.743+0000 7fa90ad9d640 1 --2- 172.21.15.27:0/682602058 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa90c09bd00 0x7fa90c09c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.743+0000 7fa90ad9d640 1 -- 172.21.15.27:0/682602058 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa90c0b2bc0 con 0x7fa8f80039d0 2024-01-15T11:33:51.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.743+0000 7fa90ad9d640 1 --2- 172.21.15.27:0/682602058 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8f80039d0 0x7fa90c0b20b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc01c880 tx=0x7fa8fc0197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:51.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.743+0000 7fa9037fe640 1 -- 172.21.15.27:0/682602058 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc0bd070 con 0x7fa8f80039d0 2024-01-15T11:33:51.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.743+0000 7fa9037fe640 1 -- 172.21.15.27:0/682602058 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8fc004020 con 0x7fa8f80039d0 2024-01-15T11:33:51.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.743+0000 7fa9037fe640 1 -- 172.21.15.27:0/682602058 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc0043d0 con 0x7fa8f80039d0 2024-01-15T11:33:51.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.743+0000 7fa911180640 1 -- 172.21.15.27:0/682602058 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa90c0b2ea0 con 0x7fa8f80039d0 2024-01-15T11:33:51.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.743+0000 7fa911180640 1 -- 172.21.15.27:0/682602058 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa90c0b25f0 con 0x7fa8f80039d0 2024-01-15T11:33:51.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.747+0000 7fa911180640 1 -- 172.21.15.27:0/682602058 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa90c0671f0 con 0x7fa8f80039d0 2024-01-15T11:33:51.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.747+0000 7fa9037fe640 1 -- 172.21.15.27:0/682602058 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fa8fc0b4070 con 0x7fa8f80039d0 2024-01-15T11:33:51.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.747+0000 7fa9037fe640 1 --2- 172.21.15.27:0/682602058 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa8ec0668f0 0x7fa8ec068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:51.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.747+0000 7fa9037fe640 1 -- 172.21.15.27:0/682602058 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8fc11dfe0 con 0x7fa8f80039d0 2024-01-15T11:33:51.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.747+0000 7fa903fff640 1 --2- 172.21.15.27:0/682602058 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa8ec0668f0 0x7fa8ec068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:51.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.747+0000 7fa903fff640 1 --2- 172.21.15.27:0/682602058 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa8ec0668f0 0x7fa8ec068db0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa90c0cb2e0 tx=0x7fa8f4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:51.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.751+0000 7fa9037fe640 1 -- 172.21.15.27:0/682602058 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa8fc0eb370 con 0x7fa8f80039d0 2024-01-15T11:33:51.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.911+0000 7fa911180640 1 -- 172.21.15.27:0/682602058 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa90c06b460 con 0x7fa8f80039d0 2024-01-15T11:33:51.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.911+0000 7fa9037fe640 1 -- 172.21.15.27:0/682602058 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa8fc0ee990 con 0x7fa8f80039d0 2024-01-15T11:33:51.913 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-01-15T11:33:51.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.911+0000 7fa911180640 1 -- 172.21.15.27:0/682602058 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa8ec0668f0 msgr2=0x7fa8ec068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:51.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.911+0000 7fa911180640 1 --2- 172.21.15.27:0/682602058 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa8ec0668f0 0x7fa8ec068db0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa90c0cb2e0 tx=0x7fa8f4009040 comp rx=0 tx=0).stop 2024-01-15T11:33:51.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.911+0000 7fa911180640 1 -- 172.21.15.27:0/682602058 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8f80039d0 msgr2=0x7fa90c0b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:51.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.911+0000 7fa911180640 1 --2- 172.21.15.27:0/682602058 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8f80039d0 0x7fa90c0b20b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc01c880 tx=0x7fa8fc0197f0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.911+0000 7fa911180640 1 -- 172.21.15.27:0/682602058 shutdown_connections 2024-01-15T11:33:51.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.911+0000 7fa911180640 1 --2- 172.21.15.27:0/682602058 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa8ec0668f0 0x7fa8ec068db0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.911+0000 7fa911180640 1 --2- 172.21.15.27:0/682602058 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa90c09bd00 0x7fa90c09c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.911+0000 7fa911180640 1 --2- 172.21.15.27:0/682602058 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa90c14f290 0x7fa90c09b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.911+0000 7fa911180640 1 --2- 172.21.15.27:0/682602058 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa8f80039d0 0x7fa90c0b20b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:51.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.911+0000 7fa911180640 1 -- 172.21.15.27:0/682602058 >> 172.21.15.27:0/682602058 conn(0x7fa90c0b0cb0 msgr2=0x7fa90c0734f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:51.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.911+0000 7fa911180640 1 -- 172.21.15.27:0/682602058 shutdown_connections 2024-01-15T11:33:51.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:51.911+0000 7fa911180640 1 -- 172.21.15.27:0/682602058 wait complete. 2024-01-15T11:33:51.935 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-15T11:33:52.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.075+0000 7f69d3a9a640 1 Processor -- start 2024-01-15T11:33:52.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.075+0000 7f69d3a9a640 1 -- start start 2024-01-15T11:33:52.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.075+0000 7f69d3a9a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f69cc144e60 0x7f69cc0cf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:52.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.075+0000 7f69d3a9a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f69cc070ca0 0x7f69cc070090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:52.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.075+0000 7f69d3a9a640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69cc070a20 con 0x7f69cc0705d0 2024-01-15T11:33:52.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.079+0000 7f69d3a9a640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69cc0d05e0 con 0x7f69cc070ca0 2024-01-15T11:33:52.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.079+0000 7f69d3a9a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc145240 con 0x7f69cc144e60 2024-01-15T11:33:52.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.079+0000 7f69d2037640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f69cc0705d0 0x7f69cc0cd6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:57988/0 (socket says 172.21.15.27:57988) 2024-01-15T11:33:52.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.079+0000 7f69d2037640 1 -- 172.21.15.27:0/1477574185 learned_addr learned my addr 172.21.15.27:0/1477574185 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:52.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.079+0000 7f69d1836640 1 --2- 172.21.15.27:0/1477574185 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f69cc144e60 0x7f69cc0cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:52.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.079+0000 7f69d1035640 1 --2- 172.21.15.27:0/1477574185 >> v2:172.21.15.93:3300/0 conn(0x7f69cc070ca0 0x7f69cc070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:52.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.079+0000 7f69d0834640 1 -- 172.21.15.27:0/1477574185 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 217539082 0 0) 0x7f69c40014a0 con 0x7f69cc0705d0 2024-01-15T11:33:52.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.079+0000 7f69d0834640 1 -- 172.21.15.27:0/1477574185 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69b8003530 con 0x7f69cc0705d0 2024-01-15T11:33:52.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.079+0000 7f69d1836640 1 -- 172.21.15.27:0/1477574185 >> v2:172.21.15.93:3300/0 conn(0x7f69cc070ca0 msgr2=0x7f69cc070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:52.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.079+0000 7f69d1836640 1 --2- 172.21.15.27:0/1477574185 >> v2:172.21.15.93:3300/0 conn(0x7f69cc070ca0 0x7f69cc070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.079+0000 7f69d1836640 1 -- 172.21.15.27:0/1477574185 >> v1:172.21.15.27:6789/0 conn(0x7f69cc0705d0 legacy=0x7f69cc0cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:52.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.079+0000 7f69d1836640 1 -- 172.21.15.27:0/1477574185 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69cc0cf9d0 con 0x7f69cc144e60 2024-01-15T11:33:52.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.079+0000 7f69d1035640 1 --2- 172.21.15.27:0/1477574185 >> v2:172.21.15.93:3300/0 conn(0x7f69cc070ca0 0x7f69cc070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:52.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.079+0000 7f69d1836640 1 --2- 172.21.15.27:0/1477574185 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f69cc144e60 0x7f69cc0cf060 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f69c80097c0 tx=0x7f69c801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73a29f99a4af6dba server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:52.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.083+0000 7f69d0834640 1 -- 172.21.15.27:0/1477574185 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c80ab650 con 0x7f69cc144e60 2024-01-15T11:33:52.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.083+0000 7f69d0834640 1 -- 172.21.15.27:0/1477574185 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c80ab7b0 con 0x7f69cc144e60 2024-01-15T11:33:52.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.083+0000 7f69d0834640 1 -- 172.21.15.27:0/1477574185 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c80abb40 con 0x7f69cc144e60 2024-01-15T11:33:52.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.083+0000 7f69d3a9a640 1 -- 172.21.15.27:0/1477574185 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f69cc144e60 msgr2=0x7f69cc0cf060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:52.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.083+0000 7f69d3a9a640 1 --2- 172.21.15.27:0/1477574185 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f69cc144e60 0x7f69cc0cf060 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f69c80097c0 tx=0x7f69c801c450 comp rx=0 tx=0).stop 2024-01-15T11:33:52.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.083+0000 7f69d3a9a640 1 -- 172.21.15.27:0/1477574185 shutdown_connections 2024-01-15T11:33:52.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.083+0000 7f69d3a9a640 1 --2- 172.21.15.27:0/1477574185 >> v2:172.21.15.93:3300/0 conn(0x7f69cc070ca0 0x7f69cc070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.083+0000 7f69d3a9a640 1 --2- 172.21.15.27:0/1477574185 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f69cc144e60 0x7f69cc0cf060 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.083+0000 7f69d3a9a640 1 -- 172.21.15.27:0/1477574185 >> 172.21.15.27:0/1477574185 conn(0x7f69cc0b2f10 msgr2=0x7f69cc0b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:52.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.083+0000 7f69d3a9a640 1 -- 172.21.15.27:0/1477574185 shutdown_connections 2024-01-15T11:33:52.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.083+0000 7f69d3a9a640 1 -- 172.21.15.27:0/1477574185 wait complete. 2024-01-15T11:33:52.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.083+0000 7f69d3a9a640 1 Processor -- start 2024-01-15T11:33:52.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.083+0000 7f69d3a9a640 1 -- start start 2024-01-15T11:33:52.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.083+0000 7f69d3a9a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69cc0705d0 0x7f69cc154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:52.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.083+0000 7f69d3a9a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f69cc070ca0 0x7f69cc152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:52.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.083+0000 7f69d3a9a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69cc144e60 0x7f69cc1f6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:52.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.083+0000 7f69d3a9a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc1f7810 con 0x7f69cc144e60 2024-01-15T11:33:52.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.083+0000 7f69d3a9a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc1533f0 con 0x7f69cc0705d0 2024-01-15T11:33:52.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.083+0000 7f69d3a9a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc1f6f70 con 0x7f69cc070ca0 2024-01-15T11:33:52.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.087+0000 7f69d2037640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69cc144e60 0x7f69cc1f6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:52.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.087+0000 7f69d2037640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69cc144e60 0x7f69cc1f6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58734/0 (socket says 172.21.15.27:58734) 2024-01-15T11:33:52.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.087+0000 7f69d2037640 1 -- 172.21.15.27:0/3463414361 learned_addr learned my addr 172.21.15.27:0/3463414361 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:52.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.087+0000 7f69d1035640 1 --2- 172.21.15.27:0/3463414361 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f69cc070ca0 0x7f69cc152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:52.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.087+0000 7f69d1836640 1 --2- 172.21.15.27:0/3463414361 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69cc0705d0 0x7f69cc154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:52.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.087+0000 7f69d2037640 1 -- 172.21.15.27:0/3463414361 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f69cc070ca0 msgr2=0x7f69cc152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:52.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.087+0000 7f69d2037640 1 --2- 172.21.15.27:0/3463414361 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f69cc070ca0 0x7f69cc152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.087+0000 7f69d2037640 1 -- 172.21.15.27:0/3463414361 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69cc0705d0 msgr2=0x7f69cc154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:52.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.087+0000 7f69d2037640 1 --2- 172.21.15.27:0/3463414361 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69cc0705d0 0x7f69cc154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.087+0000 7f69d2037640 1 -- 172.21.15.27:0/3463414361 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69bc009420 con 0x7f69cc144e60 2024-01-15T11:33:52.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.087+0000 7f69d2037640 1 --2- 172.21.15.27:0/3463414361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69cc144e60 0x7f69cc1f6620 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f69c400cb70 tx=0x7f69c400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:52.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.087+0000 7f69c27fc640 1 -- 172.21.15.27:0/3463414361 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c400ad40 con 0x7f69cc144e60 2024-01-15T11:33:52.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.087+0000 7f69c27fc640 1 -- 172.21.15.27:0/3463414361 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c4012400 con 0x7f69cc144e60 2024-01-15T11:33:52.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.087+0000 7f69c27fc640 1 -- 172.21.15.27:0/3463414361 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c400aea0 con 0x7f69cc144e60 2024-01-15T11:33:52.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.087+0000 7f69d3a9a640 1 -- 172.21.15.27:0/3463414361 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c8009420 con 0x7f69cc144e60 2024-01-15T11:33:52.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.087+0000 7f69d3a9a640 1 -- 172.21.15.27:0/3463414361 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69cc1f7530 con 0x7f69cc144e60 2024-01-15T11:33:52.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.087+0000 7f69d3a9a640 1 -- 172.21.15.27:0/3463414361 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69cc06b680 con 0x7f69cc144e60 2024-01-15T11:33:52.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.087+0000 7f69c27fc640 1 -- 172.21.15.27:0/3463414361 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f69c4007070 con 0x7f69cc144e60 2024-01-15T11:33:52.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.091+0000 7f69c27fc640 1 --2- 172.21.15.27:0/3463414361 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f69b00668f0 0x7f69b0068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:52.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.091+0000 7f69c27fc640 1 -- 172.21.15.27:0/3463414361 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69c4084170 con 0x7f69cc144e60 2024-01-15T11:33:52.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.091+0000 7f69d1836640 1 --2- 172.21.15.27:0/3463414361 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f69b00668f0 0x7f69b0068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:52.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.091+0000 7f69d1836640 1 --2- 172.21.15.27:0/3463414361 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f69b00668f0 0x7f69b0068db0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f69c80af000 tx=0x7f69c80a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:52.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.095+0000 7f69c27fc640 1 -- 172.21.15.27:0/3463414361 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f69cc06b680 con 0x7f69cc144e60 2024-01-15T11:33:52.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.263+0000 7f69d3a9a640 1 -- 172.21.15.27:0/3463414361 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f69cc070a20 con 0x7f69cc144e60 2024-01-15T11:33:52.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.263+0000 7f69c27fc640 1 -- 172.21.15.27:0/3463414361 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f69cc070a20 con 0x7f69cc144e60 2024-01-15T11:33:52.265 INFO:teuthology.orchestra.run.smithi027.stderr:listed 0 entries 2024-01-15T11:33:52.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.263+0000 7f69d3a9a640 1 -- 172.21.15.27:0/3463414361 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f69b00668f0 msgr2=0x7f69b0068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:52.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.263+0000 7f69d3a9a640 1 --2- 172.21.15.27:0/3463414361 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f69b00668f0 0x7f69b0068db0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f69c80af000 tx=0x7f69c80a7000 comp rx=0 tx=0).stop 2024-01-15T11:33:52.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.263+0000 7f69d3a9a640 1 -- 172.21.15.27:0/3463414361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69cc144e60 msgr2=0x7f69cc1f6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:52.267 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.263+0000 7f69d3a9a640 1 --2- 172.21.15.27:0/3463414361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69cc144e60 0x7f69cc1f6620 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f69c400cb70 tx=0x7f69c400a430 comp rx=0 tx=0).stop 2024-01-15T11:33:52.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.263+0000 7f69d3a9a640 1 -- 172.21.15.27:0/3463414361 shutdown_connections 2024-01-15T11:33:52.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.263+0000 7f69d3a9a640 1 --2- 172.21.15.27:0/3463414361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69cc144e60 0x7f69cc1f6620 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.263+0000 7f69d3a9a640 1 --2- 172.21.15.27:0/3463414361 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f69cc070ca0 0x7f69cc152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.263+0000 7f69d3a9a640 1 --2- 172.21.15.27:0/3463414361 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f69b00668f0 0x7f69b0068db0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.263+0000 7f69d3a9a640 1 --2- 172.21.15.27:0/3463414361 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69cc0705d0 0x7f69cc154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.263+0000 7f69d3a9a640 1 -- 172.21.15.27:0/3463414361 >> 172.21.15.27:0/3463414361 conn(0x7f69cc0b2f10 msgr2=0x7f69cc15baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:52.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.263+0000 7f69d3a9a640 1 -- 172.21.15.27:0/3463414361 shutdown_connections 2024-01-15T11:33:52.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.263+0000 7f69d3a9a640 1 -- 172.21.15.27:0/3463414361 wait complete. 2024-01-15T11:33:52.286 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-15T11:33:52.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:52.287 DEBUG:teuthology.orchestra.run.smithi027:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-01-15T11:33:52.325 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi027.front.sepia.ceph.com 2024-01-15T11:33:52.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:52.326 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-15T11:33:52.379 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:33:52.379 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T11:33:52.390 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:33:52.390 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T11:33:52.443 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:33:52.443 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T11:33:52.495 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:33:52.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.635+0000 7f5b9372a640 1 Processor -- start 2024-01-15T11:33:52.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.635+0000 7f5b9372a640 1 -- start start 2024-01-15T11:33:52.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.635+0000 7f5b9372a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5b8c0cead0 0x7f5b8c0d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:52.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.635+0000 7f5b9372a640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8c0d22c0 con 0x7f5b8c15d7b0 2024-01-15T11:33:52.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.635+0000 7f5b9372a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8c0cefd0 con 0x7f5b8c0d1eb0 2024-01-15T11:33:52.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.635+0000 7f5b9372a640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b8c0d17e0 con 0x7f5b8c0cead0 2024-01-15T11:33:52.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.635+0000 7f5b914c6640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f5b8c15d7b0 0x7f5b8c0d10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:58002/0 (socket says 172.21.15.27:58002) 2024-01-15T11:33:52.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.635+0000 7f5b914c6640 1 -- 172.21.15.27:0/445003541 learned_addr learned my addr 172.21.15.27:0/445003541 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:52.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.635+0000 7f5b83fff640 1 -- 172.21.15.27:0/445003541 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22842965 0 0) 0x7f5b8c0d22c0 con 0x7f5b8c15d7b0 2024-01-15T11:33:52.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.635+0000 7f5b90cc5640 1 --2- 172.21.15.27:0/445003541 >> v2:172.21.15.93:3300/0 conn(0x7f5b8c0cead0 0x7f5b8c0d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:52.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.635+0000 7f5b83fff640 1 -- 172.21.15.27:0/445003541 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b78003530 con 0x7f5b8c15d7b0 2024-01-15T11:33:52.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.635+0000 7f5b83fff640 1 -- 172.21.15.27:0/445003541 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1212908639 0 0) 0x7f5b78003530 con 0x7f5b8c15d7b0 2024-01-15T11:33:52.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.635+0000 7f5b83fff640 1 -- 172.21.15.27:0/445003541 >> v2:172.21.15.93:3300/0 conn(0x7f5b8c0cead0 msgr2=0x7f5b8c0d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:52.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.635+0000 7f5b83fff640 1 --2- 172.21.15.27:0/445003541 >> v2:172.21.15.93:3300/0 conn(0x7f5b8c0cead0 0x7f5b8c0d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.635+0000 7f5b83fff640 1 -- 172.21.15.27:0/445003541 >> v1:172.21.15.93:6789/0 conn(0x7f5b8c0d1eb0 legacy=0x7f5b8c06bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:52.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.635+0000 7f5b83fff640 1 -- 172.21.15.27:0/445003541 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8c0cf2b0 con 0x7f5b8c15d7b0 2024-01-15T11:33:52.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.635+0000 7f5b83fff640 1 -- 172.21.15.27:0/445003541 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1394381265 0 0) 0x7f5b88001680 con 0x7f5b8c15d7b0 2024-01-15T11:33:52.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.635+0000 7f5b83fff640 1 -- 172.21.15.27:0/445003541 >> v1:172.21.15.27:6789/0 conn(0x7f5b8c15d7b0 legacy=0x7f5b8c0d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:52.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.635+0000 7f5b83fff640 1 --2- 172.21.15.27:0/445003541 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5b780039d0 0x7f5b78003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:52.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.635+0000 7f5b83fff640 1 --2- 172.21.15.27:0/445003541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b780047d0 0x7f5b78004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:52.643 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.635+0000 7f5b83fff640 1 --2- 172.21.15.27:0/445003541 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b780052b0 0x7f5b7800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:52.643 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.635+0000 7f5b83fff640 1 -- 172.21.15.27:0/445003541 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c0d17e0 con 0x7f5b780047d0 2024-01-15T11:33:52.643 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.635+0000 7f5b83fff640 1 -- 172.21.15.27:0/445003541 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7800c1b0 con 0x7f5b780052b0 2024-01-15T11:33:52.643 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.635+0000 7f5b83fff640 1 -- 172.21.15.27:0/445003541 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7800c370 con 0x7f5b780039d0 2024-01-15T11:33:52.643 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.635+0000 7f5b90cc5640 1 --2- 172.21.15.27:0/445003541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b780047d0 0x7f5b78004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:52.643 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.639+0000 7f5b914c6640 1 --2- 172.21.15.27:0/445003541 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5b780039d0 0x7f5b78003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:52.643 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.639+0000 7f5b91cc7640 1 --2- 172.21.15.27:0/445003541 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b780052b0 0x7f5b7800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:52.643 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.639+0000 7f5b90cc5640 1 -- 172.21.15.27:0/445003541 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5b780039d0 msgr2=0x7f5b78003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:52.643 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.639+0000 7f5b90cc5640 1 --2- 172.21.15.27:0/445003541 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5b780039d0 0x7f5b78003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.639+0000 7f5b90cc5640 1 -- 172.21.15.27:0/445003541 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b780052b0 msgr2=0x7f5b7800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:52.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.639+0000 7f5b90cc5640 1 --2- 172.21.15.27:0/445003541 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b780052b0 0x7f5b7800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.639+0000 7f5b90cc5640 1 -- 172.21.15.27:0/445003541 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b78003530 con 0x7f5b780047d0 2024-01-15T11:33:52.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.639+0000 7f5b91cc7640 1 -- 172.21.15.27:0/445003541 reap_dead start 2024-01-15T11:33:52.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.639+0000 7f5b90cc5640 1 --2- 172.21.15.27:0/445003541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b780047d0 0x7f5b78004c50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009ab0 tx=0x7f5b7c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e99839566b6f159 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:52.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.639+0000 7f5b83fff640 1 -- 172.21.15.27:0/445003541 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0a64f0 con 0x7f5b780047d0 2024-01-15T11:33:52.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.639+0000 7f5b83fff640 1 -- 172.21.15.27:0/445003541 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7c0a6650 con 0x7f5b780047d0 2024-01-15T11:33:52.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.639+0000 7f5b83fff640 1 -- 172.21.15.27:0/445003541 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0a6a00 con 0x7f5b780047d0 2024-01-15T11:33:52.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b9372a640 1 -- 172.21.15.27:0/445003541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b780047d0 msgr2=0x7f5b78004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:52.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b9372a640 1 --2- 172.21.15.27:0/445003541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b780047d0 0x7f5b78004c50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009ab0 tx=0x7f5b7c01ca00 comp rx=0 tx=0).stop 2024-01-15T11:33:52.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b9372a640 1 -- 172.21.15.27:0/445003541 shutdown_connections 2024-01-15T11:33:52.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b9372a640 1 --2- 172.21.15.27:0/445003541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b780047d0 0x7f5b78004c50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b9372a640 1 -- 172.21.15.27:0/445003541 >> 172.21.15.27:0/445003541 conn(0x7f5b8c0d33b0 msgr2=0x7f5b8c0d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:52.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b9372a640 1 -- 172.21.15.27:0/445003541 shutdown_connections 2024-01-15T11:33:52.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b9372a640 1 -- 172.21.15.27:0/445003541 wait complete. 2024-01-15T11:33:52.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b9372a640 1 Processor -- start 2024-01-15T11:33:52.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b9372a640 1 -- start start 2024-01-15T11:33:52.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b9372a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b780047d0 0x7f5b8c0ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:52.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b9372a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b8c157c60 0x7f5b8c157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:52.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b9372a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5b8c0cb770 0x7f5b8c0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:52.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b9372a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c0ca480 con 0x7f5b8c157c60 2024-01-15T11:33:52.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b9372a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c0ca6d0 con 0x7f5b780047d0 2024-01-15T11:33:52.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b9372a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c0ca9b0 con 0x7f5b8c0cb770 2024-01-15T11:33:52.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b90cc5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b8c157c60 0x7f5b8c157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:52.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b90cc5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b8c157c60 0x7f5b8c157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58752/0 (socket says 172.21.15.27:58752) 2024-01-15T11:33:52.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b90cc5640 1 -- 172.21.15.27:0/2570986902 learned_addr learned my addr 172.21.15.27:0/2570986902 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:52.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b914c6640 1 --2- 172.21.15.27:0/2570986902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b780047d0 0x7f5b8c0ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:52.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b91cc7640 1 --2- 172.21.15.27:0/2570986902 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5b8c0cb770 0x7f5b8c0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:52.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b90cc5640 1 -- 172.21.15.27:0/2570986902 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5b8c0cb770 msgr2=0x7f5b8c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:52.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b90cc5640 1 --2- 172.21.15.27:0/2570986902 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5b8c0cb770 0x7f5b8c0c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b90cc5640 1 -- 172.21.15.27:0/2570986902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b780047d0 msgr2=0x7f5b8c0ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:52.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b90cc5640 1 --2- 172.21.15.27:0/2570986902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b780047d0 0x7f5b8c0ccef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b90cc5640 1 -- 172.21.15.27:0/2570986902 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8c0cac90 con 0x7f5b8c157c60 2024-01-15T11:33:52.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b91cc7640 1 --2- 172.21.15.27:0/2570986902 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5b8c0cb770 0x7f5b8c0c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:52.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.643+0000 7f5b914c6640 1 --2- 172.21.15.27:0/2570986902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b780047d0 0x7f5b8c0ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:52.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.647+0000 7f5b90cc5640 1 --2- 172.21.15.27:0/2570986902 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b8c157c60 0x7f5b8c157410 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0b0040 tx=0x7f5b7c0197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:52.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.647+0000 7f5b81ffb640 1 -- 172.21.15.27:0/2570986902 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0a64f0 con 0x7f5b8c157c60 2024-01-15T11:33:52.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.647+0000 7f5b81ffb640 1 -- 172.21.15.27:0/2570986902 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7c0a67c0 con 0x7f5b8c157c60 2024-01-15T11:33:52.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.647+0000 7f5b81ffb640 1 -- 172.21.15.27:0/2570986902 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0a6b30 con 0x7f5b8c157c60 2024-01-15T11:33:52.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.647+0000 7f5b9372a640 1 -- 172.21.15.27:0/2570986902 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b8c0caf70 con 0x7f5b8c157c60 2024-01-15T11:33:52.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.647+0000 7f5b9372a640 1 -- 172.21.15.27:0/2570986902 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b8c157950 con 0x7f5b8c157c60 2024-01-15T11:33:52.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.647+0000 7f5b9372a640 1 -- 172.21.15.27:0/2570986902 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b8c04e850 con 0x7f5b8c157c60 2024-01-15T11:33:52.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.647+0000 7f5b81ffb640 1 -- 172.21.15.27:0/2570986902 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f5b7c0a6c90 con 0x7f5b8c157c60 2024-01-15T11:33:52.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.647+0000 7f5b81ffb640 1 --2- 172.21.15.27:0/2570986902 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5b70066920 0x7f5b70068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:52.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.647+0000 7f5b81ffb640 1 -- 172.21.15.27:0/2570986902 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b7c0aa070 con 0x7f5b8c157c60 2024-01-15T11:33:52.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.647+0000 7f5b914c6640 1 --2- 172.21.15.27:0/2570986902 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5b70066920 0x7f5b70068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:52.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.651+0000 7f5b914c6640 1 --2- 172.21.15.27:0/2570986902 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5b70066920 0x7f5b70068de0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5b88000c10 tx=0x7f5b88009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:52.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.651+0000 7f5b81ffb640 1 -- 172.21.15.27:0/2570986902 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5b7c0efaa0 con 0x7f5b8c157c60 2024-01-15T11:33:52.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.819+0000 7f5b9372a640 1 -- 172.21.15.27:0/2570986902 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b8c0d3b10 con 0x7f5b8c157c60 2024-01-15T11:33:52.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.819+0000 7f5b81ffb640 1 -- 172.21.15.27:0/2570986902 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16425 (secure 0 0 0) 0x7f5b7c0ef630 con 0x7f5b8c157c60 2024-01-15T11:33:52.823 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:52.823 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:33:21.682894+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T11:33:18.397200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T11:33:19.061383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:33:52.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.823+0000 7f5b9372a640 1 -- 172.21.15.27:0/2570986902 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5b70066920 msgr2=0x7f5b70068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:52.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.823+0000 7f5b9372a640 1 --2- 172.21.15.27:0/2570986902 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5b70066920 0x7f5b70068de0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5b88000c10 tx=0x7f5b88009040 comp rx=0 tx=0).stop 2024-01-15T11:33:52.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.823+0000 7f5b9372a640 1 -- 172.21.15.27:0/2570986902 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b8c157c60 msgr2=0x7f5b8c157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:52.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.823+0000 7f5b9372a640 1 --2- 172.21.15.27:0/2570986902 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b8c157c60 0x7f5b8c157410 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0b0040 tx=0x7f5b7c0197a0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.823+0000 7f5b9372a640 1 -- 172.21.15.27:0/2570986902 shutdown_connections 2024-01-15T11:33:52.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.823+0000 7f5b9372a640 1 --2- 172.21.15.27:0/2570986902 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5b8c0cb770 0x7f5b8c0c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.823+0000 7f5b9372a640 1 --2- 172.21.15.27:0/2570986902 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b8c157c60 0x7f5b8c157410 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.823+0000 7f5b9372a640 1 --2- 172.21.15.27:0/2570986902 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5b70066920 0x7f5b70068de0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.823+0000 7f5b9372a640 1 --2- 172.21.15.27:0/2570986902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b780047d0 0x7f5b8c0ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.823+0000 7f5b9372a640 1 -- 172.21.15.27:0/2570986902 >> 172.21.15.27:0/2570986902 conn(0x7f5b8c0d33b0 msgr2=0x7f5b8c0cf4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:52.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.823+0000 7f5b9372a640 1 -- 172.21.15.27:0/2570986902 shutdown_connections 2024-01-15T11:33:52.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.823+0000 7f5b9372a640 1 -- 172.21.15.27:0/2570986902 wait complete. 2024-01-15T11:33:52.844 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T11:33:08.134662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-15T11:33:18.397200+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-15T11:33:19.061383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T11:33:52.845 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T11:33:52.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.987+0000 7ff42bf57640 1 Processor -- start 2024-01-15T11:33:52.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.987+0000 7ff42bf57640 1 -- start start 2024-01-15T11:33:52.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.991+0000 7ff42bf57640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4240cdfb0 0x7ff4240abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:52.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.991+0000 7ff42bf57640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff42415a710 0x7ff4240ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:52.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.991+0000 7ff42bf57640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff4240cbd50 0x7ff4240cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:52.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.991+0000 7ff42bf57640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4240cca80 con 0x7ff4240cbd50 2024-01-15T11:33:52.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.991+0000 7ff42bf57640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4240ce8d0 con 0x7ff42415a710 2024-01-15T11:33:52.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.991+0000 7ff42bf57640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4240b2710 con 0x7ff4240cdfb0 2024-01-15T11:33:52.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.991+0000 7ff42a4f4640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff4240cbd50 0x7ff4240cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:52.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.991+0000 7ff42a4f4640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff4240cbd50 0x7ff4240cc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58758/0 (socket says 172.21.15.27:58758) 2024-01-15T11:33:52.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.991+0000 7ff42a4f4640 1 -- 172.21.15.27:0/111968215 learned_addr learned my addr 172.21.15.27:0/111968215 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:52.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.991+0000 7ff429cf3640 1 --2- 172.21.15.27:0/111968215 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4240cdfb0 0x7ff4240abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:52.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.991+0000 7ff4294f2640 1 --2- 172.21.15.27:0/111968215 >> v2:172.21.15.93:3300/0 conn(0x7ff42415a710 0x7ff4240ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:52.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.991+0000 7ff42a4f4640 1 -- 172.21.15.27:0/111968215 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4240cdfb0 msgr2=0x7ff4240abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:52.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.991+0000 7ff42a4f4640 1 --2- 172.21.15.27:0/111968215 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4240cdfb0 0x7ff4240abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.991+0000 7ff42a4f4640 1 -- 172.21.15.27:0/111968215 >> v2:172.21.15.93:3300/0 conn(0x7ff42415a710 msgr2=0x7ff4240ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:52.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.991+0000 7ff42a4f4640 1 --2- 172.21.15.27:0/111968215 >> v2:172.21.15.93:3300/0 conn(0x7ff42415a710 0x7ff4240ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.991+0000 7ff42a4f4640 1 -- 172.21.15.27:0/111968215 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4240b29f0 con 0x7ff4240cbd50 2024-01-15T11:33:52.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.991+0000 7ff429cf3640 1 --2- 172.21.15.27:0/111968215 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4240cdfb0 0x7ff4240abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:52.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.995+0000 7ff42a4f4640 1 --2- 172.21.15.27:0/111968215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4240cbd50 0x7ff4240cc1e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff424074340 tx=0x7ff41c01ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9987ce03dfb0022f server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:52.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.995+0000 7ff428cf1640 1 -- 172.21.15.27:0/111968215 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c0a7a40 con 0x7ff4240cbd50 2024-01-15T11:33:52.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.995+0000 7ff428cf1640 1 -- 172.21.15.27:0/111968215 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41c0a7ba0 con 0x7ff4240cbd50 2024-01-15T11:33:52.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.995+0000 7ff428cf1640 1 -- 172.21.15.27:0/111968215 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c0af3f0 con 0x7ff4240cbd50 2024-01-15T11:33:52.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.995+0000 7ff42bf57640 1 -- 172.21.15.27:0/111968215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4240cbd50 msgr2=0x7ff4240cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:52.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.995+0000 7ff42bf57640 1 --2- 172.21.15.27:0/111968215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4240cbd50 0x7ff4240cc1e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff424074340 tx=0x7ff41c01ebb0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.995+0000 7ff42bf57640 1 -- 172.21.15.27:0/111968215 shutdown_connections 2024-01-15T11:33:52.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.995+0000 7ff42bf57640 1 --2- 172.21.15.27:0/111968215 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4240cbd50 0x7ff4240cc1e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.995+0000 7ff42bf57640 1 --2- 172.21.15.27:0/111968215 >> v2:172.21.15.93:3300/0 conn(0x7ff42415a710 0x7ff4240ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.995+0000 7ff42bf57640 1 --2- 172.21.15.27:0/111968215 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4240cdfb0 0x7ff4240abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:52.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.995+0000 7ff42bf57640 1 -- 172.21.15.27:0/111968215 >> 172.21.15.27:0/111968215 conn(0x7ff4240b0cb0 msgr2=0x7ff4240b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:52.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.995+0000 7ff42bf57640 1 -- 172.21.15.27:0/111968215 shutdown_connections 2024-01-15T11:33:52.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.995+0000 7ff42bf57640 1 -- 172.21.15.27:0/111968215 wait complete. 2024-01-15T11:33:53.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.995+0000 7ff42bf57640 1 Processor -- start 2024-01-15T11:33:53.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.995+0000 7ff42bf57640 1 -- start start 2024-01-15T11:33:53.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.999+0000 7ff42bf57640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4240cbd50 0x7ff424156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:53.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.999+0000 7ff42bf57640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4240cdfb0 0x7ff42414fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:53.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.999+0000 7ff42bf57640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff42415a710 0x7ff42415d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:53.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.999+0000 7ff42bf57640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42415b1a0 con 0x7ff4240cbd50 2024-01-15T11:33:53.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.999+0000 7ff42bf57640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42415cf20 con 0x7ff42415a710 2024-01-15T11:33:53.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.999+0000 7ff42bf57640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42415c630 con 0x7ff4240cdfb0 2024-01-15T11:33:53.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.999+0000 7ff429cf3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4240cbd50 0x7ff424156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:53.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.999+0000 7ff429cf3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4240cbd50 0x7ff424156360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58766/0 (socket says 172.21.15.27:58766) 2024-01-15T11:33:53.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.999+0000 7ff429cf3640 1 -- 172.21.15.27:0/891361270 learned_addr learned my addr 172.21.15.27:0/891361270 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:53.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.999+0000 7ff42a4f4640 1 --2- 172.21.15.27:0/891361270 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff42415a710 0x7ff42415d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:53.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.999+0000 7ff4294f2640 1 --2- 172.21.15.27:0/891361270 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4240cdfb0 0x7ff42414fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:53.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.999+0000 7ff429cf3640 1 -- 172.21.15.27:0/891361270 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4240cdfb0 msgr2=0x7ff42414fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:53.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.999+0000 7ff429cf3640 1 --2- 172.21.15.27:0/891361270 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4240cdfb0 0x7ff42414fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.999+0000 7ff429cf3640 1 -- 172.21.15.27:0/891361270 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff42415a710 msgr2=0x7ff42415d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:53.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.999+0000 7ff429cf3640 1 --2- 172.21.15.27:0/891361270 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff42415a710 0x7ff42415d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.999+0000 7ff429cf3640 1 -- 172.21.15.27:0/891361270 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c009b30 con 0x7ff4240cbd50 2024-01-15T11:33:53.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.999+0000 7ff429cf3640 1 --2- 172.21.15.27:0/891361270 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4240cbd50 0x7ff424156360 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff42000e810 tx=0x7ff42000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:53.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.999+0000 7ff41a7fc640 1 -- 172.21.15.27:0/891361270 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42000c8d0 con 0x7ff4240cbd50 2024-01-15T11:33:53.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.999+0000 7ff41a7fc640 1 -- 172.21.15.27:0/891361270 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42000ca30 con 0x7ff4240cbd50 2024-01-15T11:33:53.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.999+0000 7ff41a7fc640 1 -- 172.21.15.27:0/891361270 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42000cdc0 con 0x7ff4240cbd50 2024-01-15T11:33:53.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.999+0000 7ff42bf57640 1 -- 172.21.15.27:0/891361270 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff424152b00 con 0x7ff4240cbd50 2024-01-15T11:33:53.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.999+0000 7ff42bf57640 1 -- 172.21.15.27:0/891361270 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42415c8d0 con 0x7ff4240cbd50 2024-01-15T11:33:53.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.999+0000 7ff42bf57640 1 -- 172.21.15.27:0/891361270 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4240671f0 con 0x7ff4240cbd50 2024-01-15T11:33:53.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:52.999+0000 7ff41a7fc640 1 -- 172.21.15.27:0/891361270 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7ff420013410 con 0x7ff4240cbd50 2024-01-15T11:33:53.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.003+0000 7ff41a7fc640 1 --2- 172.21.15.27:0/891361270 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff4080668f0 0x7ff408068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:53.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.003+0000 7ff41a7fc640 1 -- 172.21.15.27:0/891361270 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff420084170 con 0x7ff4240cbd50 2024-01-15T11:33:53.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.003+0000 7ff4294f2640 1 --2- 172.21.15.27:0/891361270 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff4080668f0 0x7ff408068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:53.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.003+0000 7ff4294f2640 1 --2- 172.21.15.27:0/891361270 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff4080668f0 0x7ff408068db0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff424152d50 tx=0x7ff414008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:53.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.007+0000 7ff41a7fc640 1 -- 172.21.15.27:0/891361270 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff420051450 con 0x7ff4240cbd50 2024-01-15T11:33:53.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.163+0000 7ff42bf57640 1 -- 172.21.15.27:0/891361270 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff42406b460 con 0x7ff4240cbd50 2024-01-15T11:33:53.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.163+0000 7ff41a7fc640 1 -- 172.21.15.27:0/891361270 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff420009480 con 0x7ff4240cbd50 2024-01-15T11:33:53.167 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-15T11:33:53.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.167+0000 7ff42bf57640 1 -- 172.21.15.27:0/891361270 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff4080668f0 msgr2=0x7ff408068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:53.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.167+0000 7ff42bf57640 1 --2- 172.21.15.27:0/891361270 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff4080668f0 0x7ff408068db0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff424152d50 tx=0x7ff414008040 comp rx=0 tx=0).stop 2024-01-15T11:33:53.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.167+0000 7ff42bf57640 1 -- 172.21.15.27:0/891361270 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4240cbd50 msgr2=0x7ff424156360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:53.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.167+0000 7ff42bf57640 1 --2- 172.21.15.27:0/891361270 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4240cbd50 0x7ff424156360 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff42000e810 tx=0x7ff42000ecd0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.167+0000 7ff42bf57640 1 -- 172.21.15.27:0/891361270 shutdown_connections 2024-01-15T11:33:53.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.167+0000 7ff42bf57640 1 --2- 172.21.15.27:0/891361270 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff4080668f0 0x7ff408068db0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.167+0000 7ff42bf57640 1 --2- 172.21.15.27:0/891361270 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff42415a710 0x7ff42415d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.167+0000 7ff42bf57640 1 --2- 172.21.15.27:0/891361270 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4240cdfb0 0x7ff42414fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.167+0000 7ff42bf57640 1 --2- 172.21.15.27:0/891361270 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4240cbd50 0x7ff424156360 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.167+0000 7ff42bf57640 1 -- 172.21.15.27:0/891361270 >> 172.21.15.27:0/891361270 conn(0x7ff4240b0cb0 msgr2=0x7ff4240b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:53.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.167+0000 7ff42bf57640 1 -- 172.21.15.27:0/891361270 shutdown_connections 2024-01-15T11:33:53.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.167+0000 7ff42bf57640 1 -- 172.21.15.27:0/891361270 wait complete. 2024-01-15T11:33:53.188 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-15T11:33:53.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.331+0000 7f21b93c4640 1 Processor -- start 2024-01-15T11:33:53.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.331+0000 7f21b93c4640 1 -- start start 2024-01-15T11:33:53.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.331+0000 7f21b93c4640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f21b40cb9b0 0x7f21b406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:53.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.331+0000 7f21b93c4640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f21b40ce5d0 0x7f21b415bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:53.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.331+0000 7f21b93c4640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b4159630 con 0x7f21b40cbd90 2024-01-15T11:33:53.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.331+0000 7f21b93c4640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b415bba0 con 0x7f21b40ce5d0 2024-01-15T11:33:53.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.331+0000 7f21b93c4640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b40cdd50 con 0x7f21b40cb9b0 2024-01-15T11:33:53.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.331+0000 7f21b37fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f21b40ce5d0 0x7f21b415bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:53.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.331+0000 7f21abfff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f21b40cbd90 0x7f21b415f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:58016/0 (socket says 172.21.15.27:58016) 2024-01-15T11:33:53.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.331+0000 7f21abfff640 1 -- 172.21.15.27:0/3410469943 learned_addr learned my addr 172.21.15.27:0/3410469943 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:53.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.335+0000 7f21b2ffd640 1 --2- 172.21.15.27:0/3410469943 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f21b40cb9b0 0x7f21b406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:53.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.335+0000 7f21b37fe640 1 -- 172.21.15.27:0/3410469943 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f21b40cb9b0 msgr2=0x7f21b406e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:53.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.335+0000 7f21b37fe640 1 --2- 172.21.15.27:0/3410469943 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f21b40cb9b0 0x7f21b406e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.335+0000 7f21b37fe640 1 -- 172.21.15.27:0/3410469943 >> v1:172.21.15.27:6789/0 conn(0x7f21b40cbd90 legacy=0x7f21b415f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:53.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.335+0000 7f21b37fe640 1 -- 172.21.15.27:0/3410469943 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b40cd1d0 con 0x7f21b40ce5d0 2024-01-15T11:33:53.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.335+0000 7f21b2ffd640 1 --2- 172.21.15.27:0/3410469943 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f21b40cb9b0 0x7f21b406e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:53.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.335+0000 7f21b37fe640 1 --2- 172.21.15.27:0/3410469943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21b40ce5d0 0x7f21b415bfd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f21ac009d90 tx=0x7f21ac01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8994dffe73aa53bc server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:53.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.335+0000 7f21b27fc640 1 -- 172.21.15.27:0/3410469943 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac0a59c0 con 0x7f21b40ce5d0 2024-01-15T11:33:53.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.335+0000 7f21b27fc640 1 -- 172.21.15.27:0/3410469943 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ac0a5b20 con 0x7f21b40ce5d0 2024-01-15T11:33:53.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.335+0000 7f21b27fc640 1 -- 172.21.15.27:0/3410469943 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac0ad440 con 0x7f21b40ce5d0 2024-01-15T11:33:53.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b93c4640 1 -- 172.21.15.27:0/3410469943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21b40ce5d0 msgr2=0x7f21b415bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:53.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b93c4640 1 --2- 172.21.15.27:0/3410469943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21b40ce5d0 0x7f21b415bfd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f21ac009d90 tx=0x7f21ac01c920 comp rx=0 tx=0).stop 2024-01-15T11:33:53.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b93c4640 1 -- 172.21.15.27:0/3410469943 shutdown_connections 2024-01-15T11:33:53.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b93c4640 1 --2- 172.21.15.27:0/3410469943 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21b40ce5d0 0x7f21b415bfd0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b93c4640 1 --2- 172.21.15.27:0/3410469943 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f21b40cb9b0 0x7f21b406e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b93c4640 1 -- 172.21.15.27:0/3410469943 >> 172.21.15.27:0/3410469943 conn(0x7f21b40b0cb0 msgr2=0x7f21b40b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:53.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b93c4640 1 -- 172.21.15.27:0/3410469943 shutdown_connections 2024-01-15T11:33:53.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b93c4640 1 -- 172.21.15.27:0/3410469943 wait complete. 2024-01-15T11:33:53.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b93c4640 1 Processor -- start 2024-01-15T11:33:53.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b93c4640 1 -- start start 2024-01-15T11:33:53.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b93c4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21b40cb9b0 0x7f21b4142a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:53.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b93c4640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f21b40cbd90 0x7f21b4153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:53.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b93c4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21b40ce5d0 0x7f21b4143320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:53.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b93c4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b4142f90 con 0x7f21b40cb9b0 2024-01-15T11:33:53.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b93c4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b4154420 con 0x7f21b40ce5d0 2024-01-15T11:33:53.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b93c4640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b4154700 con 0x7f21b40cbd90 2024-01-15T11:33:53.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b2ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21b40cb9b0 0x7f21b4142a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:53.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b2ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21b40cb9b0 0x7f21b4142a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58774/0 (socket says 172.21.15.27:58774) 2024-01-15T11:33:53.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b2ffd640 1 -- 172.21.15.27:0/3973221936 learned_addr learned my addr 172.21.15.27:0/3973221936 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:53.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21abfff640 1 --2- 172.21.15.27:0/3973221936 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f21b40cbd90 0x7f21b4153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:53.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b37fe640 1 --2- 172.21.15.27:0/3973221936 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21b40ce5d0 0x7f21b4143320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:53.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b2ffd640 1 -- 172.21.15.27:0/3973221936 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f21b40cbd90 msgr2=0x7f21b4153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:53.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b2ffd640 1 --2- 172.21.15.27:0/3973221936 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f21b40cbd90 0x7f21b4153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b2ffd640 1 -- 172.21.15.27:0/3973221936 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21b40ce5d0 msgr2=0x7f21b4143320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:53.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b2ffd640 1 --2- 172.21.15.27:0/3973221936 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21b40ce5d0 0x7f21b4143320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b2ffd640 1 -- 172.21.15.27:0/3973221936 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ac009a70 con 0x7f21b40cb9b0 2024-01-15T11:33:53.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.339+0000 7f21b2ffd640 1 --2- 172.21.15.27:0/3973221936 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21b40cb9b0 0x7f21b4142a50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f21a400e810 tx=0x7f21a400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:53.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.343+0000 7f21ab7fe640 1 -- 172.21.15.27:0/3973221936 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a400c8d0 con 0x7f21b40cb9b0 2024-01-15T11:33:53.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.343+0000 7f21ab7fe640 1 -- 172.21.15.27:0/3973221936 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a400ca30 con 0x7f21b40cb9b0 2024-01-15T11:33:53.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.343+0000 7f21b93c4640 1 -- 172.21.15.27:0/3973221936 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b41549e0 con 0x7f21b40cb9b0 2024-01-15T11:33:53.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.343+0000 7f21ab7fe640 1 -- 172.21.15.27:0/3973221936 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a400cde0 con 0x7f21b40cb9b0 2024-01-15T11:33:53.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.343+0000 7f21b93c4640 1 -- 172.21.15.27:0/3973221936 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b4154fa0 con 0x7f21b40cb9b0 2024-01-15T11:33:53.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.343+0000 7f21b93c4640 1 -- 172.21.15.27:0/3973221936 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b40671f0 con 0x7f21b40cb9b0 2024-01-15T11:33:53.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.343+0000 7f21ab7fe640 1 -- 172.21.15.27:0/3973221936 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f21a4013410 con 0x7f21b40cb9b0 2024-01-15T11:33:53.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.343+0000 7f21ab7fe640 1 --2- 172.21.15.27:0/3973221936 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f21940668f0 0x7f2194068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:53.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.343+0000 7f21ab7fe640 1 -- 172.21.15.27:0/3973221936 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21a4084280 con 0x7f21b40cb9b0 2024-01-15T11:33:53.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.343+0000 7f21abfff640 1 --2- 172.21.15.27:0/3973221936 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f21940668f0 0x7f2194068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:53.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.347+0000 7f21abfff640 1 --2- 172.21.15.27:0/3973221936 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f21940668f0 0x7f2194068db0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f21b415b490 tx=0x7f219c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:53.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.347+0000 7f21ab7fe640 1 -- 172.21.15.27:0/3973221936 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f21a4051430 con 0x7f21b40cb9b0 2024-01-15T11:33:53.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.507+0000 7f21b93c4640 1 -- 172.21.15.27:0/3973221936 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f21b406b460 con 0x7f21b40cb9b0 2024-01-15T11:33:53.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.507+0000 7f21ab7fe640 1 -- 172.21.15.27:0/3973221936 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f21a4054a50 con 0x7f21b40cb9b0 2024-01-15T11:33:53.511 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-01-15T11:33:53.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.511+0000 7f21b93c4640 1 -- 172.21.15.27:0/3973221936 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f21940668f0 msgr2=0x7f2194068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:53.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.511+0000 7f21b93c4640 1 --2- 172.21.15.27:0/3973221936 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f21940668f0 0x7f2194068db0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f21b415b490 tx=0x7f219c009040 comp rx=0 tx=0).stop 2024-01-15T11:33:53.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.511+0000 7f21b93c4640 1 -- 172.21.15.27:0/3973221936 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21b40cb9b0 msgr2=0x7f21b4142a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:53.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.511+0000 7f21b93c4640 1 --2- 172.21.15.27:0/3973221936 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21b40cb9b0 0x7f21b4142a50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f21a400e810 tx=0x7f21a400ecd0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.511+0000 7f21b93c4640 1 -- 172.21.15.27:0/3973221936 shutdown_connections 2024-01-15T11:33:53.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.511+0000 7f21b93c4640 1 --2- 172.21.15.27:0/3973221936 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f21940668f0 0x7f2194068db0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.511+0000 7f21b93c4640 1 --2- 172.21.15.27:0/3973221936 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21b40ce5d0 0x7f21b4143320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.511+0000 7f21b93c4640 1 --2- 172.21.15.27:0/3973221936 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f21b40cbd90 0x7f21b4153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.511+0000 7f21b93c4640 1 --2- 172.21.15.27:0/3973221936 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21b40cb9b0 0x7f21b4142a50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.511+0000 7f21b93c4640 1 -- 172.21.15.27:0/3973221936 >> 172.21.15.27:0/3973221936 conn(0x7f21b40b0cb0 msgr2=0x7f21b406e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:53.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.511+0000 7f21b93c4640 1 -- 172.21.15.27:0/3973221936 shutdown_connections 2024-01-15T11:33:53.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.511+0000 7f21b93c4640 1 -- 172.21.15.27:0/3973221936 wait complete. 2024-01-15T11:33:53.532 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-15T11:33:53.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.675+0000 7f1ab9965640 1 Processor -- start 2024-01-15T11:33:53.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.675+0000 7f1ab9965640 1 -- start start 2024-01-15T11:33:53.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.675+0000 7f1ab9965640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1ab4160c40 0x7f1ab40cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:53.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.675+0000 7f1ab9965640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1ab40cf120 0x7f1ab406b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:53.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.675+0000 7f1ab9965640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1ab406bb30 0x7f1ab40cfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:53.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.675+0000 7f1ab9965640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab406bfc0 con 0x7f1ab406bb30 2024-01-15T11:33:53.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.675+0000 7f1ab9965640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab40d2340 con 0x7f1ab4160c40 2024-01-15T11:33:53.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.675+0000 7f1ab9965640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab40cde60 con 0x7f1ab40cf120 2024-01-15T11:33:53.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.675+0000 7f1ab37fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1ab406bb30 0x7f1ab40cfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:53.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.679+0000 7f1ab37fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1ab406bb30 0x7f1ab40cfcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58776/0 (socket says 172.21.15.27:58776) 2024-01-15T11:33:53.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.679+0000 7f1ab37fe640 1 -- 172.21.15.27:0/3430773486 learned_addr learned my addr 172.21.15.27:0/3430773486 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:53.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.679+0000 7f1aabfff640 1 --2- 172.21.15.27:0/3430773486 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1ab40cf120 0x7f1ab406b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:53.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.679+0000 7f1ab2ffd640 1 --2- 172.21.15.27:0/3430773486 >> v2:172.21.15.93:3300/0 conn(0x7f1ab4160c40 0x7f1ab40cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:53.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.679+0000 7f1ab37fe640 1 -- 172.21.15.27:0/3430773486 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1ab40cf120 msgr2=0x7f1ab406b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:53.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.679+0000 7f1ab37fe640 1 --2- 172.21.15.27:0/3430773486 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1ab40cf120 0x7f1ab406b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.679+0000 7f1ab37fe640 1 -- 172.21.15.27:0/3430773486 >> v2:172.21.15.93:3300/0 conn(0x7f1ab4160c40 msgr2=0x7f1ab40cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:53.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.679+0000 7f1ab37fe640 1 --2- 172.21.15.27:0/3430773486 >> v2:172.21.15.93:3300/0 conn(0x7f1ab4160c40 0x7f1ab40cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.679+0000 7f1ab37fe640 1 -- 172.21.15.27:0/3430773486 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab40d2060 con 0x7f1ab406bb30 2024-01-15T11:33:53.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.679+0000 7f1aabfff640 1 --2- 172.21.15.27:0/3430773486 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1ab40cf120 0x7f1ab406b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:53.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.679+0000 7f1ab2ffd640 1 --2- 172.21.15.27:0/3430773486 >> v2:172.21.15.93:3300/0 conn(0x7f1ab4160c40 0x7f1ab40cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:53.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.679+0000 7f1ab37fe640 1 --2- 172.21.15.27:0/3430773486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ab406bb30 0x7f1ab40cfcb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1ab409cbe0 tx=0x7f1aac01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6d08af96fb4fd server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:53.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.679+0000 7f1ab27fc640 1 -- 172.21.15.27:0/3430773486 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac0a5740 con 0x7f1ab406bb30 2024-01-15T11:33:53.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.679+0000 7f1ab27fc640 1 -- 172.21.15.27:0/3430773486 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aac0a58a0 con 0x7f1ab406bb30 2024-01-15T11:33:53.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.679+0000 7f1ab27fc640 1 -- 172.21.15.27:0/3430773486 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac0a5c30 con 0x7f1ab406bb30 2024-01-15T11:33:53.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1ab9965640 1 -- 172.21.15.27:0/3430773486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ab406bb30 msgr2=0x7f1ab40cfcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:53.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1ab9965640 1 --2- 172.21.15.27:0/3430773486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ab406bb30 0x7f1ab40cfcb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1ab409cbe0 tx=0x7f1aac01c9d0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1ab9965640 1 -- 172.21.15.27:0/3430773486 shutdown_connections 2024-01-15T11:33:53.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1ab9965640 1 --2- 172.21.15.27:0/3430773486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ab406bb30 0x7f1ab40cfcb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1ab9965640 1 --2- 172.21.15.27:0/3430773486 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1ab40cf120 0x7f1ab406b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1ab9965640 1 --2- 172.21.15.27:0/3430773486 >> v2:172.21.15.93:3300/0 conn(0x7f1ab4160c40 0x7f1ab40cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1ab9965640 1 -- 172.21.15.27:0/3430773486 >> 172.21.15.27:0/3430773486 conn(0x7f1ab409c6b0 msgr2=0x7f1ab40d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:53.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1ab9965640 1 -- 172.21.15.27:0/3430773486 shutdown_connections 2024-01-15T11:33:53.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1ab9965640 1 -- 172.21.15.27:0/3430773486 wait complete. 2024-01-15T11:33:53.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1ab9965640 1 Processor -- start 2024-01-15T11:33:53.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1ab9965640 1 -- start start 2024-01-15T11:33:53.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1ab9965640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1ab406bb30 0x7f1ab40c9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:53.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1ab9965640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ab40cf120 0x7f1ab4155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:53.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1ab9965640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1ab4160c40 0x7f1ab40b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:53.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1ab9965640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab40b6f40 con 0x7f1ab40cf120 2024-01-15T11:33:53.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1ab9965640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab40b7220 con 0x7f1ab406bb30 2024-01-15T11:33:53.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1ab9965640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab40b7500 con 0x7f1ab4160c40 2024-01-15T11:33:53.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1aabfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ab40cf120 0x7f1ab4155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:53.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1aabfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ab40cf120 0x7f1ab4155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58780/0 (socket says 172.21.15.27:58780) 2024-01-15T11:33:53.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1aabfff640 1 -- 172.21.15.27:0/3674675440 learned_addr learned my addr 172.21.15.27:0/3674675440 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:53.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1aabfff640 1 -- 172.21.15.27:0/3674675440 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1ab4160c40 msgr2=0x7f1ab40b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:53.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1ab37fe640 1 --2- 172.21.15.27:0/3674675440 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1ab4160c40 0x7f1ab40b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:53.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1ab2ffd640 1 --2- 172.21.15.27:0/3674675440 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1ab406bb30 0x7f1ab40c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:53.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1aabfff640 1 --2- 172.21.15.27:0/3674675440 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1ab4160c40 0x7f1ab40b1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1aabfff640 1 -- 172.21.15.27:0/3674675440 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1ab406bb30 msgr2=0x7f1ab40c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:53.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1aabfff640 1 --2- 172.21.15.27:0/3674675440 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1ab406bb30 0x7f1ab40c9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1aabfff640 1 -- 172.21.15.27:0/3674675440 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac009b30 con 0x7f1ab40cf120 2024-01-15T11:33:53.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1ab37fe640 1 --2- 172.21.15.27:0/3674675440 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1ab4160c40 0x7f1ab40b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:33:53.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.683+0000 7f1ab2ffd640 1 --2- 172.21.15.27:0/3674675440 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1ab406bb30 0x7f1ab40c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:33:53.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.687+0000 7f1aabfff640 1 --2- 172.21.15.27:0/3674675440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ab40cf120 0x7f1ab4155290 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00e600 tx=0x7f1a9c00eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:53.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.687+0000 7f1ab0ff9640 1 -- 172.21.15.27:0/3674675440 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c005ba0 con 0x7f1ab40cf120 2024-01-15T11:33:53.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.687+0000 7f1ab0ff9640 1 -- 172.21.15.27:0/3674675440 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9c005d00 con 0x7f1ab40cf120 2024-01-15T11:33:53.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.687+0000 7f1ab9965640 1 -- 172.21.15.27:0/3674675440 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab40b77e0 con 0x7f1ab40cf120 2024-01-15T11:33:53.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.687+0000 7f1ab0ff9640 1 -- 172.21.15.27:0/3674675440 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c004250 con 0x7f1ab40cf120 2024-01-15T11:33:53.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.687+0000 7f1ab9965640 1 -- 172.21.15.27:0/3674675440 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab40c9590 con 0x7f1ab40cf120 2024-01-15T11:33:53.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.687+0000 7f1ab9965640 1 -- 172.21.15.27:0/3674675440 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab406d5b0 con 0x7f1ab40cf120 2024-01-15T11:33:53.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.687+0000 7f1ab0ff9640 1 -- 172.21.15.27:0/3674675440 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f1a9c0043b0 con 0x7f1ab40cf120 2024-01-15T11:33:53.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.687+0000 7f1ab0ff9640 1 --2- 172.21.15.27:0/3674675440 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1a940668f0 0x7f1a94068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:53.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.687+0000 7f1ab0ff9640 1 -- 172.21.15.27:0/3674675440 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a9c084380 con 0x7f1ab40cf120 2024-01-15T11:33:53.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.687+0000 7f1ab2ffd640 1 --2- 172.21.15.27:0/3674675440 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1a940668f0 0x7f1a94068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:53.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.691+0000 7f1ab2ffd640 1 --2- 172.21.15.27:0/3674675440 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1a940668f0 0x7f1a94068db0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1aa40097a0 tx=0x7f1aa4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:53.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.691+0000 7f1ab0ff9640 1 -- 172.21.15.27:0/3674675440 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1a9c051530 con 0x7f1ab40cf120 2024-01-15T11:33:53.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.847+0000 7f1ab9965640 1 -- 172.21.15.27:0/3674675440 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1ab404e850 con 0x7f1ab40cf120 2024-01-15T11:33:53.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.851+0000 7f1ab0ff9640 1 -- 172.21.15.27:0/3674675440 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1a9c054b50 con 0x7f1ab40cf120 2024-01-15T11:33:53.853 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-01-15T11:33:53.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.851+0000 7f1ab9965640 1 -- 172.21.15.27:0/3674675440 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1a940668f0 msgr2=0x7f1a94068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:53.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.851+0000 7f1ab9965640 1 --2- 172.21.15.27:0/3674675440 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1a940668f0 0x7f1a94068db0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1aa40097a0 tx=0x7f1aa4008040 comp rx=0 tx=0).stop 2024-01-15T11:33:53.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.851+0000 7f1ab9965640 1 -- 172.21.15.27:0/3674675440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ab40cf120 msgr2=0x7f1ab4155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:53.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.851+0000 7f1ab9965640 1 --2- 172.21.15.27:0/3674675440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ab40cf120 0x7f1ab4155290 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00e600 tx=0x7f1a9c00eac0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.851+0000 7f1ab9965640 1 -- 172.21.15.27:0/3674675440 shutdown_connections 2024-01-15T11:33:53.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.851+0000 7f1ab9965640 1 --2- 172.21.15.27:0/3674675440 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1ab4160c40 0x7f1ab40b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.851+0000 7f1ab9965640 1 --2- 172.21.15.27:0/3674675440 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ab40cf120 0x7f1ab4155290 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.851+0000 7f1ab9965640 1 --2- 172.21.15.27:0/3674675440 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1a940668f0 0x7f1a94068db0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.851+0000 7f1ab9965640 1 --2- 172.21.15.27:0/3674675440 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1ab406bb30 0x7f1ab40c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:53.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.851+0000 7f1ab9965640 1 -- 172.21.15.27:0/3674675440 >> 172.21.15.27:0/3674675440 conn(0x7f1ab409c6b0 msgr2=0x7f1ab40b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:53.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.851+0000 7f1ab9965640 1 -- 172.21.15.27:0/3674675440 shutdown_connections 2024-01-15T11:33:53.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:53.851+0000 7f1ab9965640 1 -- 172.21.15.27:0/3674675440 wait complete. 2024-01-15T11:33:53.874 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-15T11:33:54.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.015+0000 7f36f3aea640 1 Processor -- start 2024-01-15T11:33:54.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.015+0000 7f36f3aea640 1 -- start start 2024-01-15T11:33:54.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.015+0000 7f36f3aea640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f36ec0cdfb0 0x7f36ec0abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:54.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.015+0000 7f36f3aea640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f36ec0cbd50 0x7f36ec0cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:54.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.015+0000 7f36f3aea640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ec0b2710 con 0x7f36ec15a710 2024-01-15T11:33:54.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.015+0000 7f36f3aea640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ec0cca80 con 0x7f36ec0cbd50 2024-01-15T11:33:54.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.015+0000 7f36f3aea640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec0b29f0 con 0x7f36ec0cdfb0 2024-01-15T11:33:54.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.015+0000 7f36f1085640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f36ec15a710 0x7f36ec0ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:58018/0 (socket says 172.21.15.27:58018) 2024-01-15T11:33:54.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.015+0000 7f36f1085640 1 -- 172.21.15.27:0/1340768818 learned_addr learned my addr 172.21.15.27:0/1340768818 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:54.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f2087640 1 --2- 172.21.15.27:0/1340768818 >> v2:172.21.15.93:3300/0 conn(0x7f36ec0cbd50 0x7f36ec0cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:54.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f1886640 1 --2- 172.21.15.27:0/1340768818 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f36ec0cdfb0 0x7f36ec0abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:54.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f0884640 1 -- 172.21.15.27:0/1340768818 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838075293 0 0) 0x7f36ec0b2710 con 0x7f36ec15a710 2024-01-15T11:33:54.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f0884640 1 -- 172.21.15.27:0/1340768818 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36d8003530 con 0x7f36ec15a710 2024-01-15T11:33:54.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f0884640 1 -- 172.21.15.27:0/1340768818 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3534487920 0 0) 0x7f36d8003530 con 0x7f36ec15a710 2024-01-15T11:33:54.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f0884640 1 -- 172.21.15.27:0/1340768818 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f36ec0cdfb0 msgr2=0x7f36ec0abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:54.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f0884640 1 --2- 172.21.15.27:0/1340768818 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f36ec0cdfb0 0x7f36ec0abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f0884640 1 -- 172.21.15.27:0/1340768818 >> v2:172.21.15.93:3300/0 conn(0x7f36ec0cbd50 msgr2=0x7f36ec0cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:54.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f0884640 1 --2- 172.21.15.27:0/1340768818 >> v2:172.21.15.93:3300/0 conn(0x7f36ec0cbd50 0x7f36ec0cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f0884640 1 -- 172.21.15.27:0/1340768818 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ec0b2cd0 con 0x7f36ec15a710 2024-01-15T11:33:54.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f0884640 1 -- 172.21.15.27:0/1340768818 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1394381265 0 0) 0x7f36dc001680 con 0x7f36ec15a710 2024-01-15T11:33:54.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f0884640 1 -- 172.21.15.27:0/1340768818 >> v1:172.21.15.27:6789/0 conn(0x7f36ec15a710 legacy=0x7f36ec0ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:54.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f0884640 1 --2- 172.21.15.27:0/1340768818 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36d8003980 0x7f36d8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:54.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f0884640 1 --2- 172.21.15.27:0/1340768818 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f36ec0cdfb0 0x7f36d80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:54.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f0884640 1 --2- 172.21.15.27:0/1340768818 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36d8004d10 0x7f36d8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:54.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f0884640 1 -- 172.21.15.27:0/1340768818 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec0cca80 con 0x7f36d8003980 2024-01-15T11:33:54.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f0884640 1 -- 172.21.15.27:0/1340768818 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec0b29f0 con 0x7f36d8004d10 2024-01-15T11:33:54.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f0884640 1 -- 172.21.15.27:0/1340768818 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d800fda0 con 0x7f36ec0cdfb0 2024-01-15T11:33:54.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f1886640 1 --2- 172.21.15.27:0/1340768818 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36d8003980 0x7f36d8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:54.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f2087640 1 --2- 172.21.15.27:0/1340768818 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36d8004d10 0x7f36d8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:54.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f1085640 1 --2- 172.21.15.27:0/1340768818 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f36ec0cdfb0 0x7f36d80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:54.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f1886640 1 -- 172.21.15.27:0/1340768818 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f36ec0cdfb0 msgr2=0x7f36d80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:54.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f1886640 1 --2- 172.21.15.27:0/1340768818 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f36ec0cdfb0 0x7f36d80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f1886640 1 -- 172.21.15.27:0/1340768818 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36d8004d10 msgr2=0x7f36d8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:54.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f1886640 1 --2- 172.21.15.27:0/1340768818 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36d8004d10 0x7f36d8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f1886640 1 -- 172.21.15.27:0/1340768818 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d8003530 con 0x7f36d8003980 2024-01-15T11:33:54.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f2087640 1 --2- 172.21.15.27:0/1340768818 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36d8004d10 0x7f36d8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:54.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.019+0000 7f36f1085640 1 --2- 172.21.15.27:0/1340768818 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f36ec0cdfb0 0x7f36d80047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:54.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.023+0000 7f36f1886640 1 --2- 172.21.15.27:0/1340768818 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36d8003980 0x7f36d8003da0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009ae0 tx=0x7f36e801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=501080ca96ae32c2 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:54.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.023+0000 7f36f0884640 1 -- 172.21.15.27:0/1340768818 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e80a5610 con 0x7f36d8003980 2024-01-15T11:33:54.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.023+0000 7f36f0884640 1 -- 172.21.15.27:0/1340768818 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e80a5770 con 0x7f36d8003980 2024-01-15T11:33:54.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.023+0000 7f36f0884640 1 -- 172.21.15.27:0/1340768818 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e80a5b20 con 0x7f36d8003980 2024-01-15T11:33:54.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.023+0000 7f36f3aea640 1 -- 172.21.15.27:0/1340768818 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36d8003980 msgr2=0x7f36d8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:54.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.023+0000 7f36f3aea640 1 --2- 172.21.15.27:0/1340768818 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36d8003980 0x7f36d8003da0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009ae0 tx=0x7f36e801ca20 comp rx=0 tx=0).stop 2024-01-15T11:33:54.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.023+0000 7f36f2087640 1 -- 172.21.15.27:0/1340768818 reap_dead start 2024-01-15T11:33:54.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.023+0000 7f36f3aea640 1 -- 172.21.15.27:0/1340768818 shutdown_connections 2024-01-15T11:33:54.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.023+0000 7f36f3aea640 1 -- 172.21.15.27:0/1340768818 >> 172.21.15.27:0/1340768818 conn(0x7f36ec0b0cb0 msgr2=0x7f36ec0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:54.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.023+0000 7f36f3aea640 1 -- 172.21.15.27:0/1340768818 shutdown_connections 2024-01-15T11:33:54.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.023+0000 7f36f3aea640 1 -- 172.21.15.27:0/1340768818 wait complete. 2024-01-15T11:33:54.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.023+0000 7f36f3aea640 1 Processor -- start 2024-01-15T11:33:54.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.023+0000 7f36f3aea640 1 -- start start 2024-01-15T11:33:54.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.027+0000 7f36f3aea640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36d8003980 0x7f36ec14ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:54.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.027+0000 7f36f3aea640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36ec14f480 0x7f36ec154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:54.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.027+0000 7f36f3aea640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f36ec0ccea0 0x7f36ec0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:54.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.027+0000 7f36f3aea640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec0cd860 con 0x7f36d8003980 2024-01-15T11:33:54.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.027+0000 7f36f3aea640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec099a30 con 0x7f36ec14f480 2024-01-15T11:33:54.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.027+0000 7f36f3aea640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec099d10 con 0x7f36ec0ccea0 2024-01-15T11:33:54.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.027+0000 7f36f1886640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36d8003980 0x7f36ec14ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:54.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.027+0000 7f36f1886640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36d8003980 0x7f36ec14ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58802/0 (socket says 172.21.15.27:58802) 2024-01-15T11:33:54.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.027+0000 7f36f1886640 1 -- 172.21.15.27:0/2582849939 learned_addr learned my addr 172.21.15.27:0/2582849939 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:54.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.027+0000 7f36f1886640 1 -- 172.21.15.27:0/2582849939 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f36ec0ccea0 msgr2=0x7f36ec0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:54.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.027+0000 7f36f1886640 1 --2- 172.21.15.27:0/2582849939 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f36ec0ccea0 0x7f36ec0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.027+0000 7f36f1886640 1 -- 172.21.15.27:0/2582849939 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36ec14f480 msgr2=0x7f36ec154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:54.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.027+0000 7f36f1886640 1 --2- 172.21.15.27:0/2582849939 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36ec14f480 0x7f36ec154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.027+0000 7f36f1886640 1 -- 172.21.15.27:0/2582849939 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ec1554b0 con 0x7f36d8003980 2024-01-15T11:33:54.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.027+0000 7f36f1886640 1 --2- 172.21.15.27:0/2582849939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36d8003980 0x7f36ec14ee30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f36e801c850 tx=0x7f36d8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:54.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.027+0000 7f36e27fc640 1 -- 172.21.15.27:0/2582849939 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e80a5e80 con 0x7f36d8003980 2024-01-15T11:33:54.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.027+0000 7f36e27fc640 1 -- 172.21.15.27:0/2582849939 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e8004020 con 0x7f36d8003980 2024-01-15T11:33:54.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.027+0000 7f36f3aea640 1 -- 172.21.15.27:0/2582849939 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ec155790 con 0x7f36d8003980 2024-01-15T11:33:54.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.027+0000 7f36e27fc640 1 -- 172.21.15.27:0/2582849939 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e80043d0 con 0x7f36d8003980 2024-01-15T11:33:54.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.027+0000 7f36f3aea640 1 -- 172.21.15.27:0/2582849939 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ec155150 con 0x7f36d8003980 2024-01-15T11:33:54.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.027+0000 7f36f3aea640 1 -- 172.21.15.27:0/2582849939 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ec155c40 con 0x7f36d8003980 2024-01-15T11:33:54.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.027+0000 7f36e27fc640 1 -- 172.21.15.27:0/2582849939 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f36e80b4040 con 0x7f36d8003980 2024-01-15T11:33:54.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.031+0000 7f36e27fc640 1 --2- 172.21.15.27:0/2582849939 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f36d00668f0 0x7f36d0068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:54.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.031+0000 7f36e27fc640 1 -- 172.21.15.27:0/2582849939 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36e811dcd0 con 0x7f36d8003980 2024-01-15T11:33:54.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.031+0000 7f36f1085640 1 --2- 172.21.15.27:0/2582849939 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f36d00668f0 0x7f36d0068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:54.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.031+0000 7f36f1085640 1 --2- 172.21.15.27:0/2582849939 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f36d00668f0 0x7f36d0068db0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f36dc001ec0 tx=0x7f36dc001e30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:54.036 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.031+0000 7f36e27fc640 1 -- 172.21.15.27:0/2582849939 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f36e80eae70 con 0x7f36d8003980 2024-01-15T11:33:54.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.203+0000 7f36f3aea640 1 -- 172.21.15.27:0/2582849939 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f36ec0671f0 con 0x7f36d8003980 2024-01-15T11:33:54.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.203+0000 7f36e27fc640 1 -- 172.21.15.27:0/2582849939 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f36e80b2080 con 0x7f36d8003980 2024-01-15T11:33:54.205 INFO:teuthology.orchestra.run.smithi027.stderr:listed 0 entries 2024-01-15T11:33:54.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.203+0000 7f36f3aea640 1 -- 172.21.15.27:0/2582849939 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f36d00668f0 msgr2=0x7f36d0068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:54.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.203+0000 7f36f3aea640 1 --2- 172.21.15.27:0/2582849939 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f36d00668f0 0x7f36d0068db0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f36dc001ec0 tx=0x7f36dc001e30 comp rx=0 tx=0).stop 2024-01-15T11:33:54.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.203+0000 7f36f3aea640 1 -- 172.21.15.27:0/2582849939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36d8003980 msgr2=0x7f36ec14ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:54.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.203+0000 7f36f3aea640 1 --2- 172.21.15.27:0/2582849939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36d8003980 0x7f36ec14ee30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f36e801c850 tx=0x7f36d8005800 comp rx=0 tx=0).stop 2024-01-15T11:33:54.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.203+0000 7f36f3aea640 1 -- 172.21.15.27:0/2582849939 shutdown_connections 2024-01-15T11:33:54.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.203+0000 7f36f3aea640 1 --2- 172.21.15.27:0/2582849939 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f36ec0ccea0 0x7f36ec0cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.203+0000 7f36f3aea640 1 --2- 172.21.15.27:0/2582849939 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f36d00668f0 0x7f36d0068db0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.203+0000 7f36f3aea640 1 --2- 172.21.15.27:0/2582849939 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36ec14f480 0x7f36ec154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.203+0000 7f36f3aea640 1 --2- 172.21.15.27:0/2582849939 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36d8003980 0x7f36ec14ee30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.203+0000 7f36f3aea640 1 -- 172.21.15.27:0/2582849939 >> 172.21.15.27:0/2582849939 conn(0x7f36ec0b0cb0 msgr2=0x7f36ec0ac3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:54.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.203+0000 7f36f3aea640 1 -- 172.21.15.27:0/2582849939 shutdown_connections 2024-01-15T11:33:54.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.203+0000 7f36f3aea640 1 -- 172.21.15.27:0/2582849939 wait complete. 2024-01-15T11:33:54.226 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-01-15T11:33:54.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:54.226 DEBUG:teuthology.orchestra.run.smithi093:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-01-15T11:33:54.263 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2024-01-15T11:33:54.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:54.263 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-15T11:33:54.326 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:33:54.326 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T11:33:54.335 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:33:54.335 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T11:33:54.388 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:33:54.388 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T11:33:54.440 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:33:54.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc2f7f5640 1 Processor -- start 2024-01-15T11:33:54.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc2f7f5640 1 -- start start 2024-01-15T11:33:54.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc2f7f5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdc280716a0 0x7fdc28071f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:54.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc2f7f5640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc28072470 0x7fdc280b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:54.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc2f7f5640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc28071b30 con 0x7fdc2815d3e0 2024-01-15T11:33:54.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc2f7f5640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc280728e0 con 0x7fdc280716a0 2024-01-15T11:33:54.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc2f7f5640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc28070920 con 0x7fdc28072470 2024-01-15T11:33:54.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc2d591640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fdc2815d3e0 0x7fdc2806c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:58020/0 (socket says 172.21.15.27:58020) 2024-01-15T11:33:54.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc2d591640 1 -- 172.21.15.27:0/2028593165 learned_addr learned my addr 172.21.15.27:0/2028593165 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:54.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc2dd92640 1 --2- 172.21.15.27:0/2028593165 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc28072470 0x7fdc280b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:54.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc2cd90640 1 --2- 172.21.15.27:0/2028593165 >> v2:172.21.15.93:3300/0 conn(0x7fdc280716a0 0x7fdc28071f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:54.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc1ffff640 1 -- 172.21.15.27:0/2028593165 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457094636 0 0) 0x7fdc28071b30 con 0x7fdc2815d3e0 2024-01-15T11:33:54.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc1ffff640 1 -- 172.21.15.27:0/2028593165 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc14003530 con 0x7fdc2815d3e0 2024-01-15T11:33:54.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc1ffff640 1 -- 172.21.15.27:0/2028593165 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 650802059 0 0) 0x7fdc14003530 con 0x7fdc2815d3e0 2024-01-15T11:33:54.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc1ffff640 1 -- 172.21.15.27:0/2028593165 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc28072470 msgr2=0x7fdc280b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:54.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc1ffff640 1 --2- 172.21.15.27:0/2028593165 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc28072470 0x7fdc280b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc1ffff640 1 -- 172.21.15.27:0/2028593165 >> v2:172.21.15.93:3300/0 conn(0x7fdc280716a0 msgr2=0x7fdc28071f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:54.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc1ffff640 1 --2- 172.21.15.27:0/2028593165 >> v2:172.21.15.93:3300/0 conn(0x7fdc280716a0 0x7fdc28071f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc1ffff640 1 -- 172.21.15.27:0/2028593165 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2815d7c0 con 0x7fdc2815d3e0 2024-01-15T11:33:54.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc1ffff640 1 -- 172.21.15.27:0/2028593165 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1394381265 0 0) 0x7fdc24001680 con 0x7fdc2815d3e0 2024-01-15T11:33:54.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc1ffff640 1 -- 172.21.15.27:0/2028593165 >> v1:172.21.15.27:6789/0 conn(0x7fdc2815d3e0 legacy=0x7fdc2806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:54.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc1ffff640 1 --2- 172.21.15.27:0/2028593165 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc28072470 0x7fdc14003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:54.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc1ffff640 1 --2- 172.21.15.27:0/2028593165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc14003f50 0x7fdc140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:54.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc1ffff640 1 --2- 172.21.15.27:0/2028593165 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc14004d10 0x7fdc14005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:54.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc1ffff640 1 -- 172.21.15.27:0/2028593165 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc280728e0 con 0x7fdc14003f50 2024-01-15T11:33:54.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc1ffff640 1 -- 172.21.15.27:0/2028593165 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc28070920 con 0x7fdc14004d10 2024-01-15T11:33:54.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.623+0000 7fdc1ffff640 1 -- 172.21.15.27:0/2028593165 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1400b990 con 0x7fdc28072470 2024-01-15T11:33:54.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.627+0000 7fdc2cd90640 1 --2- 172.21.15.27:0/2028593165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc14003f50 0x7fdc140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:54.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.627+0000 7fdc2d591640 1 --2- 172.21.15.27:0/2028593165 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc28072470 0x7fdc14003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:54.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.627+0000 7fdc2dd92640 1 --2- 172.21.15.27:0/2028593165 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc14004d10 0x7fdc14005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:54.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.627+0000 7fdc2cd90640 1 -- 172.21.15.27:0/2028593165 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc28072470 msgr2=0x7fdc14003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:54.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.627+0000 7fdc2cd90640 1 --2- 172.21.15.27:0/2028593165 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc28072470 0x7fdc14003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.627+0000 7fdc2cd90640 1 -- 172.21.15.27:0/2028593165 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc14004d10 msgr2=0x7fdc14005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:54.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.627+0000 7fdc2cd90640 1 --2- 172.21.15.27:0/2028593165 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc14004d10 0x7fdc14005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.627+0000 7fdc2cd90640 1 -- 172.21.15.27:0/2028593165 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc14003530 con 0x7fdc14003f50 2024-01-15T11:33:54.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.627+0000 7fdc2cd90640 1 --2- 172.21.15.27:0/2028593165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc14003f50 0x7fdc140047d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdc18009b10 tx=0x7fdc1801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f830df4fc06a4dd8 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:54.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.627+0000 7fdc1ffff640 1 -- 172.21.15.27:0/2028593165 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc180a5680 con 0x7fdc14003f50 2024-01-15T11:33:54.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.627+0000 7fdc1ffff640 1 -- 172.21.15.27:0/2028593165 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc180a57e0 con 0x7fdc14003f50 2024-01-15T11:33:54.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.627+0000 7fdc1ffff640 1 -- 172.21.15.27:0/2028593165 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc180a5b90 con 0x7fdc14003f50 2024-01-15T11:33:54.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.631+0000 7fdc2f7f5640 1 -- 172.21.15.27:0/2028593165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc14003f50 msgr2=0x7fdc140047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:54.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.631+0000 7fdc2f7f5640 1 --2- 172.21.15.27:0/2028593165 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc14003f50 0x7fdc140047d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdc18009b10 tx=0x7fdc1801ca90 comp rx=0 tx=0).stop 2024-01-15T11:33:54.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.631+0000 7fdc2dd92640 1 -- 172.21.15.27:0/2028593165 reap_dead start 2024-01-15T11:33:54.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.631+0000 7fdc2f7f5640 1 -- 172.21.15.27:0/2028593165 shutdown_connections 2024-01-15T11:33:54.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.631+0000 7fdc2f7f5640 1 -- 172.21.15.27:0/2028593165 >> 172.21.15.27:0/2028593165 conn(0x7fdc280b0c40 msgr2=0x7fdc280b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:54.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.631+0000 7fdc2f7f5640 1 -- 172.21.15.27:0/2028593165 shutdown_connections 2024-01-15T11:33:54.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.631+0000 7fdc2f7f5640 1 -- 172.21.15.27:0/2028593165 wait complete. 2024-01-15T11:33:54.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.631+0000 7fdc2f7f5640 1 Processor -- start 2024-01-15T11:33:54.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.631+0000 7fdc2f7f5640 1 -- start start 2024-01-15T11:33:54.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.631+0000 7fdc2f7f5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc14003f50 0x7fdc281f6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:54.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.631+0000 7fdc2f7f5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc28160260 0x7fdc2815ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:54.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.631+0000 7fdc2f7f5640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc2814aae0 0x7fdc2809b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:54.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.631+0000 7fdc2f7f5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2815efb0 con 0x7fdc28160260 2024-01-15T11:33:54.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.631+0000 7fdc2f7f5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2815fdd0 con 0x7fdc14003f50 2024-01-15T11:33:54.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.631+0000 7fdc2f7f5640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2815f1c0 con 0x7fdc2814aae0 2024-01-15T11:33:54.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.631+0000 7fdc2cd90640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc28160260 0x7fdc2815ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:54.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.631+0000 7fdc2cd90640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc28160260 0x7fdc2815ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58824/0 (socket says 172.21.15.27:58824) 2024-01-15T11:33:54.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.631+0000 7fdc2cd90640 1 -- 172.21.15.27:0/1333347062 learned_addr learned my addr 172.21.15.27:0/1333347062 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:54.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.631+0000 7fdc2d591640 1 --2- 172.21.15.27:0/1333347062 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc14003f50 0x7fdc281f6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:54.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.631+0000 7fdc2dd92640 1 --2- 172.21.15.27:0/1333347062 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc2814aae0 0x7fdc2809b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:54.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.635+0000 7fdc2cd90640 1 -- 172.21.15.27:0/1333347062 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc2814aae0 msgr2=0x7fdc2809b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:54.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.635+0000 7fdc2cd90640 1 --2- 172.21.15.27:0/1333347062 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc2814aae0 0x7fdc2809b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.635+0000 7fdc2cd90640 1 -- 172.21.15.27:0/1333347062 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc14003f50 msgr2=0x7fdc281f6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:54.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.635+0000 7fdc2cd90640 1 --2- 172.21.15.27:0/1333347062 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc14003f50 0x7fdc281f6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.635+0000 7fdc2cd90640 1 -- 172.21.15.27:0/1333347062 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2815f4a0 con 0x7fdc28160260 2024-01-15T11:33:54.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.635+0000 7fdc2cd90640 1 --2- 172.21.15.27:0/1333347062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc28160260 0x7fdc2815ea70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdc18009b10 tx=0x7fdc14005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:54.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.635+0000 7fdc1dffb640 1 -- 172.21.15.27:0/1333347062 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc180be070 con 0x7fdc28160260 2024-01-15T11:33:54.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.635+0000 7fdc1dffb640 1 -- 172.21.15.27:0/1333347062 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc18004020 con 0x7fdc28160260 2024-01-15T11:33:54.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.635+0000 7fdc1dffb640 1 -- 172.21.15.27:0/1333347062 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc180a5680 con 0x7fdc28160260 2024-01-15T11:33:54.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.635+0000 7fdc2f7f5640 1 -- 172.21.15.27:0/1333347062 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc2815f780 con 0x7fdc28160260 2024-01-15T11:33:54.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.635+0000 7fdc2f7f5640 1 -- 172.21.15.27:0/1333347062 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc2814af60 con 0x7fdc28160260 2024-01-15T11:33:54.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.635+0000 7fdc2f7f5640 1 -- 172.21.15.27:0/1333347062 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc2804e850 con 0x7fdc28160260 2024-01-15T11:33:54.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.635+0000 7fdc1dffb640 1 -- 172.21.15.27:0/1333347062 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fdc180b4040 con 0x7fdc28160260 2024-01-15T11:33:54.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.635+0000 7fdc1dffb640 1 --2- 172.21.15.27:0/1333347062 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fdc0c066940 0x7fdc0c068e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:54.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.635+0000 7fdc1dffb640 1 -- 172.21.15.27:0/1333347062 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc1811df30 con 0x7fdc28160260 2024-01-15T11:33:54.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.639+0000 7fdc2d591640 1 --2- 172.21.15.27:0/1333347062 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fdc0c066940 0x7fdc0c068e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:54.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.639+0000 7fdc2d591640 1 --2- 172.21.15.27:0/1333347062 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fdc0c066940 0x7fdc0c068e00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdc24001c00 tx=0x7fdc24001de0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:54.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.639+0000 7fdc1dffb640 1 -- 172.21.15.27:0/1333347062 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdc180eb300 con 0x7fdc28160260 2024-01-15T11:33:54.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.799+0000 7fdc2f7f5640 1 -- 172.21.15.27:0/1333347062 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc280ad060 con 0x7fdc28160260 2024-01-15T11:33:54.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.799+0000 7fdc1dffb640 1 -- 172.21.15.27:0/1333347062 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16425 (secure 0 0 0) 0x7fdc180ee920 con 0x7fdc28160260 2024-01-15T11:33:54.804 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:54.804 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:33:21.682894+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T11:33:18.397200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T11:33:19.061383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:33:54.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.803+0000 7fdc2f7f5640 1 -- 172.21.15.27:0/1333347062 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fdc0c066940 msgr2=0x7fdc0c068e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:54.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.803+0000 7fdc2f7f5640 1 --2- 172.21.15.27:0/1333347062 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fdc0c066940 0x7fdc0c068e00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdc24001c00 tx=0x7fdc24001de0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.803+0000 7fdc2f7f5640 1 -- 172.21.15.27:0/1333347062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc28160260 msgr2=0x7fdc2815ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:54.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.803+0000 7fdc2f7f5640 1 --2- 172.21.15.27:0/1333347062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc28160260 0x7fdc2815ea70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdc18009b10 tx=0x7fdc14005800 comp rx=0 tx=0).stop 2024-01-15T11:33:54.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.803+0000 7fdc2f7f5640 1 -- 172.21.15.27:0/1333347062 shutdown_connections 2024-01-15T11:33:54.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.803+0000 7fdc2f7f5640 1 --2- 172.21.15.27:0/1333347062 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc2814aae0 0x7fdc2809b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.803+0000 7fdc2f7f5640 1 --2- 172.21.15.27:0/1333347062 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdc28160260 0x7fdc2815ea70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.803+0000 7fdc2f7f5640 1 --2- 172.21.15.27:0/1333347062 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fdc0c066940 0x7fdc0c068e00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.803+0000 7fdc2f7f5640 1 --2- 172.21.15.27:0/1333347062 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc14003f50 0x7fdc281f6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.803+0000 7fdc2f7f5640 1 -- 172.21.15.27:0/1333347062 >> 172.21.15.27:0/1333347062 conn(0x7fdc280b0c40 msgr2=0x7fdc280ad860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:54.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.803+0000 7fdc2f7f5640 1 -- 172.21.15.27:0/1333347062 shutdown_connections 2024-01-15T11:33:54.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.803+0000 7fdc2f7f5640 1 -- 172.21.15.27:0/1333347062 wait complete. 2024-01-15T11:33:54.825 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T11:33:08.134662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-15T11:33:18.397200+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-15T11:33:19.061383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T11:33:54.825 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T11:33:54.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.967+0000 7f366e417640 1 Processor -- start 2024-01-15T11:33:54.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.971+0000 7f366e417640 1 -- start start 2024-01-15T11:33:54.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.971+0000 7f366e417640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f366815d8f0 0x7f366815e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:54.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.971+0000 7f366e417640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f36680d0510 0x7f36680d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:54.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.971+0000 7f366e417640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f366815ecc0 con 0x7f36680ced30 2024-01-15T11:33:54.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.971+0000 7f366e417640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36680d4420 con 0x7f366815d8f0 2024-01-15T11:33:54.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.971+0000 7f366e417640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36680cdfb0 con 0x7f36680d0510 2024-01-15T11:33:54.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.971+0000 7f3667fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f366815d8f0 0x7f366815e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:54.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.971+0000 7f36677fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f36680ced30 0x7f36680cfe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:58036/0 (socket says 172.21.15.27:58036) 2024-01-15T11:33:54.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.971+0000 7f3667fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f366815d8f0 0x7f366815e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58834/0 (socket says 172.21.15.27:58834) 2024-01-15T11:33:54.974 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.971+0000 7f36677fe640 1 -- 172.21.15.27:0/1045235800 learned_addr learned my addr 172.21.15.27:0/1045235800 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:54.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.971+0000 7f3667fff640 1 -- 172.21.15.27:0/1045235800 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f36680d0510 msgr2=0x7f36680d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:54.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.971+0000 7f366c9b4640 1 --2- 172.21.15.27:0/1045235800 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f36680d0510 0x7f36680d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:54.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.971+0000 7f3667fff640 1 --2- 172.21.15.27:0/1045235800 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f36680d0510 0x7f36680d1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.971+0000 7f3666ffd640 1 -- 172.21.15.27:0/1045235800 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4175517800 0 0) 0x7f366815ecc0 con 0x7f36680ced30 2024-01-15T11:33:54.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.971+0000 7f3667fff640 1 -- 172.21.15.27:0/1045235800 >> v1:172.21.15.27:6789/0 conn(0x7f36680ced30 legacy=0x7f36680cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:54.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.971+0000 7f3667fff640 1 -- 172.21.15.27:0/1045235800 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36680d4140 con 0x7f366815d8f0 2024-01-15T11:33:54.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.971+0000 7f366c9b4640 1 --2- 172.21.15.27:0/1045235800 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f36680d0510 0x7f36680d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:33:54.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.975+0000 7f3667fff640 1 --2- 172.21.15.27:0/1045235800 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f366815d8f0 0x7f366815e780 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f36580097f0 tx=0x7f365801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258f3c45273f64c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:54.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.975+0000 7f3666ffd640 1 -- 172.21.15.27:0/1045235800 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36580ab650 con 0x7f366815d8f0 2024-01-15T11:33:54.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.975+0000 7f3666ffd640 1 -- 172.21.15.27:0/1045235800 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36580ab7b0 con 0x7f366815d8f0 2024-01-15T11:33:54.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.975+0000 7f3666ffd640 1 -- 172.21.15.27:0/1045235800 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36580abb40 con 0x7f366815d8f0 2024-01-15T11:33:54.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.975+0000 7f366e417640 1 -- 172.21.15.27:0/1045235800 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f366815d8f0 msgr2=0x7f366815e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:54.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.975+0000 7f366e417640 1 --2- 172.21.15.27:0/1045235800 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f366815d8f0 0x7f366815e780 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f36580097f0 tx=0x7f365801c450 comp rx=0 tx=0).stop 2024-01-15T11:33:54.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.975+0000 7f366e417640 1 -- 172.21.15.27:0/1045235800 shutdown_connections 2024-01-15T11:33:54.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.975+0000 7f366e417640 1 --2- 172.21.15.27:0/1045235800 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f36680d0510 0x7f36680d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.975+0000 7f366e417640 1 --2- 172.21.15.27:0/1045235800 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f366815d8f0 0x7f366815e780 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.975+0000 7f366e417640 1 -- 172.21.15.27:0/1045235800 >> 172.21.15.27:0/1045235800 conn(0x7f366809c750 msgr2=0x7f36680d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:54.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.975+0000 7f366e417640 1 -- 172.21.15.27:0/1045235800 shutdown_connections 2024-01-15T11:33:54.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.975+0000 7f366e417640 1 -- 172.21.15.27:0/1045235800 wait complete. 2024-01-15T11:33:54.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.975+0000 7f366e417640 1 Processor -- start 2024-01-15T11:33:54.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.979+0000 7f366e417640 1 -- start start 2024-01-15T11:33:54.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.979+0000 7f366e417640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36680ced30 0x7f36680cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:54.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.979+0000 7f366e417640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36680d0510 0x7f36681440a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:54.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.979+0000 7f366e417640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f366815d8f0 0x7f366815a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:54.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.979+0000 7f366e417640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36680cc5d0 con 0x7f36680ced30 2024-01-15T11:33:54.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.979+0000 7f366e417640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36680cc8b0 con 0x7f36680d0510 2024-01-15T11:33:54.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.979+0000 7f366e417640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36680ccb90 con 0x7f366815d8f0 2024-01-15T11:33:54.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.979+0000 7f3667fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36680ced30 0x7f36680cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:54.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.979+0000 7f3667fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36680ced30 0x7f36680cbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58842/0 (socket says 172.21.15.27:58842) 2024-01-15T11:33:54.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.979+0000 7f3667fff640 1 -- 172.21.15.27:0/4069806597 learned_addr learned my addr 172.21.15.27:0/4069806597 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:54.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.979+0000 7f366c9b4640 1 --2- 172.21.15.27:0/4069806597 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f366815d8f0 0x7f366815a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:54.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.979+0000 7f36677fe640 1 --2- 172.21.15.27:0/4069806597 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36680d0510 0x7f36681440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:54.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.979+0000 7f3667fff640 1 -- 172.21.15.27:0/4069806597 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f366815d8f0 msgr2=0x7f366815a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:54.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.979+0000 7f3667fff640 1 --2- 172.21.15.27:0/4069806597 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f366815d8f0 0x7f366815a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.979+0000 7f3667fff640 1 -- 172.21.15.27:0/4069806597 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36680d0510 msgr2=0x7f36681440a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:54.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.979+0000 7f3667fff640 1 --2- 172.21.15.27:0/4069806597 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36680d0510 0x7f36681440a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:54.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.979+0000 7f3667fff640 1 -- 172.21.15.27:0/4069806597 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3658009420 con 0x7f36680ced30 2024-01-15T11:33:54.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.979+0000 7f3667fff640 1 --2- 172.21.15.27:0/4069806597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36680ced30 0x7f36680cbf60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f36580ad040 tx=0x7f365801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:54.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.979+0000 7f3664ff9640 1 -- 172.21.15.27:0/4069806597 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36580b5810 con 0x7f36680ced30 2024-01-15T11:33:54.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.979+0000 7f3664ff9640 1 -- 172.21.15.27:0/4069806597 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36580b59b0 con 0x7f36680ced30 2024-01-15T11:33:54.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.979+0000 7f3664ff9640 1 -- 172.21.15.27:0/4069806597 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36580b5d60 con 0x7f36680ced30 2024-01-15T11:33:54.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.979+0000 7f366e417640 1 -- 172.21.15.27:0/4069806597 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36680cce70 con 0x7f36680ced30 2024-01-15T11:33:54.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.979+0000 7f366e417640 1 -- 172.21.15.27:0/4069806597 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36681445e0 con 0x7f36680ced30 2024-01-15T11:33:54.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.979+0000 7f366e417640 1 -- 172.21.15.27:0/4069806597 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36680cd390 con 0x7f36680ced30 2024-01-15T11:33:54.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.983+0000 7f3664ff9640 1 -- 172.21.15.27:0/4069806597 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f36580b4390 con 0x7f36680ced30 2024-01-15T11:33:54.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.983+0000 7f3664ff9640 1 --2- 172.21.15.27:0/4069806597 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f36540668f0 0x7f3654068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:54.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.983+0000 7f3664ff9640 1 -- 172.21.15.27:0/4069806597 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f365811f1f0 con 0x7f36680ced30 2024-01-15T11:33:54.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.983+0000 7f36677fe640 1 --2- 172.21.15.27:0/4069806597 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f36540668f0 0x7f3654068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:54.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.983+0000 7f36677fe640 1 --2- 172.21.15.27:0/4069806597 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f36540668f0 0x7f3654068db0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3668141530 tx=0x7f365c007c10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:54.990 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:54.987+0000 7f3664ff9640 1 -- 172.21.15.27:0/4069806597 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f36680cd390 con 0x7f36680ced30 2024-01-15T11:33:55.146 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.143+0000 7f366e417640 1 -- 172.21.15.27:0/4069806597 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f36680cd390 con 0x7f36680ced30 2024-01-15T11:33:55.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.143+0000 7f3664ff9640 1 -- 172.21.15.27:0/4069806597 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f36680cd390 con 0x7f36680ced30 2024-01-15T11:33:55.147 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-15T11:33:55.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.147+0000 7f366e417640 1 -- 172.21.15.27:0/4069806597 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f36540668f0 msgr2=0x7f3654068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:55.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.147+0000 7f366e417640 1 --2- 172.21.15.27:0/4069806597 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f36540668f0 0x7f3654068db0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3668141530 tx=0x7f365c007c10 comp rx=0 tx=0).stop 2024-01-15T11:33:55.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.147+0000 7f366e417640 1 -- 172.21.15.27:0/4069806597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36680ced30 msgr2=0x7f36680cbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:55.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.147+0000 7f366e417640 1 --2- 172.21.15.27:0/4069806597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36680ced30 0x7f36680cbf60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f36580ad040 tx=0x7f365801ac90 comp rx=0 tx=0).stop 2024-01-15T11:33:55.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.147+0000 7f366e417640 1 -- 172.21.15.27:0/4069806597 shutdown_connections 2024-01-15T11:33:55.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.147+0000 7f366e417640 1 --2- 172.21.15.27:0/4069806597 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f366815d8f0 0x7f366815a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:55.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.147+0000 7f366e417640 1 --2- 172.21.15.27:0/4069806597 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f36540668f0 0x7f3654068db0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:55.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.147+0000 7f366e417640 1 --2- 172.21.15.27:0/4069806597 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f36680d0510 0x7f36681440a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:55.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.147+0000 7f366e417640 1 --2- 172.21.15.27:0/4069806597 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f36680ced30 0x7f36680cbf60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:55.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.147+0000 7f366e417640 1 -- 172.21.15.27:0/4069806597 >> 172.21.15.27:0/4069806597 conn(0x7f366809c750 msgr2=0x7f36680b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:55.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.147+0000 7f366e417640 1 -- 172.21.15.27:0/4069806597 shutdown_connections 2024-01-15T11:33:55.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.147+0000 7f366e417640 1 -- 172.21.15.27:0/4069806597 wait complete. 2024-01-15T11:33:55.169 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-15T11:33:55.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.311+0000 7fb5b14bb640 1 Processor -- start 2024-01-15T11:33:55.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.311+0000 7fb5b14bb640 1 -- start start 2024-01-15T11:33:55.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.315+0000 7fb5b14bb640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb5ac13cf80 0x7fb5ac13ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:55.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.315+0000 7fb5b14bb640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ac15dd20 con 0x7fb5ac1404f0 2024-01-15T11:33:55.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.315+0000 7fb5b14bb640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ac15e000 con 0x7fb5ac13f8f0 2024-01-15T11:33:55.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.315+0000 7fb5b14bb640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ac15e2e0 con 0x7fb5ac13cf80 2024-01-15T11:33:55.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.315+0000 7fb5abfff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb5ac13cf80 0x7fb5ac13ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:55.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.315+0000 7fb5abfff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb5ac13cf80 0x7fb5ac13ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52172/0 (socket says 172.21.15.27:52172) 2024-01-15T11:33:55.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.315+0000 7fb5abfff640 1 -- 172.21.15.27:0/488555523 learned_addr learned my addr 172.21.15.27:0/488555523 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:55.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.315+0000 7fb5abfff640 1 -- 172.21.15.27:0/488555523 >> v1:172.21.15.93:6789/0 conn(0x7fb5ac13f8f0 legacy=0x7fb5ac0cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:55.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.315+0000 7fb5abfff640 1 -- 172.21.15.27:0/488555523 >> v1:172.21.15.27:6789/0 conn(0x7fb5ac1404f0 legacy=0x7fb5ac06c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:55.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.315+0000 7fb5abfff640 1 -- 172.21.15.27:0/488555523 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac15e5c0 con 0x7fb5ac13cf80 2024-01-15T11:33:55.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.315+0000 7fb5abfff640 1 --2- 172.21.15.27:0/488555523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5ac13cf80 0x7fb5ac13ffb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb59c009870 tx=0x7fb59c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4c7458f9a3ebd3 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:55.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.319+0000 7fb5aaffd640 1 -- 172.21.15.27:0/488555523 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c004230 con 0x7fb5ac13cf80 2024-01-15T11:33:55.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.319+0000 7fb5aaffd640 1 -- 172.21.15.27:0/488555523 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c0a7050 con 0x7fb5ac13cf80 2024-01-15T11:33:55.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.319+0000 7fb5aaffd640 1 -- 172.21.15.27:0/488555523 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c003620 con 0x7fb5ac13cf80 2024-01-15T11:33:55.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.319+0000 7fb5b14bb640 1 -- 172.21.15.27:0/488555523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5ac13cf80 msgr2=0x7fb5ac13ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:55.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.319+0000 7fb5b14bb640 1 --2- 172.21.15.27:0/488555523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5ac13cf80 0x7fb5ac13ffb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb59c009870 tx=0x7fb59c01c440 comp rx=0 tx=0).stop 2024-01-15T11:33:55.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.319+0000 7fb5b14bb640 1 -- 172.21.15.27:0/488555523 shutdown_connections 2024-01-15T11:33:55.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.319+0000 7fb5b14bb640 1 --2- 172.21.15.27:0/488555523 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5ac13cf80 0x7fb5ac13ffb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:55.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.319+0000 7fb5b14bb640 1 -- 172.21.15.27:0/488555523 >> 172.21.15.27:0/488555523 conn(0x7fb5ac06df30 msgr2=0x7fb5ac06a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:55.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.319+0000 7fb5b14bb640 1 -- 172.21.15.27:0/488555523 shutdown_connections 2024-01-15T11:33:55.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.319+0000 7fb5b14bb640 1 -- 172.21.15.27:0/488555523 wait complete. 2024-01-15T11:33:55.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.319+0000 7fb5b14bb640 1 Processor -- start 2024-01-15T11:33:55.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.319+0000 7fb5b14bb640 1 -- start start 2024-01-15T11:33:55.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.319+0000 7fb5b14bb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5ac13cf80 0x7fb5ac1386f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:55.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.319+0000 7fb5b14bb640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb5ac13f8f0 0x7fb5ac15cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:55.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.319+0000 7fb5b14bb640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb5ac1404f0 0x7fb5ac13a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:55.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.319+0000 7fb5b14bb640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac168ed0 con 0x7fb5ac13cf80 2024-01-15T11:33:55.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.319+0000 7fb5b14bb640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac1691b0 con 0x7fb5ac13f8f0 2024-01-15T11:33:55.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.319+0000 7fb5b14bb640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac15c3e0 con 0x7fb5ac1404f0 2024-01-15T11:33:55.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.319+0000 7fb5abfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5ac13cf80 0x7fb5ac1386f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:55.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.319+0000 7fb5abfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5ac13cf80 0x7fb5ac1386f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52188/0 (socket says 172.21.15.27:52188) 2024-01-15T11:33:55.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.319+0000 7fb5abfff640 1 -- 172.21.15.27:0/2393508141 learned_addr learned my addr 172.21.15.27:0/2393508141 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:55.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.323+0000 7fb5b0cba640 1 --2- 172.21.15.27:0/2393508141 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb5ac1404f0 0x7fb5ac13a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:55.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.323+0000 7fb5ab7fe640 1 --2- 172.21.15.27:0/2393508141 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb5ac13f8f0 0x7fb5ac15cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:55.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.323+0000 7fb5abfff640 1 -- 172.21.15.27:0/2393508141 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb5ac1404f0 msgr2=0x7fb5ac13a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:55.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.323+0000 7fb5abfff640 1 --2- 172.21.15.27:0/2393508141 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb5ac1404f0 0x7fb5ac13a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:55.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.323+0000 7fb5abfff640 1 -- 172.21.15.27:0/2393508141 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb5ac13f8f0 msgr2=0x7fb5ac15cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:55.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.323+0000 7fb5abfff640 1 --2- 172.21.15.27:0/2393508141 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb5ac13f8f0 0x7fb5ac15cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:55.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.323+0000 7fb5abfff640 1 -- 172.21.15.27:0/2393508141 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59c0094d0 con 0x7fb5ac13cf80 2024-01-15T11:33:55.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.323+0000 7fb5abfff640 1 --2- 172.21.15.27:0/2393508141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5ac13cf80 0x7fb5ac1386f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0ae040 tx=0x7fb59c0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:55.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.323+0000 7fb5a8ff9640 1 -- 172.21.15.27:0/2393508141 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c003ca0 con 0x7fb5ac13cf80 2024-01-15T11:33:55.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.323+0000 7fb5a8ff9640 1 -- 172.21.15.27:0/2393508141 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c003e20 con 0x7fb5ac13cf80 2024-01-15T11:33:55.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.323+0000 7fb5b14bb640 1 -- 172.21.15.27:0/2393508141 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ac15c6c0 con 0x7fb5ac13cf80 2024-01-15T11:33:55.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.323+0000 7fb5a8ff9640 1 -- 172.21.15.27:0/2393508141 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0ab680 con 0x7fb5ac13cf80 2024-01-15T11:33:55.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.323+0000 7fb5b14bb640 1 -- 172.21.15.27:0/2393508141 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ac14ed50 con 0x7fb5ac13cf80 2024-01-15T11:33:55.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.323+0000 7fb5b14bb640 1 -- 172.21.15.27:0/2393508141 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ac15c240 con 0x7fb5ac13cf80 2024-01-15T11:33:55.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.323+0000 7fb5a8ff9640 1 -- 172.21.15.27:0/2393508141 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fb59c0ab7e0 con 0x7fb5ac13cf80 2024-01-15T11:33:55.328 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.323+0000 7fb5a8ff9640 1 --2- 172.21.15.27:0/2393508141 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb5980668f0 0x7fb598068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:55.328 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.323+0000 7fb5a8ff9640 1 -- 172.21.15.27:0/2393508141 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb59c11eea0 con 0x7fb5ac13cf80 2024-01-15T11:33:55.328 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.327+0000 7fb5ab7fe640 1 --2- 172.21.15.27:0/2393508141 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb5980668f0 0x7fb598068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:55.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.327+0000 7fb5ab7fe640 1 --2- 172.21.15.27:0/2393508141 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb5980668f0 0x7fb598068db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac13a570 tx=0x7fb5a0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:55.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.327+0000 7fb5a8ff9640 1 -- 172.21.15.27:0/2393508141 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb5ac15c240 con 0x7fb5ac13cf80 2024-01-15T11:33:55.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.487+0000 7fb5b14bb640 1 -- 172.21.15.27:0/2393508141 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb5ac15c240 con 0x7fb5ac13cf80 2024-01-15T11:33:55.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.487+0000 7fb5a8ff9640 1 -- 172.21.15.27:0/2393508141 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb5ac15c240 con 0x7fb5ac13cf80 2024-01-15T11:33:55.491 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-01-15T11:33:55.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.491+0000 7fb5b14bb640 1 -- 172.21.15.27:0/2393508141 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb5980668f0 msgr2=0x7fb598068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:55.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.491+0000 7fb5b14bb640 1 --2- 172.21.15.27:0/2393508141 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb5980668f0 0x7fb598068db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac13a570 tx=0x7fb5a0009040 comp rx=0 tx=0).stop 2024-01-15T11:33:55.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.491+0000 7fb5b14bb640 1 -- 172.21.15.27:0/2393508141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5ac13cf80 msgr2=0x7fb5ac1386f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:55.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.491+0000 7fb5b14bb640 1 --2- 172.21.15.27:0/2393508141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5ac13cf80 0x7fb5ac1386f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0ae040 tx=0x7fb59c0191e0 comp rx=0 tx=0).stop 2024-01-15T11:33:55.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.491+0000 7fb5b14bb640 1 -- 172.21.15.27:0/2393508141 shutdown_connections 2024-01-15T11:33:55.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.491+0000 7fb5b14bb640 1 --2- 172.21.15.27:0/2393508141 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb5ac1404f0 0x7fb5ac13a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:55.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.491+0000 7fb5b14bb640 1 --2- 172.21.15.27:0/2393508141 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb5980668f0 0x7fb598068db0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:55.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.491+0000 7fb5b14bb640 1 --2- 172.21.15.27:0/2393508141 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb5ac13f8f0 0x7fb5ac15cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:55.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.491+0000 7fb5b14bb640 1 --2- 172.21.15.27:0/2393508141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb5ac13cf80 0x7fb5ac1386f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:55.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.491+0000 7fb5b14bb640 1 -- 172.21.15.27:0/2393508141 >> 172.21.15.27:0/2393508141 conn(0x7fb5ac06df30 msgr2=0x7fb5ac0b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:55.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.491+0000 7fb5b14bb640 1 -- 172.21.15.27:0/2393508141 shutdown_connections 2024-01-15T11:33:55.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.491+0000 7fb5b14bb640 1 -- 172.21.15.27:0/2393508141 wait complete. 2024-01-15T11:33:55.512 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-15T11:33:55.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.655+0000 7f7da632a640 1 Processor -- start 2024-01-15T11:33:55.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.655+0000 7f7da632a640 1 -- start start 2024-01-15T11:33:55.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.655+0000 7f7da632a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7da00b07a0 0x7f7da01619e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:55.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.655+0000 7f7da632a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7da0161f20 0x7f7da00b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:55.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.655+0000 7f7da632a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7da00b2870 0x7f7da00b1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:55.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.655+0000 7f7da632a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7da00b0b80 con 0x7f7da00b07a0 2024-01-15T11:33:55.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.655+0000 7f7da632a640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7da0161290 con 0x7f7da0161f20 2024-01-15T11:33:55.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.655+0000 7f7da632a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da0161550 con 0x7f7da00b2870 2024-01-15T11:33:55.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.655+0000 7f7d9ffff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7da00b07a0 0x7f7da01619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:55.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.655+0000 7f7d9ffff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7da00b07a0 0x7f7da01619e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52198/0 (socket says 172.21.15.27:52198) 2024-01-15T11:33:55.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.655+0000 7f7d9ffff640 1 -- 172.21.15.27:0/3411398809 learned_addr learned my addr 172.21.15.27:0/3411398809 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:55.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.655+0000 7f7d9f7fe640 1 --2- 172.21.15.27:0/3411398809 >> v2:172.21.15.93:3300/0 conn(0x7f7da0161f20 0x7f7da00b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:55.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.655+0000 7f7da48c7640 1 --2- 172.21.15.27:0/3411398809 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7da00b2870 0x7f7da00b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:55.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.655+0000 7f7d9ffff640 1 -- 172.21.15.27:0/3411398809 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7da00b2870 msgr2=0x7f7da00b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:55.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.655+0000 7f7d9ffff640 1 --2- 172.21.15.27:0/3411398809 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7da00b2870 0x7f7da00b1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:55.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.655+0000 7f7d9ffff640 1 -- 172.21.15.27:0/3411398809 >> v2:172.21.15.93:3300/0 conn(0x7f7da0161f20 msgr2=0x7f7da00b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:55.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.655+0000 7f7d9ffff640 1 --2- 172.21.15.27:0/3411398809 >> v2:172.21.15.93:3300/0 conn(0x7f7da0161f20 0x7f7da00b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:55.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.655+0000 7f7d9ffff640 1 -- 172.21.15.27:0/3411398809 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da00c65a0 con 0x7f7da00b07a0 2024-01-15T11:33:55.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.655+0000 7f7da48c7640 1 --2- 172.21.15.27:0/3411398809 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7da00b2870 0x7f7da00b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:55.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.655+0000 7f7d9f7fe640 1 --2- 172.21.15.27:0/3411398809 >> v2:172.21.15.93:3300/0 conn(0x7f7da0161f20 0x7f7da00b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:55.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.659+0000 7f7d9ffff640 1 --2- 172.21.15.27:0/3411398809 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7da00b07a0 0x7f7da01619e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7da0071160 tx=0x7f7d9001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937d6b3e50245e66 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:55.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.659+0000 7f7d9effd640 1 -- 172.21.15.27:0/3411398809 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d900aa5f0 con 0x7f7da00b07a0 2024-01-15T11:33:55.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.659+0000 7f7d9effd640 1 -- 172.21.15.27:0/3411398809 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d900aa750 con 0x7f7da00b07a0 2024-01-15T11:33:55.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.659+0000 7f7d9effd640 1 -- 172.21.15.27:0/3411398809 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d900aaae0 con 0x7f7da00b07a0 2024-01-15T11:33:55.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.659+0000 7f7da632a640 1 -- 172.21.15.27:0/3411398809 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7da00b07a0 msgr2=0x7f7da01619e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:55.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.659+0000 7f7da632a640 1 --2- 172.21.15.27:0/3411398809 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7da00b07a0 0x7f7da01619e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7da0071160 tx=0x7f7d9001c4d0 comp rx=0 tx=0).stop 2024-01-15T11:33:55.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.659+0000 7f7da632a640 1 -- 172.21.15.27:0/3411398809 shutdown_connections 2024-01-15T11:33:55.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.659+0000 7f7da632a640 1 --2- 172.21.15.27:0/3411398809 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7da00b2870 0x7f7da00b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:55.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.659+0000 7f7da632a640 1 --2- 172.21.15.27:0/3411398809 >> v2:172.21.15.93:3300/0 conn(0x7f7da0161f20 0x7f7da00b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:55.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.659+0000 7f7da632a640 1 --2- 172.21.15.27:0/3411398809 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7da00b07a0 0x7f7da01619e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:55.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.659+0000 7f7da632a640 1 -- 172.21.15.27:0/3411398809 >> 172.21.15.27:0/3411398809 conn(0x7f7da00b1d50 msgr2=0x7f7da00b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:55.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.659+0000 7f7da632a640 1 -- 172.21.15.27:0/3411398809 shutdown_connections 2024-01-15T11:33:55.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.659+0000 7f7da632a640 1 -- 172.21.15.27:0/3411398809 wait complete. 2024-01-15T11:33:55.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.663+0000 7f7da632a640 1 Processor -- start 2024-01-15T11:33:55.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.663+0000 7f7da632a640 1 -- start start 2024-01-15T11:33:55.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.663+0000 7f7da632a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7da00b07a0 0x7f7da0153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:55.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.663+0000 7f7da632a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7da00b2870 0x7f7da0159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:55.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.663+0000 7f7da632a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7da0161f20 0x7f7da01565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:55.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.663+0000 7f7da632a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da015a570 con 0x7f7da00b2870 2024-01-15T11:33:55.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.663+0000 7f7da632a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da015a850 con 0x7f7da00b07a0 2024-01-15T11:33:55.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.663+0000 7f7da632a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da015ab30 con 0x7f7da0161f20 2024-01-15T11:33:55.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.663+0000 7f7d9f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7da00b2870 0x7f7da0159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:55.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.663+0000 7f7d9f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7da00b2870 0x7f7da0159bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52200/0 (socket says 172.21.15.27:52200) 2024-01-15T11:33:55.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.663+0000 7f7d9f7fe640 1 -- 172.21.15.27:0/1452913748 learned_addr learned my addr 172.21.15.27:0/1452913748 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:55.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.663+0000 7f7d9ffff640 1 --2- 172.21.15.27:0/1452913748 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7da00b07a0 0x7f7da0153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:55.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.663+0000 7f7da48c7640 1 --2- 172.21.15.27:0/1452913748 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7da0161f20 0x7f7da01565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:55.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.663+0000 7f7d9f7fe640 1 -- 172.21.15.27:0/1452913748 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7da0161f20 msgr2=0x7f7da01565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:55.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.663+0000 7f7d9f7fe640 1 --2- 172.21.15.27:0/1452913748 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7da0161f20 0x7f7da01565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:55.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.663+0000 7f7d9f7fe640 1 -- 172.21.15.27:0/1452913748 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7da00b07a0 msgr2=0x7f7da0153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:55.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.663+0000 7f7d9f7fe640 1 --2- 172.21.15.27:0/1452913748 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7da00b07a0 0x7f7da0153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:55.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.663+0000 7f7d9f7fe640 1 -- 172.21.15.27:0/1452913748 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d900094d0 con 0x7f7da00b2870 2024-01-15T11:33:55.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.663+0000 7f7d9f7fe640 1 --2- 172.21.15.27:0/1452913748 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7da00b2870 0x7f7da0159bd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400d800 tx=0x7f7d9400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:55.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.663+0000 7f7d9cff9640 1 -- 172.21.15.27:0/1452913748 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d940096a0 con 0x7f7da00b2870 2024-01-15T11:33:55.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.663+0000 7f7d9cff9640 1 -- 172.21.15.27:0/1452913748 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d94009800 con 0x7f7da00b2870 2024-01-15T11:33:55.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.663+0000 7f7d9cff9640 1 -- 172.21.15.27:0/1452913748 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d94009bb0 con 0x7f7da00b2870 2024-01-15T11:33:55.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.663+0000 7f7da632a640 1 -- 172.21.15.27:0/1452913748 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da015b400 con 0x7f7da00b2870 2024-01-15T11:33:55.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.663+0000 7f7da632a640 1 -- 172.21.15.27:0/1452913748 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da015a110 con 0x7f7da00b2870 2024-01-15T11:33:55.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.667+0000 7f7da632a640 1 -- 172.21.15.27:0/1452913748 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da015a330 con 0x7f7da00b2870 2024-01-15T11:33:55.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.667+0000 7f7d9cff9640 1 -- 172.21.15.27:0/1452913748 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f7d94009d10 con 0x7f7da00b2870 2024-01-15T11:33:55.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.667+0000 7f7d9cff9640 1 --2- 172.21.15.27:0/1452913748 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7d8c0668f0 0x7f7d8c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:55.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.667+0000 7f7d9cff9640 1 -- 172.21.15.27:0/1452913748 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d94084850 con 0x7f7da00b2870 2024-01-15T11:33:55.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.667+0000 7f7d9ffff640 1 --2- 172.21.15.27:0/1452913748 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7d8c0668f0 0x7f7d8c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:55.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.667+0000 7f7d9ffff640 1 --2- 172.21.15.27:0/1452913748 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7d8c0668f0 0x7f7d8c068db0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7d900ae000 tx=0x7f7d900b5040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:55.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.671+0000 7f7d9cff9640 1 -- 172.21.15.27:0/1452913748 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7da015a330 con 0x7f7da00b2870 2024-01-15T11:33:55.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.831+0000 7f7da632a640 1 -- 172.21.15.27:0/1452913748 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7da015a330 con 0x7f7da00b2870 2024-01-15T11:33:55.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.831+0000 7f7d9cff9640 1 -- 172.21.15.27:0/1452913748 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7da015a330 con 0x7f7da00b2870 2024-01-15T11:33:55.833 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-01-15T11:33:55.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.831+0000 7f7da632a640 1 -- 172.21.15.27:0/1452913748 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7d8c0668f0 msgr2=0x7f7d8c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:55.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.831+0000 7f7da632a640 1 --2- 172.21.15.27:0/1452913748 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7d8c0668f0 0x7f7d8c068db0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7d900ae000 tx=0x7f7d900b5040 comp rx=0 tx=0).stop 2024-01-15T11:33:55.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.831+0000 7f7da632a640 1 -- 172.21.15.27:0/1452913748 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7da00b2870 msgr2=0x7f7da0159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:55.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.831+0000 7f7da632a640 1 --2- 172.21.15.27:0/1452913748 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7da00b2870 0x7f7da0159bd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400d800 tx=0x7f7d9400dcc0 comp rx=0 tx=0).stop 2024-01-15T11:33:55.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.831+0000 7f7da632a640 1 -- 172.21.15.27:0/1452913748 shutdown_connections 2024-01-15T11:33:55.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.831+0000 7f7da632a640 1 --2- 172.21.15.27:0/1452913748 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7da0161f20 0x7f7da01565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:55.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.831+0000 7f7da632a640 1 --2- 172.21.15.27:0/1452913748 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7da00b2870 0x7f7da0159bd0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:55.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.831+0000 7f7da632a640 1 --2- 172.21.15.27:0/1452913748 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7d8c0668f0 0x7f7d8c068db0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:55.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.831+0000 7f7da632a640 1 --2- 172.21.15.27:0/1452913748 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7da00b07a0 0x7f7da0153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:55.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.831+0000 7f7da632a640 1 -- 172.21.15.27:0/1452913748 >> 172.21.15.27:0/1452913748 conn(0x7f7da00b1d50 msgr2=0x7f7da006d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:55.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.831+0000 7f7da632a640 1 -- 172.21.15.27:0/1452913748 shutdown_connections 2024-01-15T11:33:55.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.831+0000 7f7da632a640 1 -- 172.21.15.27:0/1452913748 wait complete. 2024-01-15T11:33:55.854 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-15T11:33:55.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.995+0000 7f6e55a17640 1 Processor -- start 2024-01-15T11:33:55.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.995+0000 7f6e55a17640 1 -- start start 2024-01-15T11:33:56.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.999+0000 7f6e55a17640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6e5015d7c0 0x7f6e500d3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:56.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.999+0000 7f6e55a17640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6e500d04c0 0x7f6e500cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:56.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.999+0000 7f6e55a17640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e500d11a0 con 0x7f6e50161f20 2024-01-15T11:33:56.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.999+0000 7f6e55a17640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e500d0f90 con 0x7f6e5015d7c0 2024-01-15T11:33:56.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.999+0000 7f6e55a17640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e500d1480 con 0x7f6e500d04c0 2024-01-15T11:33:56.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.999+0000 7f6e47fff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f6e50161f20 0x7f6e500cfdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33346/0 (socket says 172.21.15.27:33346) 2024-01-15T11:33:56.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.999+0000 7f6e47fff640 1 -- 172.21.15.27:0/2789773124 learned_addr learned my addr 172.21.15.27:0/2789773124 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:56.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.999+0000 7f6e4effd640 1 --2- 172.21.15.27:0/2789773124 >> v2:172.21.15.93:3300/0 conn(0x7f6e5015d7c0 0x7f6e500d3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:56.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.999+0000 7f6e4f7fe640 1 --2- 172.21.15.27:0/2789773124 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6e500d04c0 0x7f6e500cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:56.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.999+0000 7f6e4e7fc640 1 -- 172.21.15.27:0/2789773124 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 568791969 0 0) 0x7f6e500d11a0 con 0x7f6e50161f20 2024-01-15T11:33:56.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.999+0000 7f6e4e7fc640 1 -- 172.21.15.27:0/2789773124 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e3c003530 con 0x7f6e50161f20 2024-01-15T11:33:56.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.999+0000 7f6e4effd640 1 -- 172.21.15.27:0/2789773124 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6e500d04c0 msgr2=0x7f6e500cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:56.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.999+0000 7f6e4effd640 1 --2- 172.21.15.27:0/2789773124 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6e500d04c0 0x7f6e500cdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:56.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.999+0000 7f6e4effd640 1 -- 172.21.15.27:0/2789773124 >> v1:172.21.15.27:6789/0 conn(0x7f6e50161f20 legacy=0x7f6e500cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:56.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.999+0000 7f6e4e7fc640 1 -- 172.21.15.27:0/2789773124 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 150820679 0 0) 0x7f6e3c003530 con 0x7f6e50161f20 2024-01-15T11:33:56.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.999+0000 7f6e4effd640 1 -- 172.21.15.27:0/2789773124 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e500d1760 con 0x7f6e5015d7c0 2024-01-15T11:33:56.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:55.999+0000 7f6e4f7fe640 1 --2- 172.21.15.27:0/2789773124 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6e500d04c0 0x7f6e500cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:56.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.003+0000 7f6e4effd640 1 --2- 172.21.15.27:0/2789773124 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e5015d7c0 0x7f6e500d3d50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6e400097c0 tx=0x7f6e4001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a41748d9592832c server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:56.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.003+0000 7f6e4e7fc640 1 -- 172.21.15.27:0/2789773124 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e38001800 con 0x7f6e5015d7c0 2024-01-15T11:33:56.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.003+0000 7f6e4e7fc640 1 -- 172.21.15.27:0/2789773124 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e400a7050 con 0x7f6e5015d7c0 2024-01-15T11:33:56.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.003+0000 7f6e4e7fc640 1 -- 172.21.15.27:0/2789773124 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e400ab620 con 0x7f6e5015d7c0 2024-01-15T11:33:56.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.003+0000 7f6e55a17640 1 -- 172.21.15.27:0/2789773124 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e5015d7c0 msgr2=0x7f6e500d3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:56.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.003+0000 7f6e55a17640 1 --2- 172.21.15.27:0/2789773124 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e5015d7c0 0x7f6e500d3d50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6e400097c0 tx=0x7f6e4001c370 comp rx=0 tx=0).stop 2024-01-15T11:33:56.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.003+0000 7f6e55a17640 1 -- 172.21.15.27:0/2789773124 shutdown_connections 2024-01-15T11:33:56.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.003+0000 7f6e55a17640 1 --2- 172.21.15.27:0/2789773124 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6e500d04c0 0x7f6e500cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:56.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.003+0000 7f6e55a17640 1 --2- 172.21.15.27:0/2789773124 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e5015d7c0 0x7f6e500d3d50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:56.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.003+0000 7f6e55a17640 1 -- 172.21.15.27:0/2789773124 >> 172.21.15.27:0/2789773124 conn(0x7f6e5008afc0 msgr2=0x7f6e500d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:56.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.003+0000 7f6e55a17640 1 -- 172.21.15.27:0/2789773124 shutdown_connections 2024-01-15T11:33:56.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.003+0000 7f6e55a17640 1 -- 172.21.15.27:0/2789773124 wait complete. 2024-01-15T11:33:56.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.003+0000 7f6e55a17640 1 Processor -- start 2024-01-15T11:33:56.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.003+0000 7f6e55a17640 1 -- start start 2024-01-15T11:33:56.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.007+0000 7f6e55a17640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e500d04c0 0x7f6e50153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:56.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.007+0000 7f6e55a17640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6e5015d7c0 0x7f6e500b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:56.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.007+0000 7f6e55a17640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e500b7e20 0x7f6e5015ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:56.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.007+0000 7f6e55a17640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e500b0750 con 0x7f6e500b7e20 2024-01-15T11:33:56.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.007+0000 7f6e55a17640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e500b8680 con 0x7f6e500d04c0 2024-01-15T11:33:56.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.007+0000 7f6e55a17640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e500b00b0 con 0x7f6e5015d7c0 2024-01-15T11:33:56.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.007+0000 7f6e4f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e500b7e20 0x7f6e5015ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:56.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.007+0000 7f6e4f7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e500b7e20 0x7f6e5015ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52204/0 (socket says 172.21.15.27:52204) 2024-01-15T11:33:56.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.007+0000 7f6e4f7fe640 1 -- 172.21.15.27:0/356958611 learned_addr learned my addr 172.21.15.27:0/356958611 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:56.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.007+0000 7f6e4effd640 1 --2- 172.21.15.27:0/356958611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e500d04c0 0x7f6e50153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:56.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.007+0000 7f6e47fff640 1 --2- 172.21.15.27:0/356958611 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6e5015d7c0 0x7f6e500b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:56.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.007+0000 7f6e4f7fe640 1 -- 172.21.15.27:0/356958611 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6e5015d7c0 msgr2=0x7f6e500b78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:56.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.007+0000 7f6e4f7fe640 1 --2- 172.21.15.27:0/356958611 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6e5015d7c0 0x7f6e500b78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:56.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.007+0000 7f6e4f7fe640 1 -- 172.21.15.27:0/356958611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e500d04c0 msgr2=0x7f6e50153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:56.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.007+0000 7f6e4f7fe640 1 --2- 172.21.15.27:0/356958611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e500d04c0 0x7f6e50153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:56.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.007+0000 7f6e4f7fe640 1 -- 172.21.15.27:0/356958611 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e48009a70 con 0x7f6e500b7e20 2024-01-15T11:33:56.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.007+0000 7f6e47fff640 1 --2- 172.21.15.27:0/356958611 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6e5015d7c0 0x7f6e500b78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:56.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.007+0000 7f6e4f7fe640 1 --2- 172.21.15.27:0/356958611 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e500b7e20 0x7f6e5015ff10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6e4800ef90 tx=0x7f6e48009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:56.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.007+0000 7f6e4cff9640 1 -- 172.21.15.27:0/356958611 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48009d70 con 0x7f6e500b7e20 2024-01-15T11:33:56.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.007+0000 7f6e4cff9640 1 -- 172.21.15.27:0/356958611 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4800f040 con 0x7f6e500b7e20 2024-01-15T11:33:56.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.007+0000 7f6e4cff9640 1 -- 172.21.15.27:0/356958611 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e480146c0 con 0x7f6e500b7e20 2024-01-15T11:33:56.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.007+0000 7f6e55a17640 1 -- 172.21.15.27:0/356958611 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e40009420 con 0x7f6e500b7e20 2024-01-15T11:33:56.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.007+0000 7f6e55a17640 1 -- 172.21.15.27:0/356958611 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e500b0370 con 0x7f6e500b7e20 2024-01-15T11:33:56.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.007+0000 7f6e55a17640 1 -- 172.21.15.27:0/356958611 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e500b0890 con 0x7f6e500b7e20 2024-01-15T11:33:56.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.007+0000 7f6e4cff9640 1 -- 172.21.15.27:0/356958611 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f6e48014820 con 0x7f6e500b7e20 2024-01-15T11:33:56.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.011+0000 7f6e4cff9640 1 --2- 172.21.15.27:0/356958611 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6e300668f0 0x7f6e30068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:56.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.011+0000 7f6e4cff9640 1 -- 172.21.15.27:0/356958611 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e48085300 con 0x7f6e500b7e20 2024-01-15T11:33:56.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.011+0000 7f6e4effd640 1 --2- 172.21.15.27:0/356958611 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6e300668f0 0x7f6e30068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:56.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.011+0000 7f6e4effd640 1 --2- 172.21.15.27:0/356958611 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6e300668f0 0x7f6e30068db0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6e400ad000 tx=0x7f6e400a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:56.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.015+0000 7f6e4cff9640 1 -- 172.21.15.27:0/356958611 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6e500b0890 con 0x7f6e500b7e20 2024-01-15T11:33:56.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.183+0000 7f6e55a17640 1 -- 172.21.15.27:0/356958611 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6e500b0890 con 0x7f6e500b7e20 2024-01-15T11:33:56.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.183+0000 7f6e4cff9640 1 -- 172.21.15.27:0/356958611 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6e500b0890 con 0x7f6e500b7e20 2024-01-15T11:33:56.188 INFO:teuthology.orchestra.run.smithi027.stderr:listed 0 entries 2024-01-15T11:33:56.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.187+0000 7f6e55a17640 1 -- 172.21.15.27:0/356958611 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6e300668f0 msgr2=0x7f6e30068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:56.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.187+0000 7f6e55a17640 1 --2- 172.21.15.27:0/356958611 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6e300668f0 0x7f6e30068db0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6e400ad000 tx=0x7f6e400a6000 comp rx=0 tx=0).stop 2024-01-15T11:33:56.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.187+0000 7f6e55a17640 1 -- 172.21.15.27:0/356958611 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e500b7e20 msgr2=0x7f6e5015ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:56.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.187+0000 7f6e55a17640 1 --2- 172.21.15.27:0/356958611 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e500b7e20 0x7f6e5015ff10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6e4800ef90 tx=0x7f6e48009f90 comp rx=0 tx=0).stop 2024-01-15T11:33:56.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.187+0000 7f6e55a17640 1 -- 172.21.15.27:0/356958611 shutdown_connections 2024-01-15T11:33:56.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.187+0000 7f6e55a17640 1 --2- 172.21.15.27:0/356958611 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e500b7e20 0x7f6e5015ff10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:56.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.187+0000 7f6e55a17640 1 --2- 172.21.15.27:0/356958611 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6e5015d7c0 0x7f6e500b78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:56.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.187+0000 7f6e55a17640 1 --2- 172.21.15.27:0/356958611 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6e300668f0 0x7f6e30068db0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:56.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.187+0000 7f6e55a17640 1 --2- 172.21.15.27:0/356958611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6e500d04c0 0x7f6e50153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:56.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.187+0000 7f6e55a17640 1 -- 172.21.15.27:0/356958611 >> 172.21.15.27:0/356958611 conn(0x7f6e5008afc0 msgr2=0x7f6e500b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:56.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.187+0000 7f6e55a17640 1 -- 172.21.15.27:0/356958611 shutdown_connections 2024-01-15T11:33:56.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.187+0000 7f6e55a17640 1 -- 172.21.15.27:0/356958611 wait complete. 2024-01-15T11:33:56.208 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-01-15T11:33:56.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:56.209 DEBUG:teuthology.orchestra.run.smithi027:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-01-15T11:33:56.234 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi027.front.sepia.ceph.com 2024-01-15T11:33:56.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:56.234 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-01-15T11:33:56.285 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:33:56.285 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T11:33:56.295 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:33:56.296 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T11:33:56.346 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:33:56.347 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T11:33:56.399 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:33:56.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.539+0000 7fc15349a640 1 Processor -- start 2024-01-15T11:33:56.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.539+0000 7fc15349a640 1 -- start start 2024-01-15T11:33:56.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.539+0000 7fc15349a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc14c15d530 0x7fc14c0cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:56.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.539+0000 7fc15349a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc14c0d04c0 0x7fc14c1674d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:56.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.539+0000 7fc15349a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc14c0d12e0 con 0x7fc14c0cf1b0 2024-01-15T11:33:56.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.539+0000 7fc15349a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc14c0d15c0 con 0x7fc14c15d530 2024-01-15T11:33:56.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.539+0000 7fc15349a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c0d18a0 con 0x7fc14c0d04c0 2024-01-15T11:33:56.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.539+0000 7fc151236640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc14c15d530 0x7fc14c0cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:56.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.539+0000 7fc151236640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc14c15d530 0x7fc14c0cec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52220/0 (socket says 172.21.15.27:52220) 2024-01-15T11:33:56.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.539+0000 7fc151236640 1 -- 172.21.15.27:0/231594833 learned_addr learned my addr 172.21.15.27:0/231594833 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:56.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.539+0000 7fc151a37640 1 --2- 172.21.15.27:0/231594833 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc14c0d04c0 0x7fc14c1674d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:56.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.539+0000 7fc151236640 1 -- 172.21.15.27:0/231594833 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc14c0d04c0 msgr2=0x7fc14c1674d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:56.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.539+0000 7fc151236640 1 --2- 172.21.15.27:0/231594833 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc14c0d04c0 0x7fc14c1674d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:56.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.539+0000 7fc151236640 1 -- 172.21.15.27:0/231594833 >> v1:172.21.15.93:6789/0 conn(0x7fc14c0cf1b0 legacy=0x7fc14c0cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:56.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.539+0000 7fc151236640 1 -- 172.21.15.27:0/231594833 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c0d1b80 con 0x7fc14c15d530 2024-01-15T11:33:56.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.543+0000 7fc151236640 1 --2- 172.21.15.27:0/231594833 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc14c15d530 0x7fc14c0cec70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc1480098a0 tx=0x7fc14801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ca70b49a324f3f server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:56.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.543+0000 7fc143fff640 1 -- 172.21.15.27:0/231594833 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1480a8a10 con 0x7fc14c15d530 2024-01-15T11:33:56.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.543+0000 7fc143fff640 1 -- 172.21.15.27:0/231594833 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1480a8b70 con 0x7fc14c15d530 2024-01-15T11:33:56.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.543+0000 7fc143fff640 1 -- 172.21.15.27:0/231594833 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1480b0440 con 0x7fc14c15d530 2024-01-15T11:33:56.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.543+0000 7fc15349a640 1 -- 172.21.15.27:0/231594833 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc14c15d530 msgr2=0x7fc14c0cec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:56.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.543+0000 7fc15349a640 1 --2- 172.21.15.27:0/231594833 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc14c15d530 0x7fc14c0cec70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc1480098a0 tx=0x7fc14801ed10 comp rx=0 tx=0).stop 2024-01-15T11:33:56.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.543+0000 7fc15349a640 1 -- 172.21.15.27:0/231594833 shutdown_connections 2024-01-15T11:33:56.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.543+0000 7fc15349a640 1 --2- 172.21.15.27:0/231594833 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc14c0d04c0 0x7fc14c1674d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:56.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.543+0000 7fc15349a640 1 --2- 172.21.15.27:0/231594833 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc14c15d530 0x7fc14c0cec70 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:56.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.543+0000 7fc15349a640 1 -- 172.21.15.27:0/231594833 >> 172.21.15.27:0/231594833 conn(0x7fc14c09c6d0 msgr2=0x7fc14c0d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:56.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.543+0000 7fc15349a640 1 -- 172.21.15.27:0/231594833 shutdown_connections 2024-01-15T11:33:56.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.543+0000 7fc15349a640 1 -- 172.21.15.27:0/231594833 wait complete. 2024-01-15T11:33:56.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.547+0000 7fc15349a640 1 Processor -- start 2024-01-15T11:33:56.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.547+0000 7fc15349a640 1 -- start start 2024-01-15T11:33:56.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.547+0000 7fc15349a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc14c0cf1b0 0x7fc14c1e81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:56.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.547+0000 7fc15349a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc14c0d04c0 0x7fc14c1e86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:56.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.547+0000 7fc15349a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc14c15d530 0x7fc14c0b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:56.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.547+0000 7fc15349a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c15ce60 con 0x7fc14c0cf1b0 2024-01-15T11:33:56.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.547+0000 7fc15349a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c1e8f10 con 0x7fc14c0d04c0 2024-01-15T11:33:56.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.547+0000 7fc15349a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c1e91f0 con 0x7fc14c15d530 2024-01-15T11:33:56.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.547+0000 7fc151236640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc14c0cf1b0 0x7fc14c1e81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:56.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.547+0000 7fc151236640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc14c0cf1b0 0x7fc14c1e81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52236/0 (socket says 172.21.15.27:52236) 2024-01-15T11:33:56.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.547+0000 7fc151a37640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc14c15d530 0x7fc14c0b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:56.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.547+0000 7fc151236640 1 -- 172.21.15.27:0/1400298050 learned_addr learned my addr 172.21.15.27:0/1400298050 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:56.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.547+0000 7fc150a35640 1 --2- 172.21.15.27:0/1400298050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc14c0d04c0 0x7fc14c1e86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:56.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.547+0000 7fc151236640 1 -- 172.21.15.27:0/1400298050 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc14c15d530 msgr2=0x7fc14c0b5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:56.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.547+0000 7fc151236640 1 --2- 172.21.15.27:0/1400298050 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc14c15d530 0x7fc14c0b5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:56.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.547+0000 7fc151236640 1 -- 172.21.15.27:0/1400298050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc14c0d04c0 msgr2=0x7fc14c1e86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:56.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.547+0000 7fc151236640 1 --2- 172.21.15.27:0/1400298050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc14c0d04c0 0x7fc14c1e86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:56.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.547+0000 7fc151236640 1 -- 172.21.15.27:0/1400298050 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1480094d0 con 0x7fc14c0cf1b0 2024-01-15T11:33:56.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.547+0000 7fc151236640 1 --2- 172.21.15.27:0/1400298050 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc14c0cf1b0 0x7fc14c1e81a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc1480b3040 tx=0x7fc14801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:56.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.547+0000 7fc141ffb640 1 -- 172.21.15.27:0/1400298050 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1480be070 con 0x7fc14c0cf1b0 2024-01-15T11:33:56.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.547+0000 7fc141ffb640 1 -- 172.21.15.27:0/1400298050 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1480ba400 con 0x7fc14c0cf1b0 2024-01-15T11:33:56.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.547+0000 7fc15349a640 1 -- 172.21.15.27:0/1400298050 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc14c1e94d0 con 0x7fc14c0cf1b0 2024-01-15T11:33:56.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.547+0000 7fc141ffb640 1 -- 172.21.15.27:0/1400298050 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1480ba7d0 con 0x7fc14c0cf1b0 2024-01-15T11:33:56.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.547+0000 7fc15349a640 1 -- 172.21.15.27:0/1400298050 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc14c1e8c20 con 0x7fc14c0cf1b0 2024-01-15T11:33:56.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.551+0000 7fc15349a640 1 -- 172.21.15.27:0/1400298050 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc14c0d3e00 con 0x7fc14c0cf1b0 2024-01-15T11:33:56.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.551+0000 7fc141ffb640 1 -- 172.21.15.27:0/1400298050 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fc1480c3410 con 0x7fc14c0cf1b0 2024-01-15T11:33:56.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.551+0000 7fc141ffb640 1 --2- 172.21.15.27:0/1400298050 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc1300668f0 0x7fc130068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:56.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.551+0000 7fc141ffb640 1 -- 172.21.15.27:0/1400298050 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc148121ed0 con 0x7fc14c0cf1b0 2024-01-15T11:33:56.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.551+0000 7fc150a35640 1 --2- 172.21.15.27:0/1400298050 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc1300668f0 0x7fc130068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:56.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.551+0000 7fc150a35640 1 --2- 172.21.15.27:0/1400298050 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc1300668f0 0x7fc130068db0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc14c09cbd0 tx=0x7fc13c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:56.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.555+0000 7fc141ffb640 1 -- 172.21.15.27:0/1400298050 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc1480ef1b0 con 0x7fc14c0cf1b0 2024-01-15T11:33:56.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.711+0000 7fc15349a640 1 -- 172.21.15.27:0/1400298050 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc14c04e850 con 0x7fc14c0cf1b0 2024-01-15T11:33:56.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.715+0000 7fc141ffb640 1 -- 172.21.15.27:0/1400298050 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16425 (secure 0 0 0) 0x7fc1480f27d0 con 0x7fc14c0cf1b0 2024-01-15T11:33:56.717 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:56.717 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:33:21.682894+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T11:33:18.397200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T11:33:19.061383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:33:56.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.715+0000 7fc15349a640 1 -- 172.21.15.27:0/1400298050 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc1300668f0 msgr2=0x7fc130068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:56.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.715+0000 7fc15349a640 1 --2- 172.21.15.27:0/1400298050 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc1300668f0 0x7fc130068db0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc14c09cbd0 tx=0x7fc13c009040 comp rx=0 tx=0).stop 2024-01-15T11:33:56.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.715+0000 7fc15349a640 1 -- 172.21.15.27:0/1400298050 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc14c0cf1b0 msgr2=0x7fc14c1e81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:56.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.715+0000 7fc15349a640 1 --2- 172.21.15.27:0/1400298050 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc14c0cf1b0 0x7fc14c1e81a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc1480b3040 tx=0x7fc14801bab0 comp rx=0 tx=0).stop 2024-01-15T11:33:56.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.715+0000 7fc15349a640 1 -- 172.21.15.27:0/1400298050 shutdown_connections 2024-01-15T11:33:56.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.715+0000 7fc15349a640 1 --2- 172.21.15.27:0/1400298050 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc14c15d530 0x7fc14c0b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:56.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.715+0000 7fc15349a640 1 --2- 172.21.15.27:0/1400298050 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc1300668f0 0x7fc130068db0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:56.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.715+0000 7fc15349a640 1 --2- 172.21.15.27:0/1400298050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc14c0d04c0 0x7fc14c1e86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:56.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.715+0000 7fc15349a640 1 --2- 172.21.15.27:0/1400298050 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc14c0cf1b0 0x7fc14c1e81a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:56.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.715+0000 7fc15349a640 1 -- 172.21.15.27:0/1400298050 >> 172.21.15.27:0/1400298050 conn(0x7fc14c09c6d0 msgr2=0x7fc14c0b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:56.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.715+0000 7fc15349a640 1 -- 172.21.15.27:0/1400298050 shutdown_connections 2024-01-15T11:33:56.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.715+0000 7fc15349a640 1 -- 172.21.15.27:0/1400298050 wait complete. 2024-01-15T11:33:56.738 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T11:33:08.134662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-15T11:33:18.397200+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-15T11:33:19.061383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T11:33:56.738 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T11:33:56.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.883+0000 7fc88f49a640 1 Processor -- start 2024-01-15T11:33:56.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.883+0000 7fc88f49a640 1 -- start start 2024-01-15T11:33:56.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.883+0000 7fc88f49a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc888072630 0x7fc8880cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:56.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.883+0000 7fc88f49a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc8880cbe60 0x7fc8880b3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:56.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.883+0000 7fc88f49a640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8880cc2a0 con 0x7fc8880b3cb0 2024-01-15T11:33:56.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.883+0000 7fc88f49a640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8880ccea0 con 0x7fc8880cbe60 2024-01-15T11:33:56.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.883+0000 7fc88f49a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8880cd180 con 0x7fc888072630 2024-01-15T11:33:56.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.883+0000 7fc88da37640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fc8880b3cb0 0x7fc88806c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33350/0 (socket says 172.21.15.27:33350) 2024-01-15T11:33:56.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.883+0000 7fc88da37640 1 -- 172.21.15.27:0/2080392041 learned_addr learned my addr 172.21.15.27:0/2080392041 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:56.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.883+0000 7fc88d236640 1 --2- 172.21.15.27:0/2080392041 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc888072630 0x7fc8880cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:56.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.883+0000 7fc88ca35640 1 --2- 172.21.15.27:0/2080392041 >> v2:172.21.15.93:3300/0 conn(0x7fc8880cbe60 0x7fc8880b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:56.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.883+0000 7fc87ffff640 1 -- 172.21.15.27:0/2080392041 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146245275 0 0) 0x7fc8880cc2a0 con 0x7fc8880b3cb0 2024-01-15T11:33:56.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.883+0000 7fc87ffff640 1 -- 172.21.15.27:0/2080392041 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc874003530 con 0x7fc8880b3cb0 2024-01-15T11:33:56.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.883+0000 7fc88d236640 1 -- 172.21.15.27:0/2080392041 >> v2:172.21.15.93:3300/0 conn(0x7fc8880cbe60 msgr2=0x7fc8880b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:56.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.883+0000 7fc88d236640 1 --2- 172.21.15.27:0/2080392041 >> v2:172.21.15.93:3300/0 conn(0x7fc8880cbe60 0x7fc8880b3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:56.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.883+0000 7fc88d236640 1 -- 172.21.15.27:0/2080392041 >> v1:172.21.15.27:6789/0 conn(0x7fc8880b3cb0 legacy=0x7fc88806c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:56.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.883+0000 7fc87ffff640 1 -- 172.21.15.27:0/2080392041 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1032281222 0 0) 0x7fc874003530 con 0x7fc8880b3cb0 2024-01-15T11:33:56.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.883+0000 7fc88d236640 1 -- 172.21.15.27:0/2080392041 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8880cd460 con 0x7fc888072630 2024-01-15T11:33:56.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.887+0000 7fc88d236640 1 --2- 172.21.15.27:0/2080392041 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc888072630 0x7fc8880cb920 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc8840097c0 tx=0x7fc88401c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=537b068595e78f51 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:56.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.887+0000 7fc87ffff640 1 -- 172.21.15.27:0/2080392041 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc880001a00 con 0x7fc888072630 2024-01-15T11:33:56.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.887+0000 7fc87ffff640 1 -- 172.21.15.27:0/2080392041 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8840a7050 con 0x7fc888072630 2024-01-15T11:33:56.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.887+0000 7fc87ffff640 1 -- 172.21.15.27:0/2080392041 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8840ab620 con 0x7fc888072630 2024-01-15T11:33:56.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.887+0000 7fc88f49a640 1 -- 172.21.15.27:0/2080392041 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc888072630 msgr2=0x7fc8880cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:56.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.887+0000 7fc88f49a640 1 --2- 172.21.15.27:0/2080392041 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc888072630 0x7fc8880cb920 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc8840097c0 tx=0x7fc88401c3a0 comp rx=0 tx=0).stop 2024-01-15T11:33:56.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.887+0000 7fc88f49a640 1 -- 172.21.15.27:0/2080392041 shutdown_connections 2024-01-15T11:33:56.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.887+0000 7fc88f49a640 1 --2- 172.21.15.27:0/2080392041 >> v2:172.21.15.93:3300/0 conn(0x7fc8880cbe60 0x7fc8880b3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:56.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.887+0000 7fc88f49a640 1 --2- 172.21.15.27:0/2080392041 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc888072630 0x7fc8880cb920 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:56.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.887+0000 7fc88f49a640 1 -- 172.21.15.27:0/2080392041 >> 172.21.15.27:0/2080392041 conn(0x7fc8880b0cb0 msgr2=0x7fc8880b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:56.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.887+0000 7fc88f49a640 1 -- 172.21.15.27:0/2080392041 shutdown_connections 2024-01-15T11:33:56.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.887+0000 7fc88f49a640 1 -- 172.21.15.27:0/2080392041 wait complete. 2024-01-15T11:33:56.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc88f49a640 1 Processor -- start 2024-01-15T11:33:56.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc88f49a640 1 -- start start 2024-01-15T11:33:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc88f49a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc888072630 0x7fc88814cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc88f49a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc8880b3cb0 0x7fc8880c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc88f49a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc8880cbe60 0x7fc888154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc88f49a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8880ac2e0 con 0x7fc8880b3cb0 2024-01-15T11:33:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc88f49a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8880ac5c0 con 0x7fc888072630 2024-01-15T11:33:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc88f49a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8880ac8a0 con 0x7fc8880cbe60 2024-01-15T11:33:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc88ca35640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc8880b3cb0 0x7fc8880c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc88ca35640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc8880b3cb0 0x7fc8880c8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52248/0 (socket says 172.21.15.27:52248) 2024-01-15T11:33:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc88ca35640 1 -- 172.21.15.27:0/915527530 learned_addr learned my addr 172.21.15.27:0/915527530 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc88d236640 1 --2- 172.21.15.27:0/915527530 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc888072630 0x7fc88814cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc88da37640 1 --2- 172.21.15.27:0/915527530 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc8880cbe60 0x7fc888154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc88ca35640 1 -- 172.21.15.27:0/915527530 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc8880cbe60 msgr2=0x7fc888154e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc88ca35640 1 --2- 172.21.15.27:0/915527530 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc8880cbe60 0x7fc888154e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:56.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc88ca35640 1 -- 172.21.15.27:0/915527530 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc888072630 msgr2=0x7fc88814cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:56.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc88ca35640 1 --2- 172.21.15.27:0/915527530 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc888072630 0x7fc88814cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:56.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc88ca35640 1 -- 172.21.15.27:0/915527530 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc884009420 con 0x7fc8880b3cb0 2024-01-15T11:33:56.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc88da37640 1 --2- 172.21.15.27:0/915527530 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc8880cbe60 0x7fc888154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:56.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc88d236640 1 --2- 172.21.15.27:0/915527530 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc888072630 0x7fc88814cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:56.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc88ca35640 1 --2- 172.21.15.27:0/915527530 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc8880b3cb0 0x7fc8880c8330 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc87800e930 tx=0x7fc87800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:56.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc87dffb640 1 -- 172.21.15.27:0/915527530 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc878009690 con 0x7fc8880b3cb0 2024-01-15T11:33:56.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc87dffb640 1 -- 172.21.15.27:0/915527530 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87800ca00 con 0x7fc8880b3cb0 2024-01-15T11:33:56.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc87dffb640 1 -- 172.21.15.27:0/915527530 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87800cd70 con 0x7fc8880b3cb0 2024-01-15T11:33:56.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc88f49a640 1 -- 172.21.15.27:0/915527530 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8880acb80 con 0x7fc8880b3cb0 2024-01-15T11:33:56.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.891+0000 7fc88f49a640 1 -- 172.21.15.27:0/915527530 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8880c8870 con 0x7fc8880b3cb0 2024-01-15T11:33:56.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.895+0000 7fc88f49a640 1 -- 172.21.15.27:0/915527530 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8880671f0 con 0x7fc8880b3cb0 2024-01-15T11:33:56.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.895+0000 7fc87dffb640 1 -- 172.21.15.27:0/915527530 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fc878013470 con 0x7fc8880b3cb0 2024-01-15T11:33:56.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.895+0000 7fc87dffb640 1 --2- 172.21.15.27:0/915527530 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc86c066920 0x7fc86c068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:56.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.895+0000 7fc87dffb640 1 -- 172.21.15.27:0/915527530 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc878084630 con 0x7fc8880b3cb0 2024-01-15T11:33:56.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.895+0000 7fc88d236640 1 --2- 172.21.15.27:0/915527530 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc86c066920 0x7fc86c068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:56.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.895+0000 7fc88d236640 1 --2- 172.21.15.27:0/915527530 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc86c066920 0x7fc86c068de0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc8840ad000 tx=0x7fc8840a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:56.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:56.899+0000 7fc87dffb640 1 -- 172.21.15.27:0/915527530 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc878051940 con 0x7fc8880b3cb0 2024-01-15T11:33:57.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.059+0000 7fc88f49a640 1 -- 172.21.15.27:0/915527530 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc8880cc570 con 0x7fc8880b3cb0 2024-01-15T11:33:57.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.059+0000 7fc87dffb640 1 -- 172.21.15.27:0/915527530 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc878054f60 con 0x7fc8880b3cb0 2024-01-15T11:33:57.063 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-15T11:33:57.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.063+0000 7fc88f49a640 1 -- 172.21.15.27:0/915527530 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc86c066920 msgr2=0x7fc86c068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:57.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.063+0000 7fc88f49a640 1 --2- 172.21.15.27:0/915527530 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc86c066920 0x7fc86c068de0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc8840ad000 tx=0x7fc8840a6000 comp rx=0 tx=0).stop 2024-01-15T11:33:57.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.063+0000 7fc88f49a640 1 -- 172.21.15.27:0/915527530 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc8880b3cb0 msgr2=0x7fc8880c8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:57.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.063+0000 7fc88f49a640 1 --2- 172.21.15.27:0/915527530 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc8880b3cb0 0x7fc8880c8330 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc87800e930 tx=0x7fc87800edf0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.063+0000 7fc88f49a640 1 -- 172.21.15.27:0/915527530 shutdown_connections 2024-01-15T11:33:57.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.063+0000 7fc88f49a640 1 --2- 172.21.15.27:0/915527530 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc8880cbe60 0x7fc888154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.063+0000 7fc88f49a640 1 --2- 172.21.15.27:0/915527530 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc8880b3cb0 0x7fc8880c8330 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.063+0000 7fc88f49a640 1 --2- 172.21.15.27:0/915527530 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc86c066920 0x7fc86c068de0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.063+0000 7fc88f49a640 1 --2- 172.21.15.27:0/915527530 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc888072630 0x7fc88814cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.063+0000 7fc88f49a640 1 -- 172.21.15.27:0/915527530 >> 172.21.15.27:0/915527530 conn(0x7fc8880b0cb0 msgr2=0x7fc8880b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:57.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.063+0000 7fc88f49a640 1 -- 172.21.15.27:0/915527530 shutdown_connections 2024-01-15T11:33:57.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.063+0000 7fc88f49a640 1 -- 172.21.15.27:0/915527530 wait complete. 2024-01-15T11:33:57.084 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-15T11:33:57.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.227+0000 7f7208e5a640 1 Processor -- start 2024-01-15T11:33:57.231 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.227+0000 7f7208e5a640 1 -- start start 2024-01-15T11:33:57.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.227+0000 7f7208e5a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f720406e120 0x7f720415df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:57.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.227+0000 7f7208e5a640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72040cd870 con 0x7f7204154940 2024-01-15T11:33:57.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.231+0000 7f7208e5a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f720415ecc0 con 0x7f720415e4d0 2024-01-15T11:33:57.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.231+0000 7f7208e5a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7204154d20 con 0x7f720406e120 2024-01-15T11:33:57.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.231+0000 7f720259c640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7204154940 0x7f720406da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33354/0 (socket says 172.21.15.27:33354) 2024-01-15T11:33:57.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.231+0000 7f720259c640 1 -- 172.21.15.27:0/779003090 learned_addr learned my addr 172.21.15.27:0/779003090 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:57.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.231+0000 7f71fbfff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f720406e120 0x7f720415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:57.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.231+0000 7f71fbfff640 1 -- 172.21.15.27:0/779003090 >> v1:172.21.15.93:6789/0 conn(0x7f720415e4d0 legacy=0x7f72040ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:57.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.231+0000 7f71fbfff640 1 -- 172.21.15.27:0/779003090 >> v1:172.21.15.27:6789/0 conn(0x7f7204154940 legacy=0x7f720406da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:57.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.231+0000 7f71fbfff640 1 -- 172.21.15.27:0/779003090 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72040ccf40 con 0x7f720406e120 2024-01-15T11:33:57.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.231+0000 7f71fbfff640 1 --2- 172.21.15.27:0/779003090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f720406e120 0x7f720415df90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f71ec0097c0 tx=0x7f71ec01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7a5b33cc0b5021 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:57.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.231+0000 7f7201d9b640 1 -- 172.21.15.27:0/779003090 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec0ab650 con 0x7f720406e120 2024-01-15T11:33:57.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.231+0000 7f7201d9b640 1 -- 172.21.15.27:0/779003090 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ec0ab7b0 con 0x7f720406e120 2024-01-15T11:33:57.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.231+0000 7f7201d9b640 1 -- 172.21.15.27:0/779003090 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec0abb40 con 0x7f720406e120 2024-01-15T11:33:57.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.235+0000 7f7208e5a640 1 -- 172.21.15.27:0/779003090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f720406e120 msgr2=0x7f720415df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:57.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.235+0000 7f7208e5a640 1 --2- 172.21.15.27:0/779003090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f720406e120 0x7f720415df90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f71ec0097c0 tx=0x7f71ec01c450 comp rx=0 tx=0).stop 2024-01-15T11:33:57.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.235+0000 7f7208e5a640 1 -- 172.21.15.27:0/779003090 shutdown_connections 2024-01-15T11:33:57.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.235+0000 7f7208e5a640 1 --2- 172.21.15.27:0/779003090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f720406e120 0x7f720415df90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.235+0000 7f7208e5a640 1 -- 172.21.15.27:0/779003090 >> 172.21.15.27:0/779003090 conn(0x7f72040b0cb0 msgr2=0x7f72040b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:57.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.235+0000 7f7208e5a640 1 -- 172.21.15.27:0/779003090 shutdown_connections 2024-01-15T11:33:57.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.235+0000 7f7208e5a640 1 -- 172.21.15.27:0/779003090 wait complete. 2024-01-15T11:33:57.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.235+0000 7f7208e5a640 1 Processor -- start 2024-01-15T11:33:57.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.235+0000 7f7208e5a640 1 -- start start 2024-01-15T11:33:57.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.235+0000 7f7208e5a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f720406e120 0x7f7204099c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:57.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.235+0000 7f7208e5a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7204154940 0x7f7204153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:57.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.235+0000 7f7208e5a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f720415e4d0 0x7f720414c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:57.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.235+0000 7f7208e5a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7204153a50 con 0x7f720406e120 2024-01-15T11:33:57.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.235+0000 7f7208e5a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720409c0f0 con 0x7f7204154940 2024-01-15T11:33:57.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.235+0000 7f7208e5a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f720409c3d0 con 0x7f720415e4d0 2024-01-15T11:33:57.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.235+0000 7f720259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f720406e120 0x7f7204099c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:57.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.235+0000 7f71fbfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7204154940 0x7f7204153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:57.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.235+0000 7f720259c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f720406e120 0x7f7204099c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52258/0 (socket says 172.21.15.27:52258) 2024-01-15T11:33:57.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.235+0000 7f720259c640 1 -- 172.21.15.27:0/3737317703 learned_addr learned my addr 172.21.15.27:0/3737317703 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:57.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.235+0000 7f7202d9d640 1 --2- 172.21.15.27:0/3737317703 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f720415e4d0 0x7f720414c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:57.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.239+0000 7f71fbfff640 1 -- 172.21.15.27:0/3737317703 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f720415e4d0 msgr2=0x7f720414c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:57.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.239+0000 7f71fbfff640 1 --2- 172.21.15.27:0/3737317703 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f720415e4d0 0x7f720414c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.239+0000 7f71fbfff640 1 -- 172.21.15.27:0/3737317703 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f720406e120 msgr2=0x7f7204099c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:57.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.239+0000 7f71fbfff640 1 --2- 172.21.15.27:0/3737317703 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f720406e120 0x7f7204099c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.239+0000 7f71fbfff640 1 -- 172.21.15.27:0/3737317703 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ec009420 con 0x7f7204154940 2024-01-15T11:33:57.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.239+0000 7f720259c640 1 --2- 172.21.15.27:0/3737317703 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f720406e120 0x7f7204099c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:57.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.239+0000 7f71fbfff640 1 --2- 172.21.15.27:0/3737317703 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7204154940 0x7f7204153510 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f71ec0ac000 tx=0x7f71ec01ac90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:57.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.239+0000 7f71faffd640 1 -- 172.21.15.27:0/3737317703 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec0b5810 con 0x7f7204154940 2024-01-15T11:33:57.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.239+0000 7f71faffd640 1 -- 172.21.15.27:0/3737317703 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ec0b5990 con 0x7f7204154940 2024-01-15T11:33:57.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.239+0000 7f71faffd640 1 -- 172.21.15.27:0/3737317703 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec0b5d40 con 0x7f7204154940 2024-01-15T11:33:57.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.239+0000 7f7208e5a640 1 -- 172.21.15.27:0/3737317703 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f720409c6b0 con 0x7f7204154940 2024-01-15T11:33:57.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.239+0000 7f7208e5a640 1 -- 172.21.15.27:0/3737317703 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720409cc70 con 0x7f7204154940 2024-01-15T11:33:57.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.239+0000 7f7208e5a640 1 -- 172.21.15.27:0/3737317703 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72040671f0 con 0x7f7204154940 2024-01-15T11:33:57.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.239+0000 7f71faffd640 1 -- 172.21.15.27:0/3737317703 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f71ec0de430 con 0x7f7204154940 2024-01-15T11:33:57.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.239+0000 7f71faffd640 1 --2- 172.21.15.27:0/3737317703 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f71e40668f0 0x7f71e4068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:57.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.239+0000 7f71faffd640 1 -- 172.21.15.27:0/3737317703 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71ec11ef60 con 0x7f7204154940 2024-01-15T11:33:57.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.243+0000 7f720259c640 1 --2- 172.21.15.27:0/3737317703 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f71e40668f0 0x7f71e4068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:57.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.243+0000 7f720259c640 1 --2- 172.21.15.27:0/3737317703 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f71e40668f0 0x7f71e4068db0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f71f4005890 tx=0x7f71f4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:57.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.243+0000 7f71faffd640 1 -- 172.21.15.27:0/3737317703 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71ec0ec350 con 0x7f7204154940 2024-01-15T11:33:57.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.403+0000 7f7208e5a640 1 -- 172.21.15.27:0/3737317703 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f720409c510 con 0x7f7204154940 2024-01-15T11:33:57.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.403+0000 7f71faffd640 1 -- 172.21.15.27:0/3737317703 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f720409c510 con 0x7f7204154940 2024-01-15T11:33:57.408 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-01-15T11:33:57.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.407+0000 7f7208e5a640 1 -- 172.21.15.27:0/3737317703 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f71e40668f0 msgr2=0x7f71e4068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:57.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.407+0000 7f7208e5a640 1 --2- 172.21.15.27:0/3737317703 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f71e40668f0 0x7f71e4068db0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f71f4005890 tx=0x7f71f4009040 comp rx=0 tx=0).stop 2024-01-15T11:33:57.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.407+0000 7f7208e5a640 1 -- 172.21.15.27:0/3737317703 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7204154940 msgr2=0x7f7204153510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:57.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.407+0000 7f7208e5a640 1 --2- 172.21.15.27:0/3737317703 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7204154940 0x7f7204153510 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f71ec0ac000 tx=0x7f71ec01ac90 comp rx=0 tx=0).stop 2024-01-15T11:33:57.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.407+0000 7f7208e5a640 1 -- 172.21.15.27:0/3737317703 shutdown_connections 2024-01-15T11:33:57.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.407+0000 7f7208e5a640 1 --2- 172.21.15.27:0/3737317703 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f720415e4d0 0x7f720414c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.407+0000 7f7208e5a640 1 --2- 172.21.15.27:0/3737317703 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f71e40668f0 0x7f71e4068db0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.407+0000 7f7208e5a640 1 --2- 172.21.15.27:0/3737317703 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7204154940 0x7f7204153510 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.407+0000 7f7208e5a640 1 --2- 172.21.15.27:0/3737317703 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f720406e120 0x7f7204099c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.407+0000 7f7208e5a640 1 -- 172.21.15.27:0/3737317703 >> 172.21.15.27:0/3737317703 conn(0x7f72040b0cb0 msgr2=0x7f7204150000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:57.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.407+0000 7f7208e5a640 1 -- 172.21.15.27:0/3737317703 shutdown_connections 2024-01-15T11:33:57.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.407+0000 7f7208e5a640 1 -- 172.21.15.27:0/3737317703 wait complete. 2024-01-15T11:33:57.429 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-15T11:33:57.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.571+0000 7f60d17df640 1 Processor -- start 2024-01-15T11:33:57.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.571+0000 7f60d17df640 1 -- start start 2024-01-15T11:33:57.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.571+0000 7f60d17df640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60cc0cb9b0 0x7f60cc06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:57.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.571+0000 7f60d17df640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f60cc0ce5d0 0x7f60cc15bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:57.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.571+0000 7f60d17df640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60cc159630 con 0x7f60cc0cbd90 2024-01-15T11:33:57.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.571+0000 7f60d17df640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60cc15bba0 con 0x7f60cc0ce5d0 2024-01-15T11:33:57.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.571+0000 7f60d17df640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc0cdd50 con 0x7f60cc0cb9b0 2024-01-15T11:33:57.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.571+0000 7f60cb7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f60cc0ce5d0 0x7f60cc15bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:57.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.571+0000 7f60cb7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f60cc0ce5d0 0x7f60cc15bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52270/0 (socket says 172.21.15.27:52270) 2024-01-15T11:33:57.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.571+0000 7f60cb7fe640 1 -- 172.21.15.27:0/472880404 learned_addr learned my addr 172.21.15.27:0/472880404 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:57.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.575+0000 7f60caffd640 1 --2- 172.21.15.27:0/472880404 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60cc0cb9b0 0x7f60cc06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:57.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.575+0000 7f60cb7fe640 1 -- 172.21.15.27:0/472880404 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60cc0cb9b0 msgr2=0x7f60cc06e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:57.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.575+0000 7f60cb7fe640 1 --2- 172.21.15.27:0/472880404 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60cc0cb9b0 0x7f60cc06e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.575+0000 7f60cb7fe640 1 -- 172.21.15.27:0/472880404 >> v1:172.21.15.93:6789/0 conn(0x7f60cc0cbd90 legacy=0x7f60cc15f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:57.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.575+0000 7f60cb7fe640 1 -- 172.21.15.27:0/472880404 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc0cd1d0 con 0x7f60cc0ce5d0 2024-01-15T11:33:57.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.575+0000 7f60cb7fe640 1 --2- 172.21.15.27:0/472880404 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60cc0ce5d0 0x7f60cc15bfd0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009870 tx=0x7f60c401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb2777d3cbd8f server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:57.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.575+0000 7f60ca7fc640 1 -- 172.21.15.27:0/472880404 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c40aa650 con 0x7f60cc0ce5d0 2024-01-15T11:33:57.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.575+0000 7f60ca7fc640 1 -- 172.21.15.27:0/472880404 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c40aa7b0 con 0x7f60cc0ce5d0 2024-01-15T11:33:57.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.575+0000 7f60ca7fc640 1 -- 172.21.15.27:0/472880404 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c40aab40 con 0x7f60cc0ce5d0 2024-01-15T11:33:57.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.575+0000 7f60d17df640 1 -- 172.21.15.27:0/472880404 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60cc0ce5d0 msgr2=0x7f60cc15bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:57.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.575+0000 7f60d17df640 1 --2- 172.21.15.27:0/472880404 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60cc0ce5d0 0x7f60cc15bfd0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009870 tx=0x7f60c401c510 comp rx=0 tx=0).stop 2024-01-15T11:33:57.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.579+0000 7f60d17df640 1 -- 172.21.15.27:0/472880404 shutdown_connections 2024-01-15T11:33:57.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.579+0000 7f60d17df640 1 --2- 172.21.15.27:0/472880404 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60cc0ce5d0 0x7f60cc15bfd0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.579+0000 7f60d17df640 1 --2- 172.21.15.27:0/472880404 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60cc0cb9b0 0x7f60cc06e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.579+0000 7f60d17df640 1 -- 172.21.15.27:0/472880404 >> 172.21.15.27:0/472880404 conn(0x7f60cc0b0cb0 msgr2=0x7f60cc0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:57.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.579+0000 7f60d17df640 1 -- 172.21.15.27:0/472880404 shutdown_connections 2024-01-15T11:33:57.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.579+0000 7f60d17df640 1 -- 172.21.15.27:0/472880404 wait complete. 2024-01-15T11:33:57.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.579+0000 7f60d17df640 1 Processor -- start 2024-01-15T11:33:57.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.579+0000 7f60d17df640 1 -- start start 2024-01-15T11:33:57.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.579+0000 7f60d17df640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60cc0cb9b0 0x7f60cc150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:57.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.579+0000 7f60d17df640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60cc0cbd90 0x7f60cc154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:57.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.579+0000 7f60d17df640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60cc0ce5d0 0x7f60cc151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:57.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.579+0000 7f60d17df640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc150840 con 0x7f60cc0ce5d0 2024-01-15T11:33:57.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.579+0000 7f60d17df640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc150a70 con 0x7f60cc0cbd90 2024-01-15T11:33:57.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.579+0000 7f60d17df640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc150d50 con 0x7f60cc0cb9b0 2024-01-15T11:33:57.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.579+0000 7f60cb7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60cc0ce5d0 0x7f60cc151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:57.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.579+0000 7f60cb7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60cc0ce5d0 0x7f60cc151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52286/0 (socket says 172.21.15.27:52286) 2024-01-15T11:33:57.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.579+0000 7f60cb7fe640 1 -- 172.21.15.27:0/2627853376 learned_addr learned my addr 172.21.15.27:0/2627853376 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:57.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.579+0000 7f60caffd640 1 --2- 172.21.15.27:0/2627853376 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60cc0cb9b0 0x7f60cc150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:57.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.579+0000 7f60c27fc640 1 --2- 172.21.15.27:0/2627853376 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60cc0cbd90 0x7f60cc154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:57.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.579+0000 7f60cb7fe640 1 -- 172.21.15.27:0/2627853376 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60cc0cb9b0 msgr2=0x7f60cc150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:57.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.579+0000 7f60cb7fe640 1 --2- 172.21.15.27:0/2627853376 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60cc0cb9b0 0x7f60cc150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.579+0000 7f60cb7fe640 1 -- 172.21.15.27:0/2627853376 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60cc0cbd90 msgr2=0x7f60cc154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:57.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.579+0000 7f60cb7fe640 1 --2- 172.21.15.27:0/2627853376 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60cc0cbd90 0x7f60cc154820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.579+0000 7f60cb7fe640 1 -- 172.21.15.27:0/2627853376 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c40094d0 con 0x7f60cc0ce5d0 2024-01-15T11:33:57.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.579+0000 7f60cb7fe640 1 --2- 172.21.15.27:0/2627853376 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60cc0ce5d0 0x7f60cc151b10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f60c40ac040 tx=0x7f60c401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:57.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.583+0000 7f60c3fff640 1 -- 172.21.15.27:0/2627853376 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c40bd5f0 con 0x7f60cc0ce5d0 2024-01-15T11:33:57.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.583+0000 7f60c3fff640 1 -- 172.21.15.27:0/2627853376 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c40bd770 con 0x7f60cc0ce5d0 2024-01-15T11:33:57.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.583+0000 7f60c3fff640 1 -- 172.21.15.27:0/2627853376 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c40bdb20 con 0x7f60cc0ce5d0 2024-01-15T11:33:57.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.583+0000 7f60d17df640 1 -- 172.21.15.27:0/2627853376 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60cc151030 con 0x7f60cc0ce5d0 2024-01-15T11:33:57.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.583+0000 7f60d17df640 1 -- 172.21.15.27:0/2627853376 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60cc1515f0 con 0x7f60cc0ce5d0 2024-01-15T11:33:57.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.583+0000 7f60d17df640 1 -- 172.21.15.27:0/2627853376 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60cc0671f0 con 0x7f60cc0ce5d0 2024-01-15T11:33:57.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.583+0000 7f60c3fff640 1 -- 172.21.15.27:0/2627853376 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f60c40b3600 con 0x7f60cc0ce5d0 2024-01-15T11:33:57.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.583+0000 7f60c3fff640 1 --2- 172.21.15.27:0/2627853376 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f60ac0668f0 0x7f60ac068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:57.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.583+0000 7f60c3fff640 1 -- 172.21.15.27:0/2627853376 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60c411f410 con 0x7f60cc0ce5d0 2024-01-15T11:33:57.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.583+0000 7f60caffd640 1 --2- 172.21.15.27:0/2627853376 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f60ac0668f0 0x7f60ac068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:57.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.587+0000 7f60caffd640 1 --2- 172.21.15.27:0/2627853376 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f60ac0668f0 0x7f60ac068db0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009b60 tx=0x7f60bc009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:57.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.587+0000 7f60c3fff640 1 -- 172.21.15.27:0/2627853376 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f60c40ec660 con 0x7f60cc0ce5d0 2024-01-15T11:33:57.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.747+0000 7f60d17df640 1 -- 172.21.15.27:0/2627853376 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f60cc150e90 con 0x7f60cc0ce5d0 2024-01-15T11:33:57.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.747+0000 7f60c3fff640 1 -- 172.21.15.27:0/2627853376 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f60cc150e90 con 0x7f60cc0ce5d0 2024-01-15T11:33:57.749 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-01-15T11:33:57.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.747+0000 7f60d17df640 1 -- 172.21.15.27:0/2627853376 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f60ac0668f0 msgr2=0x7f60ac068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:57.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.747+0000 7f60d17df640 1 --2- 172.21.15.27:0/2627853376 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f60ac0668f0 0x7f60ac068db0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009b60 tx=0x7f60bc009190 comp rx=0 tx=0).stop 2024-01-15T11:33:57.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.747+0000 7f60d17df640 1 -- 172.21.15.27:0/2627853376 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60cc0ce5d0 msgr2=0x7f60cc151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:57.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.747+0000 7f60d17df640 1 --2- 172.21.15.27:0/2627853376 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60cc0ce5d0 0x7f60cc151b10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f60c40ac040 tx=0x7f60c401ad50 comp rx=0 tx=0).stop 2024-01-15T11:33:57.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.747+0000 7f60d17df640 1 -- 172.21.15.27:0/2627853376 shutdown_connections 2024-01-15T11:33:57.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.747+0000 7f60d17df640 1 --2- 172.21.15.27:0/2627853376 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60cc0ce5d0 0x7f60cc151b10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.747+0000 7f60d17df640 1 --2- 172.21.15.27:0/2627853376 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f60ac0668f0 0x7f60ac068db0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.747+0000 7f60d17df640 1 --2- 172.21.15.27:0/2627853376 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60cc0cbd90 0x7f60cc154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.747+0000 7f60d17df640 1 --2- 172.21.15.27:0/2627853376 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60cc0cb9b0 0x7f60cc150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.747+0000 7f60d17df640 1 -- 172.21.15.27:0/2627853376 >> 172.21.15.27:0/2627853376 conn(0x7f60cc0b0cb0 msgr2=0x7f60cc071760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:57.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.747+0000 7f60d17df640 1 -- 172.21.15.27:0/2627853376 shutdown_connections 2024-01-15T11:33:57.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.747+0000 7f60d17df640 1 -- 172.21.15.27:0/2627853376 wait complete. 2024-01-15T11:33:57.771 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-15T11:33:57.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.911+0000 7f65c3217640 1 Processor -- start 2024-01-15T11:33:57.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.911+0000 7f65c3217640 1 -- start start 2024-01-15T11:33:57.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.915+0000 7f65c3217640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f65bc15a710 0x7f65bc0abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:57.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.915+0000 7f65c3217640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f65bc0cbd50 0x7f65bc0cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:57.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.915+0000 7f65c3217640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65bc0b2710 con 0x7f65bc0cdfb0 2024-01-15T11:33:57.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.915+0000 7f65c3217640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65bc0cca80 con 0x7f65bc0cbd50 2024-01-15T11:33:57.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.915+0000 7f65c3217640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc0b29f0 con 0x7f65bc15a710 2024-01-15T11:33:57.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.915+0000 7f65c17b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f65bc0cbd50 0x7f65bc0cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:57.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.915+0000 7f65bbfff640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f65bc15a710 0x7f65bc0abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:57.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.915+0000 7f65c17b4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f65bc0cbd50 0x7f65bc0cc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:33064/0 (socket says 172.21.15.27:33064) 2024-01-15T11:33:57.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.915+0000 7f65bbfff640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f65bc15a710 0x7f65bc0abf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:54134/0 (socket says 172.21.15.27:54134) 2024-01-15T11:33:57.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.915+0000 7f65c17b4640 1 -- 172.21.15.27:0/2608393375 learned_addr learned my addr 172.21.15.27:0/2608393375 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:57.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.915+0000 7f65c0fb3640 1 --1- 172.21.15.27:0/2608393375 >> v1:172.21.15.93:6789/0 conn(0x7f65bc0cdfb0 0x7f65bc0ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.27:54824/0 (socket says 172.21.15.27:54824) 2024-01-15T11:33:57.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.915+0000 7f65c17b4640 1 -- 172.21.15.27:0/2608393375 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f65bc15a710 msgr2=0x7f65bc0abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:57.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.915+0000 7f65c17b4640 1 --2- 172.21.15.27:0/2608393375 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f65bc15a710 0x7f65bc0abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.915+0000 7f65c17b4640 1 -- 172.21.15.27:0/2608393375 >> v1:172.21.15.93:6789/0 conn(0x7f65bc0cdfb0 legacy=0x7f65bc0ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:57.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.915+0000 7f65c17b4640 1 -- 172.21.15.27:0/2608393375 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65bc0b2cd0 con 0x7f65bc0cbd50 2024-01-15T11:33:57.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.915+0000 7f65bbfff640 1 --2- 172.21.15.27:0/2608393375 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f65bc15a710 0x7f65bc0abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:57.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.919+0000 7f65c17b4640 1 --2- 172.21.15.27:0/2608393375 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65bc0cbd50 0x7f65bc0cc1e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f65b4009e50 tx=0x7f65b401c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f0c6c1dd4ed095c server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:57.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.919+0000 7f65bb7fe640 1 -- 172.21.15.27:0/2608393375 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b40a58d0 con 0x7f65bc0cbd50 2024-01-15T11:33:57.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.919+0000 7f65bb7fe640 1 -- 172.21.15.27:0/2608393375 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b40a5a30 con 0x7f65bc0cbd50 2024-01-15T11:33:57.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.919+0000 7f65bb7fe640 1 -- 172.21.15.27:0/2608393375 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b40a5dc0 con 0x7f65bc0cbd50 2024-01-15T11:33:57.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.919+0000 7f65c3217640 1 -- 172.21.15.27:0/2608393375 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65bc0cbd50 msgr2=0x7f65bc0cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:57.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.919+0000 7f65c3217640 1 --2- 172.21.15.27:0/2608393375 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65bc0cbd50 0x7f65bc0cc1e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f65b4009e50 tx=0x7f65b401c9e0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.919+0000 7f65c3217640 1 -- 172.21.15.27:0/2608393375 shutdown_connections 2024-01-15T11:33:57.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.919+0000 7f65c3217640 1 --2- 172.21.15.27:0/2608393375 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65bc0cbd50 0x7f65bc0cc1e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.919+0000 7f65c3217640 1 --2- 172.21.15.27:0/2608393375 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f65bc15a710 0x7f65bc0abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.919+0000 7f65c3217640 1 -- 172.21.15.27:0/2608393375 >> 172.21.15.27:0/2608393375 conn(0x7f65bc0b0cb0 msgr2=0x7f65bc0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:57.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.919+0000 7f65c3217640 1 -- 172.21.15.27:0/2608393375 shutdown_connections 2024-01-15T11:33:57.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.919+0000 7f65c3217640 1 -- 172.21.15.27:0/2608393375 wait complete. 2024-01-15T11:33:57.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.919+0000 7f65c3217640 1 Processor -- start 2024-01-15T11:33:57.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.919+0000 7f65c3217640 1 -- start start 2024-01-15T11:33:57.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.923+0000 7f65c3217640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65bc0cbd50 0x7f65bc1489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:57.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.923+0000 7f65c3217640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f65bc0cdfb0 0x7f65bc1635a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:57.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.923+0000 7f65c3217640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65bc15a710 0x7f65bc163ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:57.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.923+0000 7f65c3217640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc15ab40 con 0x7f65bc0cbd50 2024-01-15T11:33:57.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.923+0000 7f65c3217640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc15ad90 con 0x7f65bc15a710 2024-01-15T11:33:57.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.923+0000 7f65c3217640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc15b070 con 0x7f65bc0cdfb0 2024-01-15T11:33:57.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.923+0000 7f65c0fb3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65bc0cbd50 0x7f65bc1489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:57.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.923+0000 7f65c0fb3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65bc0cbd50 0x7f65bc1489b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52292/0 (socket says 172.21.15.27:52292) 2024-01-15T11:33:57.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.923+0000 7f65c0fb3640 1 -- 172.21.15.27:0/2564493402 learned_addr learned my addr 172.21.15.27:0/2564493402 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:57.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.923+0000 7f65bbfff640 1 --2- 172.21.15.27:0/2564493402 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f65bc0cdfb0 0x7f65bc1635a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:57.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.923+0000 7f65c17b4640 1 --2- 172.21.15.27:0/2564493402 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65bc15a710 0x7f65bc163ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:57.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.923+0000 7f65c0fb3640 1 -- 172.21.15.27:0/2564493402 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f65bc0cdfb0 msgr2=0x7f65bc1635a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:57.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.923+0000 7f65c0fb3640 1 --2- 172.21.15.27:0/2564493402 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f65bc0cdfb0 0x7f65bc1635a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.923+0000 7f65c0fb3640 1 -- 172.21.15.27:0/2564493402 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65bc15a710 msgr2=0x7f65bc163ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:57.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.923+0000 7f65c0fb3640 1 --2- 172.21.15.27:0/2564493402 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65bc15a710 0x7f65bc163ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:57.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.923+0000 7f65c0fb3640 1 -- 172.21.15.27:0/2564493402 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a8009420 con 0x7f65bc0cbd50 2024-01-15T11:33:57.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.923+0000 7f65c0fb3640 1 --2- 172.21.15.27:0/2564493402 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65bc0cbd50 0x7f65bc1489b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f65b000c420 tx=0x7f65b000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:57.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.923+0000 7f65b97fa640 1 -- 172.21.15.27:0/2564493402 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b00074e0 con 0x7f65bc0cbd50 2024-01-15T11:33:57.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.923+0000 7f65b97fa640 1 -- 172.21.15.27:0/2564493402 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b0007640 con 0x7f65bc0cbd50 2024-01-15T11:33:57.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.923+0000 7f65c3217640 1 -- 172.21.15.27:0/2564493402 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b4009b30 con 0x7f65bc0cbd50 2024-01-15T11:33:57.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.923+0000 7f65b97fa640 1 -- 172.21.15.27:0/2564493402 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b0004a30 con 0x7f65bc0cbd50 2024-01-15T11:33:57.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.923+0000 7f65c3217640 1 -- 172.21.15.27:0/2564493402 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65bc15b630 con 0x7f65bc0cbd50 2024-01-15T11:33:57.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.923+0000 7f65c3217640 1 -- 172.21.15.27:0/2564493402 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65bc1f6090 con 0x7f65bc0cbd50 2024-01-15T11:33:57.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.923+0000 7f65b97fa640 1 -- 172.21.15.27:0/2564493402 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f65b0004b90 con 0x7f65bc0cbd50 2024-01-15T11:33:57.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.927+0000 7f65b97fa640 1 --2- 172.21.15.27:0/2564493402 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f65a00668f0 0x7f65a0068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:57.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.927+0000 7f65b97fa640 1 -- 172.21.15.27:0/2564493402 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65b0083d30 con 0x7f65bc0cbd50 2024-01-15T11:33:57.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.927+0000 7f65bbfff640 1 --2- 172.21.15.27:0/2564493402 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f65a00668f0 0x7f65a0068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:57.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.927+0000 7f65bbfff640 1 --2- 172.21.15.27:0/2564493402 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f65a00668f0 0x7f65a0068db0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f65bc164580 tx=0x7f65a8009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:57.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:57.931+0000 7f65b97fa640 1 -- 172.21.15.27:0/2564493402 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f65b0051010 con 0x7f65bc0cbd50 2024-01-15T11:33:58.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.103+0000 7f65c3217640 1 -- 172.21.15.27:0/2564493402 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f65bc0671f0 con 0x7f65bc0cbd50 2024-01-15T11:33:58.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.103+0000 7f65b97fa640 1 -- 172.21.15.27:0/2564493402 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f65b0054630 con 0x7f65bc0cbd50 2024-01-15T11:33:58.105 INFO:teuthology.orchestra.run.smithi027.stderr:listed 0 entries 2024-01-15T11:33:58.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.103+0000 7f65c3217640 1 -- 172.21.15.27:0/2564493402 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f65a00668f0 msgr2=0x7f65a0068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:58.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.103+0000 7f65c3217640 1 --2- 172.21.15.27:0/2564493402 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f65a00668f0 0x7f65a0068db0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f65bc164580 tx=0x7f65a8009190 comp rx=0 tx=0).stop 2024-01-15T11:33:58.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.103+0000 7f65c3217640 1 -- 172.21.15.27:0/2564493402 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65bc0cbd50 msgr2=0x7f65bc1489b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:58.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.103+0000 7f65c3217640 1 --2- 172.21.15.27:0/2564493402 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65bc0cbd50 0x7f65bc1489b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f65b000c420 tx=0x7f65b000c8e0 comp rx=0 tx=0).stop 2024-01-15T11:33:58.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.103+0000 7f65c3217640 1 -- 172.21.15.27:0/2564493402 shutdown_connections 2024-01-15T11:33:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.103+0000 7f65c3217640 1 --2- 172.21.15.27:0/2564493402 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f65a00668f0 0x7f65a0068db0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.103+0000 7f65c3217640 1 --2- 172.21.15.27:0/2564493402 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65bc15a710 0x7f65bc163ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.103+0000 7f65c3217640 1 --2- 172.21.15.27:0/2564493402 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f65bc0cdfb0 0x7f65bc1635a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.103+0000 7f65c3217640 1 --2- 172.21.15.27:0/2564493402 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f65bc0cbd50 0x7f65bc1489b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.103+0000 7f65c3217640 1 -- 172.21.15.27:0/2564493402 >> 172.21.15.27:0/2564493402 conn(0x7f65bc0b0cb0 msgr2=0x7f65bc0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.103+0000 7f65c3217640 1 -- 172.21.15.27:0/2564493402 shutdown_connections 2024-01-15T11:33:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.103+0000 7f65c3217640 1 -- 172.21.15.27:0/2564493402 wait complete. 2024-01-15T11:33:58.126 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-01-15T11:33:58.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:58.127 DEBUG:teuthology.orchestra.run.smithi093:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-01-15T11:33:58.151 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2024-01-15T11:33:58.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:33:58.151 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-01-15T11:33:58.204 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-15T11:33:58.204 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-15T11:33:58.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.343+0000 7f1ee8a79640 1 Processor -- start 2024-01-15T11:33:58.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.343+0000 7f1ee8a79640 1 -- start start 2024-01-15T11:33:58.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.343+0000 7f1ee8a79640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1ee415d3e0 0x7f1ee40716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:58.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.343+0000 7f1ee8a79640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ee4070920 con 0x7f1ee4072640 2024-01-15T11:33:58.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.343+0000 7f1ee8a79640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ee415d7c0 con 0x7f1ee406c630 2024-01-15T11:33:58.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.343+0000 7f1ee8a79640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ee4071be0 con 0x7f1ee415d3e0 2024-01-15T11:33:58.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.343+0000 7f1ee259c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1ee415d3e0 0x7f1ee40716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:58.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.343+0000 7f1ee2d9d640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f1ee4072640 0x7f1ee40b1f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33358/0 (socket says 172.21.15.27:33358) 2024-01-15T11:33:58.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.343+0000 7f1ee2d9d640 1 -- 172.21.15.27:0/1485930391 learned_addr learned my addr 172.21.15.27:0/1485930391 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:58.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.347+0000 7f1ee259c640 1 -- 172.21.15.27:0/1485930391 >> v1:172.21.15.93:6789/0 conn(0x7f1ee406c630 legacy=0x7f1ee4071f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:58.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.347+0000 7f1ee259c640 1 -- 172.21.15.27:0/1485930391 >> v1:172.21.15.27:6789/0 conn(0x7f1ee4072640 legacy=0x7f1ee40b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:58.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.347+0000 7f1ee259c640 1 -- 172.21.15.27:0/1485930391 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee4070bc0 con 0x7f1ee415d3e0 2024-01-15T11:33:58.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.347+0000 7f1ee259c640 1 --2- 172.21.15.27:0/1485930391 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ee415d3e0 0x7f1ee40716a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1ed40097c0 tx=0x7f1ed401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0f9d3f0dfc07e1 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:58.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.347+0000 7f1ee1d9b640 1 -- 172.21.15.27:0/1485930391 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed40ab650 con 0x7f1ee415d3e0 2024-01-15T11:33:58.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.347+0000 7f1ee1d9b640 1 -- 172.21.15.27:0/1485930391 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed40ab7b0 con 0x7f1ee415d3e0 2024-01-15T11:33:58.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.347+0000 7f1ee1d9b640 1 -- 172.21.15.27:0/1485930391 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed40abb40 con 0x7f1ee415d3e0 2024-01-15T11:33:58.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.347+0000 7f1ee8a79640 1 -- 172.21.15.27:0/1485930391 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ee415d3e0 msgr2=0x7f1ee40716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:58.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.351+0000 7f1ee8a79640 1 --2- 172.21.15.27:0/1485930391 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ee415d3e0 0x7f1ee40716a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1ed40097c0 tx=0x7f1ed401c450 comp rx=0 tx=0).stop 2024-01-15T11:33:58.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.351+0000 7f1ee8a79640 1 -- 172.21.15.27:0/1485930391 shutdown_connections 2024-01-15T11:33:58.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.351+0000 7f1ee8a79640 1 --2- 172.21.15.27:0/1485930391 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ee415d3e0 0x7f1ee40716a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:58.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.351+0000 7f1ee8a79640 1 -- 172.21.15.27:0/1485930391 >> 172.21.15.27:0/1485930391 conn(0x7f1ee40b0c40 msgr2=0x7f1ee40b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:58.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.351+0000 7f1ee8a79640 1 -- 172.21.15.27:0/1485930391 shutdown_connections 2024-01-15T11:33:58.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.351+0000 7f1ee8a79640 1 -- 172.21.15.27:0/1485930391 wait complete. 2024-01-15T11:33:58.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.351+0000 7f1ee8a79640 1 Processor -- start 2024-01-15T11:33:58.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.351+0000 7f1ee8a79640 1 -- start start 2024-01-15T11:33:58.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.351+0000 7f1ee8a79640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1ee406c630 0x7f1ee4168820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:58.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.351+0000 7f1ee8a79640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1ee4072640 0x7f1ee4099a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:58.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.351+0000 7f1ee8a79640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ee415d3e0 0x7f1ee415fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:58.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.351+0000 7f1ee8a79640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee4154bd0 con 0x7f1ee415d3e0 2024-01-15T11:33:58.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.351+0000 7f1ee8a79640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee415eaa0 con 0x7f1ee4072640 2024-01-15T11:33:58.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.351+0000 7f1ee8a79640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee415ed80 con 0x7f1ee406c630 2024-01-15T11:33:58.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.351+0000 7f1ee259c640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1ee406c630 0x7f1ee4168820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:58.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.351+0000 7f1ee2d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ee415d3e0 0x7f1ee415fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:58.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.351+0000 7f1edbfff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1ee4072640 0x7f1ee4099a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:58.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.351+0000 7f1ee259c640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1ee406c630 0x7f1ee4168820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:54144/0 (socket says 172.21.15.27:54144) 2024-01-15T11:33:58.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.351+0000 7f1ee259c640 1 -- 172.21.15.27:0/2780762586 learned_addr learned my addr 172.21.15.27:0/2780762586 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:58.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.351+0000 7f1ee259c640 1 -- 172.21.15.27:0/2780762586 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1ee4072640 msgr2=0x7f1ee4099a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:58.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.351+0000 7f1ee259c640 1 --2- 172.21.15.27:0/2780762586 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1ee4072640 0x7f1ee4099a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:58.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.351+0000 7f1ee259c640 1 -- 172.21.15.27:0/2780762586 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ee415d3e0 msgr2=0x7f1ee415fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:58.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.351+0000 7f1ee259c640 1 --2- 172.21.15.27:0/2780762586 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ee415d3e0 0x7f1ee415fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:58.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.351+0000 7f1ee259c640 1 -- 172.21.15.27:0/2780762586 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed4009420 con 0x7f1ee406c630 2024-01-15T11:33:58.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.351+0000 7f1ee2d9d640 1 --2- 172.21.15.27:0/2780762586 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ee415d3e0 0x7f1ee415fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:33:58.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.355+0000 7f1ee259c640 1 --2- 172.21.15.27:0/2780762586 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1ee406c630 0x7f1ee4168820 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4019060 tx=0x7f1ed401ac90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:58.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.355+0000 7f1edaffd640 1 -- 172.21.15.27:0/2780762586 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed40b5810 con 0x7f1ee406c630 2024-01-15T11:33:58.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.355+0000 7f1edaffd640 1 -- 172.21.15.27:0/2780762586 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed40b5990 con 0x7f1ee406c630 2024-01-15T11:33:58.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.355+0000 7f1edaffd640 1 -- 172.21.15.27:0/2780762586 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed40b5d40 con 0x7f1ee406c630 2024-01-15T11:33:58.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.355+0000 7f1ee8a79640 1 -- 172.21.15.27:0/2780762586 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee415f060 con 0x7f1ee406c630 2024-01-15T11:33:58.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.355+0000 7f1ee8a79640 1 -- 172.21.15.27:0/2780762586 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee415f620 con 0x7f1ee406c630 2024-01-15T11:33:58.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.355+0000 7f1ee8a79640 1 -- 172.21.15.27:0/2780762586 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee415f810 con 0x7f1ee406c630 2024-01-15T11:33:58.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.355+0000 7f1edaffd640 1 -- 172.21.15.27:0/2780762586 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f1ed40b4390 con 0x7f1ee406c630 2024-01-15T11:33:58.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.355+0000 7f1edaffd640 1 --2- 172.21.15.27:0/2780762586 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1ec40668f0 0x7f1ec4068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:58.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.355+0000 7f1edaffd640 1 -- 172.21.15.27:0/2780762586 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ed411efd0 con 0x7f1ee406c630 2024-01-15T11:33:58.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.359+0000 7f1edbfff640 1 --2- 172.21.15.27:0/2780762586 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1ec40668f0 0x7f1ec4068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:58.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.359+0000 7f1edbfff640 1 --2- 172.21.15.27:0/2780762586 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1ec40668f0 0x7f1ec4068db0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1ee409cd50 tx=0x7f1ecc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:58.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.363+0000 7f1edaffd640 1 -- 172.21.15.27:0/2780762586 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1ed40ec220 con 0x7f1ee406c630 2024-01-15T11:33:58.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.551+0000 7f1ee8a79640 1 -- 172.21.15.27:0/2780762586 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ee404e850 con 0x7f1ee406c630 2024-01-15T11:33:58.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.551+0000 7f1edaffd640 1 -- 172.21.15.27:0/2780762586 <== mon.2 v2:172.21.15.93:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f1ed40ef840 con 0x7f1ee406c630 2024-01-15T11:33:58.553 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:58.554 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3682867520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3682867520},{"type":"v1","addr":"172.21.15.93:6837","nonce":3682867520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/2849635892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2849635892},{"type":"v1","addr":"172.21.15.93:6836","nonce":2849635892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/889491859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":889491859},{"type":"v1","addr":"172.21.15.27:6833","nonce":889491859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-15T11:33:20.068559+0000","modified":"2024-01-15T11:33:23.168516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/2516765751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2516765751},{"type":"v1","addr":"172.21.15.27:6835","nonce":2516765751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-15T11:33:58.554 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 8 2024-01-15T11:33:58.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.551+0000 7f1ee8a79640 1 -- 172.21.15.27:0/2780762586 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1ec40668f0 msgr2=0x7f1ec4068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:58.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.551+0000 7f1ee8a79640 1 --2- 172.21.15.27:0/2780762586 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1ec40668f0 0x7f1ec4068db0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1ee409cd50 tx=0x7f1ecc009040 comp rx=0 tx=0).stop 2024-01-15T11:33:58.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.551+0000 7f1ee8a79640 1 -- 172.21.15.27:0/2780762586 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1ee406c630 msgr2=0x7f1ee4168820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:58.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.551+0000 7f1ee8a79640 1 --2- 172.21.15.27:0/2780762586 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1ee406c630 0x7f1ee4168820 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4019060 tx=0x7f1ed401ac90 comp rx=0 tx=0).stop 2024-01-15T11:33:58.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.551+0000 7f1ee8a79640 1 -- 172.21.15.27:0/2780762586 shutdown_connections 2024-01-15T11:33:58.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.551+0000 7f1ee8a79640 1 --2- 172.21.15.27:0/2780762586 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1ee415d3e0 0x7f1ee415fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:58.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.551+0000 7f1ee8a79640 1 --2- 172.21.15.27:0/2780762586 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1ec40668f0 0x7f1ec4068db0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:58.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.551+0000 7f1ee8a79640 1 --2- 172.21.15.27:0/2780762586 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1ee4072640 0x7f1ee4099a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:58.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.551+0000 7f1ee8a79640 1 --2- 172.21.15.27:0/2780762586 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1ee406c630 0x7f1ee4168820 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:58.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.551+0000 7f1ee8a79640 1 -- 172.21.15.27:0/2780762586 >> 172.21.15.27:0/2780762586 conn(0x7f1ee40b0c40 msgr2=0x7f1ee40aebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:58.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.551+0000 7f1ee8a79640 1 -- 172.21.15.27:0/2780762586 shutdown_connections 2024-01-15T11:33:58.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.551+0000 7f1ee8a79640 1 -- 172.21.15.27:0/2780762586 wait complete. 2024-01-15T11:33:58.575 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:33:58.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.715+0000 7fd5347aa640 1 Processor -- start 2024-01-15T11:33:58.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.715+0000 7fd5347aa640 1 -- start start 2024-01-15T11:33:58.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.715+0000 7fd5347aa640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd52c06dfd0 0x7fd52c06e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:58.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.715+0000 7fd5347aa640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd52c0adcc0 0x7fd52c0ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:58.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.715+0000 7fd5347aa640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd52c06e980 con 0x7fd52c143ae0 2024-01-15T11:33:58.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.715+0000 7fd5347aa640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd52c070670 con 0x7fd52c06dfd0 2024-01-15T11:33:58.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.715+0000 7fd5347aa640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd52c070950 con 0x7fd52c0adcc0 2024-01-15T11:33:58.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.715+0000 7fd532546640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd52c143ae0 0x7fd52c0b1f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33374/0 (socket says 172.21.15.27:33374) 2024-01-15T11:33:58.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.715+0000 7fd532546640 1 -- 172.21.15.27:0/2689429430 learned_addr learned my addr 172.21.15.27:0/2689429430 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:33:58.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.715+0000 7fd531d45640 1 --2- 172.21.15.27:0/2689429430 >> v2:172.21.15.27:3300/0 conn(0x7fd52c06dfd0 0x7fd52c06e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:58.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.715+0000 7fd532d47640 1 --2- 172.21.15.27:0/2689429430 >> v2:172.21.15.93:3300/0 conn(0x7fd52c0adcc0 0x7fd52c0ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:58.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.719+0000 7fd531d45640 1 -- 172.21.15.27:0/2689429430 >> v2:172.21.15.93:3300/0 conn(0x7fd52c0adcc0 msgr2=0x7fd52c0ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:58.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.719+0000 7fd531d45640 1 --2- 172.21.15.27:0/2689429430 >> v2:172.21.15.93:3300/0 conn(0x7fd52c0adcc0 0x7fd52c0ae0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:58.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.719+0000 7fd531d45640 1 -- 172.21.15.27:0/2689429430 >> v1:172.21.15.27:6789/0 conn(0x7fd52c143ae0 legacy=0x7fd52c0b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:58.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.719+0000 7fd531d45640 1 -- 172.21.15.27:0/2689429430 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52c070c30 con 0x7fd52c06dfd0 2024-01-15T11:33:58.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.719+0000 7fd532d47640 1 --2- 172.21.15.27:0/2689429430 >> v2:172.21.15.93:3300/0 conn(0x7fd52c0adcc0 0x7fd52c0ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:58.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.719+0000 7fd531d45640 1 --2- 172.21.15.27:0/2689429430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd52c06dfd0 0x7fd52c06e440 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd52c072ad0 tx=0x7fd51c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3feaee0a31b8f366 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:58.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.719+0000 7fd531544640 1 -- 172.21.15.27:0/2689429430 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c0a7070 con 0x7fd52c06dfd0 2024-01-15T11:33:58.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.719+0000 7fd531544640 1 -- 172.21.15.27:0/2689429430 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c0ab430 con 0x7fd52c06dfd0 2024-01-15T11:33:58.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.719+0000 7fd531544640 1 -- 172.21.15.27:0/2689429430 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c0ab7c0 con 0x7fd52c06dfd0 2024-01-15T11:33:58.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.719+0000 7fd5347aa640 1 -- 172.21.15.27:0/2689429430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd52c06dfd0 msgr2=0x7fd52c06e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:58.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.719+0000 7fd5347aa640 1 --2- 172.21.15.27:0/2689429430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd52c06dfd0 0x7fd52c06e440 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd52c072ad0 tx=0x7fd51c01c430 comp rx=0 tx=0).stop 2024-01-15T11:33:58.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.719+0000 7fd5347aa640 1 -- 172.21.15.27:0/2689429430 shutdown_connections 2024-01-15T11:33:58.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.719+0000 7fd5347aa640 1 --2- 172.21.15.27:0/2689429430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd52c06dfd0 0x7fd52c06e440 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:58.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.719+0000 7fd5347aa640 1 --2- 172.21.15.27:0/2689429430 >> v2:172.21.15.93:3300/0 conn(0x7fd52c0adcc0 0x7fd52c0ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:58.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.719+0000 7fd5347aa640 1 -- 172.21.15.27:0/2689429430 >> 172.21.15.27:0/2689429430 conn(0x7fd52c0b0c40 msgr2=0x7fd52c0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:58.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.719+0000 7fd5347aa640 1 -- 172.21.15.27:0/2689429430 shutdown_connections 2024-01-15T11:33:58.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.723+0000 7fd5347aa640 1 -- 172.21.15.27:0/2689429430 wait complete. 2024-01-15T11:33:58.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.723+0000 7fd5347aa640 1 Processor -- start 2024-01-15T11:33:58.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.723+0000 7fd5347aa640 1 -- start start 2024-01-15T11:33:58.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.723+0000 7fd5347aa640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd52c06dfd0 0x7fd52c15c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:58.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.723+0000 7fd5347aa640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd52c0adcc0 0x7fd52c0c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:58.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.723+0000 7fd5347aa640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd52c143ae0 0x7fd52c134750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:58.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.723+0000 7fd5347aa640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c0c43f0 con 0x7fd52c143ae0 2024-01-15T11:33:58.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.723+0000 7fd5347aa640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c134c90 con 0x7fd52c0adcc0 2024-01-15T11:33:58.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.723+0000 7fd5347aa640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c15d810 con 0x7fd52c06dfd0 2024-01-15T11:33:58.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.723+0000 7fd532d47640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd52c143ae0 0x7fd52c134750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:58.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.723+0000 7fd532d47640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd52c143ae0 0x7fd52c134750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52332/0 (socket says 172.21.15.27:52332) 2024-01-15T11:33:58.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.723+0000 7fd532d47640 1 -- 172.21.15.27:0/3097364272 learned_addr learned my addr 172.21.15.27:0/3097364272 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:58.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.723+0000 7fd531d45640 1 --2- 172.21.15.27:0/3097364272 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd52c0adcc0 0x7fd52c0c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:58.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.723+0000 7fd532546640 1 --2- 172.21.15.27:0/3097364272 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd52c06dfd0 0x7fd52c15c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:58.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.723+0000 7fd532d47640 1 -- 172.21.15.27:0/3097364272 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd52c06dfd0 msgr2=0x7fd52c15c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:58.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.723+0000 7fd532d47640 1 --2- 172.21.15.27:0/3097364272 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd52c06dfd0 0x7fd52c15c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:58.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.723+0000 7fd532d47640 1 -- 172.21.15.27:0/3097364272 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd52c0adcc0 msgr2=0x7fd52c0c3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:58.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.723+0000 7fd532d47640 1 --2- 172.21.15.27:0/3097364272 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd52c0adcc0 0x7fd52c0c3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:58.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.723+0000 7fd532d47640 1 -- 172.21.15.27:0/3097364272 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c009420 con 0x7fd52c143ae0 2024-01-15T11:33:58.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.723+0000 7fd532d47640 1 --2- 172.21.15.27:0/3097364272 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd52c143ae0 0x7fd52c134750 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd524009fa0 tx=0x7fd52400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:58.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.727+0000 7fd522ffd640 1 -- 172.21.15.27:0/3097364272 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd524003ba0 con 0x7fd52c143ae0 2024-01-15T11:33:58.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.727+0000 7fd522ffd640 1 -- 172.21.15.27:0/3097364272 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52400f040 con 0x7fd52c143ae0 2024-01-15T11:33:58.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.727+0000 7fd522ffd640 1 -- 172.21.15.27:0/3097364272 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd524004030 con 0x7fd52c143ae0 2024-01-15T11:33:58.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.727+0000 7fd5347aa640 1 -- 172.21.15.27:0/3097364272 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52c15bb60 con 0x7fd52c143ae0 2024-01-15T11:33:58.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.727+0000 7fd5347aa640 1 -- 172.21.15.27:0/3097364272 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52c15c120 con 0x7fd52c143ae0 2024-01-15T11:33:58.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.727+0000 7fd5347aa640 1 -- 172.21.15.27:0/3097364272 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd52c15c310 con 0x7fd52c143ae0 2024-01-15T11:33:58.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.727+0000 7fd522ffd640 1 -- 172.21.15.27:0/3097364272 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fd524004190 con 0x7fd52c143ae0 2024-01-15T11:33:58.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.727+0000 7fd522ffd640 1 --2- 172.21.15.27:0/3097364272 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd510066920 0x7fd510068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:58.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.727+0000 7fd522ffd640 1 -- 172.21.15.27:0/3097364272 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5240847f0 con 0x7fd52c143ae0 2024-01-15T11:33:58.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.727+0000 7fd532546640 1 --2- 172.21.15.27:0/3097364272 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd510066920 0x7fd510068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:58.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.731+0000 7fd532546640 1 --2- 172.21.15.27:0/3097364272 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd510066920 0x7fd510068de0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd528005890 tx=0x7fd528009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:58.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.731+0000 7fd522ffd640 1 -- 172.21.15.27:0/3097364272 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd5240519b0 con 0x7fd52c143ae0 2024-01-15T11:33:58.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.891+0000 7fd5347aa640 1 -- 172.21.15.27:0/3097364272 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd52c04e850 con 0x7fd52c143ae0 2024-01-15T11:33:58.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.891+0000 7fd522ffd640 1 -- 172.21.15.27:0/3097364272 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16425 (secure 0 0 0) 0x7fd52401a090 con 0x7fd52c143ae0 2024-01-15T11:33:58.894 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:33:58.894 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:33:21.682894+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T11:33:18.397200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T11:33:19.061383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:33:58.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.891+0000 7fd5347aa640 1 -- 172.21.15.27:0/3097364272 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd510066920 msgr2=0x7fd510068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:58.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.891+0000 7fd5347aa640 1 --2- 172.21.15.27:0/3097364272 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd510066920 0x7fd510068de0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd528005890 tx=0x7fd528009040 comp rx=0 tx=0).stop 2024-01-15T11:33:58.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.891+0000 7fd5347aa640 1 -- 172.21.15.27:0/3097364272 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd52c143ae0 msgr2=0x7fd52c134750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:58.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.891+0000 7fd5347aa640 1 --2- 172.21.15.27:0/3097364272 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd52c143ae0 0x7fd52c134750 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd524009fa0 tx=0x7fd52400d560 comp rx=0 tx=0).stop 2024-01-15T11:33:58.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.891+0000 7fd5347aa640 1 -- 172.21.15.27:0/3097364272 shutdown_connections 2024-01-15T11:33:58.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.891+0000 7fd5347aa640 1 --2- 172.21.15.27:0/3097364272 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd52c143ae0 0x7fd52c134750 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:58.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.891+0000 7fd5347aa640 1 --2- 172.21.15.27:0/3097364272 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd510066920 0x7fd510068de0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:58.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.891+0000 7fd5347aa640 1 --2- 172.21.15.27:0/3097364272 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd52c0adcc0 0x7fd52c0c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:58.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.891+0000 7fd5347aa640 1 --2- 172.21.15.27:0/3097364272 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd52c06dfd0 0x7fd52c15c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:58.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.891+0000 7fd5347aa640 1 -- 172.21.15.27:0/3097364272 >> 172.21.15.27:0/3097364272 conn(0x7fd52c0b0c40 msgr2=0x7fd52c06cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:58.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.891+0000 7fd5347aa640 1 -- 172.21.15.27:0/3097364272 shutdown_connections 2024-01-15T11:33:58.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:58.891+0000 7fd5347aa640 1 -- 172.21.15.27:0/3097364272 wait complete. 2024-01-15T11:33:58.916 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T11:33:08.134662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-15T11:33:18.397200+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-15T11:33:19.061383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T11:33:58.917 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T11:33:59.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.063+0000 7f3e1e0fe640 1 Processor -- start 2024-01-15T11:33:59.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.063+0000 7f3e1e0fe640 1 -- start start 2024-01-15T11:33:59.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.063+0000 7f3e1e0fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3e180cdfb0 0x7f3e180abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:59.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.063+0000 7f3e1e0fe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3e1815a710 0x7f3e180ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:59.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.063+0000 7f3e1e0fe640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3e180cbd50 0x7f3e180cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:59.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.063+0000 7f3e1e0fe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e180cca80 con 0x7f3e180cdfb0 2024-01-15T11:33:59.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.063+0000 7f3e1e0fe640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e180ce8d0 con 0x7f3e1815a710 2024-01-15T11:33:59.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.063+0000 7f3e1e0fe640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e180b2710 con 0x7f3e180cbd50 2024-01-15T11:33:59.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.063+0000 7f3e177fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3e180cdfb0 0x7f3e180abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:59.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.067+0000 7f3e177fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f3e180cdfb0 0x7f3e180abf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52340/0 (socket says 172.21.15.27:52340) 2024-01-15T11:33:59.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.067+0000 7f3e177fe640 1 -- 172.21.15.27:0/2277155764 learned_addr learned my addr 172.21.15.27:0/2277155764 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:59.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.067+0000 7f3e17fff640 1 --2- 172.21.15.27:0/2277155764 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3e180cbd50 0x7f3e180cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:59.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.067+0000 7f3e16ffd640 1 --2- 172.21.15.27:0/2277155764 >> v2:172.21.15.93:3300/0 conn(0x7f3e1815a710 0x7f3e180ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:59.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.067+0000 7f3e177fe640 1 -- 172.21.15.27:0/2277155764 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3e180cbd50 msgr2=0x7f3e180cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:59.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.067+0000 7f3e177fe640 1 --2- 172.21.15.27:0/2277155764 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3e180cbd50 0x7f3e180cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.067+0000 7f3e177fe640 1 -- 172.21.15.27:0/2277155764 >> v2:172.21.15.93:3300/0 conn(0x7f3e1815a710 msgr2=0x7f3e180ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:59.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.067+0000 7f3e177fe640 1 --2- 172.21.15.27:0/2277155764 >> v2:172.21.15.93:3300/0 conn(0x7f3e1815a710 0x7f3e180ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.067+0000 7f3e177fe640 1 -- 172.21.15.27:0/2277155764 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e180b29f0 con 0x7f3e180cdfb0 2024-01-15T11:33:59.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.067+0000 7f3e17fff640 1 --2- 172.21.15.27:0/2277155764 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3e180cbd50 0x7f3e180cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:59.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.067+0000 7f3e16ffd640 1 --2- 172.21.15.27:0/2277155764 >> v2:172.21.15.93:3300/0 conn(0x7f3e1815a710 0x7f3e180ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:59.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.067+0000 7f3e177fe640 1 --2- 172.21.15.27:0/2277155764 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e180cdfb0 0x7f3e180abf90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3e180d0040 tx=0x7f3e0801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94933bc04a4f397 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:59.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.067+0000 7f3e167fc640 1 -- 172.21.15.27:0/2277155764 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e080aa5f0 con 0x7f3e180cdfb0 2024-01-15T11:33:59.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.067+0000 7f3e167fc640 1 -- 172.21.15.27:0/2277155764 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e080aa750 con 0x7f3e180cdfb0 2024-01-15T11:33:59.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.067+0000 7f3e167fc640 1 -- 172.21.15.27:0/2277155764 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e080aaae0 con 0x7f3e180cdfb0 2024-01-15T11:33:59.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.067+0000 7f3e1e0fe640 1 -- 172.21.15.27:0/2277155764 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e180cdfb0 msgr2=0x7f3e180abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:59.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.067+0000 7f3e1e0fe640 1 --2- 172.21.15.27:0/2277155764 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e180cdfb0 0x7f3e180abf90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3e180d0040 tx=0x7f3e0801c4d0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.071+0000 7f3e1e0fe640 1 -- 172.21.15.27:0/2277155764 shutdown_connections 2024-01-15T11:33:59.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.071+0000 7f3e1e0fe640 1 --2- 172.21.15.27:0/2277155764 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3e180cbd50 0x7f3e180cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.071+0000 7f3e1e0fe640 1 --2- 172.21.15.27:0/2277155764 >> v2:172.21.15.93:3300/0 conn(0x7f3e1815a710 0x7f3e180ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.071+0000 7f3e1e0fe640 1 --2- 172.21.15.27:0/2277155764 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e180cdfb0 0x7f3e180abf90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.071+0000 7f3e1e0fe640 1 -- 172.21.15.27:0/2277155764 >> 172.21.15.27:0/2277155764 conn(0x7f3e180b0cb0 msgr2=0x7f3e180b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:59.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.071+0000 7f3e1e0fe640 1 -- 172.21.15.27:0/2277155764 shutdown_connections 2024-01-15T11:33:59.073 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.071+0000 7f3e1e0fe640 1 -- 172.21.15.27:0/2277155764 wait complete. 2024-01-15T11:33:59.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.071+0000 7f3e1e0fe640 1 Processor -- start 2024-01-15T11:33:59.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.071+0000 7f3e1e0fe640 1 -- start start 2024-01-15T11:33:59.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.071+0000 7f3e1e0fe640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3e180cbd50 0x7f3e180721b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:59.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.071+0000 7f3e1e0fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e180cdfb0 0x7f3e18154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:59.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.071+0000 7f3e1e0fe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3e1815a710 0x7f3e180ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:59.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.071+0000 7f3e1e0fe640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e181f9190 con 0x7f3e180cdfb0 2024-01-15T11:33:59.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.071+0000 7f3e1e0fe640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e181f9fb0 con 0x7f3e1815a710 2024-01-15T11:33:59.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.071+0000 7f3e1e0fe640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e180726f0 con 0x7f3e180cbd50 2024-01-15T11:33:59.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.071+0000 7f3e16ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e180cdfb0 0x7f3e18154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:59.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.071+0000 7f3e16ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e180cdfb0 0x7f3e18154df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52354/0 (socket says 172.21.15.27:52354) 2024-01-15T11:33:59.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.071+0000 7f3e16ffd640 1 -- 172.21.15.27:0/1027959796 learned_addr learned my addr 172.21.15.27:0/1027959796 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:59.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.071+0000 7f3e17fff640 1 --2- 172.21.15.27:0/1027959796 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3e1815a710 0x7f3e180ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:59.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.071+0000 7f3e177fe640 1 --2- 172.21.15.27:0/1027959796 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3e180cbd50 0x7f3e180721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:59.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.071+0000 7f3e16ffd640 1 -- 172.21.15.27:0/1027959796 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3e180cbd50 msgr2=0x7f3e180721b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:59.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.071+0000 7f3e16ffd640 1 --2- 172.21.15.27:0/1027959796 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3e180cbd50 0x7f3e180721b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.071+0000 7f3e16ffd640 1 -- 172.21.15.27:0/1027959796 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3e1815a710 msgr2=0x7f3e180ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:59.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.071+0000 7f3e16ffd640 1 --2- 172.21.15.27:0/1027959796 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3e1815a710 0x7f3e180ad1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.071+0000 7f3e16ffd640 1 -- 172.21.15.27:0/1027959796 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e080094d0 con 0x7f3e180cdfb0 2024-01-15T11:33:59.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.075+0000 7f3e16ffd640 1 --2- 172.21.15.27:0/1027959796 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e180cdfb0 0x7f3e18154df0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00d800 tx=0x7f3e0c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:59.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.075+0000 7f3dfffff640 1 -- 172.21.15.27:0/1027959796 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c00b6c0 con 0x7f3e180cdfb0 2024-01-15T11:33:59.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.075+0000 7f3dfffff640 1 -- 172.21.15.27:0/1027959796 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c00b820 con 0x7f3e180cdfb0 2024-01-15T11:33:59.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.075+0000 7f3dfffff640 1 -- 172.21.15.27:0/1027959796 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c00bbb0 con 0x7f3e180cdfb0 2024-01-15T11:33:59.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.075+0000 7f3e1e0fe640 1 -- 172.21.15.27:0/1027959796 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e18156040 con 0x7f3e180cdfb0 2024-01-15T11:33:59.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.075+0000 7f3e1e0fe640 1 -- 172.21.15.27:0/1027959796 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e181f9680 con 0x7f3e180cdfb0 2024-01-15T11:33:59.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.075+0000 7f3e1e0fe640 1 -- 172.21.15.27:0/1027959796 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e180671f0 con 0x7f3e180cdfb0 2024-01-15T11:33:59.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.075+0000 7f3dfffff640 1 -- 172.21.15.27:0/1027959796 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f3e0c00bd10 con 0x7f3e180cdfb0 2024-01-15T11:33:59.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.075+0000 7f3dfffff640 1 --2- 172.21.15.27:0/1027959796 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3e040668f0 0x7f3e04068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:59.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.075+0000 7f3dfffff640 1 -- 172.21.15.27:0/1027959796 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e0c0848e0 con 0x7f3e180cdfb0 2024-01-15T11:33:59.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.079+0000 7f3e177fe640 1 --2- 172.21.15.27:0/1027959796 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3e040668f0 0x7f3e04068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:59.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.079+0000 7f3e177fe640 1 --2- 172.21.15.27:0/1027959796 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3e040668f0 0x7f3e04068db0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3e080ae000 tx=0x7f3e080a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:59.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.079+0000 7f3dfffff640 1 -- 172.21.15.27:0/1027959796 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3e0c051b20 con 0x7f3e180cdfb0 2024-01-15T11:33:59.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.239+0000 7f3e1e0fe640 1 -- 172.21.15.27:0/1027959796 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3e18157830 con 0x7f3e180cdfb0 2024-01-15T11:33:59.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.239+0000 7f3dfffff640 1 -- 172.21.15.27:0/1027959796 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3e0c055140 con 0x7f3e180cdfb0 2024-01-15T11:33:59.243 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-15T11:33:59.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.243+0000 7f3e1e0fe640 1 -- 172.21.15.27:0/1027959796 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3e040668f0 msgr2=0x7f3e04068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:59.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.243+0000 7f3e1e0fe640 1 --2- 172.21.15.27:0/1027959796 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3e040668f0 0x7f3e04068db0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3e080ae000 tx=0x7f3e080a7000 comp rx=0 tx=0).stop 2024-01-15T11:33:59.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.243+0000 7f3e1e0fe640 1 -- 172.21.15.27:0/1027959796 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e180cdfb0 msgr2=0x7f3e18154df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:59.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.243+0000 7f3e1e0fe640 1 --2- 172.21.15.27:0/1027959796 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e180cdfb0 0x7f3e18154df0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00d800 tx=0x7f3e0c00dcc0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.243+0000 7f3e1e0fe640 1 -- 172.21.15.27:0/1027959796 shutdown_connections 2024-01-15T11:33:59.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.243+0000 7f3e1e0fe640 1 --2- 172.21.15.27:0/1027959796 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3e040668f0 0x7f3e04068db0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.243+0000 7f3e1e0fe640 1 --2- 172.21.15.27:0/1027959796 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3e1815a710 0x7f3e180ad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.243+0000 7f3e1e0fe640 1 --2- 172.21.15.27:0/1027959796 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e180cdfb0 0x7f3e18154df0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.243+0000 7f3e1e0fe640 1 --2- 172.21.15.27:0/1027959796 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3e180cbd50 0x7f3e180721b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.243+0000 7f3e1e0fe640 1 -- 172.21.15.27:0/1027959796 >> 172.21.15.27:0/1027959796 conn(0x7f3e180b0cb0 msgr2=0x7f3e180abf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:59.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.243+0000 7f3e1e0fe640 1 -- 172.21.15.27:0/1027959796 shutdown_connections 2024-01-15T11:33:59.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.243+0000 7f3e1e0fe640 1 -- 172.21.15.27:0/1027959796 wait complete. 2024-01-15T11:33:59.264 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-15T11:33:59.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.407+0000 7f1c329f8640 1 Processor -- start 2024-01-15T11:33:59.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.407+0000 7f1c329f8640 1 -- start start 2024-01-15T11:33:59.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.407+0000 7f1c329f8640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1c2c0cb9b0 0x7f1c2c06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:59.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.407+0000 7f1c329f8640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1c2c0cbd90 0x7f1c2c15f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:59.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.407+0000 7f1c329f8640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c2c0ce5d0 0x7f1c2c15bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:59.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.407+0000 7f1c329f8640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c2c15bba0 con 0x7f1c2c0cbd90 2024-01-15T11:33:59.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.407+0000 7f1c329f8640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c2c0cdd50 con 0x7f1c2c0cb9b0 2024-01-15T11:33:59.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.407+0000 7f1c329f8640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c159630 con 0x7f1c2c0ce5d0 2024-01-15T11:33:59.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.407+0000 7f1c2b7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1c2c0cbd90 0x7f1c2c15f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:59.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.407+0000 7f1c2b7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1c2c0cbd90 0x7f1c2c15f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52360/0 (socket says 172.21.15.27:52360) 2024-01-15T11:33:59.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.407+0000 7f1c2b7fe640 1 -- 172.21.15.27:0/3793158649 learned_addr learned my addr 172.21.15.27:0/3793158649 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:59.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.407+0000 7f1c30f95640 1 --2- 172.21.15.27:0/3793158649 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c2c0ce5d0 0x7f1c2c15bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:59.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.407+0000 7f1c2bfff640 1 --2- 172.21.15.27:0/3793158649 >> v2:172.21.15.93:3300/0 conn(0x7f1c2c0cb9b0 0x7f1c2c06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:59.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.407+0000 7f1c2b7fe640 1 -- 172.21.15.27:0/3793158649 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c2c0ce5d0 msgr2=0x7f1c2c15bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:59.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.407+0000 7f1c2b7fe640 1 --2- 172.21.15.27:0/3793158649 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c2c0ce5d0 0x7f1c2c15bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.407+0000 7f1c2b7fe640 1 -- 172.21.15.27:0/3793158649 >> v2:172.21.15.93:3300/0 conn(0x7f1c2c0cb9b0 msgr2=0x7f1c2c06e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:59.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.407+0000 7f1c2b7fe640 1 --2- 172.21.15.27:0/3793158649 >> v2:172.21.15.93:3300/0 conn(0x7f1c2c0cb9b0 0x7f1c2c06e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.407+0000 7f1c2b7fe640 1 -- 172.21.15.27:0/3793158649 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2c15f6d0 con 0x7f1c2c0cbd90 2024-01-15T11:33:59.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.407+0000 7f1c2bfff640 1 --2- 172.21.15.27:0/3793158649 >> v2:172.21.15.93:3300/0 conn(0x7f1c2c0cb9b0 0x7f1c2c06e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:59.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.411+0000 7f1c2b7fe640 1 --2- 172.21.15.27:0/3793158649 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c2c0cbd90 0x7f1c2c15f190 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c06c360 tx=0x7f1c2001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1c47330c9e0b0e server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:59.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.411+0000 7f1c2affd640 1 -- 172.21.15.27:0/3793158649 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c200ab670 con 0x7f1c2c0cbd90 2024-01-15T11:33:59.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.411+0000 7f1c2affd640 1 -- 172.21.15.27:0/3793158649 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c200ab7d0 con 0x7f1c2c0cbd90 2024-01-15T11:33:59.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.411+0000 7f1c2affd640 1 -- 172.21.15.27:0/3793158649 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c200abb60 con 0x7f1c2c0cbd90 2024-01-15T11:33:59.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.411+0000 7f1c329f8640 1 -- 172.21.15.27:0/3793158649 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c2c0cbd90 msgr2=0x7f1c2c15f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:59.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.411+0000 7f1c329f8640 1 --2- 172.21.15.27:0/3793158649 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c2c0cbd90 0x7f1c2c15f190 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c06c360 tx=0x7f1c2001c4d0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.411+0000 7f1c329f8640 1 -- 172.21.15.27:0/3793158649 shutdown_connections 2024-01-15T11:33:59.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.411+0000 7f1c329f8640 1 --2- 172.21.15.27:0/3793158649 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c2c0ce5d0 0x7f1c2c15bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.411+0000 7f1c329f8640 1 --2- 172.21.15.27:0/3793158649 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c2c0cbd90 0x7f1c2c15f190 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.411+0000 7f1c329f8640 1 --2- 172.21.15.27:0/3793158649 >> v2:172.21.15.93:3300/0 conn(0x7f1c2c0cb9b0 0x7f1c2c06e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.411+0000 7f1c329f8640 1 -- 172.21.15.27:0/3793158649 >> 172.21.15.27:0/3793158649 conn(0x7f1c2c0b0cb0 msgr2=0x7f1c2c0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:59.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.411+0000 7f1c329f8640 1 -- 172.21.15.27:0/3793158649 shutdown_connections 2024-01-15T11:33:59.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.411+0000 7f1c329f8640 1 -- 172.21.15.27:0/3793158649 wait complete. 2024-01-15T11:33:59.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.415+0000 7f1c329f8640 1 Processor -- start 2024-01-15T11:33:59.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.415+0000 7f1c329f8640 1 -- start start 2024-01-15T11:33:59.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.415+0000 7f1c329f8640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c2c0cb9b0 0x7f1c2c14d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:59.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.415+0000 7f1c329f8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c2c0cbd90 0x7f1c2c1517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:59.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.415+0000 7f1c329f8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c2c0ce5d0 0x7f1c2c153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:59.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.415+0000 7f1c329f8640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c14e010 con 0x7f1c2c0cbd90 2024-01-15T11:33:59.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.415+0000 7f1c329f8640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c1fab70 con 0x7f1c2c0ce5d0 2024-01-15T11:33:59.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.415+0000 7f1c329f8640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c0b36b0 con 0x7f1c2c0cb9b0 2024-01-15T11:33:59.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.415+0000 7f1c2b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c2c0cbd90 0x7f1c2c1517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:59.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.415+0000 7f1c2b7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c2c0cbd90 0x7f1c2c1517d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52372/0 (socket says 172.21.15.27:52372) 2024-01-15T11:33:59.419 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.415+0000 7f1c2b7fe640 1 -- 172.21.15.27:0/53336625 learned_addr learned my addr 172.21.15.27:0/53336625 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:59.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.415+0000 7f1c2bfff640 1 --2- 172.21.15.27:0/53336625 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c2c0cb9b0 0x7f1c2c14d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:59.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.415+0000 7f1c30f95640 1 --2- 172.21.15.27:0/53336625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c2c0ce5d0 0x7f1c2c153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:59.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.415+0000 7f1c2b7fe640 1 -- 172.21.15.27:0/53336625 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c2c0cb9b0 msgr2=0x7f1c2c14d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:59.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.415+0000 7f1c2b7fe640 1 --2- 172.21.15.27:0/53336625 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c2c0cb9b0 0x7f1c2c14d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.415+0000 7f1c2b7fe640 1 -- 172.21.15.27:0/53336625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c2c0ce5d0 msgr2=0x7f1c2c153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:59.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.415+0000 7f1c2b7fe640 1 --2- 172.21.15.27:0/53336625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c2c0ce5d0 0x7f1c2c153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.415+0000 7f1c2b7fe640 1 -- 172.21.15.27:0/53336625 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c200094d0 con 0x7f1c2c0cbd90 2024-01-15T11:33:59.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.415+0000 7f1c2b7fe640 1 --2- 172.21.15.27:0/53336625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c2c0cbd90 0x7f1c2c1517d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1c2001ab80 tx=0x7f1c2001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:59.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.415+0000 7f1c28ff9640 1 -- 172.21.15.27:0/53336625 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c200ab670 con 0x7f1c2c0cbd90 2024-01-15T11:33:59.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.415+0000 7f1c28ff9640 1 -- 172.21.15.27:0/53336625 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c200b4800 con 0x7f1c2c0cbd90 2024-01-15T11:33:59.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.415+0000 7f1c28ff9640 1 -- 172.21.15.27:0/53336625 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c200b4b90 con 0x7f1c2c0cbd90 2024-01-15T11:33:59.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.415+0000 7f1c329f8640 1 -- 172.21.15.27:0/53336625 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c2c0b3990 con 0x7f1c2c0cbd90 2024-01-15T11:33:59.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.415+0000 7f1c329f8640 1 -- 172.21.15.27:0/53336625 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c2c0b3f50 con 0x7f1c2c0cbd90 2024-01-15T11:33:59.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.419+0000 7f1c329f8640 1 -- 172.21.15.27:0/53336625 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c2c0671f0 con 0x7f1c2c0cbd90 2024-01-15T11:33:59.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.419+0000 7f1c28ff9640 1 -- 172.21.15.27:0/53336625 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f1c200b4cf0 con 0x7f1c2c0cbd90 2024-01-15T11:33:59.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.419+0000 7f1c28ff9640 1 --2- 172.21.15.27:0/53336625 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1c180668f0 0x7f1c18068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:59.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.419+0000 7f1c28ff9640 1 -- 172.21.15.27:0/53336625 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c2011e890 con 0x7f1c2c0cbd90 2024-01-15T11:33:59.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.419+0000 7f1c2bfff640 1 --2- 172.21.15.27:0/53336625 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1c180668f0 0x7f1c18068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:59.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.419+0000 7f1c2bfff640 1 --2- 172.21.15.27:0/53336625 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1c180668f0 0x7f1c18068db0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c009950 tx=0x7f1c1c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:59.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.423+0000 7f1c28ff9640 1 -- 172.21.15.27:0/53336625 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1c200ebb70 con 0x7f1c2c0cbd90 2024-01-15T11:33:59.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.579+0000 7f1c329f8640 1 -- 172.21.15.27:0/53336625 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1c2c06b460 con 0x7f1c2c0cbd90 2024-01-15T11:33:59.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.579+0000 7f1c28ff9640 1 -- 172.21.15.27:0/53336625 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1c200c4020 con 0x7f1c2c0cbd90 2024-01-15T11:33:59.583 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-01-15T11:33:59.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.583+0000 7f1c329f8640 1 -- 172.21.15.27:0/53336625 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1c180668f0 msgr2=0x7f1c18068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:59.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.583+0000 7f1c329f8640 1 --2- 172.21.15.27:0/53336625 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1c180668f0 0x7f1c18068db0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c009950 tx=0x7f1c1c008040 comp rx=0 tx=0).stop 2024-01-15T11:33:59.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.583+0000 7f1c329f8640 1 -- 172.21.15.27:0/53336625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c2c0cbd90 msgr2=0x7f1c2c1517d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:59.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.583+0000 7f1c329f8640 1 --2- 172.21.15.27:0/53336625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c2c0cbd90 0x7f1c2c1517d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1c2001ab80 tx=0x7f1c2001ad10 comp rx=0 tx=0).stop 2024-01-15T11:33:59.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.583+0000 7f1c329f8640 1 -- 172.21.15.27:0/53336625 shutdown_connections 2024-01-15T11:33:59.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.583+0000 7f1c329f8640 1 --2- 172.21.15.27:0/53336625 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1c180668f0 0x7f1c18068db0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.583+0000 7f1c329f8640 1 --2- 172.21.15.27:0/53336625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c2c0ce5d0 0x7f1c2c153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.583+0000 7f1c329f8640 1 --2- 172.21.15.27:0/53336625 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c2c0cbd90 0x7f1c2c1517d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.583+0000 7f1c329f8640 1 --2- 172.21.15.27:0/53336625 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c2c0cb9b0 0x7f1c2c14d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.583+0000 7f1c329f8640 1 -- 172.21.15.27:0/53336625 >> 172.21.15.27:0/53336625 conn(0x7f1c2c0b0cb0 msgr2=0x7f1c2c15fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:59.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.583+0000 7f1c329f8640 1 -- 172.21.15.27:0/53336625 shutdown_connections 2024-01-15T11:33:59.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.583+0000 7f1c329f8640 1 -- 172.21.15.27:0/53336625 wait complete. 2024-01-15T11:33:59.604 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-15T11:33:59.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.747+0000 7fb7de3df640 1 Processor -- start 2024-01-15T11:33:59.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.747+0000 7fb7de3df640 1 -- start start 2024-01-15T11:33:59.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.747+0000 7fb7de3df640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb7d815a710 0x7fb7d80abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:59.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.747+0000 7fb7de3df640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7d80cbd50 0x7fb7d80cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:59.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.747+0000 7fb7de3df640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7d80b2710 con 0x7fb7d80cdfb0 2024-01-15T11:33:59.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.747+0000 7fb7de3df640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7d80cca80 con 0x7fb7d815a710 2024-01-15T11:33:59.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.747+0000 7fb7de3df640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d80b29f0 con 0x7fb7d80cbd50 2024-01-15T11:33:59.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.751+0000 7fb7d77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb7d815a710 0x7fb7d80abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:59.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.751+0000 7fb7d77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb7d815a710 0x7fb7d80abf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52376/0 (socket says 172.21.15.27:52376) 2024-01-15T11:33:59.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.751+0000 7fb7d77fe640 1 -- 172.21.15.27:0/2848342848 learned_addr learned my addr 172.21.15.27:0/2848342848 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:59.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.751+0000 7fb7dc97c640 1 --2- 172.21.15.27:0/2848342848 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7d80cbd50 0x7fb7d80cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:59.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.751+0000 7fb7d77fe640 1 -- 172.21.15.27:0/2848342848 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7d80cbd50 msgr2=0x7fb7d80cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:59.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.751+0000 7fb7d77fe640 1 --2- 172.21.15.27:0/2848342848 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7d80cbd50 0x7fb7d80cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.751+0000 7fb7d77fe640 1 -- 172.21.15.27:0/2848342848 >> v1:172.21.15.93:6789/0 conn(0x7fb7d80cdfb0 legacy=0x7fb7d80ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:33:59.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.751+0000 7fb7d77fe640 1 -- 172.21.15.27:0/2848342848 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d80b2cd0 con 0x7fb7d815a710 2024-01-15T11:33:59.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.751+0000 7fb7d77fe640 1 --2- 172.21.15.27:0/2848342848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7d815a710 0x7fb7d80abf90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc009870 tx=0x7fb7cc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5bf9ac095970b5b server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:59.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.751+0000 7fb7d6ffd640 1 -- 172.21.15.27:0/2848342848 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc0aa610 con 0x7fb7d815a710 2024-01-15T11:33:59.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.751+0000 7fb7d6ffd640 1 -- 172.21.15.27:0/2848342848 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7cc0a6040 con 0x7fb7d815a710 2024-01-15T11:33:59.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.751+0000 7fb7d6ffd640 1 -- 172.21.15.27:0/2848342848 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc0aa990 con 0x7fb7d815a710 2024-01-15T11:33:59.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.755+0000 7fb7de3df640 1 -- 172.21.15.27:0/2848342848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7d815a710 msgr2=0x7fb7d80abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:59.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.755+0000 7fb7de3df640 1 --2- 172.21.15.27:0/2848342848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7d815a710 0x7fb7d80abf90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc009870 tx=0x7fb7cc01c4d0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.755+0000 7fb7de3df640 1 -- 172.21.15.27:0/2848342848 shutdown_connections 2024-01-15T11:33:59.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.755+0000 7fb7de3df640 1 --2- 172.21.15.27:0/2848342848 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7d80cbd50 0x7fb7d80cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.755+0000 7fb7de3df640 1 --2- 172.21.15.27:0/2848342848 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7d815a710 0x7fb7d80abf90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.755+0000 7fb7de3df640 1 -- 172.21.15.27:0/2848342848 >> 172.21.15.27:0/2848342848 conn(0x7fb7d80b0cb0 msgr2=0x7fb7d80b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:59.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.755+0000 7fb7de3df640 1 -- 172.21.15.27:0/2848342848 shutdown_connections 2024-01-15T11:33:59.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.755+0000 7fb7de3df640 1 -- 172.21.15.27:0/2848342848 wait complete. 2024-01-15T11:33:59.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.755+0000 7fb7de3df640 1 Processor -- start 2024-01-15T11:33:59.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.755+0000 7fb7de3df640 1 -- start start 2024-01-15T11:33:59.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.755+0000 7fb7de3df640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7d80cbd50 0x7fb7d8071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:59.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.755+0000 7fb7de3df640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7d80cdfb0 0x7fb7d8152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:59.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.755+0000 7fb7de3df640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7d815a710 0x7fb7d80abf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:59.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.755+0000 7fb7de3df640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d815c880 con 0x7fb7d815a710 2024-01-15T11:33:59.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.755+0000 7fb7de3df640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d815cab0 con 0x7fb7d80cdfb0 2024-01-15T11:33:59.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.755+0000 7fb7de3df640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d815cd90 con 0x7fb7d80cbd50 2024-01-15T11:33:59.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.755+0000 7fb7dc97c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7d815a710 0x7fb7d80abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:59.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.755+0000 7fb7dc97c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7d815a710 0x7fb7d80abf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52386/0 (socket says 172.21.15.27:52386) 2024-01-15T11:33:59.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.755+0000 7fb7dc97c640 1 -- 172.21.15.27:0/1731911303 learned_addr learned my addr 172.21.15.27:0/1731911303 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:33:59.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.755+0000 7fb7d7fff640 1 --2- 172.21.15.27:0/1731911303 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7d80cbd50 0x7fb7d8071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:59.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.755+0000 7fb7d77fe640 1 --2- 172.21.15.27:0/1731911303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7d80cdfb0 0x7fb7d8152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:59.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.759+0000 7fb7dc97c640 1 -- 172.21.15.27:0/1731911303 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7d80cbd50 msgr2=0x7fb7d8071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:59.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.759+0000 7fb7dc97c640 1 --2- 172.21.15.27:0/1731911303 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7d80cbd50 0x7fb7d8071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.759+0000 7fb7dc97c640 1 -- 172.21.15.27:0/1731911303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7d80cdfb0 msgr2=0x7fb7d8152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:59.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.759+0000 7fb7dc97c640 1 --2- 172.21.15.27:0/1731911303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7d80cdfb0 0x7fb7d8152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.759+0000 7fb7dc97c640 1 -- 172.21.15.27:0/1731911303 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7cc0094d0 con 0x7fb7d815a710 2024-01-15T11:33:59.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.759+0000 7fb7d77fe640 1 --2- 172.21.15.27:0/1731911303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7d80cdfb0 0x7fb7d8152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:33:59.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.759+0000 7fb7dc97c640 1 --2- 172.21.15.27:0/1731911303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7d815a710 0x7fb7d80abf90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0007e40 tx=0x7fb7d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:59.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.759+0000 7fb7d4ff9640 1 -- 172.21.15.27:0/1731911303 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0014620 con 0x7fb7d815a710 2024-01-15T11:33:59.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.759+0000 7fb7d4ff9640 1 -- 172.21.15.27:0/1731911303 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d000ee90 con 0x7fb7d815a710 2024-01-15T11:33:59.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.759+0000 7fb7de3df640 1 -- 172.21.15.27:0/1731911303 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d815d070 con 0x7fb7d815a710 2024-01-15T11:33:59.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.759+0000 7fb7d4ff9640 1 -- 172.21.15.27:0/1731911303 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d00149e0 con 0x7fb7d815a710 2024-01-15T11:33:59.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.759+0000 7fb7de3df640 1 -- 172.21.15.27:0/1731911303 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d815d630 con 0x7fb7d815a710 2024-01-15T11:33:59.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.759+0000 7fb7de3df640 1 -- 172.21.15.27:0/1731911303 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d80671f0 con 0x7fb7d815a710 2024-01-15T11:33:59.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.759+0000 7fb7d4ff9640 1 -- 172.21.15.27:0/1731911303 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fb7d0014b40 con 0x7fb7d815a710 2024-01-15T11:33:59.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.759+0000 7fb7d4ff9640 1 --2- 172.21.15.27:0/1731911303 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb7c40668f0 0x7fb7c4068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:33:59.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.759+0000 7fb7d4ff9640 1 -- 172.21.15.27:0/1731911303 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7d0084e40 con 0x7fb7d815a710 2024-01-15T11:33:59.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.759+0000 7fb7d7fff640 1 --2- 172.21.15.27:0/1731911303 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb7c40668f0 0x7fb7c4068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:33:59.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.763+0000 7fb7d7fff640 1 --2- 172.21.15.27:0/1731911303 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb7c40668f0 0x7fb7c4068db0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8004e30 tx=0x7fb7c8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:33:59.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.763+0000 7fb7d4ff9640 1 -- 172.21.15.27:0/1731911303 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb7d0052070 con 0x7fb7d815a710 2024-01-15T11:33:59.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.923+0000 7fb7de3df640 1 -- 172.21.15.27:0/1731911303 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb7d806b460 con 0x7fb7d815a710 2024-01-15T11:33:59.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.923+0000 7fb7d4ff9640 1 -- 172.21.15.27:0/1731911303 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb7d0055690 con 0x7fb7d815a710 2024-01-15T11:33:59.925 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-01-15T11:33:59.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.923+0000 7fb7de3df640 1 -- 172.21.15.27:0/1731911303 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb7c40668f0 msgr2=0x7fb7c4068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:59.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.923+0000 7fb7de3df640 1 --2- 172.21.15.27:0/1731911303 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb7c40668f0 0x7fb7c4068db0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8004e30 tx=0x7fb7c8009040 comp rx=0 tx=0).stop 2024-01-15T11:33:59.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.923+0000 7fb7de3df640 1 -- 172.21.15.27:0/1731911303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7d815a710 msgr2=0x7fb7d80abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:33:59.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.923+0000 7fb7de3df640 1 --2- 172.21.15.27:0/1731911303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7d815a710 0x7fb7d80abf90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0007e40 tx=0x7fb7d000e4b0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.923+0000 7fb7de3df640 1 -- 172.21.15.27:0/1731911303 shutdown_connections 2024-01-15T11:33:59.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.923+0000 7fb7de3df640 1 --2- 172.21.15.27:0/1731911303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb7d815a710 0x7fb7d80abf90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.923+0000 7fb7de3df640 1 --2- 172.21.15.27:0/1731911303 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb7c40668f0 0x7fb7c4068db0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.923+0000 7fb7de3df640 1 --2- 172.21.15.27:0/1731911303 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7d80cdfb0 0x7fb7d8152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.923+0000 7fb7de3df640 1 --2- 172.21.15.27:0/1731911303 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7d80cbd50 0x7fb7d8071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:33:59.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.923+0000 7fb7de3df640 1 -- 172.21.15.27:0/1731911303 >> 172.21.15.27:0/1731911303 conn(0x7fb7d80b0cb0 msgr2=0x7fb7d80ace90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:33:59.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.923+0000 7fb7de3df640 1 -- 172.21.15.27:0/1731911303 shutdown_connections 2024-01-15T11:33:59.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:33:59.923+0000 7fb7de3df640 1 -- 172.21.15.27:0/1731911303 wait complete. 2024-01-15T11:33:59.948 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-15T11:34:00.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.087+0000 7f0a013df640 1 Processor -- start 2024-01-15T11:34:00.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.091+0000 7f0a013df640 1 -- start start 2024-01-15T11:34:00.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.091+0000 7f0a013df640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f09fc0ac630 0x7f09fc0706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:00.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.091+0000 7f0a013df640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f09fc070c20 0x7f09fc06c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:00.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.091+0000 7f0a013df640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09fc145060 con 0x7f09fc144c80 2024-01-15T11:34:00.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.091+0000 7f0a013df640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09fc071fd0 con 0x7f09fc070c20 2024-01-15T11:34:00.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.091+0000 7f0a013df640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc071450 con 0x7f09fc0ac630 2024-01-15T11:34:00.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.091+0000 7f09faffd640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f09fc144c80 0x7f09fc0abf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33390/0 (socket says 172.21.15.27:33390) 2024-01-15T11:34:00.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.091+0000 7f09faffd640 1 -- 172.21.15.27:0/2483506893 learned_addr learned my addr 172.21.15.27:0/2483506893 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:00.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.091+0000 7f09fb7fe640 1 --2- 172.21.15.27:0/2483506893 >> v2:172.21.15.27:3300/0 conn(0x7f09fc070c20 0x7f09fc06c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:00.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.091+0000 7f09f3fff640 1 --2- 172.21.15.27:0/2483506893 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f09fc0ac630 0x7f09fc0706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:00.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.091+0000 7f09fa7fc640 1 -- 172.21.15.27:0/2483506893 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1175096433 0 0) 0x7f09fc145060 con 0x7f09fc144c80 2024-01-15T11:34:00.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.091+0000 7f09fa7fc640 1 -- 172.21.15.27:0/2483506893 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09e8003530 con 0x7f09fc144c80 2024-01-15T11:34:00.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.091+0000 7f09fb7fe640 1 -- 172.21.15.27:0/2483506893 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f09fc0ac630 msgr2=0x7f09fc0706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:00.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.091+0000 7f09fb7fe640 1 --2- 172.21.15.27:0/2483506893 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f09fc0ac630 0x7f09fc0706e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:00.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.091+0000 7f09fb7fe640 1 -- 172.21.15.27:0/2483506893 >> v1:172.21.15.27:6789/0 conn(0x7f09fc144c80 legacy=0x7f09fc0abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:00.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.091+0000 7f09fb7fe640 1 -- 172.21.15.27:0/2483506893 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc071730 con 0x7f09fc070c20 2024-01-15T11:34:00.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.095+0000 7f09fb7fe640 1 --2- 172.21.15.27:0/2483506893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09fc070c20 0x7f09fc06c910 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f09f4009d90 tx=0x7f09f401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f84a7029df88bb server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:00.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.095+0000 7f09fa7fc640 1 -- 172.21.15.27:0/2483506893 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f40a59e0 con 0x7f09fc070c20 2024-01-15T11:34:00.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.095+0000 7f09fa7fc640 1 -- 172.21.15.27:0/2483506893 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f40a5b40 con 0x7f09fc070c20 2024-01-15T11:34:00.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.095+0000 7f09fa7fc640 1 -- 172.21.15.27:0/2483506893 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f40ad440 con 0x7f09fc070c20 2024-01-15T11:34:00.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.095+0000 7f0a013df640 1 -- 172.21.15.27:0/2483506893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09fc070c20 msgr2=0x7f09fc06c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:00.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.095+0000 7f0a013df640 1 --2- 172.21.15.27:0/2483506893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09fc070c20 0x7f09fc06c910 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f09f4009d90 tx=0x7f09f401c920 comp rx=0 tx=0).stop 2024-01-15T11:34:00.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.095+0000 7f0a013df640 1 -- 172.21.15.27:0/2483506893 shutdown_connections 2024-01-15T11:34:00.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.095+0000 7f0a013df640 1 --2- 172.21.15.27:0/2483506893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09fc070c20 0x7f09fc06c910 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:00.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.095+0000 7f0a013df640 1 --2- 172.21.15.27:0/2483506893 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f09fc0ac630 0x7f09fc0706e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:00.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.095+0000 7f0a013df640 1 -- 172.21.15.27:0/2483506893 >> 172.21.15.27:0/2483506893 conn(0x7f09fc0b0c40 msgr2=0x7f09fc0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:00.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.095+0000 7f0a013df640 1 -- 172.21.15.27:0/2483506893 shutdown_connections 2024-01-15T11:34:00.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.095+0000 7f0a013df640 1 -- 172.21.15.27:0/2483506893 wait complete. 2024-01-15T11:34:00.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.095+0000 7f0a013df640 1 Processor -- start 2024-01-15T11:34:00.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.095+0000 7f0a013df640 1 -- start start 2024-01-15T11:34:00.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.099+0000 7f0a013df640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09fc070c20 0x7f09fc13f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:00.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.099+0000 7f0a013df640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09fc0ac630 0x7f09fc13a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:00.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.099+0000 7f0a013df640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f09fc144c80 0x7f09fc09b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:00.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.099+0000 7f0a013df640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc13fe50 con 0x7f09fc070c20 2024-01-15T11:34:00.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.099+0000 7f0a013df640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc0b2df0 con 0x7f09fc0ac630 2024-01-15T11:34:00.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.099+0000 7f0a013df640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc1f9f80 con 0x7f09fc144c80 2024-01-15T11:34:00.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.099+0000 7f09faffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09fc070c20 0x7f09fc13f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:00.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.099+0000 7f09faffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09fc070c20 0x7f09fc13f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52406/0 (socket says 172.21.15.27:52406) 2024-01-15T11:34:00.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.099+0000 7f09faffd640 1 -- 172.21.15.27:0/3227233476 learned_addr learned my addr 172.21.15.27:0/3227233476 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:00.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.099+0000 7f09f3fff640 1 --2- 172.21.15.27:0/3227233476 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09fc0ac630 0x7f09fc13a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:00.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.099+0000 7f09fb7fe640 1 --2- 172.21.15.27:0/3227233476 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f09fc144c80 0x7f09fc09b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:00.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.099+0000 7f09faffd640 1 -- 172.21.15.27:0/3227233476 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f09fc144c80 msgr2=0x7f09fc09b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:00.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.099+0000 7f09faffd640 1 --2- 172.21.15.27:0/3227233476 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f09fc144c80 0x7f09fc09b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:00.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.099+0000 7f09faffd640 1 -- 172.21.15.27:0/3227233476 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09fc0ac630 msgr2=0x7f09fc13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:00.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.099+0000 7f09faffd640 1 --2- 172.21.15.27:0/3227233476 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09fc0ac630 0x7f09fc13a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:00.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.099+0000 7f09faffd640 1 -- 172.21.15.27:0/3227233476 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f4009a70 con 0x7f09fc070c20 2024-01-15T11:34:00.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.099+0000 7f09faffd640 1 --2- 172.21.15.27:0/3227233476 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09fc070c20 0x7f09fc13f910 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00c3c0 tx=0x7f09ec00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:00.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.099+0000 7f09f37fe640 1 -- 172.21.15.27:0/3227233476 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec005cf0 con 0x7f09fc070c20 2024-01-15T11:34:00.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.099+0000 7f09f37fe640 1 -- 172.21.15.27:0/3227233476 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ec005e50 con 0x7f09fc070c20 2024-01-15T11:34:00.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.099+0000 7f09f37fe640 1 -- 172.21.15.27:0/3227233476 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec0072f0 con 0x7f09fc070c20 2024-01-15T11:34:00.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.099+0000 7f0a013df640 1 -- 172.21.15.27:0/3227233476 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09fc13ac70 con 0x7f09fc070c20 2024-01-15T11:34:00.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.099+0000 7f0a013df640 1 -- 172.21.15.27:0/3227233476 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09fc0b24c0 con 0x7f09fc070c20 2024-01-15T11:34:00.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.099+0000 7f0a013df640 1 -- 172.21.15.27:0/3227233476 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09fc0b1ba0 con 0x7f09fc070c20 2024-01-15T11:34:00.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.099+0000 7f09f37fe640 1 -- 172.21.15.27:0/3227233476 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f09ec007450 con 0x7f09fc070c20 2024-01-15T11:34:00.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.103+0000 7f09f37fe640 1 --2- 172.21.15.27:0/3227233476 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f09dc0668f0 0x7f09dc068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:00.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.103+0000 7f09f37fe640 1 -- 172.21.15.27:0/3227233476 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09ec0839c0 con 0x7f09fc070c20 2024-01-15T11:34:00.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.103+0000 7f09f3fff640 1 --2- 172.21.15.27:0/3227233476 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f09dc0668f0 0x7f09dc068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:00.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.103+0000 7f09f3fff640 1 --2- 172.21.15.27:0/3227233476 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f09dc0668f0 0x7f09dc068db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f09fc0b1730 tx=0x7f09e4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:00.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.107+0000 7f09f37fe640 1 -- 172.21.15.27:0/3227233476 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f09ec050bf0 con 0x7f09fc070c20 2024-01-15T11:34:00.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.299+0000 7f0a013df640 1 -- 172.21.15.27:0/3227233476 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09fc04e850 con 0x7f09fc070c20 2024-01-15T11:34:00.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.299+0000 7f09f37fe640 1 -- 172.21.15.27:0/3227233476 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f09ec017070 con 0x7f09fc070c20 2024-01-15T11:34:00.301 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:34:00.301 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3682867520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3682867520},{"type":"v1","addr":"172.21.15.93:6837","nonce":3682867520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/2849635892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2849635892},{"type":"v1","addr":"172.21.15.93:6836","nonce":2849635892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/889491859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":889491859},{"type":"v1","addr":"172.21.15.27:6833","nonce":889491859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-15T11:33:20.068559+0000","modified":"2024-01-15T11:33:23.168516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/2516765751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2516765751},{"type":"v1","addr":"172.21.15.27:6835","nonce":2516765751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-15T11:34:00.301 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 8 2024-01-15T11:34:00.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.299+0000 7f0a013df640 1 -- 172.21.15.27:0/3227233476 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f09dc0668f0 msgr2=0x7f09dc068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:00.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.299+0000 7f0a013df640 1 --2- 172.21.15.27:0/3227233476 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f09dc0668f0 0x7f09dc068db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f09fc0b1730 tx=0x7f09e4008040 comp rx=0 tx=0).stop 2024-01-15T11:34:00.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.299+0000 7f0a013df640 1 -- 172.21.15.27:0/3227233476 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09fc070c20 msgr2=0x7f09fc13f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:00.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.299+0000 7f0a013df640 1 --2- 172.21.15.27:0/3227233476 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09fc070c20 0x7f09fc13f910 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00c3c0 tx=0x7f09ec00c880 comp rx=0 tx=0).stop 2024-01-15T11:34:00.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.299+0000 7f0a013df640 1 -- 172.21.15.27:0/3227233476 shutdown_connections 2024-01-15T11:34:00.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.299+0000 7f0a013df640 1 --2- 172.21.15.27:0/3227233476 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f09fc144c80 0x7f09fc09b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:00.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.299+0000 7f0a013df640 1 --2- 172.21.15.27:0/3227233476 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f09dc0668f0 0x7f09dc068db0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:00.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.299+0000 7f0a013df640 1 --2- 172.21.15.27:0/3227233476 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09fc0ac630 0x7f09fc13a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:00.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.299+0000 7f0a013df640 1 --2- 172.21.15.27:0/3227233476 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09fc070c20 0x7f09fc13f910 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:00.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.299+0000 7f0a013df640 1 -- 172.21.15.27:0/3227233476 >> 172.21.15.27:0/3227233476 conn(0x7f09fc0b0c40 msgr2=0x7f09fc143dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:00.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.299+0000 7f0a013df640 1 -- 172.21.15.27:0/3227233476 shutdown_connections 2024-01-15T11:34:00.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.299+0000 7f0a013df640 1 -- 172.21.15.27:0/3227233476 wait complete. 2024-01-15T11:34:00.322 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:34:00.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.463+0000 7fcf11438640 1 Processor -- start 2024-01-15T11:34:00.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.463+0000 7fcf11438640 1 -- start start 2024-01-15T11:34:00.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.463+0000 7fcf11438640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcf0c0b3080 0x7fcf0c0b3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:00.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.463+0000 7fcf11438640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcf0c0d0350 0x7fcf0c06c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:00.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.463+0000 7fcf11438640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf0c0d0800 con 0x7fcf0c0b3fb0 2024-01-15T11:34:00.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.463+0000 7fcf11438640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0c06f690 con 0x7fcf0c0b3080 2024-01-15T11:34:00.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.463+0000 7fcf11438640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c0b39a0 con 0x7fcf0c0d0350 2024-01-15T11:34:00.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.463+0000 7fcf0bfff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcf0c0b3080 0x7fcf0c0b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:00.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.463+0000 7fcf0b7fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fcf0c0b3fb0 0x7fcf0c0cfc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33402/0 (socket says 172.21.15.27:33402) 2024-01-15T11:34:00.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.463+0000 7fcf0b7fe640 1 -- 172.21.15.27:0/2997331596 learned_addr learned my addr 172.21.15.27:0/2997331596 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:00.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.463+0000 7fcf10c37640 1 --2- 172.21.15.27:0/2997331596 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcf0c0d0350 0x7fcf0c06c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:00.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.463+0000 7fcf0bfff640 1 -- 172.21.15.27:0/2997331596 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcf0c0d0350 msgr2=0x7fcf0c06c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:00.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.463+0000 7fcf0bfff640 1 --2- 172.21.15.27:0/2997331596 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcf0c0d0350 0x7fcf0c06c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:00.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.463+0000 7fcf0bfff640 1 -- 172.21.15.27:0/2997331596 >> v1:172.21.15.27:6789/0 conn(0x7fcf0c0b3fb0 legacy=0x7fcf0c0cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:00.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.463+0000 7fcf0bfff640 1 -- 172.21.15.27:0/2997331596 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c06ea10 con 0x7fcf0c0b3080 2024-01-15T11:34:00.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.463+0000 7fcf0affd640 1 -- 172.21.15.27:0/2997331596 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251999530 0 0) 0x7fcf0c0d0800 con 0x7fcf0c0b3fb0 2024-01-15T11:34:00.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.467+0000 7fcf0bfff640 1 --2- 172.21.15.27:0/2997331596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf0c0b3080 0x7fcf0c0b3460 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcefc0097c0 tx=0x7fcefc01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c271657c3bbec61 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:00.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.467+0000 7fcf0affd640 1 -- 172.21.15.27:0/2997331596 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc0ac620 con 0x7fcf0c0b3080 2024-01-15T11:34:00.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.467+0000 7fcf0affd640 1 -- 172.21.15.27:0/2997331596 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcefc0ac780 con 0x7fcf0c0b3080 2024-01-15T11:34:00.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.467+0000 7fcf0affd640 1 -- 172.21.15.27:0/2997331596 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc0acb10 con 0x7fcf0c0b3080 2024-01-15T11:34:00.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.467+0000 7fcf11438640 1 -- 172.21.15.27:0/2997331596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf0c0b3080 msgr2=0x7fcf0c0b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:00.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.467+0000 7fcf11438640 1 --2- 172.21.15.27:0/2997331596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf0c0b3080 0x7fcf0c0b3460 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcefc0097c0 tx=0x7fcefc01c3c0 comp rx=0 tx=0).stop 2024-01-15T11:34:00.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.467+0000 7fcf11438640 1 -- 172.21.15.27:0/2997331596 shutdown_connections 2024-01-15T11:34:00.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.467+0000 7fcf11438640 1 --2- 172.21.15.27:0/2997331596 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcf0c0d0350 0x7fcf0c06c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:00.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.467+0000 7fcf11438640 1 --2- 172.21.15.27:0/2997331596 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf0c0b3080 0x7fcf0c0b3460 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:00.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.467+0000 7fcf11438640 1 -- 172.21.15.27:0/2997331596 >> 172.21.15.27:0/2997331596 conn(0x7fcf0c0666a0 msgr2=0x7fcf0c066ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:00.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.467+0000 7fcf11438640 1 -- 172.21.15.27:0/2997331596 shutdown_connections 2024-01-15T11:34:00.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.467+0000 7fcf11438640 1 -- 172.21.15.27:0/2997331596 wait complete. 2024-01-15T11:34:00.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.471+0000 7fcf11438640 1 Processor -- start 2024-01-15T11:34:00.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.471+0000 7fcf11438640 1 -- start start 2024-01-15T11:34:00.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.471+0000 7fcf11438640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf0c0b3080 0x7fcf0c0b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:00.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.471+0000 7fcf11438640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcf0c0b3fb0 0x7fcf0c15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:00.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.471+0000 7fcf11438640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf0c0d0350 0x7fcf0c15ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:00.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.471+0000 7fcf11438640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c15d350 con 0x7fcf0c0b3080 2024-01-15T11:34:00.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.471+0000 7fcf11438640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c13a7f0 con 0x7fcf0c0d0350 2024-01-15T11:34:00.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.471+0000 7fcf11438640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c15ff00 con 0x7fcf0c0b3fb0 2024-01-15T11:34:00.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.471+0000 7fcf0bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf0c0b3080 0x7fcf0c0b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:00.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.471+0000 7fcf0bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf0c0b3080 0x7fcf0c0b56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52426/0 (socket says 172.21.15.27:52426) 2024-01-15T11:34:00.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.471+0000 7fcf0bfff640 1 -- 172.21.15.27:0/4266735057 learned_addr learned my addr 172.21.15.27:0/4266735057 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:00.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.471+0000 7fcf0b7fe640 1 --2- 172.21.15.27:0/4266735057 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcf0c0b3fb0 0x7fcf0c15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:00.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.471+0000 7fcf10c37640 1 --2- 172.21.15.27:0/4266735057 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf0c0d0350 0x7fcf0c15ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:00.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.471+0000 7fcf0bfff640 1 -- 172.21.15.27:0/4266735057 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcf0c0b3fb0 msgr2=0x7fcf0c15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:00.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.471+0000 7fcf0bfff640 1 --2- 172.21.15.27:0/4266735057 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcf0c0b3fb0 0x7fcf0c15c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:00.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.471+0000 7fcf0bfff640 1 -- 172.21.15.27:0/4266735057 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf0c0d0350 msgr2=0x7fcf0c15ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:00.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.471+0000 7fcf0bfff640 1 --2- 172.21.15.27:0/4266735057 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf0c0d0350 0x7fcf0c15ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:00.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.471+0000 7fcf0bfff640 1 -- 172.21.15.27:0/4266735057 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcefc009420 con 0x7fcf0c0b3080 2024-01-15T11:34:00.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.471+0000 7fcf10c37640 1 --2- 172.21.15.27:0/4266735057 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf0c0d0350 0x7fcf0c15ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:34:00.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.471+0000 7fcf0bfff640 1 --2- 172.21.15.27:0/4266735057 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf0c0b3080 0x7fcf0c0b56b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcefc000c10 tx=0x7fcefc01ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:00.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.471+0000 7fcf08ff9640 1 -- 172.21.15.27:0/4266735057 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc0ac620 con 0x7fcf0c0b3080 2024-01-15T11:34:00.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.471+0000 7fcf08ff9640 1 -- 172.21.15.27:0/4266735057 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcefc004030 con 0x7fcf0c0b3080 2024-01-15T11:34:00.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.471+0000 7fcf08ff9640 1 -- 172.21.15.27:0/4266735057 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc0043a0 con 0x7fcf0c0b3080 2024-01-15T11:34:00.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.471+0000 7fcf11438640 1 -- 172.21.15.27:0/4266735057 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf0c1601e0 con 0x7fcf0c0b3080 2024-01-15T11:34:00.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.471+0000 7fcf11438640 1 -- 172.21.15.27:0/4266735057 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf0c1607a0 con 0x7fcf0c0b3080 2024-01-15T11:34:00.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.475+0000 7fcf11438640 1 -- 172.21.15.27:0/4266735057 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf0c074a00 con 0x7fcf0c0b3080 2024-01-15T11:34:00.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.475+0000 7fcf08ff9640 1 -- 172.21.15.27:0/4266735057 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fcefc0aa070 con 0x7fcf0c0b3080 2024-01-15T11:34:00.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.475+0000 7fcf08ff9640 1 --2- 172.21.15.27:0/4266735057 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fcef80668f0 0x7fcef8068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:00.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.475+0000 7fcf08ff9640 1 -- 172.21.15.27:0/4266735057 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcefc11e870 con 0x7fcf0c0b3080 2024-01-15T11:34:00.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.475+0000 7fcf0b7fe640 1 --2- 172.21.15.27:0/4266735057 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fcef80668f0 0x7fcef8068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:00.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.475+0000 7fcf0b7fe640 1 --2- 172.21.15.27:0/4266735057 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fcef80668f0 0x7fcef8068db0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c13a2b0 tx=0x7fcf00007df0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:00.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.479+0000 7fcf08ff9640 1 -- 172.21.15.27:0/4266735057 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcefc0ebd10 con 0x7fcf0c0b3080 2024-01-15T11:34:00.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.639+0000 7fcf11438640 1 -- 172.21.15.27:0/4266735057 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf0c160c50 con 0x7fcf0c0b3080 2024-01-15T11:34:00.642 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.639+0000 7fcf08ff9640 1 -- 172.21.15.27:0/4266735057 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16425 (secure 0 0 0) 0x7fcefc0c5090 con 0x7fcf0c0b3080 2024-01-15T11:34:00.642 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:34:00.642 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:33:21.682894+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T11:33:18.397200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T11:33:19.061383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:34:00.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.639+0000 7fcf11438640 1 -- 172.21.15.27:0/4266735057 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fcef80668f0 msgr2=0x7fcef8068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:00.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.639+0000 7fcf11438640 1 --2- 172.21.15.27:0/4266735057 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fcef80668f0 0x7fcef8068db0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c13a2b0 tx=0x7fcf00007df0 comp rx=0 tx=0).stop 2024-01-15T11:34:00.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.639+0000 7fcf11438640 1 -- 172.21.15.27:0/4266735057 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf0c0b3080 msgr2=0x7fcf0c0b56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:00.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.639+0000 7fcf11438640 1 --2- 172.21.15.27:0/4266735057 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf0c0b3080 0x7fcf0c0b56b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcefc000c10 tx=0x7fcefc01ac00 comp rx=0 tx=0).stop 2024-01-15T11:34:00.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.639+0000 7fcf11438640 1 -- 172.21.15.27:0/4266735057 shutdown_connections 2024-01-15T11:34:00.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.639+0000 7fcf11438640 1 --2- 172.21.15.27:0/4266735057 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fcef80668f0 0x7fcef8068db0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:00.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.639+0000 7fcf11438640 1 --2- 172.21.15.27:0/4266735057 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf0c0d0350 0x7fcf0c15ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:00.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.639+0000 7fcf11438640 1 --2- 172.21.15.27:0/4266735057 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcf0c0b3fb0 0x7fcf0c15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:00.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.639+0000 7fcf11438640 1 --2- 172.21.15.27:0/4266735057 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf0c0b3080 0x7fcf0c0b56b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:00.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.639+0000 7fcf11438640 1 -- 172.21.15.27:0/4266735057 >> 172.21.15.27:0/4266735057 conn(0x7fcf0c0666a0 msgr2=0x7fcf0c143a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:00.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.639+0000 7fcf11438640 1 -- 172.21.15.27:0/4266735057 shutdown_connections 2024-01-15T11:34:00.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.639+0000 7fcf11438640 1 -- 172.21.15.27:0/4266735057 wait complete. 2024-01-15T11:34:00.663 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-15T11:34:00.663 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-15T11:34:00.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.803+0000 7fe0b292a640 1 Processor -- start 2024-01-15T11:34:00.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.807+0000 7fe0b292a640 1 -- start start 2024-01-15T11:34:00.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.807+0000 7fe0b292a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fe0ac143ae0 0x7fe0ac0b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:00.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.807+0000 7fe0b292a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0ac06dfd0 0x7fe0ac06e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:00.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.807+0000 7fe0b292a640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ac0b2480 con 0x7fe0ac0adcc0 2024-01-15T11:34:00.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.807+0000 7fe0b292a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ac0ae820 con 0x7fe0ac143ae0 2024-01-15T11:34:00.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.807+0000 7fe0b292a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac06e950 con 0x7fe0ac06dfd0 2024-01-15T11:34:00.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.807+0000 7fe0b0ec7640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe0ac0adcc0 0x7fe0ac0ae110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33418/0 (socket says 172.21.15.27:33418) 2024-01-15T11:34:00.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.807+0000 7fe0b0ec7640 1 -- 172.21.15.27:0/1101189190 learned_addr learned my addr 172.21.15.27:0/1101189190 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:00.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.807+0000 7fe0abfff640 1 --2- 172.21.15.27:0/1101189190 >> v2:172.21.15.27:3300/0 conn(0x7fe0ac143ae0 0x7fe0ac0b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:00.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.807+0000 7fe0ab7fe640 1 --2- 172.21.15.27:0/1101189190 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0ac06dfd0 0x7fe0ac06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:00.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.807+0000 7fe0aaffd640 1 -- 172.21.15.27:0/1101189190 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3200052752 0 0) 0x7fe0ac0b2480 con 0x7fe0ac0adcc0 2024-01-15T11:34:00.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.807+0000 7fe0aaffd640 1 -- 172.21.15.27:0/1101189190 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe094005740 con 0x7fe0ac0adcc0 2024-01-15T11:34:00.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.807+0000 7fe0abfff640 1 -- 172.21.15.27:0/1101189190 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0ac06dfd0 msgr2=0x7fe0ac06e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:00.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.807+0000 7fe0abfff640 1 --2- 172.21.15.27:0/1101189190 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0ac06dfd0 0x7fe0ac06e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:00.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.807+0000 7fe0abfff640 1 -- 172.21.15.27:0/1101189190 >> v1:172.21.15.27:6789/0 conn(0x7fe0ac0adcc0 legacy=0x7fe0ac0ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:00.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.807+0000 7fe0abfff640 1 -- 172.21.15.27:0/1101189190 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ac070670 con 0x7fe0ac143ae0 2024-01-15T11:34:00.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.811+0000 7fe0abfff640 1 --2- 172.21.15.27:0/1101189190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0ac143ae0 0x7fe0ac0b1f40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0097c0 tx=0x7fe09c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80fb7bc6790a6914 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:00.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.811+0000 7fe0aaffd640 1 -- 172.21.15.27:0/1101189190 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c0ab650 con 0x7fe0ac143ae0 2024-01-15T11:34:00.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.811+0000 7fe0aaffd640 1 -- 172.21.15.27:0/1101189190 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09c0ab7b0 con 0x7fe0ac143ae0 2024-01-15T11:34:00.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.811+0000 7fe0aaffd640 1 -- 172.21.15.27:0/1101189190 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c0abb40 con 0x7fe0ac143ae0 2024-01-15T11:34:00.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.811+0000 7fe0b292a640 1 -- 172.21.15.27:0/1101189190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0ac143ae0 msgr2=0x7fe0ac0b1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:00.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.811+0000 7fe0b292a640 1 --2- 172.21.15.27:0/1101189190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0ac143ae0 0x7fe0ac0b1f40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0097c0 tx=0x7fe09c01c450 comp rx=0 tx=0).stop 2024-01-15T11:34:00.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.811+0000 7fe0b292a640 1 -- 172.21.15.27:0/1101189190 shutdown_connections 2024-01-15T11:34:00.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.811+0000 7fe0b292a640 1 --2- 172.21.15.27:0/1101189190 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0ac06dfd0 0x7fe0ac06e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:00.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.811+0000 7fe0b292a640 1 --2- 172.21.15.27:0/1101189190 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0ac143ae0 0x7fe0ac0b1f40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:00.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.811+0000 7fe0b292a640 1 -- 172.21.15.27:0/1101189190 >> 172.21.15.27:0/1101189190 conn(0x7fe0ac0b0c40 msgr2=0x7fe0ac0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:00.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.811+0000 7fe0b292a640 1 -- 172.21.15.27:0/1101189190 shutdown_connections 2024-01-15T11:34:00.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.811+0000 7fe0b292a640 1 -- 172.21.15.27:0/1101189190 wait complete. 2024-01-15T11:34:00.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.811+0000 7fe0b292a640 1 Processor -- start 2024-01-15T11:34:00.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.815+0000 7fe0b292a640 1 -- start start 2024-01-15T11:34:00.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.815+0000 7fe0b292a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0ac06dfd0 0x7fe0ac15d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:00.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.815+0000 7fe0b292a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0ac0adcc0 0x7fe0ac1646b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:00.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.815+0000 7fe0b292a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0ac143ae0 0x7fe0ac1405e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:00.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.815+0000 7fe0b292a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac0c5930 con 0x7fe0ac06dfd0 2024-01-15T11:34:00.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.815+0000 7fe0b292a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac15db40 con 0x7fe0ac0adcc0 2024-01-15T11:34:00.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.815+0000 7fe0b292a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac15bda0 con 0x7fe0ac143ae0 2024-01-15T11:34:00.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.815+0000 7fe0abfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0ac06dfd0 0x7fe0ac15d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:00.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.815+0000 7fe0abfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0ac06dfd0 0x7fe0ac15d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52444/0 (socket says 172.21.15.27:52444) 2024-01-15T11:34:00.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.815+0000 7fe0abfff640 1 -- 172.21.15.27:0/946657392 learned_addr learned my addr 172.21.15.27:0/946657392 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:00.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.815+0000 7fe0b0ec7640 1 --2- 172.21.15.27:0/946657392 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0ac143ae0 0x7fe0ac1405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:00.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.815+0000 7fe0ab7fe640 1 --2- 172.21.15.27:0/946657392 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0ac0adcc0 0x7fe0ac1646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:00.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.815+0000 7fe0abfff640 1 -- 172.21.15.27:0/946657392 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0ac143ae0 msgr2=0x7fe0ac1405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:00.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.815+0000 7fe0abfff640 1 --2- 172.21.15.27:0/946657392 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0ac143ae0 0x7fe0ac1405e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:00.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.815+0000 7fe0abfff640 1 -- 172.21.15.27:0/946657392 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0ac0adcc0 msgr2=0x7fe0ac1646b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:00.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.815+0000 7fe0abfff640 1 --2- 172.21.15.27:0/946657392 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0ac0adcc0 0x7fe0ac1646b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:00.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.815+0000 7fe0abfff640 1 -- 172.21.15.27:0/946657392 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c009420 con 0x7fe0ac06dfd0 2024-01-15T11:34:00.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.815+0000 7fe0abfff640 1 --2- 172.21.15.27:0/946657392 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0ac06dfd0 0x7fe0ac15d600 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0ad040 tx=0x7fe09c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:00.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.815+0000 7fe0a8ff9640 1 -- 172.21.15.27:0/946657392 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c0bf610 con 0x7fe0ac06dfd0 2024-01-15T11:34:00.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.815+0000 7fe0a8ff9640 1 -- 172.21.15.27:0/946657392 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09c0bf790 con 0x7fe0ac06dfd0 2024-01-15T11:34:00.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.815+0000 7fe0b292a640 1 -- 172.21.15.27:0/946657392 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ac15c080 con 0x7fe0ac06dfd0 2024-01-15T11:34:00.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.815+0000 7fe0a8ff9640 1 -- 172.21.15.27:0/946657392 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c0bfb40 con 0x7fe0ac06dfd0 2024-01-15T11:34:00.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.815+0000 7fe0b292a640 1 -- 172.21.15.27:0/946657392 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ac15c640 con 0x7fe0ac06dfd0 2024-01-15T11:34:00.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.815+0000 7fe0b292a640 1 -- 172.21.15.27:0/946657392 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ac0c5a70 con 0x7fe0ac06dfd0 2024-01-15T11:34:00.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.819+0000 7fe0a8ff9640 1 -- 172.21.15.27:0/946657392 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fe09c0b5400 con 0x7fe0ac06dfd0 2024-01-15T11:34:00.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.819+0000 7fe0a8ff9640 1 --2- 172.21.15.27:0/946657392 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fe0980668f0 0x7fe098068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:00.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.819+0000 7fe0a8ff9640 1 -- 172.21.15.27:0/946657392 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe09c11f210 con 0x7fe0ac06dfd0 2024-01-15T11:34:00.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.819+0000 7fe0ab7fe640 1 --2- 172.21.15.27:0/946657392 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fe0980668f0 0x7fe098068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:00.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.819+0000 7fe0ab7fe640 1 --2- 172.21.15.27:0/946657392 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fe0980668f0 0x7fe098068db0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac06e750 tx=0x7fe0a0009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:00.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:00.823+0000 7fe0a8ff9640 1 -- 172.21.15.27:0/946657392 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe09c0ec470 con 0x7fe0ac06dfd0 2024-01-15T11:34:01.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.015+0000 7fe0b292a640 1 -- 172.21.15.27:0/946657392 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0ac04e850 con 0x7fe0ac06dfd0 2024-01-15T11:34:01.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.015+0000 7fe0a8ff9640 1 -- 172.21.15.27:0/946657392 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7fe09c0efa90 con 0x7fe0ac06dfd0 2024-01-15T11:34:01.017 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:34:01.017 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3682867520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3682867520},{"type":"v1","addr":"172.21.15.93:6837","nonce":3682867520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/2849635892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2849635892},{"type":"v1","addr":"172.21.15.93:6836","nonce":2849635892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/889491859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":889491859},{"type":"v1","addr":"172.21.15.27:6833","nonce":889491859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-15T11:33:20.068559+0000","modified":"2024-01-15T11:33:23.168516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/2516765751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2516765751},{"type":"v1","addr":"172.21.15.27:6835","nonce":2516765751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-15T11:34:01.018 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 8 2024-01-15T11:34:01.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.015+0000 7fe0b292a640 1 -- 172.21.15.27:0/946657392 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fe0980668f0 msgr2=0x7fe098068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:01.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.015+0000 7fe0b292a640 1 --2- 172.21.15.27:0/946657392 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fe0980668f0 0x7fe098068db0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac06e750 tx=0x7fe0a0009190 comp rx=0 tx=0).stop 2024-01-15T11:34:01.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.015+0000 7fe0b292a640 1 -- 172.21.15.27:0/946657392 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0ac06dfd0 msgr2=0x7fe0ac15d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:01.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.015+0000 7fe0b292a640 1 --2- 172.21.15.27:0/946657392 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0ac06dfd0 0x7fe0ac15d600 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0ad040 tx=0x7fe09c01ac90 comp rx=0 tx=0).stop 2024-01-15T11:34:01.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.015+0000 7fe0b292a640 1 -- 172.21.15.27:0/946657392 shutdown_connections 2024-01-15T11:34:01.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.015+0000 7fe0b292a640 1 --2- 172.21.15.27:0/946657392 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0ac143ae0 0x7fe0ac1405e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.015+0000 7fe0b292a640 1 --2- 172.21.15.27:0/946657392 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fe0980668f0 0x7fe098068db0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.015+0000 7fe0b292a640 1 --2- 172.21.15.27:0/946657392 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0ac0adcc0 0x7fe0ac1646b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.015+0000 7fe0b292a640 1 --2- 172.21.15.27:0/946657392 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe0ac06dfd0 0x7fe0ac15d600 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.015+0000 7fe0b292a640 1 -- 172.21.15.27:0/946657392 >> 172.21.15.27:0/946657392 conn(0x7fe0ac0b0c40 msgr2=0x7fe0ac1421a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:01.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.015+0000 7fe0b292a640 1 -- 172.21.15.27:0/946657392 shutdown_connections 2024-01-15T11:34:01.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.015+0000 7fe0b292a640 1 -- 172.21.15.27:0/946657392 wait complete. 2024-01-15T11:34:01.038 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-15T11:34:01.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.179+0000 7f2a3d832640 1 Processor -- start 2024-01-15T11:34:01.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.179+0000 7f2a3d832640 1 -- start start 2024-01-15T11:34:01.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.179+0000 7f2a3d832640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2a38143ae0 0x7f2a380b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:01.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.179+0000 7f2a3d832640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2a3806dfd0 0x7f2a3806e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:01.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.183+0000 7f2a3d832640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a3806e980 con 0x7f2a380adcc0 2024-01-15T11:34:01.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.183+0000 7f2a3d832640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a380ae7f0 con 0x7f2a3806dfd0 2024-01-15T11:34:01.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.183+0000 7f2a3d832640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a380b2480 con 0x7f2a38143ae0 2024-01-15T11:34:01.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.183+0000 7f2a377fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f2a380adcc0 0x7f2a380ae0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33434/0 (socket says 172.21.15.27:33434) 2024-01-15T11:34:01.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.183+0000 7f2a2ffff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f2a3806dfd0 0x7f2a3806e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:01.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.183+0000 7f2a377fe640 1 -- 172.21.15.27:0/4232076198 learned_addr learned my addr 172.21.15.27:0/4232076198 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:01.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.183+0000 7f2a36ffd640 1 --2- 172.21.15.27:0/4232076198 >> v2:172.21.15.93:3300/0 conn(0x7f2a38143ae0 0x7f2a380b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:01.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.183+0000 7f2a367fc640 1 -- 172.21.15.27:0/4232076198 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679893634 0 0) 0x7f2a3806e980 con 0x7f2a380adcc0 2024-01-15T11:34:01.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.183+0000 7f2a367fc640 1 -- 172.21.15.27:0/4232076198 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a24003530 con 0x7f2a380adcc0 2024-01-15T11:34:01.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.183+0000 7f2a36ffd640 1 -- 172.21.15.27:0/4232076198 >> v2:172.21.15.27:3300/0 conn(0x7f2a3806dfd0 msgr2=0x7f2a3806e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:01.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.183+0000 7f2a36ffd640 1 --2- 172.21.15.27:0/4232076198 >> v2:172.21.15.27:3300/0 conn(0x7f2a3806dfd0 0x7f2a3806e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.183+0000 7f2a36ffd640 1 -- 172.21.15.27:0/4232076198 >> v1:172.21.15.27:6789/0 conn(0x7f2a380adcc0 legacy=0x7f2a380ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:01.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.183+0000 7f2a36ffd640 1 -- 172.21.15.27:0/4232076198 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a38070670 con 0x7f2a38143ae0 2024-01-15T11:34:01.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.183+0000 7f2a2ffff640 1 --2- 172.21.15.27:0/4232076198 >> v2:172.21.15.27:3300/0 conn(0x7f2a3806dfd0 0x7f2a3806e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:34:01.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.183+0000 7f2a36ffd640 1 --2- 172.21.15.27:0/4232076198 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a38143ae0 0x7f2a380b1f40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2a38070080 tx=0x7f2a2801c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d99a24b4475a695f server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:01.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.187+0000 7f2a367fc640 1 -- 172.21.15.27:0/4232076198 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a280a7070 con 0x7f2a38143ae0 2024-01-15T11:34:01.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.187+0000 7f2a367fc640 1 -- 172.21.15.27:0/4232076198 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a280ab430 con 0x7f2a38143ae0 2024-01-15T11:34:01.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.187+0000 7f2a367fc640 1 -- 172.21.15.27:0/4232076198 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a280ab7c0 con 0x7f2a38143ae0 2024-01-15T11:34:01.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.187+0000 7f2a3d832640 1 -- 172.21.15.27:0/4232076198 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a38143ae0 msgr2=0x7f2a380b1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:01.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.187+0000 7f2a3d832640 1 --2- 172.21.15.27:0/4232076198 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a38143ae0 0x7f2a380b1f40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2a38070080 tx=0x7f2a2801c430 comp rx=0 tx=0).stop 2024-01-15T11:34:01.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.187+0000 7f2a3d832640 1 -- 172.21.15.27:0/4232076198 shutdown_connections 2024-01-15T11:34:01.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.187+0000 7f2a3d832640 1 --2- 172.21.15.27:0/4232076198 >> v2:172.21.15.27:3300/0 conn(0x7f2a3806dfd0 0x7f2a3806e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.187+0000 7f2a3d832640 1 --2- 172.21.15.27:0/4232076198 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a38143ae0 0x7f2a380b1f40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.187+0000 7f2a3d832640 1 -- 172.21.15.27:0/4232076198 >> 172.21.15.27:0/4232076198 conn(0x7f2a380b0c40 msgr2=0x7f2a380b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:01.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.187+0000 7f2a3d832640 1 -- 172.21.15.27:0/4232076198 shutdown_connections 2024-01-15T11:34:01.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.187+0000 7f2a3d832640 1 -- 172.21.15.27:0/4232076198 wait complete. 2024-01-15T11:34:01.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.187+0000 7f2a3d832640 1 Processor -- start 2024-01-15T11:34:01.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.187+0000 7f2a3d832640 1 -- start start 2024-01-15T11:34:01.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.187+0000 7f2a3d832640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a3806dfd0 0x7f2a3809c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:01.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.187+0000 7f2a3d832640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a380adcc0 0x7f2a38159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:01.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.187+0000 7f2a3d832640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2a38143ae0 0x7f2a3813d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:01.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.187+0000 7f2a3d832640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3809c9a0 con 0x7f2a3806dfd0 2024-01-15T11:34:01.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.187+0000 7f2a3d832640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3815b9a0 con 0x7f2a380adcc0 2024-01-15T11:34:01.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.187+0000 7f2a3d832640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3815bc20 con 0x7f2a38143ae0 2024-01-15T11:34:01.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.191+0000 7f2a36ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a3806dfd0 0x7f2a3809c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:01.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.191+0000 7f2a36ffd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a3806dfd0 0x7f2a3809c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52464/0 (socket says 172.21.15.27:52464) 2024-01-15T11:34:01.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.191+0000 7f2a36ffd640 1 -- 172.21.15.27:0/567190331 learned_addr learned my addr 172.21.15.27:0/567190331 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:01.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.191+0000 7f2a36ffd640 1 -- 172.21.15.27:0/567190331 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2a38143ae0 msgr2=0x7f2a3813d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:01.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.191+0000 7f2a36ffd640 1 --2- 172.21.15.27:0/567190331 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2a38143ae0 0x7f2a3813d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.191+0000 7f2a36ffd640 1 -- 172.21.15.27:0/567190331 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a380adcc0 msgr2=0x7f2a38159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:01.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.191+0000 7f2a36ffd640 1 --2- 172.21.15.27:0/567190331 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a380adcc0 0x7f2a38159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.191+0000 7f2a36ffd640 1 -- 172.21.15.27:0/567190331 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a20009420 con 0x7f2a3806dfd0 2024-01-15T11:34:01.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.191+0000 7f2a36ffd640 1 --2- 172.21.15.27:0/567190331 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a3806dfd0 0x7f2a3809c460 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2a280ad040 tx=0x7f2a2801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:01.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.191+0000 7f2a34ff9640 1 -- 172.21.15.27:0/567190331 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a280bf610 con 0x7f2a3806dfd0 2024-01-15T11:34:01.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.191+0000 7f2a34ff9640 1 -- 172.21.15.27:0/567190331 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a280bf790 con 0x7f2a3806dfd0 2024-01-15T11:34:01.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.191+0000 7f2a3d832640 1 -- 172.21.15.27:0/567190331 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a28009420 con 0x7f2a3806dfd0 2024-01-15T11:34:01.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.191+0000 7f2a34ff9640 1 -- 172.21.15.27:0/567190331 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a280bfb40 con 0x7f2a3806dfd0 2024-01-15T11:34:01.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.191+0000 7f2a3d832640 1 -- 172.21.15.27:0/567190331 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3815c1e0 con 0x7f2a3806dfd0 2024-01-15T11:34:01.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.191+0000 7f2a3d832640 1 -- 172.21.15.27:0/567190331 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a3804e850 con 0x7f2a3806dfd0 2024-01-15T11:34:01.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.191+0000 7f2a34ff9640 1 -- 172.21.15.27:0/567190331 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f2a280bfca0 con 0x7f2a3806dfd0 2024-01-15T11:34:01.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.195+0000 7f2a34ff9640 1 --2- 172.21.15.27:0/567190331 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f2a18066920 0x7f2a18068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:01.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.195+0000 7f2a34ff9640 1 -- 172.21.15.27:0/567190331 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f2a2811ee40 con 0x7f2a3806dfd0 2024-01-15T11:34:01.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.195+0000 7f2a2ffff640 1 --2- 172.21.15.27:0/567190331 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f2a18066920 0x7f2a18068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:01.197 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.195+0000 7f2a2ffff640 1 --2- 172.21.15.27:0/567190331 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f2a18066920 0x7f2a18068de0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2a20006e90 tx=0x7f2a20006de0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:01.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.199+0000 7f2a34ff9640 1 -- 172.21.15.27:0/567190331 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2a280ebfc0 con 0x7f2a3806dfd0 2024-01-15T11:34:01.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.387+0000 7f2a3d832640 1 -- 172.21.15.27:0/567190331 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a380ae420 con 0x7f2a3806dfd0 2024-01-15T11:34:01.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.391+0000 7f2a34ff9640 1 -- 172.21.15.27:0/567190331 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4904 (secure 0 0 0) 0x7f2a280ef5e0 con 0x7f2a3806dfd0 2024-01-15T11:34:01.393 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:34:01.393 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3682867520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6835","nonce":3682867520},{"type":"v1","addr":"172.21.15.93:6837","nonce":3682867520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6836/2849635892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2849635892},{"type":"v1","addr":"172.21.15.93:6836","nonce":2849635892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6833/889491859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":889491859},{"type":"v1","addr":"172.21.15.27:6833","nonce":889491859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-15T11:33:20.068559+0000","modified":"2024-01-15T11:33:23.168516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/2516765751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2516765751},{"type":"v1","addr":"172.21.15.27:6835","nonce":2516765751}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-15T11:34:01.393 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 8 2024-01-15T11:34:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.391+0000 7f2a3d832640 1 -- 172.21.15.27:0/567190331 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f2a18066920 msgr2=0x7f2a18068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.391+0000 7f2a3d832640 1 --2- 172.21.15.27:0/567190331 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f2a18066920 0x7f2a18068de0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2a20006e90 tx=0x7f2a20006de0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.391+0000 7f2a3d832640 1 -- 172.21.15.27:0/567190331 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a3806dfd0 msgr2=0x7f2a3809c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.391+0000 7f2a3d832640 1 --2- 172.21.15.27:0/567190331 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a3806dfd0 0x7f2a3809c460 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2a280ad040 tx=0x7f2a2801ac70 comp rx=0 tx=0).stop 2024-01-15T11:34:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.391+0000 7f2a3d832640 1 -- 172.21.15.27:0/567190331 shutdown_connections 2024-01-15T11:34:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.391+0000 7f2a3d832640 1 --2- 172.21.15.27:0/567190331 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2a38143ae0 0x7f2a3813d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.391+0000 7f2a3d832640 1 --2- 172.21.15.27:0/567190331 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f2a18066920 0x7f2a18068de0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.391+0000 7f2a3d832640 1 --2- 172.21.15.27:0/567190331 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2a380adcc0 0x7f2a38159260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.391+0000 7f2a3d832640 1 --2- 172.21.15.27:0/567190331 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2a3806dfd0 0x7f2a3809c460 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.391+0000 7f2a3d832640 1 -- 172.21.15.27:0/567190331 >> 172.21.15.27:0/567190331 conn(0x7f2a380b0c40 msgr2=0x7f2a38141410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:01.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.391+0000 7f2a3d832640 1 -- 172.21.15.27:0/567190331 shutdown_connections 2024-01-15T11:34:01.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.391+0000 7f2a3d832640 1 -- 172.21.15.27:0/567190331 wait complete. 2024-01-15T11:34:01.414 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:34:01.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.555+0000 7fb9d2dc4640 1 Processor -- start 2024-01-15T11:34:01.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.555+0000 7fb9d2dc4640 1 -- start start 2024-01-15T11:34:01.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.555+0000 7fb9d2dc4640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb9cc0cead0 0x7fb9cc0d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:01.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.555+0000 7fb9d2dc4640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb9cc0d1eb0 0x7fb9cc06bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:01.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.555+0000 7fb9d2dc4640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9cc0d2300 con 0x7fb9cc15d7b0 2024-01-15T11:34:01.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.555+0000 7fb9d2dc4640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9cc0d17e0 con 0x7fb9cc0cead0 2024-01-15T11:34:01.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.555+0000 7fb9d2dc4640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc0cefd0 con 0x7fb9cc0d1eb0 2024-01-15T11:34:01.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.555+0000 7fb9cbfff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb9cc0cead0 0x7fb9cc0d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:01.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.555+0000 7fb9cbfff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb9cc0cead0 0x7fb9cc0d1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52476/0 (socket says 172.21.15.27:52476) 2024-01-15T11:34:01.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.555+0000 7fb9cbfff640 1 -- 172.21.15.27:0/1787526305 learned_addr learned my addr 172.21.15.27:0/1787526305 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:01.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.555+0000 7fb9d1361640 1 --2- 172.21.15.27:0/1787526305 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb9cc0d1eb0 0x7fb9cc06bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:01.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.555+0000 7fb9cbfff640 1 -- 172.21.15.27:0/1787526305 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb9cc0d1eb0 msgr2=0x7fb9cc06bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:01.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.555+0000 7fb9cbfff640 1 --2- 172.21.15.27:0/1787526305 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb9cc0d1eb0 0x7fb9cc06bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.555+0000 7fb9cbfff640 1 -- 172.21.15.27:0/1787526305 >> v1:172.21.15.93:6789/0 conn(0x7fb9cc15d7b0 legacy=0x7fb9cc0d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:01.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.555+0000 7fb9cbfff640 1 -- 172.21.15.27:0/1787526305 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9cc0cf2b0 con 0x7fb9cc0cead0 2024-01-15T11:34:01.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.555+0000 7fb9d1361640 1 --2- 172.21.15.27:0/1787526305 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb9cc0d1eb0 0x7fb9cc06bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:34:01.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.559+0000 7fb9cbfff640 1 --2- 172.21.15.27:0/1787526305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9cc0cead0 0x7fb9cc0d1970 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8009870 tx=0x7fb9b801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96974c12f3de1e0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:01.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.559+0000 7fb9cb7fe640 1 -- 172.21.15.27:0/1787526305 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b80ab5f0 con 0x7fb9cc0cead0 2024-01-15T11:34:01.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.559+0000 7fb9cb7fe640 1 -- 172.21.15.27:0/1787526305 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b80ab750 con 0x7fb9cc0cead0 2024-01-15T11:34:01.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.559+0000 7fb9cb7fe640 1 -- 172.21.15.27:0/1787526305 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b80abae0 con 0x7fb9cc0cead0 2024-01-15T11:34:01.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.559+0000 7fb9d2dc4640 1 -- 172.21.15.27:0/1787526305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9cc0cead0 msgr2=0x7fb9cc0d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:01.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.559+0000 7fb9d2dc4640 1 --2- 172.21.15.27:0/1787526305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9cc0cead0 0x7fb9cc0d1970 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8009870 tx=0x7fb9b801c3f0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.559+0000 7fb9d2dc4640 1 -- 172.21.15.27:0/1787526305 shutdown_connections 2024-01-15T11:34:01.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.559+0000 7fb9d2dc4640 1 --2- 172.21.15.27:0/1787526305 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb9cc0d1eb0 0x7fb9cc06bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.559+0000 7fb9d2dc4640 1 --2- 172.21.15.27:0/1787526305 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9cc0cead0 0x7fb9cc0d1970 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.559+0000 7fb9d2dc4640 1 -- 172.21.15.27:0/1787526305 >> 172.21.15.27:0/1787526305 conn(0x7fb9cc0d33b0 msgr2=0x7fb9cc0d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:01.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.559+0000 7fb9d2dc4640 1 -- 172.21.15.27:0/1787526305 shutdown_connections 2024-01-15T11:34:01.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.559+0000 7fb9d2dc4640 1 -- 172.21.15.27:0/1787526305 wait complete. 2024-01-15T11:34:01.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.563+0000 7fb9d2dc4640 1 Processor -- start 2024-01-15T11:34:01.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.563+0000 7fb9d2dc4640 1 -- start start 2024-01-15T11:34:01.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.563+0000 7fb9d2dc4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9cc0cead0 0x7fb9cc1582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:01.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.563+0000 7fb9d2dc4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9cc0d1eb0 0x7fb9cc0c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:01.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.563+0000 7fb9d2dc4640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb9cc15d7b0 0x7fb9cc156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:01.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.563+0000 7fb9d2dc4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc159770 con 0x7fb9cc0d1eb0 2024-01-15T11:34:01.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.563+0000 7fb9d2dc4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc159b90 con 0x7fb9cc0cead0 2024-01-15T11:34:01.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.563+0000 7fb9d2dc4640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc158af0 con 0x7fb9cc15d7b0 2024-01-15T11:34:01.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.563+0000 7fb9cbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9cc0d1eb0 0x7fb9cc0c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:01.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.563+0000 7fb9cbfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9cc0d1eb0 0x7fb9cc0c7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52482/0 (socket says 172.21.15.27:52482) 2024-01-15T11:34:01.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.563+0000 7fb9cbfff640 1 -- 172.21.15.27:0/979237507 learned_addr learned my addr 172.21.15.27:0/979237507 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:01.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.563+0000 7fb9d0b60640 1 --2- 172.21.15.27:0/979237507 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9cc0cead0 0x7fb9cc1582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:01.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.563+0000 7fb9cbfff640 1 -- 172.21.15.27:0/979237507 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb9cc15d7b0 msgr2=0x7fb9cc156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:01.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.563+0000 7fb9cbfff640 1 --2- 172.21.15.27:0/979237507 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb9cc15d7b0 0x7fb9cc156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.563+0000 7fb9cbfff640 1 -- 172.21.15.27:0/979237507 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9cc0cead0 msgr2=0x7fb9cc1582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:01.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.563+0000 7fb9cbfff640 1 --2- 172.21.15.27:0/979237507 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9cc0cead0 0x7fb9cc1582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.563+0000 7fb9cbfff640 1 -- 172.21.15.27:0/979237507 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b80094d0 con 0x7fb9cc0d1eb0 2024-01-15T11:34:01.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.563+0000 7fb9d0b60640 1 --2- 172.21.15.27:0/979237507 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9cc0cead0 0x7fb9cc1582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:34:01.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.563+0000 7fb9cbfff640 1 --2- 172.21.15.27:0/979237507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9cc0d1eb0 0x7fb9cc0c7290 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb9b801a020 tx=0x7fb9b801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:01.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.563+0000 7fb9c97fa640 1 -- 172.21.15.27:0/979237507 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b80b4800 con 0x7fb9cc0d1eb0 2024-01-15T11:34:01.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.563+0000 7fb9c97fa640 1 -- 172.21.15.27:0/979237507 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b80b4960 con 0x7fb9cc0d1eb0 2024-01-15T11:34:01.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.563+0000 7fb9c97fa640 1 -- 172.21.15.27:0/979237507 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b80b4d10 con 0x7fb9cc0d1eb0 2024-01-15T11:34:01.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.563+0000 7fb9d2dc4640 1 -- 172.21.15.27:0/979237507 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9cc158dd0 con 0x7fb9cc0d1eb0 2024-01-15T11:34:01.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.563+0000 7fb9d2dc4640 1 -- 172.21.15.27:0/979237507 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9cc159390 con 0x7fb9cc0d1eb0 2024-01-15T11:34:01.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.563+0000 7fb9d2dc4640 1 -- 172.21.15.27:0/979237507 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9cc1598b0 con 0x7fb9cc0d1eb0 2024-01-15T11:34:01.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.567+0000 7fb9c97fa640 1 -- 172.21.15.27:0/979237507 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fb9b80c7440 con 0x7fb9cc0d1eb0 2024-01-15T11:34:01.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.567+0000 7fb9c97fa640 1 --2- 172.21.15.27:0/979237507 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb9b00668f0 0x7fb9b0068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:01.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.567+0000 7fb9c97fa640 1 -- 172.21.15.27:0/979237507 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fb9b80a8050 con 0x7fb9cc0d1eb0 2024-01-15T11:34:01.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.567+0000 7fb9d0b60640 1 --2- 172.21.15.27:0/979237507 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb9b00668f0 0x7fb9b0068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:01.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.567+0000 7fb9d0b60640 1 --2- 172.21.15.27:0/979237507 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb9b00668f0 0x7fb9b0068db0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0000f70 tx=0x7fb9c0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:01.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.571+0000 7fb9c97fa640 1 -- 172.21.15.27:0/979237507 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb9cc1598b0 con 0x7fb9cc0d1eb0 2024-01-15T11:34:01.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.727+0000 7fb9d2dc4640 1 -- 172.21.15.27:0/979237507 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9cc1598b0 con 0x7fb9cc0d1eb0 2024-01-15T11:34:01.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.727+0000 7fb9c97fa640 1 -- 172.21.15.27:0/979237507 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16474 (secure 0 0 0) 0x7fb9cc1598b0 con 0x7fb9cc0d1eb0 2024-01-15T11:34:01.732 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:34:01.733 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":23,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:34:00.937858+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-15T11:33:18.397200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-15T11:33:19.061383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2a","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:34:01.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.731+0000 7fb9d2dc4640 1 -- 172.21.15.27:0/979237507 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb9b00668f0 msgr2=0x7fb9b0068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:01.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.731+0000 7fb9d2dc4640 1 --2- 172.21.15.27:0/979237507 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb9b00668f0 0x7fb9b0068db0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0000f70 tx=0x7fb9c0009040 comp rx=0 tx=0).stop 2024-01-15T11:34:01.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.731+0000 7fb9d2dc4640 1 -- 172.21.15.27:0/979237507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9cc0d1eb0 msgr2=0x7fb9cc0c7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:01.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.731+0000 7fb9d2dc4640 1 --2- 172.21.15.27:0/979237507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9cc0d1eb0 0x7fb9cc0c7290 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb9b801a020 tx=0x7fb9b801ac30 comp rx=0 tx=0).stop 2024-01-15T11:34:01.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.731+0000 7fb9d2dc4640 1 -- 172.21.15.27:0/979237507 shutdown_connections 2024-01-15T11:34:01.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.731+0000 7fb9d2dc4640 1 --2- 172.21.15.27:0/979237507 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb9cc15d7b0 0x7fb9cc156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.731+0000 7fb9d2dc4640 1 --2- 172.21.15.27:0/979237507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb9cc0d1eb0 0x7fb9cc0c7290 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.731+0000 7fb9d2dc4640 1 --2- 172.21.15.27:0/979237507 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb9b00668f0 0x7fb9b0068db0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.731+0000 7fb9d2dc4640 1 --2- 172.21.15.27:0/979237507 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb9cc0cead0 0x7fb9cc1582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.731+0000 7fb9d2dc4640 1 -- 172.21.15.27:0/979237507 >> 172.21.15.27:0/979237507 conn(0x7fb9cc0d33b0 msgr2=0x7fb9cc0d3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:01.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.731+0000 7fb9d2dc4640 1 -- 172.21.15.27:0/979237507 shutdown_connections 2024-01-15T11:34:01.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.731+0000 7fb9d2dc4640 1 -- 172.21.15.27:0/979237507 wait complete. 2024-01-15T11:34:01.754 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-15T11:34:01.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.895+0000 7ff6c0580640 1 Processor -- start 2024-01-15T11:34:01.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.895+0000 7ff6c0580640 1 -- start start 2024-01-15T11:34:01.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.899+0000 7ff6c0580640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff6b80cb9b0 0x7ff6b806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:01.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.899+0000 7ff6c0580640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff6b80cbd90 0x7ff6b815f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:01.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.899+0000 7ff6c0580640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff6b80ce5d0 0x7ff6b815bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:01.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.899+0000 7ff6c0580640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b815bba0 con 0x7ff6b80ce5d0 2024-01-15T11:34:01.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.899+0000 7ff6c0580640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b80cdd50 con 0x7ff6b80cb9b0 2024-01-15T11:34:01.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.899+0000 7ff6c0580640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b8159630 con 0x7ff6b80cbd90 2024-01-15T11:34:01.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.899+0000 7ff6beb1d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff6b80ce5d0 0x7ff6b815bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:01.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.899+0000 7ff6beb1d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff6b80ce5d0 0x7ff6b815bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52488/0 (socket says 172.21.15.27:52488) 2024-01-15T11:34:01.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.899+0000 7ff6beb1d640 1 -- 172.21.15.27:0/2831082439 learned_addr learned my addr 172.21.15.27:0/2831082439 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:01.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.899+0000 7ff6be31c640 1 --2- 172.21.15.27:0/2831082439 >> v2:172.21.15.93:3300/0 conn(0x7ff6b80cb9b0 0x7ff6b806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:01.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.899+0000 7ff6bdb1b640 1 --2- 172.21.15.27:0/2831082439 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff6b80cbd90 0x7ff6b815f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:01.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.899+0000 7ff6beb1d640 1 -- 172.21.15.27:0/2831082439 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff6b80cbd90 msgr2=0x7ff6b815f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:01.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.899+0000 7ff6beb1d640 1 --2- 172.21.15.27:0/2831082439 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff6b80cbd90 0x7ff6b815f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.899+0000 7ff6beb1d640 1 -- 172.21.15.27:0/2831082439 >> v2:172.21.15.93:3300/0 conn(0x7ff6b80cb9b0 msgr2=0x7ff6b806e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:01.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.899+0000 7ff6beb1d640 1 --2- 172.21.15.27:0/2831082439 >> v2:172.21.15.93:3300/0 conn(0x7ff6b80cb9b0 0x7ff6b806e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.899+0000 7ff6beb1d640 1 -- 172.21.15.27:0/2831082439 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b815f6d0 con 0x7ff6b80ce5d0 2024-01-15T11:34:01.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.903+0000 7ff6beb1d640 1 --2- 172.21.15.27:0/2831082439 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6b80ce5d0 0x7ff6b815bfd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff6b806c360 tx=0x7ff6b001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc6d13978899960 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:01.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.903+0000 7ff6bd31a640 1 -- 172.21.15.27:0/2831082439 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b00a5800 con 0x7ff6b80ce5d0 2024-01-15T11:34:01.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.903+0000 7ff6bd31a640 1 -- 172.21.15.27:0/2831082439 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b00a5960 con 0x7ff6b80ce5d0 2024-01-15T11:34:01.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.903+0000 7ff6bd31a640 1 -- 172.21.15.27:0/2831082439 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b00a5cf0 con 0x7ff6b80ce5d0 2024-01-15T11:34:01.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.903+0000 7ff6c0580640 1 -- 172.21.15.27:0/2831082439 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6b80ce5d0 msgr2=0x7ff6b815bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:01.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.903+0000 7ff6c0580640 1 --2- 172.21.15.27:0/2831082439 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6b80ce5d0 0x7ff6b815bfd0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff6b806c360 tx=0x7ff6b001c9a0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.903+0000 7ff6c0580640 1 -- 172.21.15.27:0/2831082439 shutdown_connections 2024-01-15T11:34:01.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.903+0000 7ff6c0580640 1 --2- 172.21.15.27:0/2831082439 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6b80ce5d0 0x7ff6b815bfd0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.903+0000 7ff6c0580640 1 --2- 172.21.15.27:0/2831082439 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff6b80cbd90 0x7ff6b815f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.903+0000 7ff6c0580640 1 --2- 172.21.15.27:0/2831082439 >> v2:172.21.15.93:3300/0 conn(0x7ff6b80cb9b0 0x7ff6b806e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.903+0000 7ff6c0580640 1 -- 172.21.15.27:0/2831082439 >> 172.21.15.27:0/2831082439 conn(0x7ff6b80b0cb0 msgr2=0x7ff6b80b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:01.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.903+0000 7ff6c0580640 1 -- 172.21.15.27:0/2831082439 shutdown_connections 2024-01-15T11:34:01.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.903+0000 7ff6c0580640 1 -- 172.21.15.27:0/2831082439 wait complete. 2024-01-15T11:34:01.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.903+0000 7ff6c0580640 1 Processor -- start 2024-01-15T11:34:01.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.903+0000 7ff6c0580640 1 -- start start 2024-01-15T11:34:01.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.903+0000 7ff6c0580640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff6b80cb9b0 0x7ff6b814fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:01.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.907+0000 7ff6c0580640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6b80cbd90 0x7ff6b814eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:01.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.907+0000 7ff6c0580640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6b80ce5d0 0x7ff6b8154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:01.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.907+0000 7ff6c0580640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b814f530 con 0x7ff6b80cbd90 2024-01-15T11:34:01.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.907+0000 7ff6c0580640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b80b2270 con 0x7ff6b80ce5d0 2024-01-15T11:34:01.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.907+0000 7ff6c0580640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b80acfa0 con 0x7ff6b80cb9b0 2024-01-15T11:34:01.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.907+0000 7ff6bdb1b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6b80cbd90 0x7ff6b814eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:01.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.907+0000 7ff6bdb1b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6b80cbd90 0x7ff6b814eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52490/0 (socket says 172.21.15.27:52490) 2024-01-15T11:34:01.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.907+0000 7ff6bdb1b640 1 -- 172.21.15.27:0/2988460474 learned_addr learned my addr 172.21.15.27:0/2988460474 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:01.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.907+0000 7ff6be31c640 1 --2- 172.21.15.27:0/2988460474 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff6b80cb9b0 0x7ff6b814fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.907+0000 7ff6beb1d640 1 --2- 172.21.15.27:0/2988460474 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6b80ce5d0 0x7ff6b8154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.907+0000 7ff6bdb1b640 1 -- 172.21.15.27:0/2988460474 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff6b80cb9b0 msgr2=0x7ff6b814fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.907+0000 7ff6bdb1b640 1 --2- 172.21.15.27:0/2988460474 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff6b80cb9b0 0x7ff6b814fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.907+0000 7ff6bdb1b640 1 -- 172.21.15.27:0/2988460474 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6b80ce5d0 msgr2=0x7ff6b8154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.907+0000 7ff6bdb1b640 1 --2- 172.21.15.27:0/2988460474 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6b80ce5d0 0x7ff6b8154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.907+0000 7ff6bdb1b640 1 -- 172.21.15.27:0/2988460474 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b0009b30 con 0x7ff6b80cbd90 2024-01-15T11:34:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.907+0000 7ff6bdb1b640 1 --2- 172.21.15.27:0/2988460474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6b80cbd90 0x7ff6b814eff0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff6a800d800 tx=0x7ff6a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.907+0000 7ff6aeffd640 1 -- 172.21.15.27:0/2988460474 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a800b6c0 con 0x7ff6b80cbd90 2024-01-15T11:34:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.907+0000 7ff6aeffd640 1 -- 172.21.15.27:0/2988460474 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a800b820 con 0x7ff6b80cbd90 2024-01-15T11:34:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.907+0000 7ff6aeffd640 1 -- 172.21.15.27:0/2988460474 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a800bb90 con 0x7ff6b80cbd90 2024-01-15T11:34:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.907+0000 7ff6c0580640 1 -- 172.21.15.27:0/2988460474 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b80ad280 con 0x7ff6b80cbd90 2024-01-15T11:34:01.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.907+0000 7ff6c0580640 1 -- 172.21.15.27:0/2988460474 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b80b1f00 con 0x7ff6b80cbd90 2024-01-15T11:34:01.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.907+0000 7ff6c0580640 1 -- 172.21.15.27:0/2988460474 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b80671f0 con 0x7ff6b80cbd90 2024-01-15T11:34:01.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.907+0000 7ff6aeffd640 1 -- 172.21.15.27:0/2988460474 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7ff6a800bcf0 con 0x7ff6b80cbd90 2024-01-15T11:34:01.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.911+0000 7ff6aeffd640 1 --2- 172.21.15.27:0/2988460474 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff69c0668f0 0x7ff69c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:01.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.911+0000 7ff6aeffd640 1 -- 172.21.15.27:0/2988460474 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ff6a8084850 con 0x7ff6b80cbd90 2024-01-15T11:34:01.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.911+0000 7ff6be31c640 1 --2- 172.21.15.27:0/2988460474 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff69c0668f0 0x7ff69c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:01.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.911+0000 7ff6be31c640 1 --2- 172.21.15.27:0/2988460474 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff69c0668f0 0x7ff69c068db0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff6b81537a0 tx=0x7ff6b4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:01.916 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:01.915+0000 7ff6aeffd640 1 -- 172.21.15.27:0/2988460474 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff6a8051a80 con 0x7ff6b80cbd90 2024-01-15T11:34:02.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.111+0000 7ff6c0580640 1 -- 172.21.15.27:0/2988460474 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff6b80ad7a0 con 0x7ff6b80cbd90 2024-01-15T11:34:02.113 INFO:tasks.ceph.mon.a.smithi027.stderr:2024-01-15T11:34:02.111+0000 7fb49cf85640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-15T11:34:02.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.111+0000 7ff6aeffd640 1 -- 172.21.15.27:0/2988460474 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff6b80ad7a0 con 0x7ff6b80cbd90 2024-01-15T11:34:02.116 INFO:teuthology.orchestra.run.smithi027.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-15T11:34:02.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.115+0000 7ff6c0580640 1 -- 172.21.15.27:0/2988460474 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff69c0668f0 msgr2=0x7ff69c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:02.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.115+0000 7ff6c0580640 1 --2- 172.21.15.27:0/2988460474 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff69c0668f0 0x7ff69c068db0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff6b81537a0 tx=0x7ff6b4008040 comp rx=0 tx=0).stop 2024-01-15T11:34:02.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.115+0000 7ff6c0580640 1 -- 172.21.15.27:0/2988460474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6b80cbd90 msgr2=0x7ff6b814eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:02.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.115+0000 7ff6c0580640 1 --2- 172.21.15.27:0/2988460474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6b80cbd90 0x7ff6b814eff0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff6a800d800 tx=0x7ff6a800dcc0 comp rx=0 tx=0).stop 2024-01-15T11:34:02.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.115+0000 7ff6c0580640 1 -- 172.21.15.27:0/2988460474 shutdown_connections 2024-01-15T11:34:02.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.115+0000 7ff6c0580640 1 --2- 172.21.15.27:0/2988460474 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff69c0668f0 0x7ff69c068db0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:02.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.115+0000 7ff6c0580640 1 --2- 172.21.15.27:0/2988460474 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff6b80ce5d0 0x7ff6b8154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:02.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.115+0000 7ff6c0580640 1 --2- 172.21.15.27:0/2988460474 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6b80cbd90 0x7ff6b814eff0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:02.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.115+0000 7ff6c0580640 1 --2- 172.21.15.27:0/2988460474 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff6b80cb9b0 0x7ff6b814fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:02.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.115+0000 7ff6c0580640 1 -- 172.21.15.27:0/2988460474 >> 172.21.15.27:0/2988460474 conn(0x7ff6b80b0cb0 msgr2=0x7ff6b8165120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:02.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.115+0000 7ff6c0580640 1 -- 172.21.15.27:0/2988460474 shutdown_connections 2024-01-15T11:34:02.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.115+0000 7ff6c0580640 1 -- 172.21.15.27:0/2988460474 wait complete. 2024-01-15T11:34:02.131 INFO:tasks.ceph.mds.a.smithi027.stderr: -6785> 2024-01-15T11:33:24.651+0000 7f1765809640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-15T11:34:02.140 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-15T11:34:02.182 INFO:tasks.ceph.mds.a.smithi027.stdout:starting mds.a at 2024-01-15T11:34:02.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.287+0000 7f6be1f01640 1 Processor -- start 2024-01-15T11:34:02.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.287+0000 7f6be1f01640 1 -- start start 2024-01-15T11:34:02.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.287+0000 7f6be1f01640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6bdc0d0510 0x7f6bdc0d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:02.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.287+0000 7f6be1f01640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bdc0cdfb0 con 0x7f6bdc0ced30 2024-01-15T11:34:02.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.287+0000 7f6be1f01640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bdc0d4140 con 0x7f6bdc15d8f0 2024-01-15T11:34:02.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.287+0000 7f6be1f01640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bdc0d4420 con 0x7f6bdc0d0510 2024-01-15T11:34:02.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.287+0000 7f6bdbfff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6bdc0d0510 0x7f6bdc0d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:02.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.287+0000 7f6bd3fff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f6bdc0ced30 0x7f6bdc0cfe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33446/0 (socket says 172.21.15.27:33446) 2024-01-15T11:34:02.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.287+0000 7f6bd3fff640 1 -- 172.21.15.27:0/3734650887 learned_addr learned my addr 172.21.15.27:0/3734650887 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:02.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.291+0000 7f6bdbfff640 1 -- 172.21.15.27:0/3734650887 >> v1:172.21.15.93:6789/0 conn(0x7f6bdc15d8f0 legacy=0x7f6bdc15e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:02.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.291+0000 7f6bdbfff640 1 -- 172.21.15.27:0/3734650887 >> v1:172.21.15.27:6789/0 conn(0x7f6bdc0ced30 legacy=0x7f6bdc0cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:02.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.291+0000 7f6bdbfff640 1 -- 172.21.15.27:0/3734650887 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc0ce250 con 0x7f6bdc0d0510 2024-01-15T11:34:02.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.291+0000 7f6bdbfff640 1 --2- 172.21.15.27:0/3734650887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6bdc0d0510 0x7f6bdc0d1000 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4009d90 tx=0x7f6bd401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0fac2fcda82883 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:02.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.291+0000 7f6bdaffd640 1 -- 172.21.15.27:0/3734650887 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd40a58f0 con 0x7f6bdc0d0510 2024-01-15T11:34:02.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.291+0000 7f6bdaffd640 1 -- 172.21.15.27:0/3734650887 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd40a5a50 con 0x7f6bdc0d0510 2024-01-15T11:34:02.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.291+0000 7f6bdaffd640 1 -- 172.21.15.27:0/3734650887 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd40a5de0 con 0x7f6bdc0d0510 2024-01-15T11:34:02.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.291+0000 7f6be1f01640 1 -- 172.21.15.27:0/3734650887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6bdc0d0510 msgr2=0x7f6bdc0d1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:02.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.291+0000 7f6be1f01640 1 --2- 172.21.15.27:0/3734650887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6bdc0d0510 0x7f6bdc0d1000 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4009d90 tx=0x7f6bd401c920 comp rx=0 tx=0).stop 2024-01-15T11:34:02.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.291+0000 7f6be1f01640 1 -- 172.21.15.27:0/3734650887 shutdown_connections 2024-01-15T11:34:02.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.291+0000 7f6be1f01640 1 --2- 172.21.15.27:0/3734650887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6bdc0d0510 0x7f6bdc0d1000 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:02.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.291+0000 7f6be1f01640 1 -- 172.21.15.27:0/3734650887 >> 172.21.15.27:0/3734650887 conn(0x7f6bdc09c750 msgr2=0x7f6bdc0d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:02.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.291+0000 7f6be1f01640 1 -- 172.21.15.27:0/3734650887 shutdown_connections 2024-01-15T11:34:02.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.295+0000 7f6be1f01640 1 -- 172.21.15.27:0/3734650887 wait complete. 2024-01-15T11:34:02.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.295+0000 7f6be1f01640 1 Processor -- start 2024-01-15T11:34:02.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.295+0000 7f6be1f01640 1 -- start start 2024-01-15T11:34:02.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.295+0000 7f6be1f01640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bdc0ced30 0x7f6bdc160e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:02.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.295+0000 7f6be1f01640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6bdc0d0510 0x7f6bdc152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:02.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.295+0000 7f6be1f01640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6bdc15d8f0 0x7f6bdc152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:02.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.295+0000 7f6be1f01640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc15e740 con 0x7f6bdc0d0510 2024-01-15T11:34:02.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.295+0000 7f6be1f01640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc158ff0 con 0x7f6bdc0ced30 2024-01-15T11:34:02.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.295+0000 7f6be1f01640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc1592d0 con 0x7f6bdc15d8f0 2024-01-15T11:34:02.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.295+0000 7f6bd3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6bdc0d0510 0x7f6bdc152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:02.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.295+0000 7f6bd3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6bdc0d0510 0x7f6bdc152510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52522/0 (socket says 172.21.15.27:52522) 2024-01-15T11:34:02.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.295+0000 7f6bd3fff640 1 -- 172.21.15.27:0/957655492 learned_addr learned my addr 172.21.15.27:0/957655492 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:02.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.295+0000 7f6bdbfff640 1 --2- 172.21.15.27:0/957655492 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6bdc15d8f0 0x7f6bdc152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:02.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.295+0000 7f6bdb7fe640 1 --2- 172.21.15.27:0/957655492 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bdc0ced30 0x7f6bdc160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:02.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.295+0000 7f6bd3fff640 1 -- 172.21.15.27:0/957655492 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6bdc15d8f0 msgr2=0x7f6bdc152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:02.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.295+0000 7f6bd3fff640 1 --2- 172.21.15.27:0/957655492 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6bdc15d8f0 0x7f6bdc152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:02.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.295+0000 7f6bd3fff640 1 -- 172.21.15.27:0/957655492 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bdc0ced30 msgr2=0x7f6bdc160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:02.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.295+0000 7f6bd3fff640 1 --2- 172.21.15.27:0/957655492 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bdc0ced30 0x7f6bdc160e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:02.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.295+0000 7f6bd3fff640 1 -- 172.21.15.27:0/957655492 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd4009a70 con 0x7f6bdc0d0510 2024-01-15T11:34:02.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.295+0000 7f6bd3fff640 1 --2- 172.21.15.27:0/957655492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6bdc0d0510 0x7f6bdc152510 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400c500 tx=0x7f6bc400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:02.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.295+0000 7f6bd8ff9640 1 -- 172.21.15.27:0/957655492 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4005cf0 con 0x7f6bdc0d0510 2024-01-15T11:34:02.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.295+0000 7f6bd8ff9640 1 -- 172.21.15.27:0/957655492 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc4005e50 con 0x7f6bdc0d0510 2024-01-15T11:34:02.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.295+0000 7f6be1f01640 1 -- 172.21.15.27:0/957655492 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bdc1595b0 con 0x7f6bdc0d0510 2024-01-15T11:34:02.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.295+0000 7f6bd8ff9640 1 -- 172.21.15.27:0/957655492 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc40072f0 con 0x7f6bdc0d0510 2024-01-15T11:34:02.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.299+0000 7f6be1f01640 1 -- 172.21.15.27:0/957655492 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bdc161360 con 0x7f6bdc0d0510 2024-01-15T11:34:02.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.299+0000 7f6be1f01640 1 -- 172.21.15.27:0/957655492 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bdc04e850 con 0x7f6bdc0d0510 2024-01-15T11:34:02.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.299+0000 7f6bd8ff9640 1 -- 172.21.15.27:0/957655492 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f6bc4007450 con 0x7f6bdc0d0510 2024-01-15T11:34:02.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.299+0000 7f6bd8ff9640 1 --2- 172.21.15.27:0/957655492 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6bbc0668f0 0x7f6bbc068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:02.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.299+0000 7f6bd8ff9640 1 -- 172.21.15.27:0/957655492 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f6bc4083910 con 0x7f6bdc0d0510 2024-01-15T11:34:02.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.299+0000 7f6bdb7fe640 1 --2- 172.21.15.27:0/957655492 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6bbc0668f0 0x7f6bbc068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:02.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.303+0000 7f6bdb7fe640 1 --2- 172.21.15.27:0/957655492 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6bbc0668f0 0x7f6bbc068db0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc000f70 tx=0x7f6bcc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:02.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.303+0000 7f6bd8ff9640 1 -- 172.21.15.27:0/957655492 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6bc4050ba0 con 0x7f6bdc0d0510 2024-01-15T11:34:02.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:02.499+0000 7f6be1f01640 1 -- 172.21.15.27:0/957655492 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6bdc0cf9d0 con 0x7f6bdc0d0510 2024-01-15T11:34:03.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.115+0000 7f6bd8ff9640 1 -- 172.21.15.27:0/957655492 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6bc40170a0 con 0x7f6bdc0d0510 2024-01-15T11:34:03.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.115+0000 7f6be1f01640 1 -- 172.21.15.27:0/957655492 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6bbc0668f0 msgr2=0x7f6bbc068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:03.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.115+0000 7f6be1f01640 1 --2- 172.21.15.27:0/957655492 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6bbc0668f0 0x7f6bbc068db0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc000f70 tx=0x7f6bcc009040 comp rx=0 tx=0).stop 2024-01-15T11:34:03.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.115+0000 7f6be1f01640 1 -- 172.21.15.27:0/957655492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6bdc0d0510 msgr2=0x7f6bdc152510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:03.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.115+0000 7f6be1f01640 1 --2- 172.21.15.27:0/957655492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6bdc0d0510 0x7f6bdc152510 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400c500 tx=0x7f6bc400c9c0 comp rx=0 tx=0).stop 2024-01-15T11:34:03.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.115+0000 7f6be1f01640 1 -- 172.21.15.27:0/957655492 shutdown_connections 2024-01-15T11:34:03.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.115+0000 7f6be1f01640 1 --2- 172.21.15.27:0/957655492 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6bdc15d8f0 0x7f6bdc152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:03.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.115+0000 7f6be1f01640 1 --2- 172.21.15.27:0/957655492 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6bdc0d0510 0x7f6bdc152510 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:03.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.115+0000 7f6be1f01640 1 --2- 172.21.15.27:0/957655492 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6bbc0668f0 0x7f6bbc068db0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:03.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.115+0000 7f6be1f01640 1 --2- 172.21.15.27:0/957655492 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bdc0ced30 0x7f6bdc160e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:03.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.115+0000 7f6be1f01640 1 -- 172.21.15.27:0/957655492 >> 172.21.15.27:0/957655492 conn(0x7f6bdc09c750 msgr2=0x7f6bdc0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:03.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.115+0000 7f6be1f01640 1 -- 172.21.15.27:0/957655492 shutdown_connections 2024-01-15T11:34:03.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.115+0000 7f6be1f01640 1 -- 172.21.15.27:0/957655492 wait complete. 2024-01-15T11:34:03.142 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-15T11:34:03.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.327+0000 7f9a38432640 1 Processor -- start 2024-01-15T11:34:03.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.327+0000 7f9a38432640 1 -- start start 2024-01-15T11:34:03.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.331+0000 7f9a38432640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9a300ce5d0 0x7f9a3015bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:03.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.331+0000 7f9a38432640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a30159630 con 0x7f9a3006e3f0 2024-01-15T11:34:03.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.331+0000 7f9a38432640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a300cd1d0 con 0x7f9a300cb9b0 2024-01-15T11:34:03.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.331+0000 7f9a38432640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a3006e860 con 0x7f9a300ce5d0 2024-01-15T11:34:03.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.331+0000 7f9a359cd640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f9a3006e3f0 0x7f9a3015f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33456/0 (socket says 172.21.15.27:33456) 2024-01-15T11:34:03.334 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.331+0000 7f9a359cd640 1 -- 172.21.15.27:0/2242424081 learned_addr learned my addr 172.21.15.27:0/2242424081 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:03.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.331+0000 7f9a369cf640 1 --2- 172.21.15.27:0/2242424081 >> v2:172.21.15.93:3300/0 conn(0x7f9a300ce5d0 0x7f9a3015bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:03.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.331+0000 7f9a351cc640 1 -- 172.21.15.27:0/2242424081 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566972811 0 0) 0x7f9a30159630 con 0x7f9a3006e3f0 2024-01-15T11:34:03.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.331+0000 7f9a351cc640 1 -- 172.21.15.27:0/2242424081 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a1c003530 con 0x7f9a3006e3f0 2024-01-15T11:34:03.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.331+0000 7f9a351cc640 1 -- 172.21.15.27:0/2242424081 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2384438134 0 0) 0x7f9a300cd1d0 con 0x7f9a300cb9b0 2024-01-15T11:34:03.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.331+0000 7f9a351cc640 1 -- 172.21.15.27:0/2242424081 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a30159630 con 0x7f9a300cb9b0 2024-01-15T11:34:03.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.331+0000 7f9a369cf640 1 -- 172.21.15.27:0/2242424081 >> v1:172.21.15.93:6789/0 conn(0x7f9a300cb9b0 legacy=0x7f9a300cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:03.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.331+0000 7f9a369cf640 1 -- 172.21.15.27:0/2242424081 >> v1:172.21.15.27:6789/0 conn(0x7f9a3006e3f0 legacy=0x7f9a3015f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:03.335 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.331+0000 7f9a369cf640 1 -- 172.21.15.27:0/2242424081 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a300cd4b0 con 0x7f9a300ce5d0 2024-01-15T11:34:03.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.335+0000 7f9a369cf640 1 --2- 172.21.15.27:0/2242424081 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a300ce5d0 0x7f9a3015bfd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009d90 tx=0x7f9a2801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e20ed660f0280e0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:03.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.335+0000 7f9a351cc640 1 -- 172.21.15.27:0/2242424081 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a280a57f0 con 0x7f9a300ce5d0 2024-01-15T11:34:03.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.335+0000 7f9a351cc640 1 -- 172.21.15.27:0/2242424081 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a280a5950 con 0x7f9a300ce5d0 2024-01-15T11:34:03.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.335+0000 7f9a351cc640 1 -- 172.21.15.27:0/2242424081 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a280a5ce0 con 0x7f9a300ce5d0 2024-01-15T11:34:03.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.335+0000 7f9a38432640 1 -- 172.21.15.27:0/2242424081 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a300ce5d0 msgr2=0x7f9a3015bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:03.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.335+0000 7f9a38432640 1 --2- 172.21.15.27:0/2242424081 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a300ce5d0 0x7f9a3015bfd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009d90 tx=0x7f9a2801c950 comp rx=0 tx=0).stop 2024-01-15T11:34:03.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.335+0000 7f9a38432640 1 -- 172.21.15.27:0/2242424081 shutdown_connections 2024-01-15T11:34:03.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.335+0000 7f9a38432640 1 --2- 172.21.15.27:0/2242424081 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a300ce5d0 0x7f9a3015bfd0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:03.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.335+0000 7f9a38432640 1 -- 172.21.15.27:0/2242424081 >> 172.21.15.27:0/2242424081 conn(0x7f9a300b0cb0 msgr2=0x7f9a300b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:03.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.335+0000 7f9a38432640 1 -- 172.21.15.27:0/2242424081 shutdown_connections 2024-01-15T11:34:03.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.335+0000 7f9a38432640 1 -- 172.21.15.27:0/2242424081 wait complete. 2024-01-15T11:34:03.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.335+0000 7f9a38432640 1 Processor -- start 2024-01-15T11:34:03.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.335+0000 7f9a38432640 1 -- start start 2024-01-15T11:34:03.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.339+0000 7f9a38432640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9a3006e3f0 0x7f9a30156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:03.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.339+0000 7f9a38432640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a300cb9b0 0x7f9a30165aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:03.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.339+0000 7f9a38432640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a300ce5d0 0x7f9a300b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:03.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.339+0000 7f9a38432640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a300ad360 con 0x7f9a300cb9b0 2024-01-15T11:34:03.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.339+0000 7f9a38432640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a30157480 con 0x7f9a300ce5d0 2024-01-15T11:34:03.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.339+0000 7f9a38432640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a30165680 con 0x7f9a3006e3f0 2024-01-15T11:34:03.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.339+0000 7f9a359cd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a300cb9b0 0x7f9a30165aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:03.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.339+0000 7f9a359cd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a300cb9b0 0x7f9a30165aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52532/0 (socket says 172.21.15.27:52532) 2024-01-15T11:34:03.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.339+0000 7f9a359cd640 1 -- 172.21.15.27:0/2002891505 learned_addr learned my addr 172.21.15.27:0/2002891505 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:03.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.339+0000 7f9a361ce640 1 --2- 172.21.15.27:0/2002891505 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9a3006e3f0 0x7f9a30156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:03.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.339+0000 7f9a369cf640 1 --2- 172.21.15.27:0/2002891505 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a300ce5d0 0x7f9a300b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:03.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.339+0000 7f9a359cd640 1 -- 172.21.15.27:0/2002891505 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9a3006e3f0 msgr2=0x7f9a30156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:03.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.339+0000 7f9a359cd640 1 --2- 172.21.15.27:0/2002891505 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9a3006e3f0 0x7f9a30156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:03.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.339+0000 7f9a359cd640 1 -- 172.21.15.27:0/2002891505 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a300ce5d0 msgr2=0x7f9a300b2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:03.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.339+0000 7f9a359cd640 1 --2- 172.21.15.27:0/2002891505 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a300ce5d0 0x7f9a300b2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:03.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.339+0000 7f9a359cd640 1 -- 172.21.15.27:0/2002891505 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a28009a70 con 0x7f9a300cb9b0 2024-01-15T11:34:03.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.339+0000 7f9a369cf640 1 --2- 172.21.15.27:0/2002891505 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a300ce5d0 0x7f9a300b2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:34:03.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.339+0000 7f9a359cd640 1 --2- 172.21.15.27:0/2002891505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a300cb9b0 0x7f9a30165aa0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000c4d0 tx=0x7f9a2000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:03.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.339+0000 7f9a26ffd640 1 -- 172.21.15.27:0/2002891505 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a20005cf0 con 0x7f9a300cb9b0 2024-01-15T11:34:03.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.339+0000 7f9a26ffd640 1 -- 172.21.15.27:0/2002891505 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a20005e50 con 0x7f9a300cb9b0 2024-01-15T11:34:03.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.339+0000 7f9a26ffd640 1 -- 172.21.15.27:0/2002891505 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a200072b0 con 0x7f9a300cb9b0 2024-01-15T11:34:03.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.339+0000 7f9a38432640 1 -- 172.21.15.27:0/2002891505 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a300b2d50 con 0x7f9a300cb9b0 2024-01-15T11:34:03.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.339+0000 7f9a38432640 1 -- 172.21.15.27:0/2002891505 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a300ad080 con 0x7f9a300cb9b0 2024-01-15T11:34:03.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.339+0000 7f9a38432640 1 -- 172.21.15.27:0/2002891505 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a300671f0 con 0x7f9a300cb9b0 2024-01-15T11:34:03.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.339+0000 7f9a26ffd640 1 -- 172.21.15.27:0/2002891505 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f9a20007410 con 0x7f9a300cb9b0 2024-01-15T11:34:03.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.343+0000 7f9a26ffd640 1 --2- 172.21.15.27:0/2002891505 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9a140668f0 0x7f9a14068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:03.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.343+0000 7f9a26ffd640 1 -- 172.21.15.27:0/2002891505 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f9a20083a90 con 0x7f9a300cb9b0 2024-01-15T11:34:03.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.343+0000 7f9a361ce640 1 --2- 172.21.15.27:0/2002891505 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9a140668f0 0x7f9a14068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:03.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.343+0000 7f9a361ce640 1 --2- 172.21.15.27:0/2002891505 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9a140668f0 0x7f9a14068db0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0011f0 tx=0x7f9a2c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:03.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.347+0000 7f9a26ffd640 1 -- 172.21.15.27:0/2002891505 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9a20050c70 con 0x7f9a300cb9b0 2024-01-15T11:34:03.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:03.503+0000 7f9a38432640 1 -- 172.21.15.27:0/2002891505 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9a300cc640 con 0x7f9a300cb9b0 2024-01-15T11:34:04.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.115+0000 7f9a26ffd640 1 -- 172.21.15.27:0/2002891505 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9a20017020 con 0x7f9a300cb9b0 2024-01-15T11:34:04.120 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' removed 2024-01-15T11:34:04.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.119+0000 7f9a38432640 1 -- 172.21.15.27:0/2002891505 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9a140668f0 msgr2=0x7f9a14068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:04.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.119+0000 7f9a38432640 1 --2- 172.21.15.27:0/2002891505 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9a140668f0 0x7f9a14068db0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0011f0 tx=0x7f9a2c009040 comp rx=0 tx=0).stop 2024-01-15T11:34:04.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.119+0000 7f9a38432640 1 -- 172.21.15.27:0/2002891505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a300cb9b0 msgr2=0x7f9a30165aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:04.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.119+0000 7f9a38432640 1 --2- 172.21.15.27:0/2002891505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a300cb9b0 0x7f9a30165aa0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000c4d0 tx=0x7f9a2000c990 comp rx=0 tx=0).stop 2024-01-15T11:34:04.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.119+0000 7f9a38432640 1 -- 172.21.15.27:0/2002891505 shutdown_connections 2024-01-15T11:34:04.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.119+0000 7f9a38432640 1 --2- 172.21.15.27:0/2002891505 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9a140668f0 0x7f9a14068db0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:04.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.119+0000 7f9a38432640 1 --2- 172.21.15.27:0/2002891505 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9a300ce5d0 0x7f9a300b2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:04.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.119+0000 7f9a38432640 1 --2- 172.21.15.27:0/2002891505 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9a300cb9b0 0x7f9a30165aa0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:04.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.119+0000 7f9a38432640 1 --2- 172.21.15.27:0/2002891505 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9a3006e3f0 0x7f9a30156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:04.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.119+0000 7f9a38432640 1 -- 172.21.15.27:0/2002891505 >> 172.21.15.27:0/2002891505 conn(0x7f9a300b0cb0 msgr2=0x7f9a3015cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:04.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.119+0000 7f9a38432640 1 -- 172.21.15.27:0/2002891505 shutdown_connections 2024-01-15T11:34:04.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.119+0000 7f9a38432640 1 -- 172.21.15.27:0/2002891505 wait complete. 2024-01-15T11:34:04.143 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-15T11:34:04.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.287+0000 7f48ce479640 1 Processor -- start 2024-01-15T11:34:04.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.287+0000 7f48ce479640 1 -- start start 2024-01-15T11:34:04.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.287+0000 7f48ce479640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f48c80ad000 0x7f48c806cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:04.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.287+0000 7f48ce479640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c80b2cb0 con 0x7f48c8070a50 2024-01-15T11:34:04.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.287+0000 7f48ce479640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c80b2f90 con 0x7f48c8147060 2024-01-15T11:34:04.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.287+0000 7f48ce479640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c80b3270 con 0x7f48c80ad000 2024-01-15T11:34:04.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.291+0000 7f48cca16640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f48c8070a50 0x7f48c80b3d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:33458/0 (socket says 172.21.15.27:33458) 2024-01-15T11:34:04.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.291+0000 7f48c77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f48c80ad000 0x7f48c806cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:04.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.291+0000 7f48cca16640 1 -- 172.21.15.27:0/3393007158 learned_addr learned my addr 172.21.15.27:0/3393007158 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:04.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.291+0000 7f48c77fe640 1 -- 172.21.15.27:0/3393007158 >> v1:172.21.15.93:6789/0 conn(0x7f48c8147060 legacy=0x7f48c80b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:04.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.291+0000 7f48c77fe640 1 -- 172.21.15.27:0/3393007158 >> v1:172.21.15.27:6789/0 conn(0x7f48c8070a50 legacy=0x7f48c80b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:04.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.291+0000 7f48c77fe640 1 -- 172.21.15.27:0/3393007158 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c80b3550 con 0x7f48c80ad000 2024-01-15T11:34:04.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.291+0000 7f48c77fe640 1 --2- 172.21.15.27:0/3393007158 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48c80ad000 0x7f48c806cde0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f48bc0097c0 tx=0x7f48bc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6417bb2593a1f841 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:04.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.291+0000 7f48c6ffd640 1 -- 172.21.15.27:0/3393007158 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc0a8050 con 0x7f48c80ad000 2024-01-15T11:34:04.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.291+0000 7f48c6ffd640 1 -- 172.21.15.27:0/3393007158 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48bc0ac5f0 con 0x7f48c80ad000 2024-01-15T11:34:04.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.291+0000 7f48c6ffd640 1 -- 172.21.15.27:0/3393007158 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc0ac980 con 0x7f48c80ad000 2024-01-15T11:34:04.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.295+0000 7f48ce479640 1 -- 172.21.15.27:0/3393007158 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48c80ad000 msgr2=0x7f48c806cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:04.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.295+0000 7f48ce479640 1 --2- 172.21.15.27:0/3393007158 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48c80ad000 0x7f48c806cde0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f48bc0097c0 tx=0x7f48bc01c480 comp rx=0 tx=0).stop 2024-01-15T11:34:04.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.295+0000 7f48ce479640 1 -- 172.21.15.27:0/3393007158 shutdown_connections 2024-01-15T11:34:04.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.295+0000 7f48ce479640 1 --2- 172.21.15.27:0/3393007158 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48c80ad000 0x7f48c806cde0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:04.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.295+0000 7f48ce479640 1 -- 172.21.15.27:0/3393007158 >> 172.21.15.27:0/3393007158 conn(0x7f48c80cf3b0 msgr2=0x7f48c80cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:04.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.295+0000 7f48ce479640 1 -- 172.21.15.27:0/3393007158 shutdown_connections 2024-01-15T11:34:04.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.295+0000 7f48ce479640 1 -- 172.21.15.27:0/3393007158 wait complete. 2024-01-15T11:34:04.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.295+0000 7f48ce479640 1 Processor -- start 2024-01-15T11:34:04.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.295+0000 7f48ce479640 1 -- start start 2024-01-15T11:34:04.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.295+0000 7f48ce479640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f48c8070a50 0x7f48c815e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:04.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.295+0000 7f48ce479640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f48c80ad000 0x7f48c81fa230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:04.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.295+0000 7f48ce479640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48c8147060 0x7f48c80b2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:04.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.295+0000 7f48ce479640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c81fb0f0 con 0x7f48c8147060 2024-01-15T11:34:04.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.295+0000 7f48ce479640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c815e9d0 con 0x7f48c80ad000 2024-01-15T11:34:04.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.295+0000 7f48ce479640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c81fab30 con 0x7f48c8070a50 2024-01-15T11:34:04.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.295+0000 7f48cca16640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48c8147060 0x7f48c80b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:04.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.295+0000 7f48cca16640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48c8147060 0x7f48c80b2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52540/0 (socket says 172.21.15.27:52540) 2024-01-15T11:34:04.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.295+0000 7f48cca16640 1 -- 172.21.15.27:0/3834979389 learned_addr learned my addr 172.21.15.27:0/3834979389 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:04.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.295+0000 7f48c77fe640 1 --2- 172.21.15.27:0/3834979389 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f48c80ad000 0x7f48c81fa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:04.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.295+0000 7f48c7fff640 1 --2- 172.21.15.27:0/3834979389 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f48c8070a50 0x7f48c815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:04.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.295+0000 7f48cca16640 1 -- 172.21.15.27:0/3834979389 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f48c8070a50 msgr2=0x7f48c815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:04.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.295+0000 7f48cca16640 1 --2- 172.21.15.27:0/3834979389 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f48c8070a50 0x7f48c815e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:04.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.295+0000 7f48cca16640 1 -- 172.21.15.27:0/3834979389 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f48c80ad000 msgr2=0x7f48c81fa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:04.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.295+0000 7f48cca16640 1 --2- 172.21.15.27:0/3834979389 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f48c80ad000 0x7f48c81fa230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:04.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.299+0000 7f48cca16640 1 -- 172.21.15.27:0/3834979389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc009420 con 0x7f48c8147060 2024-01-15T11:34:04.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.299+0000 7f48cca16640 1 --2- 172.21.15.27:0/3834979389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48c8147060 0x7f48c80b2010 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f48c000ca80 tx=0x7f48c000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:04.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.299+0000 7f48c4ff9640 1 -- 172.21.15.27:0/3834979389 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c000ac30 con 0x7f48c8147060 2024-01-15T11:34:04.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.299+0000 7f48c4ff9640 1 -- 172.21.15.27:0/3834979389 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c000ad90 con 0x7f48c8147060 2024-01-15T11:34:04.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.299+0000 7f48c4ff9640 1 -- 172.21.15.27:0/3834979389 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c0012600 con 0x7f48c8147060 2024-01-15T11:34:04.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.299+0000 7f48ce479640 1 -- 172.21.15.27:0/3834979389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c81fae10 con 0x7f48c8147060 2024-01-15T11:34:04.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.299+0000 7f48ce479640 1 -- 172.21.15.27:0/3834979389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c8162cf0 con 0x7f48c8147060 2024-01-15T11:34:04.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.299+0000 7f48ce479640 1 -- 172.21.15.27:0/3834979389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c8162ee0 con 0x7f48c8147060 2024-01-15T11:34:04.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.299+0000 7f48c4ff9640 1 -- 172.21.15.27:0/3834979389 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f48c0007070 con 0x7f48c8147060 2024-01-15T11:34:04.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.299+0000 7f48c4ff9640 1 --2- 172.21.15.27:0/3834979389 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f48b40668f0 0x7f48b4068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:04.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.299+0000 7f48c4ff9640 1 -- 172.21.15.27:0/3834979389 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5386+0+0 (secure 0 0 0) 0x7f48c0084090 con 0x7f48c8147060 2024-01-15T11:34:04.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.299+0000 7f48c7fff640 1 --2- 172.21.15.27:0/3834979389 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f48b40668f0 0x7f48b4068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:04.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.303+0000 7f48c7fff640 1 --2- 172.21.15.27:0/3834979389 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f48b40668f0 0x7f48b4068db0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f48b8000f70 tx=0x7f48b8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:04.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.303+0000 7f48c4ff9640 1 -- 172.21.15.27:0/3834979389 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f48c00514b0 con 0x7f48c8147060 2024-01-15T11:34:04.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:04.463+0000 7f48ce479640 1 -- 172.21.15.27:0/3834979389 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f48c804e850 con 0x7f48c8147060 2024-01-15T11:34:05.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.119+0000 7f48c4ff9640 1 -- 172.21.15.27:0/3834979389 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f48c0054ad0 con 0x7f48c8147060 2024-01-15T11:34:05.122 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' removed 2024-01-15T11:34:05.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.123+0000 7f48ce479640 1 -- 172.21.15.27:0/3834979389 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f48b40668f0 msgr2=0x7f48b4068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:05.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.123+0000 7f48ce479640 1 --2- 172.21.15.27:0/3834979389 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f48b40668f0 0x7f48b4068db0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f48b8000f70 tx=0x7f48b8009040 comp rx=0 tx=0).stop 2024-01-15T11:34:05.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.123+0000 7f48ce479640 1 -- 172.21.15.27:0/3834979389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48c8147060 msgr2=0x7f48c80b2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:05.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.123+0000 7f48ce479640 1 --2- 172.21.15.27:0/3834979389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48c8147060 0x7f48c80b2010 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f48c000ca80 tx=0x7f48c000cf40 comp rx=0 tx=0).stop 2024-01-15T11:34:05.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.123+0000 7f48ce479640 1 -- 172.21.15.27:0/3834979389 shutdown_connections 2024-01-15T11:34:05.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.123+0000 7f48ce479640 1 --2- 172.21.15.27:0/3834979389 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f48c8147060 0x7f48c80b2010 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:05.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.123+0000 7f48ce479640 1 --2- 172.21.15.27:0/3834979389 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f48b40668f0 0x7f48b4068db0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:05.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.123+0000 7f48ce479640 1 --2- 172.21.15.27:0/3834979389 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f48c80ad000 0x7f48c81fa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:05.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.123+0000 7f48ce479640 1 --2- 172.21.15.27:0/3834979389 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f48c8070a50 0x7f48c815e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:05.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.123+0000 7f48ce479640 1 -- 172.21.15.27:0/3834979389 >> 172.21.15.27:0/3834979389 conn(0x7f48c80cf3b0 msgr2=0x7f48c80ce570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:05.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.123+0000 7f48ce479640 1 -- 172.21.15.27:0/3834979389 shutdown_connections 2024-01-15T11:34:05.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.123+0000 7f48ce479640 1 -- 172.21.15.27:0/3834979389 wait complete. 2024-01-15T11:34:05.148 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-15T11:34:05.148 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-15T11:34:05.148 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-15T11:34:05.148 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T11:34:05.149 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-15T11:34:05.149 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-15T11:34:05.149 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-15T11:34:05.149 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T11:34:05.149 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-15T11:34:05.150 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-15T11:34:05.150 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-15T11:34:05.150 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T11:34:05.150 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-15T11:34:05.150 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-15T11:34:05.151 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-15T11:34:05.151 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T11:34:05.164 INFO:tasks.ceph.mds.a:Stopped 2024-01-15T11:34:05.164 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-15T11:34:05.165 INFO:tasks.ceph.mds.c:Stopped 2024-01-15T11:34:05.165 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-15T11:34:05.178 INFO:tasks.ceph.mds.d:Stopped 2024-01-15T11:34:05.178 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-15T11:34:05.179 INFO:tasks.ceph.mds.b:Stopped 2024-01-15T11:34:05.179 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-15T11:34:05.211 INFO:tasks.ceph.mds.a:Started 2024-01-15T11:34:05.212 DEBUG:teuthology.parallel:result is None 2024-01-15T11:34:05.213 INFO:tasks.ceph.mds.c:Started 2024-01-15T11:34:05.214 DEBUG:teuthology.parallel:result is None 2024-01-15T11:34:05.230 INFO:tasks.ceph.mds.d:Started 2024-01-15T11:34:05.230 DEBUG:teuthology.parallel:result is None 2024-01-15T11:34:05.232 INFO:tasks.ceph.mds.b:Started 2024-01-15T11:34:05.232 DEBUG:teuthology.parallel:result is None 2024-01-15T11:34:05.233 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-15T11:34:05.304 INFO:tasks.ceph.mds.a.smithi027.stdout:starting mds.a at 2024-01-15T11:34:05.305 INFO:tasks.ceph.mds.c.smithi027.stdout:starting mds.c at 2024-01-15T11:34:05.318 INFO:tasks.ceph.mds.b.smithi093.stdout:starting mds.b at 2024-01-15T11:34:05.319 INFO:tasks.ceph.mds.d.smithi093.stdout:starting mds.d at 2024-01-15T11:34:05.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.387+0000 7fbcaf05a640 1 Processor -- start 2024-01-15T11:34:05.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.387+0000 7fbcaf05a640 1 -- start start 2024-01-15T11:34:05.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.391+0000 7fbcaf05a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbca80ce5d0 0x7fbca815bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:05.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.391+0000 7fbcaf05a640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca8159630 con 0x7fbca80cb9b0 2024-01-15T11:34:05.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.391+0000 7fbcaf05a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca80cd1d0 con 0x7fbca806e3f0 2024-01-15T11:34:05.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.391+0000 7fbcaf05a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca806e860 con 0x7fbca80ce5d0 2024-01-15T11:34:05.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.391+0000 7fbcacdf6640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fbca80cb9b0 0x7fbca80cbd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45920/0 (socket says 172.21.15.27:45920) 2024-01-15T11:34:05.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.391+0000 7fbcacdf6640 1 -- 172.21.15.27:0/4119960904 learned_addr learned my addr 172.21.15.27:0/4119960904 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:05.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.391+0000 7fbcad5f7640 1 --2- 172.21.15.27:0/4119960904 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbca80ce5d0 0x7fbca815bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:05.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.391+0000 7fbca77fe640 1 -- 172.21.15.27:0/4119960904 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 419269425 0 0) 0x7fbca8159630 con 0x7fbca80cb9b0 2024-01-15T11:34:05.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.391+0000 7fbca77fe640 1 -- 172.21.15.27:0/4119960904 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc98003530 con 0x7fbca80cb9b0 2024-01-15T11:34:05.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.391+0000 7fbca77fe640 1 -- 172.21.15.27:0/4119960904 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2633105665 0 0) 0x7fbca80cd1d0 con 0x7fbca806e3f0 2024-01-15T11:34:05.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.391+0000 7fbca77fe640 1 -- 172.21.15.27:0/4119960904 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbca8159630 con 0x7fbca806e3f0 2024-01-15T11:34:05.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.391+0000 7fbca77fe640 1 -- 172.21.15.27:0/4119960904 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3537478971 0 0) 0x7fbc98003530 con 0x7fbca80cb9b0 2024-01-15T11:34:05.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.391+0000 7fbcad5f7640 1 -- 172.21.15.27:0/4119960904 >> v1:172.21.15.93:6789/0 conn(0x7fbca806e3f0 legacy=0x7fbca815f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:05.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.391+0000 7fbcad5f7640 1 -- 172.21.15.27:0/4119960904 >> v1:172.21.15.27:6789/0 conn(0x7fbca80cb9b0 legacy=0x7fbca80cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:05.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.391+0000 7fbcad5f7640 1 -- 172.21.15.27:0/4119960904 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca80cd4b0 con 0x7fbca80ce5d0 2024-01-15T11:34:05.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.395+0000 7fbcad5f7640 1 --2- 172.21.15.27:0/4119960904 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbca80ce5d0 0x7fbca815bfd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009dc0 tx=0x7fbca001c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2b42976394e1231 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:05.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.395+0000 7fbca77fe640 1 -- 172.21.15.27:0/4119960904 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c001680 con 0x7fbca80ce5d0 2024-01-15T11:34:05.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.395+0000 7fbca77fe640 1 -- 172.21.15.27:0/4119960904 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca00a64c0 con 0x7fbca80ce5d0 2024-01-15T11:34:05.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.395+0000 7fbca77fe640 1 -- 172.21.15.27:0/4119960904 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca00a6850 con 0x7fbca80ce5d0 2024-01-15T11:34:05.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.395+0000 7fbcaf05a640 1 -- 172.21.15.27:0/4119960904 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbca80ce5d0 msgr2=0x7fbca815bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:05.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.395+0000 7fbcaf05a640 1 --2- 172.21.15.27:0/4119960904 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbca80ce5d0 0x7fbca815bfd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009dc0 tx=0x7fbca001c890 comp rx=0 tx=0).stop 2024-01-15T11:34:05.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.395+0000 7fbcaf05a640 1 -- 172.21.15.27:0/4119960904 shutdown_connections 2024-01-15T11:34:05.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.395+0000 7fbcaf05a640 1 --2- 172.21.15.27:0/4119960904 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbca80ce5d0 0x7fbca815bfd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:05.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.395+0000 7fbcaf05a640 1 -- 172.21.15.27:0/4119960904 >> 172.21.15.27:0/4119960904 conn(0x7fbca80b0cb0 msgr2=0x7fbca80b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:05.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.395+0000 7fbcaf05a640 1 -- 172.21.15.27:0/4119960904 shutdown_connections 2024-01-15T11:34:05.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.395+0000 7fbcaf05a640 1 -- 172.21.15.27:0/4119960904 wait complete. 2024-01-15T11:34:05.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.395+0000 7fbcaf05a640 1 Processor -- start 2024-01-15T11:34:05.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.399+0000 7fbcaf05a640 1 -- start start 2024-01-15T11:34:05.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.399+0000 7fbcaf05a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbca806e3f0 0x7fbca8150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:05.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.399+0000 7fbcaf05a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbca80cb9b0 0x7fbca80b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:05.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.399+0000 7fbcaf05a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbca80ce5d0 0x7fbca8164960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:05.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.399+0000 7fbcaf05a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca80b2770 con 0x7fbca806e3f0 2024-01-15T11:34:05.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.399+0000 7fbcaf05a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca80b29c0 con 0x7fbca80cb9b0 2024-01-15T11:34:05.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.399+0000 7fbcaf05a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca80b2ca0 con 0x7fbca80ce5d0 2024-01-15T11:34:05.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.399+0000 7fbcacdf6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbca806e3f0 0x7fbca8150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:05.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.399+0000 7fbcacdf6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbca806e3f0 0x7fbca8150f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38810/0 (socket says 172.21.15.27:38810) 2024-01-15T11:34:05.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.399+0000 7fbcacdf6640 1 -- 172.21.15.27:0/2069702922 learned_addr learned my addr 172.21.15.27:0/2069702922 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:05.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.399+0000 7fbca7fff640 1 --2- 172.21.15.27:0/2069702922 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbca80cb9b0 0x7fbca80b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:05.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.399+0000 7fbcad5f7640 1 --2- 172.21.15.27:0/2069702922 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbca80ce5d0 0x7fbca8164960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:05.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.399+0000 7fbcacdf6640 1 -- 172.21.15.27:0/2069702922 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbca80ce5d0 msgr2=0x7fbca8164960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:05.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.399+0000 7fbcacdf6640 1 --2- 172.21.15.27:0/2069702922 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbca80ce5d0 0x7fbca8164960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:05.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.399+0000 7fbcacdf6640 1 -- 172.21.15.27:0/2069702922 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbca80cb9b0 msgr2=0x7fbca80b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:05.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.399+0000 7fbcacdf6640 1 --2- 172.21.15.27:0/2069702922 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbca80cb9b0 0x7fbca80b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:05.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.399+0000 7fbcacdf6640 1 -- 172.21.15.27:0/2069702922 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca0009a70 con 0x7fbca806e3f0 2024-01-15T11:34:05.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.399+0000 7fbcacdf6640 1 --2- 172.21.15.27:0/2069702922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbca806e3f0 0x7fbca8150f80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c00c780 tx=0x7fbc9c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:05.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.399+0000 7fbca57fa640 1 -- 172.21.15.27:0/2069702922 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c005cf0 con 0x7fbca806e3f0 2024-01-15T11:34:05.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.399+0000 7fbca57fa640 1 -- 172.21.15.27:0/2069702922 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9c005e50 con 0x7fbca806e3f0 2024-01-15T11:34:05.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.399+0000 7fbcaf05a640 1 -- 172.21.15.27:0/2069702922 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca80b2f80 con 0x7fbca806e3f0 2024-01-15T11:34:05.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.399+0000 7fbca57fa640 1 -- 172.21.15.27:0/2069702922 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c0072b0 con 0x7fbca806e3f0 2024-01-15T11:34:05.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.399+0000 7fbcaf05a640 1 -- 172.21.15.27:0/2069702922 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca8071f20 con 0x7fbca806e3f0 2024-01-15T11:34:05.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.403+0000 7fbcaf05a640 1 -- 172.21.15.27:0/2069702922 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca80671f0 con 0x7fbca806e3f0 2024-01-15T11:34:05.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.403+0000 7fbca57fa640 1 -- 172.21.15.27:0/2069702922 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fbc9c007410 con 0x7fbca806e3f0 2024-01-15T11:34:05.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.403+0000 7fbca57fa640 1 --2- 172.21.15.27:0/2069702922 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbc8c0668f0 0x7fbc8c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:05.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.403+0000 7fbca57fa640 1 -- 172.21.15.27:0/2069702922 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbc9c083920 con 0x7fbca806e3f0 2024-01-15T11:34:05.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.403+0000 7fbca7fff640 1 --2- 172.21.15.27:0/2069702922 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbc8c0668f0 0x7fbc8c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:05.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.403+0000 7fbca7fff640 1 --2- 172.21.15.27:0/2069702922 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbc8c0668f0 0x7fbc8c068db0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbca8155710 tx=0x7fbc94009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:05.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.407+0000 7fbca57fa640 1 -- 172.21.15.27:0/2069702922 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbc9c050de0 con 0x7fbca806e3f0 2024-01-15T11:34:05.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:05.575+0000 7fbcaf05a640 1 -- 172.21.15.27:0/2069702922 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fbca806b460 con 0x7fbca806e3f0 2024-01-15T11:34:06.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.143+0000 7fbca57fa640 1 -- 172.21.15.27:0/2069702922 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbc9c017020 con 0x7fbca806e3f0 2024-01-15T11:34:06.149 INFO:teuthology.orchestra.run.smithi027.stderr: removed all blocklist entries 2024-01-15T11:34:06.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.147+0000 7fbcaf05a640 1 -- 172.21.15.27:0/2069702922 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbc8c0668f0 msgr2=0x7fbc8c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:06.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.147+0000 7fbcaf05a640 1 --2- 172.21.15.27:0/2069702922 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbc8c0668f0 0x7fbc8c068db0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbca8155710 tx=0x7fbc94009040 comp rx=0 tx=0).stop 2024-01-15T11:34:06.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.147+0000 7fbcaf05a640 1 -- 172.21.15.27:0/2069702922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbca806e3f0 msgr2=0x7fbca8150f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:06.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.147+0000 7fbcaf05a640 1 --2- 172.21.15.27:0/2069702922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbca806e3f0 0x7fbca8150f80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c00c780 tx=0x7fbc9c00cc40 comp rx=0 tx=0).stop 2024-01-15T11:34:06.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.147+0000 7fbcaf05a640 1 -- 172.21.15.27:0/2069702922 shutdown_connections 2024-01-15T11:34:06.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.147+0000 7fbcaf05a640 1 --2- 172.21.15.27:0/2069702922 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbca80ce5d0 0x7fbca8164960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:06.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.147+0000 7fbcaf05a640 1 --2- 172.21.15.27:0/2069702922 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbc8c0668f0 0x7fbc8c068db0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:06.152 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.147+0000 7fbcaf05a640 1 --2- 172.21.15.27:0/2069702922 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbca80cb9b0 0x7fbca80b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:06.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.147+0000 7fbcaf05a640 1 --2- 172.21.15.27:0/2069702922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbca806e3f0 0x7fbca8150f80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:06.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.147+0000 7fbcaf05a640 1 -- 172.21.15.27:0/2069702922 >> 172.21.15.27:0/2069702922 conn(0x7fbca80b0cb0 msgr2=0x7fbca815e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:06.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.147+0000 7fbcaf05a640 1 -- 172.21.15.27:0/2069702922 shutdown_connections 2024-01-15T11:34:06.153 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.147+0000 7fbcaf05a640 1 -- 172.21.15.27:0/2069702922 wait complete. 2024-01-15T11:34:06.174 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-15T11:34:06.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.315+0000 7fecac217640 1 Processor -- start 2024-01-15T11:34:06.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.315+0000 7fecac217640 1 -- start start 2024-01-15T11:34:06.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.315+0000 7fecac217640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7feca4146c60 0x7feca4070020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:06.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.315+0000 7fecac217640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feca4147040 0x7feca4070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:06.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.315+0000 7fecac217640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca415dba0 con 0x7feca406bb10 2024-01-15T11:34:06.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.319+0000 7fecac217640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca406d100 con 0x7feca4146c60 2024-01-15T11:34:06.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.319+0000 7fecac217640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca406c660 con 0x7feca4147040 2024-01-15T11:34:06.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.319+0000 7feca9fb3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7feca4146c60 0x7feca4070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:06.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.319+0000 7feca97b2640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feca4147040 0x7feca4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:06.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.319+0000 7feca9fb3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7feca4146c60 0x7feca4070020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:50416/0 (socket says 172.21.15.27:50416) 2024-01-15T11:34:06.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.319+0000 7feca9fb3640 1 -- 172.21.15.27:0/3658954264 learned_addr learned my addr 172.21.15.27:0/3658954264 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:06.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.319+0000 7feca9fb3640 1 -- 172.21.15.27:0/3658954264 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feca4147040 msgr2=0x7feca4070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:06.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.319+0000 7feca9fb3640 1 --2- 172.21.15.27:0/3658954264 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feca4147040 0x7feca4070560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:06.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.319+0000 7feca9fb3640 1 -- 172.21.15.27:0/3658954264 >> v1:172.21.15.93:6789/0 conn(0x7feca406bb10 legacy=0x7feca406bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:06.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.319+0000 7feca9fb3640 1 -- 172.21.15.27:0/3658954264 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca406c860 con 0x7feca4146c60 2024-01-15T11:34:06.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.319+0000 7feca8fb1640 1 -- 172.21.15.27:0/3658954264 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731356199 0 0) 0x7feca415dba0 con 0x7feca406bb10 2024-01-15T11:34:06.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.319+0000 7feca97b2640 1 --2- 172.21.15.27:0/3658954264 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feca4147040 0x7feca4070560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:34:06.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.319+0000 7feca9fb3640 1 --2- 172.21.15.27:0/3658954264 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feca4146c60 0x7feca4070020 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7feca0009870 tx=0x7feca001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63a7b2a01ee330b7 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:06.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.323+0000 7feca8fb1640 1 -- 172.21.15.27:0/3658954264 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca00aa670 con 0x7feca4146c60 2024-01-15T11:34:06.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.323+0000 7feca8fb1640 1 -- 172.21.15.27:0/3658954264 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca00aa7d0 con 0x7feca4146c60 2024-01-15T11:34:06.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.323+0000 7feca8fb1640 1 -- 172.21.15.27:0/3658954264 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca00aab60 con 0x7feca4146c60 2024-01-15T11:34:06.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.323+0000 7fecac217640 1 -- 172.21.15.27:0/3658954264 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feca4146c60 msgr2=0x7feca4070020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:06.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.323+0000 7fecac217640 1 --2- 172.21.15.27:0/3658954264 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feca4146c60 0x7feca4070020 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7feca0009870 tx=0x7feca001c510 comp rx=0 tx=0).stop 2024-01-15T11:34:06.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.323+0000 7fecac217640 1 -- 172.21.15.27:0/3658954264 shutdown_connections 2024-01-15T11:34:06.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.323+0000 7fecac217640 1 --2- 172.21.15.27:0/3658954264 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feca4147040 0x7feca4070560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:06.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.323+0000 7fecac217640 1 --2- 172.21.15.27:0/3658954264 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feca4146c60 0x7feca4070020 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:06.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.323+0000 7fecac217640 1 -- 172.21.15.27:0/3658954264 >> 172.21.15.27:0/3658954264 conn(0x7feca40b2ea0 msgr2=0x7feca40b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:06.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.323+0000 7fecac217640 1 -- 172.21.15.27:0/3658954264 shutdown_connections 2024-01-15T11:34:06.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.323+0000 7fecac217640 1 -- 172.21.15.27:0/3658954264 wait complete. 2024-01-15T11:34:06.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.323+0000 7fecac217640 1 Processor -- start 2024-01-15T11:34:06.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.323+0000 7fecac217640 1 -- start start 2024-01-15T11:34:06.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.323+0000 7fecac217640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feca406bb10 0x7feca413cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:06.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.323+0000 7fecac217640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feca4146c60 0x7feca415c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:06.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.323+0000 7fecac217640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feca4147040 0x7feca4155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:06.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.323+0000 7fecac217640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca4142060 con 0x7feca4147040 2024-01-15T11:34:06.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.323+0000 7fecac217640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca41579b0 con 0x7feca4146c60 2024-01-15T11:34:06.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.323+0000 7fecac217640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca413d760 con 0x7feca406bb10 2024-01-15T11:34:06.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.327+0000 7feca97b2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feca4146c60 0x7feca415c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:06.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.327+0000 7feca9fb3640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feca406bb10 0x7feca413cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:06.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.327+0000 7feca97b2640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feca4146c60 0x7feca415c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:50426/0 (socket says 172.21.15.27:50426) 2024-01-15T11:34:06.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.327+0000 7feca97b2640 1 -- 172.21.15.27:0/3176873067 learned_addr learned my addr 172.21.15.27:0/3176873067 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:06.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.327+0000 7fecaa7b4640 1 --2- 172.21.15.27:0/3176873067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feca4147040 0x7feca4155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:06.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.327+0000 7feca97b2640 1 -- 172.21.15.27:0/3176873067 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feca406bb10 msgr2=0x7feca413cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:06.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.327+0000 7feca97b2640 1 --2- 172.21.15.27:0/3176873067 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feca406bb10 0x7feca413cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:06.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.327+0000 7feca97b2640 1 -- 172.21.15.27:0/3176873067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feca4147040 msgr2=0x7feca4155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:06.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.327+0000 7feca97b2640 1 --2- 172.21.15.27:0/3176873067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feca4147040 0x7feca4155dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:06.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.327+0000 7feca97b2640 1 -- 172.21.15.27:0/3176873067 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec94009420 con 0x7feca4146c60 2024-01-15T11:34:06.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.327+0000 7feca97b2640 1 --2- 172.21.15.27:0/3176873067 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feca4146c60 0x7feca415c490 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fec9400e980 tx=0x7fec9400ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:06.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.327+0000 7fec9a7fc640 1 -- 172.21.15.27:0/3176873067 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9400ca00 con 0x7feca4146c60 2024-01-15T11:34:06.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.327+0000 7fec9a7fc640 1 -- 172.21.15.27:0/3176873067 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9400cb60 con 0x7feca4146c60 2024-01-15T11:34:06.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.327+0000 7fec9a7fc640 1 -- 172.21.15.27:0/3176873067 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec94013470 con 0x7feca4146c60 2024-01-15T11:34:06.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.327+0000 7fecac217640 1 -- 172.21.15.27:0/3176873067 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca00094d0 con 0x7feca4146c60 2024-01-15T11:34:06.332 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.327+0000 7fecac217640 1 -- 172.21.15.27:0/3176873067 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca4141aa0 con 0x7feca4146c60 2024-01-15T11:34:06.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.327+0000 7fecac217640 1 -- 172.21.15.27:0/3176873067 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca404e850 con 0x7feca4146c60 2024-01-15T11:34:06.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.327+0000 7fec9a7fc640 1 -- 172.21.15.27:0/3176873067 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fec940059a0 con 0x7feca4146c60 2024-01-15T11:34:06.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.331+0000 7fec9a7fc640 1 --2- 172.21.15.27:0/3176873067 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fec88066970 0x7fec88068e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:06.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.331+0000 7fec9a7fc640 1 -- 172.21.15.27:0/3176873067 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fec94084290 con 0x7feca4146c60 2024-01-15T11:34:06.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.331+0000 7feca9fb3640 1 --2- 172.21.15.27:0/3176873067 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fec88066970 0x7fec88068e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:06.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.331+0000 7feca9fb3640 1 --2- 172.21.15.27:0/3176873067 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fec88066970 0x7fec88068e30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7feca00ae000 tx=0x7feca00b5040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:06.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.331+0000 7fec9a7fc640 1 -- 172.21.15.27:0/3176873067 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fec940518b0 con 0x7feca4146c60 2024-01-15T11:34:06.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.547+0000 7fecac217640 1 -- 172.21.15.27:0/3176873067 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7feca40d1f60 con 0x7feca4146c60 2024-01-15T11:34:06.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.547+0000 7fec9a7fc640 1 -- 172.21.15.27:0/3176873067 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fec94054ed0 con 0x7feca4146c60 2024-01-15T11:34:06.551 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:34:06.552 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-01-15T11:34:06.552 INFO:teuthology.orchestra.run.smithi027.stdout: "auth_dump": [ 2024-01-15T11:34:06.552 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:06.552 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.a", 2024-01-15T11:34:06.552 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQC/F6VlkQEwEBAA64qIAc+BZqfvKf4MxjK5vQ==", 2024-01-15T11:34:06.552 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-15T11:34:06.552 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2024-01-15T11:34:06.552 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2024-01-15T11:34:06.553 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2024-01-15T11:34:06.553 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-15T11:34:06.553 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.553 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:34:06.553 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:06.553 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.b", 2024-01-15T11:34:06.553 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQC/F6VlEJzaHBAAuFV9d3S7QfnlmLs2i1fHdQ==", 2024-01-15T11:34:06.553 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-15T11:34:06.553 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2024-01-15T11:34:06.553 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2024-01-15T11:34:06.554 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2024-01-15T11:34:06.554 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-15T11:34:06.554 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.554 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:34:06.554 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:06.554 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.c", 2024-01-15T11:34:06.554 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQC/F6VlRTDJFxAAptWtTuoQ/zgNLuoVOHH7/Q==", 2024-01-15T11:34:06.554 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-15T11:34:06.554 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2024-01-15T11:34:06.554 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2024-01-15T11:34:06.555 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2024-01-15T11:34:06.555 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-15T11:34:06.555 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.555 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:34:06.555 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:06.555 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mds.d", 2024-01-15T11:34:06.555 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQC/F6Vl/2tQJBAAnmPf3qvrV+9fBCci2718qA==", 2024-01-15T11:34:06.555 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-15T11:34:06.555 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2024-01-15T11:34:06.555 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2024-01-15T11:34:06.555 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2024-01-15T11:34:06.556 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-15T11:34:06.556 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.556 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:34:06.556 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:06.556 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.0", 2024-01-15T11:34:06.556 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDDF6VlWTWsBhAA+zuBPc/TWd+lmwHHLQQjGQ==", 2024-01-15T11:34:06.556 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-15T11:34:06.556 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2024-01-15T11:34:06.556 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2024-01-15T11:34:06.556 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-15T11:34:06.557 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.557 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:34:06.557 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:06.557 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.1", 2024-01-15T11:34:06.557 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDGF6Vl7KktDRAA2tGIsiVfz9SbwJ2n+e37Cw==", 2024-01-15T11:34:06.557 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-15T11:34:06.557 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2024-01-15T11:34:06.557 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2024-01-15T11:34:06.557 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-15T11:34:06.557 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.557 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:34:06.558 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:06.558 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.2", 2024-01-15T11:34:06.558 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDJF6VlXOIlFBAAaF2Yhzgcak/sPzGSX+hghA==", 2024-01-15T11:34:06.558 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-15T11:34:06.558 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2024-01-15T11:34:06.558 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2024-01-15T11:34:06.558 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-15T11:34:06.558 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.558 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:34:06.558 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:06.558 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.3", 2024-01-15T11:34:06.559 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDMF6VlD18TGxAA7zzIX8ZQs4RtdjrmnNA3aA==", 2024-01-15T11:34:06.559 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-15T11:34:06.559 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2024-01-15T11:34:06.559 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2024-01-15T11:34:06.559 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-15T11:34:06.559 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.559 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:34:06.559 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:06.559 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.4", 2024-01-15T11:34:06.559 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDSF6VlLqDOHxAAokLZvbakoKitnoncRqC07Q==", 2024-01-15T11:34:06.559 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-15T11:34:06.560 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2024-01-15T11:34:06.560 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2024-01-15T11:34:06.560 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-15T11:34:06.560 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.560 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:34:06.560 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:06.560 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.5", 2024-01-15T11:34:06.560 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDVF6VlXm3KJhAA2AR8RdY+n75c7ojqtuaiqA==", 2024-01-15T11:34:06.560 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-15T11:34:06.560 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2024-01-15T11:34:06.560 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2024-01-15T11:34:06.561 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-15T11:34:06.561 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.561 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:34:06.561 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:06.561 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.6", 2024-01-15T11:34:06.561 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDYF6VlWpAuLhAAH7/X4yyIoQLJ0JJmPun67w==", 2024-01-15T11:34:06.561 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-15T11:34:06.561 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2024-01-15T11:34:06.561 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2024-01-15T11:34:06.561 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-15T11:34:06.561 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.561 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:34:06.562 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:06.562 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "osd.7", 2024-01-15T11:34:06.562 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDbF6Vlw5RkNhAA4mli4D4sevDuKSkFhq0h0g==", 2024-01-15T11:34:06.562 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-15T11:34:06.562 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow profile osd", 2024-01-15T11:34:06.562 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile osd", 2024-01-15T11:34:06.562 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-15T11:34:06.562 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.562 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:34:06.562 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:06.562 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.0", 2024-01-15T11:34:06.563 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQC/F6Vlh3mVKBAAfHmOP/4KjAs9i7VdmSNMDA==", 2024-01-15T11:34:06.563 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-15T11:34:06.563 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2024-01-15T11:34:06.563 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2024-01-15T11:34:06.563 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2024-01-15T11:34:06.563 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2024-01-15T11:34:06.563 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.563 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:34:06.563 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:06.563 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.1", 2024-01-15T11:34:06.563 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQC/F6VltiRpMhAAO8VTZJHKfyRl818K6KTyug==", 2024-01-15T11:34:06.564 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-15T11:34:06.564 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2024-01-15T11:34:06.564 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2024-01-15T11:34:06.564 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2024-01-15T11:34:06.564 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2024-01-15T11:34:06.564 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:34:06.564 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:06.564 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.2", 2024-01-15T11:34:06.564 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQC/F6Vly/LOLhAAGNJNBcSD+uTOrSvLAu5Gpw==", 2024-01-15T11:34:06.565 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-15T11:34:06.565 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2024-01-15T11:34:06.565 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2024-01-15T11:34:06.565 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2024-01-15T11:34:06.565 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2024-01-15T11:34:06.565 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.565 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:34:06.565 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:06.565 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.3", 2024-01-15T11:34:06.565 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQC/F6VlhRiyOBAA16k+wHXOOl8BH09KVs396A==", 2024-01-15T11:34:06.565 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-15T11:34:06.565 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow", 2024-01-15T11:34:06.566 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow r", 2024-01-15T11:34:06.566 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow rw", 2024-01-15T11:34:06.566 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow rwx" 2024-01-15T11:34:06.566 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.566 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:34:06.566 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:06.566 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.admin", 2024-01-15T11:34:06.566 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQC+F6Vl4vLBLhAAlCvmNmxI50IylIqfn76LBA==", 2024-01-15T11:34:06.566 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-15T11:34:06.566 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2024-01-15T11:34:06.566 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr": "allow *", 2024-01-15T11:34:06.567 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow *", 2024-01-15T11:34:06.567 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-15T11:34:06.567 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.567 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:34:06.567 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:06.567 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.bootstrap-mds", 2024-01-15T11:34:06.567 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDmF6Vl2xpKOhAAxnJNt3oV/FTLr7gVWQcZ6Q==", 2024-01-15T11:34:06.567 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-15T11:34:06.567 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile bootstrap-mds" 2024-01-15T11:34:06.567 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.567 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:34:06.567 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:06.568 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.bootstrap-mgr", 2024-01-15T11:34:06.568 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDmF6VljyRKOhAASyj55P16Sfe+lHtPrwMJgA==", 2024-01-15T11:34:06.568 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-15T11:34:06.568 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile bootstrap-mgr" 2024-01-15T11:34:06.568 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.568 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:34:06.568 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:06.568 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.bootstrap-osd", 2024-01-15T11:34:06.568 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDmF6VlVy1KOhAAUBVis7yYPNtyghSlTH00pg==", 2024-01-15T11:34:06.568 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-15T11:34:06.568 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile bootstrap-osd" 2024-01-15T11:34:06.568 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.569 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:34:06.569 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:06.569 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.bootstrap-rbd", 2024-01-15T11:34:06.569 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDmF6Vl9zVKOhAAXGyRfnAAQF9BXKb/qud7yA==", 2024-01-15T11:34:06.569 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-15T11:34:06.569 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile bootstrap-rbd" 2024-01-15T11:34:06.569 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.569 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:34:06.569 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:06.569 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-01-15T11:34:06.569 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDmF6Vl9j9KOhAA9827UAKJnX8YAIfbxlRduw==", 2024-01-15T11:34:06.569 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-15T11:34:06.570 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-01-15T11:34:06.570 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.570 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:34:06.570 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:06.570 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "client.bootstrap-rgw", 2024-01-15T11:34:06.570 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQDmF6VlYklKOhAAd6tZPvCeibUqXAqgeVjTxA==", 2024-01-15T11:34:06.570 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-15T11:34:06.570 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile bootstrap-rgw" 2024-01-15T11:34:06.570 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.570 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:34:06.570 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:06.570 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mgr.x", 2024-01-15T11:34:06.571 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQC/F6VlxzrRCxAAgWBI+Amt0FR1D4R8o4evuw==", 2024-01-15T11:34:06.571 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-15T11:34:06.571 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2024-01-15T11:34:06.571 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile mgr", 2024-01-15T11:34:06.571 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-15T11:34:06.571 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.571 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:34:06.571 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:06.571 INFO:teuthology.orchestra.run.smithi027.stdout: "entity": "mgr.y", 2024-01-15T11:34:06.571 INFO:teuthology.orchestra.run.smithi027.stdout: "key": "AQC/F6Vl0YbpBxAA+3H7PeENvRGq2RCxm1H1Rg==", 2024-01-15T11:34:06.571 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": { 2024-01-15T11:34:06.571 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": "allow *", 2024-01-15T11:34:06.572 INFO:teuthology.orchestra.run.smithi027.stdout: "mon": "allow profile mgr", 2024-01-15T11:34:06.572 INFO:teuthology.orchestra.run.smithi027.stdout: "osd": "allow *" 2024-01-15T11:34:06.572 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.572 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:06.572 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-01-15T11:34:06.572 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-01-15T11:34:06.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.551+0000 7fecac217640 1 -- 172.21.15.27:0/3176873067 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fec88066970 msgr2=0x7fec88068e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:06.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.551+0000 7fecac217640 1 --2- 172.21.15.27:0/3176873067 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fec88066970 0x7fec88068e30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7feca00ae000 tx=0x7feca00b5040 comp rx=0 tx=0).stop 2024-01-15T11:34:06.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.551+0000 7fecac217640 1 -- 172.21.15.27:0/3176873067 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feca4146c60 msgr2=0x7feca415c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:06.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.551+0000 7fecac217640 1 --2- 172.21.15.27:0/3176873067 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feca4146c60 0x7feca415c490 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fec9400e980 tx=0x7fec9400ee40 comp rx=0 tx=0).stop 2024-01-15T11:34:06.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.551+0000 7fecac217640 1 -- 172.21.15.27:0/3176873067 shutdown_connections 2024-01-15T11:34:06.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.551+0000 7fecac217640 1 --2- 172.21.15.27:0/3176873067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7feca4147040 0x7feca4155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:06.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.551+0000 7fecac217640 1 --2- 172.21.15.27:0/3176873067 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fec88066970 0x7fec88068e30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:06.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.551+0000 7fecac217640 1 --2- 172.21.15.27:0/3176873067 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feca4146c60 0x7feca415c490 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:06.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.551+0000 7fecac217640 1 --2- 172.21.15.27:0/3176873067 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7feca406bb10 0x7feca413cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:06.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.551+0000 7fecac217640 1 -- 172.21.15.27:0/3176873067 >> 172.21.15.27:0/3176873067 conn(0x7feca40b2ea0 msgr2=0x7feca4144c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:06.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.551+0000 7fecac217640 1 -- 172.21.15.27:0/3176873067 shutdown_connections 2024-01-15T11:34:06.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.551+0000 7fecac217640 1 -- 172.21.15.27:0/3176873067 wait complete. 2024-01-15T11:34:06.575 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-01-15T11:34:06.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.715+0000 7ff046557640 1 Processor -- start 2024-01-15T11:34:06.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.715+0000 7ff046557640 1 -- start start 2024-01-15T11:34:06.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.719+0000 7ff046557640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff0400b07a0 0x7ff0401619e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:06.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.719+0000 7ff046557640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff0400b15f0 0x7ff0400cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:06.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.719+0000 7ff046557640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff040161290 con 0x7ff040161f20 2024-01-15T11:34:06.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.719+0000 7ff046557640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0400b0b80 con 0x7ff0400b15f0 2024-01-15T11:34:06.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.719+0000 7ff046557640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04015ebc0 con 0x7ff0400b07a0 2024-01-15T11:34:06.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.719+0000 7ff044af4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff0400b15f0 0x7ff0400cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:06.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.719+0000 7ff03ffff640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff0400b07a0 0x7ff0401619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:06.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.719+0000 7ff044af4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff0400b15f0 0x7ff0400cc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:50430/0 (socket says 172.21.15.27:50430) 2024-01-15T11:34:06.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.719+0000 7ff044af4640 1 -- 172.21.15.27:0/2921759174 learned_addr learned my addr 172.21.15.27:0/2921759174 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:06.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.719+0000 7ff044af4640 1 -- 172.21.15.27:0/2921759174 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff0400b07a0 msgr2=0x7ff0401619e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:06.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.719+0000 7ff044af4640 1 --2- 172.21.15.27:0/2921759174 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff0400b07a0 0x7ff0401619e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:06.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.719+0000 7ff044af4640 1 -- 172.21.15.27:0/2921759174 >> v1:172.21.15.93:6789/0 conn(0x7ff040161f20 legacy=0x7ff0400b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:06.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.719+0000 7ff044af4640 1 -- 172.21.15.27:0/2921759174 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff040161550 con 0x7ff0400b15f0 2024-01-15T11:34:06.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.723+0000 7ff044af4640 1 --2- 172.21.15.27:0/2921759174 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0400b15f0 0x7ff0400cc9a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff038009e50 tx=0x7ff03801ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b196fe7e99e30f6b server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:06.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.723+0000 7ff03effd640 1 -- 172.21.15.27:0/2921759174 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0380a57d0 con 0x7ff0400b15f0 2024-01-15T11:34:06.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.723+0000 7ff03effd640 1 -- 172.21.15.27:0/2921759174 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0380a5930 con 0x7ff0400b15f0 2024-01-15T11:34:06.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.723+0000 7ff03effd640 1 -- 172.21.15.27:0/2921759174 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0380a5cc0 con 0x7ff0400b15f0 2024-01-15T11:34:06.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.723+0000 7ff046557640 1 -- 172.21.15.27:0/2921759174 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0400b15f0 msgr2=0x7ff0400cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:06.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.723+0000 7ff046557640 1 --2- 172.21.15.27:0/2921759174 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0400b15f0 0x7ff0400cc9a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff038009e50 tx=0x7ff03801ca10 comp rx=0 tx=0).stop 2024-01-15T11:34:06.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.723+0000 7ff046557640 1 -- 172.21.15.27:0/2921759174 shutdown_connections 2024-01-15T11:34:06.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.723+0000 7ff046557640 1 --2- 172.21.15.27:0/2921759174 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0400b15f0 0x7ff0400cc9a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:06.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.723+0000 7ff046557640 1 --2- 172.21.15.27:0/2921759174 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff0400b07a0 0x7ff0401619e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:06.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.723+0000 7ff046557640 1 -- 172.21.15.27:0/2921759174 >> 172.21.15.27:0/2921759174 conn(0x7ff0400b1d50 msgr2=0x7ff0400b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:06.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.723+0000 7ff046557640 1 -- 172.21.15.27:0/2921759174 shutdown_connections 2024-01-15T11:34:06.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.723+0000 7ff046557640 1 -- 172.21.15.27:0/2921759174 wait complete. 2024-01-15T11:34:06.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.723+0000 7ff046557640 1 Processor -- start 2024-01-15T11:34:06.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.723+0000 7ff046557640 1 -- start start 2024-01-15T11:34:06.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.723+0000 7ff046557640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0400b07a0 0x7ff04015edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:06.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.727+0000 7ff046557640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff0400b15f0 0x7ff04015f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:06.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.727+0000 7ff046557640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff040161f20 0x7ff040154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:06.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.727+0000 7ff046557640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0400ad3a0 con 0x7ff0400b07a0 2024-01-15T11:34:06.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.727+0000 7ff046557640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0400ad680 con 0x7ff040161f20 2024-01-15T11:34:06.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.727+0000 7ff046557640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0400af7e0 con 0x7ff0400b15f0 2024-01-15T11:34:06.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.727+0000 7ff03ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0400b07a0 0x7ff04015edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:06.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.727+0000 7ff03ffff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0400b07a0 0x7ff04015edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38822/0 (socket says 172.21.15.27:38822) 2024-01-15T11:34:06.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.727+0000 7ff03ffff640 1 -- 172.21.15.27:0/1053364200 learned_addr learned my addr 172.21.15.27:0/1053364200 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:06.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.727+0000 7ff044af4640 1 --2- 172.21.15.27:0/1053364200 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff040161f20 0x7ff040154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:06.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.727+0000 7ff03f7fe640 1 --2- 172.21.15.27:0/1053364200 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff0400b15f0 0x7ff04015f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:06.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.727+0000 7ff03ffff640 1 -- 172.21.15.27:0/1053364200 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff0400b15f0 msgr2=0x7ff04015f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:06.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.727+0000 7ff03ffff640 1 --2- 172.21.15.27:0/1053364200 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff0400b15f0 0x7ff04015f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:06.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.727+0000 7ff03ffff640 1 -- 172.21.15.27:0/1053364200 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff040161f20 msgr2=0x7ff040154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:06.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.727+0000 7ff03ffff640 1 --2- 172.21.15.27:0/1053364200 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff040161f20 0x7ff040154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:06.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.727+0000 7ff03ffff640 1 -- 172.21.15.27:0/1053364200 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff038009b30 con 0x7ff0400b07a0 2024-01-15T11:34:06.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.727+0000 7ff03ffff640 1 --2- 172.21.15.27:0/1053364200 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0400b07a0 0x7ff04015edd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff03000e930 tx=0x7ff03000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:06.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.727+0000 7ff03cff9640 1 -- 172.21.15.27:0/1053364200 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff030009690 con 0x7ff0400b07a0 2024-01-15T11:34:06.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.727+0000 7ff03cff9640 1 -- 172.21.15.27:0/1053364200 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03000ca00 con 0x7ff0400b07a0 2024-01-15T11:34:06.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.727+0000 7ff046557640 1 -- 172.21.15.27:0/1053364200 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0400afac0 con 0x7ff0400b07a0 2024-01-15T11:34:06.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.727+0000 7ff03cff9640 1 -- 172.21.15.27:0/1053364200 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03000cd70 con 0x7ff0400b07a0 2024-01-15T11:34:06.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.727+0000 7ff046557640 1 -- 172.21.15.27:0/1053364200 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0400ad030 con 0x7ff0400b07a0 2024-01-15T11:34:06.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.727+0000 7ff046557640 1 -- 172.21.15.27:0/1053364200 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff04004e850 con 0x7ff0400b07a0 2024-01-15T11:34:06.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.727+0000 7ff03cff9640 1 -- 172.21.15.27:0/1053364200 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7ff030013470 con 0x7ff0400b07a0 2024-01-15T11:34:06.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.731+0000 7ff03cff9640 1 --2- 172.21.15.27:0/1053364200 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff02c0668f0 0x7ff02c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:06.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.731+0000 7ff03cff9640 1 -- 172.21.15.27:0/1053364200 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff0300842c0 con 0x7ff0400b07a0 2024-01-15T11:34:06.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.731+0000 7ff03f7fe640 1 --2- 172.21.15.27:0/1053364200 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff02c0668f0 0x7ff02c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:06.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.731+0000 7ff03f7fe640 1 --2- 172.21.15.27:0/1053364200 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff02c0668f0 0x7ff02c068db0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff040157820 tx=0x7ff034009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:06.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.735+0000 7ff03cff9640 1 -- 172.21.15.27:0/1053364200 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff0300519c0 con 0x7ff0400b07a0 2024-01-15T11:34:06.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.943+0000 7ff046557640 1 -- 172.21.15.27:0/1053364200 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7ff0400c5350 con 0x7ff0400b07a0 2024-01-15T11:34:06.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.947+0000 7ff03cff9640 1 -- 172.21.15.27:0/1053364200 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff030054fe0 con 0x7ff0400b07a0 2024-01-15T11:34:06.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.951+0000 7ff046557640 1 -- 172.21.15.27:0/1053364200 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff02c0668f0 msgr2=0x7ff02c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:06.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.951+0000 7ff046557640 1 --2- 172.21.15.27:0/1053364200 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff02c0668f0 0x7ff02c068db0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff040157820 tx=0x7ff034009040 comp rx=0 tx=0).stop 2024-01-15T11:34:06.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.951+0000 7ff046557640 1 -- 172.21.15.27:0/1053364200 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0400b07a0 msgr2=0x7ff04015edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:06.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.951+0000 7ff046557640 1 --2- 172.21.15.27:0/1053364200 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0400b07a0 0x7ff04015edd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff03000e930 tx=0x7ff03000edf0 comp rx=0 tx=0).stop 2024-01-15T11:34:06.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.951+0000 7ff046557640 1 -- 172.21.15.27:0/1053364200 shutdown_connections 2024-01-15T11:34:06.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.951+0000 7ff046557640 1 --2- 172.21.15.27:0/1053364200 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff02c0668f0 0x7ff02c068db0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:06.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.951+0000 7ff046557640 1 --2- 172.21.15.27:0/1053364200 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff040161f20 0x7ff040154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:06.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.951+0000 7ff046557640 1 --2- 172.21.15.27:0/1053364200 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff0400b15f0 0x7ff04015f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:06.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.951+0000 7ff046557640 1 --2- 172.21.15.27:0/1053364200 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff0400b07a0 0x7ff04015edd0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:06.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.951+0000 7ff046557640 1 -- 172.21.15.27:0/1053364200 >> 172.21.15.27:0/1053364200 conn(0x7ff0400b1d50 msgr2=0x7ff0400cf6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:06.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.951+0000 7ff046557640 1 -- 172.21.15.27:0/1053364200 shutdown_connections 2024-01-15T11:34:06.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:06.951+0000 7ff046557640 1 -- 172.21.15.27:0/1053364200 wait complete. 2024-01-15T11:34:06.972 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-01-15T11:34:07.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.115+0000 7f55bf09a640 1 Processor -- start 2024-01-15T11:34:07.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.115+0000 7f55bf09a640 1 -- start start 2024-01-15T11:34:07.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.115+0000 7f55bf09a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f55b815a710 0x7f55b80abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:07.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.115+0000 7f55bf09a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f55b80cbd50 0x7f55b80cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:07.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.115+0000 7f55bf09a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b80b2710 con 0x7f55b80cdfb0 2024-01-15T11:34:07.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.115+0000 7f55bf09a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b80cca80 con 0x7f55b80cbd50 2024-01-15T11:34:07.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.115+0000 7f55bf09a640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b80b29f0 con 0x7f55b815a710 2024-01-15T11:34:07.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.115+0000 7f55bd637640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f55b80cbd50 0x7f55b80cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:07.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.119+0000 7f55bd637640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f55b80cbd50 0x7f55b80cc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38830/0 (socket says 172.21.15.27:38830) 2024-01-15T11:34:07.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.119+0000 7f55bd637640 1 -- 172.21.15.27:0/3366574136 learned_addr learned my addr 172.21.15.27:0/3366574136 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:07.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.119+0000 7f55b7fff640 1 --2- 172.21.15.27:0/3366574136 >> v2:172.21.15.93:3300/0 conn(0x7f55b815a710 0x7f55b80abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:07.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.119+0000 7f55bd637640 1 -- 172.21.15.27:0/3366574136 >> v2:172.21.15.93:3300/0 conn(0x7f55b815a710 msgr2=0x7f55b80abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:07.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.119+0000 7f55bd637640 1 --2- 172.21.15.27:0/3366574136 >> v2:172.21.15.93:3300/0 conn(0x7f55b815a710 0x7f55b80abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.119+0000 7f55bd637640 1 -- 172.21.15.27:0/3366574136 >> v1:172.21.15.93:6789/0 conn(0x7f55b80cdfb0 legacy=0x7f55b80ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:07.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.119+0000 7f55bd637640 1 -- 172.21.15.27:0/3366574136 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b80b2cd0 con 0x7f55b80cbd50 2024-01-15T11:34:07.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.119+0000 7f55bd637640 1 --2- 172.21.15.27:0/3366574136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55b80cbd50 0x7f55b80cc1e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f55b80d0040 tx=0x7f55b001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad24a9a1cf96cfc server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:07.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.119+0000 7f55b77fe640 1 -- 172.21.15.27:0/3366574136 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b00a5880 con 0x7f55b80cbd50 2024-01-15T11:34:07.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.119+0000 7f55b77fe640 1 -- 172.21.15.27:0/3366574136 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b00a59e0 con 0x7f55b80cbd50 2024-01-15T11:34:07.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.119+0000 7f55b77fe640 1 -- 172.21.15.27:0/3366574136 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b00a5d70 con 0x7f55b80cbd50 2024-01-15T11:34:07.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.123+0000 7f55bf09a640 1 -- 172.21.15.27:0/3366574136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55b80cbd50 msgr2=0x7f55b80cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:07.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.123+0000 7f55bf09a640 1 --2- 172.21.15.27:0/3366574136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55b80cbd50 0x7f55b80cc1e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f55b80d0040 tx=0x7f55b001c9a0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.123+0000 7f55bf09a640 1 -- 172.21.15.27:0/3366574136 shutdown_connections 2024-01-15T11:34:07.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.123+0000 7f55bf09a640 1 --2- 172.21.15.27:0/3366574136 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55b80cbd50 0x7f55b80cc1e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.123+0000 7f55bf09a640 1 --2- 172.21.15.27:0/3366574136 >> v2:172.21.15.93:3300/0 conn(0x7f55b815a710 0x7f55b80abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.123+0000 7f55bf09a640 1 -- 172.21.15.27:0/3366574136 >> 172.21.15.27:0/3366574136 conn(0x7f55b80b0cb0 msgr2=0x7f55b80b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:07.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.123+0000 7f55bf09a640 1 -- 172.21.15.27:0/3366574136 shutdown_connections 2024-01-15T11:34:07.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.123+0000 7f55bf09a640 1 -- 172.21.15.27:0/3366574136 wait complete. 2024-01-15T11:34:07.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.123+0000 7f55bf09a640 1 Processor -- start 2024-01-15T11:34:07.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.123+0000 7f55bf09a640 1 -- start start 2024-01-15T11:34:07.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.123+0000 7f55bf09a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f55b80cbd50 0x7f55b81671c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:07.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.123+0000 7f55bf09a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55b80cdfb0 0x7f55b81649e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:07.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.123+0000 7f55bf09a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f55b815a710 0x7f55b814fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:07.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.123+0000 7f55bf09a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b8153d20 con 0x7f55b80cdfb0 2024-01-15T11:34:07.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.123+0000 7f55bf09a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b8164f20 con 0x7f55b815a710 2024-01-15T11:34:07.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.123+0000 7f55bf09a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b8167850 con 0x7f55b80cbd50 2024-01-15T11:34:07.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.123+0000 7f55b7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55b80cdfb0 0x7f55b81649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:07.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.123+0000 7f55b7fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55b80cdfb0 0x7f55b81649e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38834/0 (socket says 172.21.15.27:38834) 2024-01-15T11:34:07.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.123+0000 7f55b7fff640 1 -- 172.21.15.27:0/256712047 learned_addr learned my addr 172.21.15.27:0/256712047 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:07.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.123+0000 7f55bd637640 1 --2- 172.21.15.27:0/256712047 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f55b815a710 0x7f55b814fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:07.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.123+0000 7f55bce36640 1 --2- 172.21.15.27:0/256712047 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f55b80cbd50 0x7f55b81671c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:07.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.123+0000 7f55b7fff640 1 -- 172.21.15.27:0/256712047 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f55b80cbd50 msgr2=0x7f55b81671c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:07.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.123+0000 7f55b7fff640 1 --2- 172.21.15.27:0/256712047 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f55b80cbd50 0x7f55b81671c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.127+0000 7f55b7fff640 1 -- 172.21.15.27:0/256712047 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f55b815a710 msgr2=0x7f55b814fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:07.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.127+0000 7f55b7fff640 1 --2- 172.21.15.27:0/256712047 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f55b815a710 0x7f55b814fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.127+0000 7f55b7fff640 1 -- 172.21.15.27:0/256712047 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b0009b30 con 0x7f55b80cdfb0 2024-01-15T11:34:07.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.127+0000 7f55b7fff640 1 --2- 172.21.15.27:0/256712047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55b80cdfb0 0x7f55b81649e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f55a400e870 tx=0x7f55a400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:07.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.127+0000 7f55b57fa640 1 -- 172.21.15.27:0/256712047 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a4009510 con 0x7f55b80cdfb0 2024-01-15T11:34:07.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.127+0000 7f55b57fa640 1 -- 172.21.15.27:0/256712047 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a400eec0 con 0x7f55b80cdfb0 2024-01-15T11:34:07.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.127+0000 7f55b57fa640 1 -- 172.21.15.27:0/256712047 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a400cb80 con 0x7f55b80cdfb0 2024-01-15T11:34:07.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.127+0000 7f55bf09a640 1 -- 172.21.15.27:0/256712047 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b8167b30 con 0x7f55b80cdfb0 2024-01-15T11:34:07.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.127+0000 7f55bf09a640 1 -- 172.21.15.27:0/256712047 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b81680f0 con 0x7f55b80cdfb0 2024-01-15T11:34:07.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.127+0000 7f55bf09a640 1 -- 172.21.15.27:0/256712047 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b80cb660 con 0x7f55b80cdfb0 2024-01-15T11:34:07.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.127+0000 7f55b57fa640 1 -- 172.21.15.27:0/256712047 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f55a400cce0 con 0x7f55b80cdfb0 2024-01-15T11:34:07.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.127+0000 7f55b57fa640 1 --2- 172.21.15.27:0/256712047 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f559c066920 0x7f559c068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:07.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.127+0000 7f55b57fa640 1 -- 172.21.15.27:0/256712047 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f55a40841e0 con 0x7f55b80cdfb0 2024-01-15T11:34:07.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.127+0000 7f55bce36640 1 --2- 172.21.15.27:0/256712047 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f559c066920 0x7f559c068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:07.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.131+0000 7f55bce36640 1 --2- 172.21.15.27:0/256712047 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f559c066920 0x7f559c068de0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f55ac007fd0 tx=0x7f55ac009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:07.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.131+0000 7f55b57fa640 1 -- 172.21.15.27:0/256712047 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f55a4051790 con 0x7f55b80cdfb0 2024-01-15T11:34:07.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.347+0000 7f55bf09a640 1 -- 172.21.15.27:0/256712047 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f55b80671f0 con 0x7f55b80cdfb0 2024-01-15T11:34:07.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.351+0000 7f55b57fa640 1 -- 172.21.15.27:0/256712047 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f55a4054db0 con 0x7f55b80cdfb0 2024-01-15T11:34:07.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.351+0000 7f55bf09a640 1 -- 172.21.15.27:0/256712047 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f559c066920 msgr2=0x7f559c068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:07.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.351+0000 7f55bf09a640 1 --2- 172.21.15.27:0/256712047 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f559c066920 0x7f559c068de0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f55ac007fd0 tx=0x7f55ac009040 comp rx=0 tx=0).stop 2024-01-15T11:34:07.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.351+0000 7f55bf09a640 1 -- 172.21.15.27:0/256712047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55b80cdfb0 msgr2=0x7f55b81649e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:07.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.351+0000 7f55bf09a640 1 --2- 172.21.15.27:0/256712047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55b80cdfb0 0x7f55b81649e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f55a400e870 tx=0x7f55a400ec70 comp rx=0 tx=0).stop 2024-01-15T11:34:07.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.351+0000 7f55bf09a640 1 -- 172.21.15.27:0/256712047 shutdown_connections 2024-01-15T11:34:07.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.351+0000 7f55bf09a640 1 --2- 172.21.15.27:0/256712047 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f559c066920 0x7f559c068de0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.351+0000 7f55bf09a640 1 --2- 172.21.15.27:0/256712047 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f55b815a710 0x7f55b814fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.351+0000 7f55bf09a640 1 --2- 172.21.15.27:0/256712047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f55b80cdfb0 0x7f55b81649e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.351+0000 7f55bf09a640 1 --2- 172.21.15.27:0/256712047 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f55b80cbd50 0x7f55b81671c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.351+0000 7f55bf09a640 1 -- 172.21.15.27:0/256712047 >> 172.21.15.27:0/256712047 conn(0x7f55b80b0cb0 msgr2=0x7f55b80cd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:07.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.351+0000 7f55bf09a640 1 -- 172.21.15.27:0/256712047 shutdown_connections 2024-01-15T11:34:07.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.351+0000 7f55bf09a640 1 -- 172.21.15.27:0/256712047 wait complete. 2024-01-15T11:34:07.374 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-01-15T11:34:07.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.515+0000 7f89bdc79640 1 Processor -- start 2024-01-15T11:34:07.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.515+0000 7f89bdc79640 1 -- start start 2024-01-15T11:34:07.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.515+0000 7f89bdc79640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f89b8159f00 0x7f89b80ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:07.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.515+0000 7f89bdc79640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f89b80ae680 0x7f89b80cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:07.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.515+0000 7f89bdc79640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b8072950 con 0x7f89b80cd920 2024-01-15T11:34:07.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.515+0000 7f89bdc79640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b806e2b0 con 0x7f89b8159f00 2024-01-15T11:34:07.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.515+0000 7f89bdc79640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b806c6f0 con 0x7f89b80ae680 2024-01-15T11:34:07.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.515+0000 7f89b77fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f89b8159f00 0x7f89b80ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:07.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.515+0000 7f89b7fff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f89b80cd920 0x7f89b815d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45924/0 (socket says 172.21.15.27:45924) 2024-01-15T11:34:07.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.515+0000 7f89b7fff640 1 -- 172.21.15.27:0/2299870120 learned_addr learned my addr 172.21.15.27:0/2299870120 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:07.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.515+0000 7f89b6ffd640 1 --2- 172.21.15.27:0/2299870120 >> v2:172.21.15.93:3300/0 conn(0x7f89b80ae680 0x7f89b80cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:07.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.519+0000 7f89b77fe640 1 -- 172.21.15.27:0/2299870120 >> v2:172.21.15.93:3300/0 conn(0x7f89b80ae680 msgr2=0x7f89b80cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:07.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.519+0000 7f89b77fe640 1 --2- 172.21.15.27:0/2299870120 >> v2:172.21.15.93:3300/0 conn(0x7f89b80ae680 0x7f89b80cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.519+0000 7f89b77fe640 1 -- 172.21.15.27:0/2299870120 >> v1:172.21.15.27:6789/0 conn(0x7f89b80cd920 legacy=0x7f89b815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:07.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.519+0000 7f89b77fe640 1 -- 172.21.15.27:0/2299870120 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b806e550 con 0x7f89b8159f00 2024-01-15T11:34:07.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.519+0000 7f89b67fc640 1 -- 172.21.15.27:0/2299870120 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1757782571 0 0) 0x7f89b8072950 con 0x7f89b80cd920 2024-01-15T11:34:07.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.519+0000 7f89b77fe640 1 --2- 172.21.15.27:0/2299870120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89b8159f00 0x7f89b80ccea0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f89b80d0040 tx=0x7f89a801d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f488bb56a7673778 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:07.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.519+0000 7f89b67fc640 1 -- 172.21.15.27:0/2299870120 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a80a6760 con 0x7f89b8159f00 2024-01-15T11:34:07.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.519+0000 7f89b67fc640 1 -- 172.21.15.27:0/2299870120 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a80a68c0 con 0x7f89b8159f00 2024-01-15T11:34:07.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.519+0000 7f89b67fc640 1 -- 172.21.15.27:0/2299870120 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a80a6c50 con 0x7f89b8159f00 2024-01-15T11:34:07.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.519+0000 7f89bdc79640 1 -- 172.21.15.27:0/2299870120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89b8159f00 msgr2=0x7f89b80ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:07.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.519+0000 7f89bdc79640 1 --2- 172.21.15.27:0/2299870120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89b8159f00 0x7f89b80ccea0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f89b80d0040 tx=0x7f89a801d800 comp rx=0 tx=0).stop 2024-01-15T11:34:07.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.519+0000 7f89bdc79640 1 -- 172.21.15.27:0/2299870120 shutdown_connections 2024-01-15T11:34:07.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.519+0000 7f89bdc79640 1 --2- 172.21.15.27:0/2299870120 >> v2:172.21.15.93:3300/0 conn(0x7f89b80ae680 0x7f89b80cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.519+0000 7f89bdc79640 1 --2- 172.21.15.27:0/2299870120 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89b8159f00 0x7f89b80ccea0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.519+0000 7f89bdc79640 1 -- 172.21.15.27:0/2299870120 >> 172.21.15.27:0/2299870120 conn(0x7f89b80b0cb0 msgr2=0x7f89b80b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:07.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.519+0000 7f89bdc79640 1 -- 172.21.15.27:0/2299870120 shutdown_connections 2024-01-15T11:34:07.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.519+0000 7f89bdc79640 1 -- 172.21.15.27:0/2299870120 wait complete. 2024-01-15T11:34:07.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.523+0000 7f89bdc79640 1 Processor -- start 2024-01-15T11:34:07.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.523+0000 7f89bdc79640 1 -- start start 2024-01-15T11:34:07.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.523+0000 7f89bdc79640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89b80ae680 0x7f89b814fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:07.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.523+0000 7f89bdc79640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89b80cd920 0x7f89b8151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:07.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.523+0000 7f89bdc79640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f89b81530d0 0x7f89b8146b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:07.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.523+0000 7f89bdc79640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b8152c40 con 0x7f89b80ae680 2024-01-15T11:34:07.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.523+0000 7f89bdc79640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b8151dd0 con 0x7f89b80cd920 2024-01-15T11:34:07.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.523+0000 7f89bdc79640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b8147080 con 0x7f89b81530d0 2024-01-15T11:34:07.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.523+0000 7f89b77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89b80ae680 0x7f89b814fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:07.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.523+0000 7f89b77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89b80ae680 0x7f89b814fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38864/0 (socket says 172.21.15.27:38864) 2024-01-15T11:34:07.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.523+0000 7f89b77fe640 1 -- 172.21.15.27:0/3260135922 learned_addr learned my addr 172.21.15.27:0/3260135922 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:07.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.523+0000 7f89b6ffd640 1 --2- 172.21.15.27:0/3260135922 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89b80cd920 0x7f89b8151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:07.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.523+0000 7f89b7fff640 1 --2- 172.21.15.27:0/3260135922 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f89b81530d0 0x7f89b8146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:07.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.523+0000 7f89b77fe640 1 -- 172.21.15.27:0/3260135922 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f89b81530d0 msgr2=0x7f89b8146b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:07.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.523+0000 7f89b77fe640 1 --2- 172.21.15.27:0/3260135922 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f89b81530d0 0x7f89b8146b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.523+0000 7f89b77fe640 1 -- 172.21.15.27:0/3260135922 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89b80cd920 msgr2=0x7f89b8151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:07.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.523+0000 7f89b77fe640 1 --2- 172.21.15.27:0/3260135922 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89b80cd920 0x7f89b8151890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.523+0000 7f89b77fe640 1 -- 172.21.15.27:0/3260135922 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a800a5c0 con 0x7f89b80ae680 2024-01-15T11:34:07.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.523+0000 7f89b7fff640 1 --2- 172.21.15.27:0/3260135922 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f89b81530d0 0x7f89b8146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:34:07.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.523+0000 7f89b77fe640 1 --2- 172.21.15.27:0/3260135922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89b80ae680 0x7f89b814fbb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f89a801d270 tx=0x7f89a801a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:07.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.523+0000 7f899ffff640 1 -- 172.21.15.27:0/3260135922 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a8004230 con 0x7f89b80ae680 2024-01-15T11:34:07.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.527+0000 7f899ffff640 1 -- 172.21.15.27:0/3260135922 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a8004390 con 0x7f89b80ae680 2024-01-15T11:34:07.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.527+0000 7f899ffff640 1 -- 172.21.15.27:0/3260135922 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a8003820 con 0x7f89b80ae680 2024-01-15T11:34:07.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.527+0000 7f89bdc79640 1 -- 172.21.15.27:0/3260135922 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b8152030 con 0x7f89b80ae680 2024-01-15T11:34:07.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.527+0000 7f89bdc79640 1 -- 172.21.15.27:0/3260135922 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b81525f0 con 0x7f89b80ae680 2024-01-15T11:34:07.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.527+0000 7f89bdc79640 1 -- 172.21.15.27:0/3260135922 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b80671f0 con 0x7f89b80ae680 2024-01-15T11:34:07.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.527+0000 7f899ffff640 1 -- 172.21.15.27:0/3260135922 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f89a80b5050 con 0x7f89b80ae680 2024-01-15T11:34:07.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.527+0000 7f899ffff640 1 --2- 172.21.15.27:0/3260135922 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f89a4066920 0x7f89a4068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:07.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.527+0000 7f899ffff640 1 -- 172.21.15.27:0/3260135922 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f89a811ebf0 con 0x7f89b80ae680 2024-01-15T11:34:07.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.527+0000 7f89b6ffd640 1 --2- 172.21.15.27:0/3260135922 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f89a4066920 0x7f89a4068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:07.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.531+0000 7f89b6ffd640 1 --2- 172.21.15.27:0/3260135922 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f89a4066920 0x7f89a4068de0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f89b81597d0 tx=0x7f89ac008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:07.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.531+0000 7f899ffff640 1 -- 172.21.15.27:0/3260135922 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f89a80ec0e0 con 0x7f89b80ae680 2024-01-15T11:34:07.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.743+0000 7f89bdc79640 1 -- 172.21.15.27:0/3260135922 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f89b806b460 con 0x7f89b80ae680 2024-01-15T11:34:07.750 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.747+0000 7f899ffff640 1 -- 172.21.15.27:0/3260135922 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f89a80b30a0 con 0x7f89b80ae680 2024-01-15T11:34:07.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.751+0000 7f89bdc79640 1 -- 172.21.15.27:0/3260135922 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f89a4066920 msgr2=0x7f89a4068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:07.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.751+0000 7f89bdc79640 1 --2- 172.21.15.27:0/3260135922 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f89a4066920 0x7f89a4068de0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f89b81597d0 tx=0x7f89ac008040 comp rx=0 tx=0).stop 2024-01-15T11:34:07.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.751+0000 7f89bdc79640 1 -- 172.21.15.27:0/3260135922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89b80ae680 msgr2=0x7f89b814fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:07.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.751+0000 7f89bdc79640 1 --2- 172.21.15.27:0/3260135922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89b80ae680 0x7f89b814fbb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f89a801d270 tx=0x7f89a801a5a0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.751+0000 7f89bdc79640 1 -- 172.21.15.27:0/3260135922 shutdown_connections 2024-01-15T11:34:07.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.751+0000 7f89bdc79640 1 --2- 172.21.15.27:0/3260135922 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f89b81530d0 0x7f89b8146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.751+0000 7f89bdc79640 1 --2- 172.21.15.27:0/3260135922 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f89a4066920 0x7f89a4068de0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.751+0000 7f89bdc79640 1 --2- 172.21.15.27:0/3260135922 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89b80cd920 0x7f89b8151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.751+0000 7f89bdc79640 1 --2- 172.21.15.27:0/3260135922 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f89b80ae680 0x7f89b814fbb0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.751+0000 7f89bdc79640 1 -- 172.21.15.27:0/3260135922 >> 172.21.15.27:0/3260135922 conn(0x7f89b80b0cb0 msgr2=0x7f89b8070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:07.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.751+0000 7f89bdc79640 1 -- 172.21.15.27:0/3260135922 shutdown_connections 2024-01-15T11:34:07.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.751+0000 7f89bdc79640 1 -- 172.21.15.27:0/3260135922 wait complete. 2024-01-15T11:34:07.772 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-01-15T11:34:07.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.911+0000 7ff4ac2bb640 1 Processor -- start 2024-01-15T11:34:07.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.911+0000 7ff4ac2bb640 1 -- start start 2024-01-15T11:34:07.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.915+0000 7ff4ac2bb640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff4a406e2a0 0x7ff4a40b5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:07.917 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.915+0000 7ff4ac2bb640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff4a406e680 0x7ff4a40cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:07.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.915+0000 7ff4ac2bb640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4a40b2bd0 0x7ff4a40b3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:07.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.915+0000 7ff4ac2bb640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a40b50f0 con 0x7ff4a406e680 2024-01-15T11:34:07.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.915+0000 7ff4ac2bb640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a40b5a50 con 0x7ff4a406e2a0 2024-01-15T11:34:07.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.915+0000 7ff4ac2bb640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a40af110 con 0x7ff4a40b2bd0 2024-01-15T11:34:07.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.915+0000 7ff4a9856640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff4a406e680 0x7ff4a40cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:07.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.915+0000 7ff4a9856640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7ff4a406e680 0x7ff4a40cf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38874/0 (socket says 172.21.15.27:38874) 2024-01-15T11:34:07.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.915+0000 7ff4a9856640 1 -- 172.21.15.27:0/2617045401 learned_addr learned my addr 172.21.15.27:0/2617045401 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:07.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.915+0000 7ff4aa858640 1 --2- 172.21.15.27:0/2617045401 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4a40b2bd0 0x7ff4a40b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:07.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.915+0000 7ff4aa057640 1 --2- 172.21.15.27:0/2617045401 >> v2:172.21.15.93:3300/0 conn(0x7ff4a406e2a0 0x7ff4a40b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:07.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.915+0000 7ff4a9856640 1 -- 172.21.15.27:0/2617045401 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4a40b2bd0 msgr2=0x7ff4a40b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:07.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.915+0000 7ff4a9856640 1 --2- 172.21.15.27:0/2617045401 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4a40b2bd0 0x7ff4a40b3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.915+0000 7ff4a9856640 1 -- 172.21.15.27:0/2617045401 >> v2:172.21.15.93:3300/0 conn(0x7ff4a406e2a0 msgr2=0x7ff4a40b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:07.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.915+0000 7ff4a9856640 1 --2- 172.21.15.27:0/2617045401 >> v2:172.21.15.93:3300/0 conn(0x7ff4a406e2a0 0x7ff4a40b5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.915+0000 7ff4a9856640 1 -- 172.21.15.27:0/2617045401 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a40b4470 con 0x7ff4a406e680 2024-01-15T11:34:07.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.915+0000 7ff4aa858640 1 --2- 172.21.15.27:0/2617045401 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4a40b2bd0 0x7ff4a40b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:34:07.918 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.915+0000 7ff4aa057640 1 --2- 172.21.15.27:0/2617045401 >> v2:172.21.15.93:3300/0 conn(0x7ff4a406e2a0 0x7ff4a40b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:34:07.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.919+0000 7ff4a9856640 1 --2- 172.21.15.27:0/2617045401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4a406e680 0x7ff4a40cf1b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff4a40b2960 tx=0x7ff49401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f9619e6b0db0ee server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:07.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.919+0000 7ff4a9055640 1 -- 172.21.15.27:0/2617045401 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4940ac620 con 0x7ff4a406e680 2024-01-15T11:34:07.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.919+0000 7ff4a9055640 1 -- 172.21.15.27:0/2617045401 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4940ac780 con 0x7ff4a406e680 2024-01-15T11:34:07.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.919+0000 7ff4a9055640 1 -- 172.21.15.27:0/2617045401 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4940acb10 con 0x7ff4a406e680 2024-01-15T11:34:07.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.919+0000 7ff4ac2bb640 1 -- 172.21.15.27:0/2617045401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4a406e680 msgr2=0x7ff4a40cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:07.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.919+0000 7ff4ac2bb640 1 --2- 172.21.15.27:0/2617045401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4a406e680 0x7ff4a40cf1b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff4a40b2960 tx=0x7ff49401c440 comp rx=0 tx=0).stop 2024-01-15T11:34:07.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.919+0000 7ff4ac2bb640 1 -- 172.21.15.27:0/2617045401 shutdown_connections 2024-01-15T11:34:07.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.919+0000 7ff4ac2bb640 1 --2- 172.21.15.27:0/2617045401 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4a40b2bd0 0x7ff4a40b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.919+0000 7ff4ac2bb640 1 --2- 172.21.15.27:0/2617045401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4a406e680 0x7ff4a40cf1b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.919+0000 7ff4ac2bb640 1 --2- 172.21.15.27:0/2617045401 >> v2:172.21.15.93:3300/0 conn(0x7ff4a406e2a0 0x7ff4a40b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.919+0000 7ff4ac2bb640 1 -- 172.21.15.27:0/2617045401 >> 172.21.15.27:0/2617045401 conn(0x7ff4a4071d80 msgr2=0x7ff4a406a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:07.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.919+0000 7ff4ac2bb640 1 -- 172.21.15.27:0/2617045401 shutdown_connections 2024-01-15T11:34:07.922 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.919+0000 7ff4ac2bb640 1 -- 172.21.15.27:0/2617045401 wait complete. 2024-01-15T11:34:07.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.919+0000 7ff4ac2bb640 1 Processor -- start 2024-01-15T11:34:07.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.919+0000 7ff4ac2bb640 1 -- start start 2024-01-15T11:34:07.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.923+0000 7ff4ac2bb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4a406e2a0 0x7ff4a4155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:07.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.923+0000 7ff4ac2bb640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4a406e680 0x7ff4a4144200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:07.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.923+0000 7ff4ac2bb640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4a40b2bd0 0x7ff4a4149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:07.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.923+0000 7ff4ac2bb640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a4156930 con 0x7ff4a406e2a0 2024-01-15T11:34:07.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.923+0000 7ff4ac2bb640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a414a330 con 0x7ff4a40b2bd0 2024-01-15T11:34:07.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.923+0000 7ff4ac2bb640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a4155cb0 con 0x7ff4a406e680 2024-01-15T11:34:07.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.923+0000 7ff4aa057640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4a406e2a0 0x7ff4a4155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:07.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.923+0000 7ff4aa057640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4a406e2a0 0x7ff4a4155680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38882/0 (socket says 172.21.15.27:38882) 2024-01-15T11:34:07.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.923+0000 7ff4aa057640 1 -- 172.21.15.27:0/1955121285 learned_addr learned my addr 172.21.15.27:0/1955121285 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:07.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.923+0000 7ff4a9856640 1 --2- 172.21.15.27:0/1955121285 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4a406e680 0x7ff4a4144200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:07.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.923+0000 7ff4aa858640 1 --2- 172.21.15.27:0/1955121285 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4a40b2bd0 0x7ff4a4149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:07.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.923+0000 7ff4aa057640 1 -- 172.21.15.27:0/1955121285 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4a406e680 msgr2=0x7ff4a4144200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:07.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.923+0000 7ff4aa057640 1 --2- 172.21.15.27:0/1955121285 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4a406e680 0x7ff4a4144200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.923+0000 7ff4aa057640 1 -- 172.21.15.27:0/1955121285 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4a40b2bd0 msgr2=0x7ff4a4149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:07.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.923+0000 7ff4aa057640 1 --2- 172.21.15.27:0/1955121285 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4a40b2bd0 0x7ff4a4149df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:07.926 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.923+0000 7ff4aa057640 1 -- 172.21.15.27:0/1955121285 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4940094d0 con 0x7ff4a406e2a0 2024-01-15T11:34:07.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.923+0000 7ff4aa858640 1 --2- 172.21.15.27:0/1955121285 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4a40b2bd0 0x7ff4a4149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:34:07.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.923+0000 7ff4aa057640 1 --2- 172.21.15.27:0/1955121285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4a406e2a0 0x7ff4a4155680 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff4a000c7f0 tx=0x7ff4a000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:07.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.923+0000 7ff49affd640 1 -- 172.21.15.27:0/1955121285 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a0007820 con 0x7ff4a406e2a0 2024-01-15T11:34:07.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.923+0000 7ff49affd640 1 -- 172.21.15.27:0/1955121285 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a0007980 con 0x7ff4a406e2a0 2024-01-15T11:34:07.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.923+0000 7ff4ac2bb640 1 -- 172.21.15.27:0/1955121285 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a4155f90 con 0x7ff4a406e2a0 2024-01-15T11:34:07.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.923+0000 7ff49affd640 1 -- 172.21.15.27:0/1955121285 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a0007d30 con 0x7ff4a406e2a0 2024-01-15T11:34:07.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.923+0000 7ff4ac2bb640 1 -- 172.21.15.27:0/1955121285 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a4156550 con 0x7ff4a406e2a0 2024-01-15T11:34:07.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.923+0000 7ff4ac2bb640 1 -- 172.21.15.27:0/1955121285 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a404e850 con 0x7ff4a406e2a0 2024-01-15T11:34:07.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.923+0000 7ff49affd640 1 -- 172.21.15.27:0/1955121285 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7ff4a00113f0 con 0x7ff4a406e2a0 2024-01-15T11:34:07.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.927+0000 7ff49affd640 1 --2- 172.21.15.27:0/1955121285 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff488066920 0x7ff488068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:07.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.927+0000 7ff49affd640 1 -- 172.21.15.27:0/1955121285 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff4a00844b0 con 0x7ff4a406e2a0 2024-01-15T11:34:07.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.927+0000 7ff4a9856640 1 --2- 172.21.15.27:0/1955121285 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff488066920 0x7ff488068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:07.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.927+0000 7ff4a9856640 1 --2- 172.21.15.27:0/1955121285 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff488066920 0x7ff488068de0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff4940ae000 tx=0x7ff494008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:07.932 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:07.927+0000 7ff49affd640 1 -- 172.21.15.27:0/1955121285 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff4a0051910 con 0x7ff4a406e2a0 2024-01-15T11:34:08.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.139+0000 7ff4ac2bb640 1 -- 172.21.15.27:0/1955121285 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7ff4a41589c0 con 0x7ff4a406e2a0 2024-01-15T11:34:08.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.143+0000 7ff49affd640 1 -- 172.21.15.27:0/1955121285 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff4a001f0a0 con 0x7ff4a406e2a0 2024-01-15T11:34:08.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.143+0000 7ff4ac2bb640 1 -- 172.21.15.27:0/1955121285 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff488066920 msgr2=0x7ff488068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:08.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.143+0000 7ff4ac2bb640 1 --2- 172.21.15.27:0/1955121285 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff488066920 0x7ff488068de0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff4940ae000 tx=0x7ff494008040 comp rx=0 tx=0).stop 2024-01-15T11:34:08.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.143+0000 7ff4ac2bb640 1 -- 172.21.15.27:0/1955121285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4a406e2a0 msgr2=0x7ff4a4155680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:08.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.143+0000 7ff4ac2bb640 1 --2- 172.21.15.27:0/1955121285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4a406e2a0 0x7ff4a4155680 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff4a000c7f0 tx=0x7ff4a000ccb0 comp rx=0 tx=0).stop 2024-01-15T11:34:08.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.143+0000 7ff4ac2bb640 1 -- 172.21.15.27:0/1955121285 shutdown_connections 2024-01-15T11:34:08.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.143+0000 7ff4ac2bb640 1 --2- 172.21.15.27:0/1955121285 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff488066920 0x7ff488068de0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:08.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.143+0000 7ff4ac2bb640 1 --2- 172.21.15.27:0/1955121285 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4a40b2bd0 0x7ff4a4149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:08.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.143+0000 7ff4ac2bb640 1 --2- 172.21.15.27:0/1955121285 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4a406e680 0x7ff4a4144200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:08.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.143+0000 7ff4ac2bb640 1 --2- 172.21.15.27:0/1955121285 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff4a406e2a0 0x7ff4a4155680 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:08.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.143+0000 7ff4ac2bb640 1 -- 172.21.15.27:0/1955121285 >> 172.21.15.27:0/1955121285 conn(0x7ff4a4071d80 msgr2=0x7ff4a40ce6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:08.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.143+0000 7ff4ac2bb640 1 -- 172.21.15.27:0/1955121285 shutdown_connections 2024-01-15T11:34:08.148 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.143+0000 7ff4ac2bb640 1 -- 172.21.15.27:0/1955121285 wait complete. 2024-01-15T11:34:08.167 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-01-15T11:34:08.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.307+0000 7f1c4769a640 1 Processor -- start 2024-01-15T11:34:08.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.307+0000 7f1c4769a640 1 -- start start 2024-01-15T11:34:08.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.311+0000 7f1c4769a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1c40154940 0x7f1c4006da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:08.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.311+0000 7f1c4769a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c4015e6a0 0x7f1c400ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:08.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.311+0000 7f1c4769a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c400cd870 con 0x7f1c4006df50 2024-01-15T11:34:08.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.311+0000 7f1c4769a640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c40154d20 con 0x7f1c40154940 2024-01-15T11:34:08.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.311+0000 7f1c4769a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4015ecc0 con 0x7f1c4015e6a0 2024-01-15T11:34:08.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.311+0000 7f1c45c37640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c4015e6a0 0x7f1c400ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:08.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.311+0000 7f1c45436640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1c40154940 0x7f1c4006da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:08.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.311+0000 7f1c44c35640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f1c4006df50 0x7f1c4015df90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.27:55428/0 (socket says 172.21.15.27:55428) 2024-01-15T11:34:08.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.311+0000 7f1c44c35640 1 -- 172.21.15.27:0/2279083140 learned_addr learned my addr 172.21.15.27:0/2279083140 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:08.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.311+0000 7f1c45436640 1 -- 172.21.15.27:0/2279083140 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c4015e6a0 msgr2=0x7f1c400ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:08.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.311+0000 7f1c45436640 1 --2- 172.21.15.27:0/2279083140 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c4015e6a0 0x7f1c400ad080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:08.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.311+0000 7f1c45436640 1 -- 172.21.15.27:0/2279083140 >> v1:172.21.15.93:6789/0 conn(0x7f1c4006df50 legacy=0x7f1c4015df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:08.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.311+0000 7f1c45436640 1 -- 172.21.15.27:0/2279083140 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c400ccf40 con 0x7f1c40154940 2024-01-15T11:34:08.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.311+0000 7f1c37fff640 1 -- 172.21.15.27:0/2279083140 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587707063 0 0) 0x7f1c400cd870 con 0x7f1c4006df50 2024-01-15T11:34:08.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.311+0000 7f1c45c37640 1 --2- 172.21.15.27:0/2279083140 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c4015e6a0 0x7f1c400ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:34:08.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.315+0000 7f1c45436640 1 --2- 172.21.15.27:0/2279083140 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c40154940 0x7f1c4006da10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0097c0 tx=0x7f1c3c01c270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dab614506512f80 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:08.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.315+0000 7f1c37fff640 1 -- 172.21.15.27:0/2279083140 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c0ab600 con 0x7f1c40154940 2024-01-15T11:34:08.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.315+0000 7f1c37fff640 1 -- 172.21.15.27:0/2279083140 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3c0a7050 con 0x7f1c40154940 2024-01-15T11:34:08.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.315+0000 7f1c37fff640 1 -- 172.21.15.27:0/2279083140 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c0ab980 con 0x7f1c40154940 2024-01-15T11:34:08.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.315+0000 7f1c4769a640 1 -- 172.21.15.27:0/2279083140 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c40154940 msgr2=0x7f1c4006da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:08.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.315+0000 7f1c4769a640 1 --2- 172.21.15.27:0/2279083140 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c40154940 0x7f1c4006da10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0097c0 tx=0x7f1c3c01c270 comp rx=0 tx=0).stop 2024-01-15T11:34:08.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.315+0000 7f1c4769a640 1 -- 172.21.15.27:0/2279083140 shutdown_connections 2024-01-15T11:34:08.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.315+0000 7f1c4769a640 1 --2- 172.21.15.27:0/2279083140 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c4015e6a0 0x7f1c400ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:08.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.315+0000 7f1c4769a640 1 --2- 172.21.15.27:0/2279083140 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c40154940 0x7f1c4006da10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:08.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.315+0000 7f1c4769a640 1 -- 172.21.15.27:0/2279083140 >> 172.21.15.27:0/2279083140 conn(0x7f1c400b0cb0 msgr2=0x7f1c400b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:08.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.315+0000 7f1c4769a640 1 -- 172.21.15.27:0/2279083140 shutdown_connections 2024-01-15T11:34:08.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.315+0000 7f1c4769a640 1 -- 172.21.15.27:0/2279083140 wait complete. 2024-01-15T11:34:08.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.315+0000 7f1c4769a640 1 Processor -- start 2024-01-15T11:34:08.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.315+0000 7f1c4769a640 1 -- start start 2024-01-15T11:34:08.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.319+0000 7f1c4769a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c4006df50 0x7f1c4013b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:08.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.319+0000 7f1c4769a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c40154940 0x7f1c40071580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:08.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.319+0000 7f1c4769a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c4015e6a0 0x7f1c401509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:08.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.319+0000 7f1c4769a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c40155670 con 0x7f1c4006df50 2024-01-15T11:34:08.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.319+0000 7f1c4769a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c40071e40 con 0x7f1c4015e6a0 2024-01-15T11:34:08.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.319+0000 7f1c4769a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c40155880 con 0x7f1c40154940 2024-01-15T11:34:08.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.319+0000 7f1c45436640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c4006df50 0x7f1c4013b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:08.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.319+0000 7f1c45436640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c4006df50 0x7f1c4013b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38892/0 (socket says 172.21.15.27:38892) 2024-01-15T11:34:08.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.319+0000 7f1c45436640 1 -- 172.21.15.27:0/5969428 learned_addr learned my addr 172.21.15.27:0/5969428 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:08.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.319+0000 7f1c44c35640 1 --2- 172.21.15.27:0/5969428 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c40154940 0x7f1c40071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:08.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.319+0000 7f1c45c37640 1 --2- 172.21.15.27:0/5969428 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c4015e6a0 0x7f1c401509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:08.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.319+0000 7f1c45436640 1 -- 172.21.15.27:0/5969428 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c40154940 msgr2=0x7f1c40071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:08.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.319+0000 7f1c45436640 1 --2- 172.21.15.27:0/5969428 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c40154940 0x7f1c40071580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:08.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.319+0000 7f1c45436640 1 -- 172.21.15.27:0/5969428 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c4015e6a0 msgr2=0x7f1c401509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:08.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.319+0000 7f1c45436640 1 --2- 172.21.15.27:0/5969428 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c4015e6a0 0x7f1c401509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:08.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.319+0000 7f1c45436640 1 -- 172.21.15.27:0/5969428 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c38009a70 con 0x7f1c4006df50 2024-01-15T11:34:08.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.319+0000 7f1c45436640 1 --2- 172.21.15.27:0/5969428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c4006df50 0x7f1c4013b7d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c019ea0 tx=0x7f1c3c01aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:08.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.319+0000 7f1c35ffb640 1 -- 172.21.15.27:0/5969428 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c006e20 con 0x7f1c4006df50 2024-01-15T11:34:08.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.319+0000 7f1c35ffb640 1 -- 172.21.15.27:0/5969428 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3c0b7450 con 0x7f1c4006df50 2024-01-15T11:34:08.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.319+0000 7f1c4769a640 1 -- 172.21.15.27:0/5969428 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c3c009420 con 0x7f1c4006df50 2024-01-15T11:34:08.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.319+0000 7f1c35ffb640 1 -- 172.21.15.27:0/5969428 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c0b7800 con 0x7f1c4006df50 2024-01-15T11:34:08.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.319+0000 7f1c4769a640 1 -- 172.21.15.27:0/5969428 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c40155e40 con 0x7f1c4006df50 2024-01-15T11:34:08.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.319+0000 7f1c4769a640 1 -- 172.21.15.27:0/5969428 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c400671f0 con 0x7f1c4006df50 2024-01-15T11:34:08.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.319+0000 7f1c35ffb640 1 -- 172.21.15.27:0/5969428 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f1c3c0b7960 con 0x7f1c4006df50 2024-01-15T11:34:08.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.323+0000 7f1c35ffb640 1 --2- 172.21.15.27:0/5969428 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1c240668f0 0x7f1c24068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:08.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.323+0000 7f1c35ffb640 1 -- 172.21.15.27:0/5969428 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1c3c11e870 con 0x7f1c4006df50 2024-01-15T11:34:08.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.323+0000 7f1c44c35640 1 --2- 172.21.15.27:0/5969428 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1c240668f0 0x7f1c24068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:08.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.323+0000 7f1c44c35640 1 --2- 172.21.15.27:0/5969428 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1c240668f0 0x7f1c24068db0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1c40072380 tx=0x7f1c30007d60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:08.328 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.327+0000 7f1c35ffb640 1 -- 172.21.15.27:0/5969428 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1c3c0ebce0 con 0x7f1c4006df50 2024-01-15T11:34:08.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.543+0000 7f1c4769a640 1 -- 172.21.15.27:0/5969428 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f1c4006e350 con 0x7f1c4006df50 2024-01-15T11:34:08.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.543+0000 7f1c35ffb640 1 -- 172.21.15.27:0/5969428 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1c3c0ef300 con 0x7f1c4006df50 2024-01-15T11:34:08.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.547+0000 7f1c4769a640 1 -- 172.21.15.27:0/5969428 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1c240668f0 msgr2=0x7f1c24068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:08.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.547+0000 7f1c4769a640 1 --2- 172.21.15.27:0/5969428 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1c240668f0 0x7f1c24068db0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1c40072380 tx=0x7f1c30007d60 comp rx=0 tx=0).stop 2024-01-15T11:34:08.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.547+0000 7f1c4769a640 1 -- 172.21.15.27:0/5969428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c4006df50 msgr2=0x7f1c4013b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:08.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.547+0000 7f1c4769a640 1 --2- 172.21.15.27:0/5969428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c4006df50 0x7f1c4013b7d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c019ea0 tx=0x7f1c3c01aab0 comp rx=0 tx=0).stop 2024-01-15T11:34:08.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.547+0000 7f1c4769a640 1 -- 172.21.15.27:0/5969428 shutdown_connections 2024-01-15T11:34:08.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.547+0000 7f1c4769a640 1 --2- 172.21.15.27:0/5969428 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f1c240668f0 0x7f1c24068db0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:08.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.547+0000 7f1c4769a640 1 --2- 172.21.15.27:0/5969428 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c4015e6a0 0x7f1c401509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:08.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.547+0000 7f1c4769a640 1 --2- 172.21.15.27:0/5969428 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c40154940 0x7f1c40071580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:08.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.547+0000 7f1c4769a640 1 --2- 172.21.15.27:0/5969428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c4006df50 0x7f1c4013b7d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:08.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.547+0000 7f1c4769a640 1 -- 172.21.15.27:0/5969428 >> 172.21.15.27:0/5969428 conn(0x7f1c400b0cb0 msgr2=0x7f1c400aca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:08.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.547+0000 7f1c4769a640 1 -- 172.21.15.27:0/5969428 shutdown_connections 2024-01-15T11:34:08.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.547+0000 7f1c4769a640 1 -- 172.21.15.27:0/5969428 wait complete. 2024-01-15T11:34:08.569 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-01-15T11:34:08.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.711+0000 7fcdb6b2b640 1 Processor -- start 2024-01-15T11:34:08.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.711+0000 7fcdb6b2b640 1 -- start start 2024-01-15T11:34:08.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.711+0000 7fcdb6b2b640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcdb00b4c40 0x7fcdb00b5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:08.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.711+0000 7fcdb6b2b640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb00b55d0 con 0x7fcdb00d10e0 2024-01-15T11:34:08.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.711+0000 7fcdb6b2b640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb00b6250 con 0x7fcdb015d2a0 2024-01-15T11:34:08.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.711+0000 7fcdb6b2b640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb00ce8c0 con 0x7fcdb00b4c40 2024-01-15T11:34:08.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.711+0000 7fcdb5328640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fcdb00b4c40 0x7fcdb00b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:08.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.711+0000 7fcdb632a640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fcdb00d10e0 0x7fcdb00d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45938/0 (socket says 172.21.15.27:45938) 2024-01-15T11:34:08.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.711+0000 7fcdb632a640 1 -- 172.21.15.27:0/4290385263 learned_addr learned my addr 172.21.15.27:0/4290385263 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:08.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.711+0000 7fcdb5328640 1 -- 172.21.15.27:0/4290385263 >> v1:172.21.15.93:6789/0 conn(0x7fcdb015d2a0 legacy=0x7fcdb00d26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:08.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.711+0000 7fcdb5328640 1 -- 172.21.15.27:0/4290385263 >> v1:172.21.15.27:6789/0 conn(0x7fcdb00d10e0 legacy=0x7fcdb00d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:08.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.711+0000 7fcdb5328640 1 -- 172.21.15.27:0/4290385263 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb0161cf0 con 0x7fcdb00b4c40 2024-01-15T11:34:08.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.715+0000 7fcdb5328640 1 --2- 172.21.15.27:0/4290385263 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdb00b4c40 0x7fcdb00b5090 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcda00097c0 tx=0x7fcda001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee26bf74ab2fbb98 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:08.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.715+0000 7fcdb4b27640 1 -- 172.21.15.27:0/4290385263 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda00ac620 con 0x7fcdb00b4c40 2024-01-15T11:34:08.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.715+0000 7fcdb4b27640 1 -- 172.21.15.27:0/4290385263 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda00ac780 con 0x7fcdb00b4c40 2024-01-15T11:34:08.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.715+0000 7fcdb4b27640 1 -- 172.21.15.27:0/4290385263 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda00acb10 con 0x7fcdb00b4c40 2024-01-15T11:34:08.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.715+0000 7fcdb6b2b640 1 -- 172.21.15.27:0/4290385263 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdb00b4c40 msgr2=0x7fcdb00b5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:08.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.715+0000 7fcdb6b2b640 1 --2- 172.21.15.27:0/4290385263 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdb00b4c40 0x7fcdb00b5090 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcda00097c0 tx=0x7fcda001c3c0 comp rx=0 tx=0).stop 2024-01-15T11:34:08.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.715+0000 7fcdb6b2b640 1 -- 172.21.15.27:0/4290385263 shutdown_connections 2024-01-15T11:34:08.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.715+0000 7fcdb6b2b640 1 --2- 172.21.15.27:0/4290385263 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdb00b4c40 0x7fcdb00b5090 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:08.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.715+0000 7fcdb6b2b640 1 -- 172.21.15.27:0/4290385263 >> 172.21.15.27:0/4290385263 conn(0x7fcdb00668a0 msgr2=0x7fcdb00cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:08.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.715+0000 7fcdb6b2b640 1 -- 172.21.15.27:0/4290385263 shutdown_connections 2024-01-15T11:34:08.719 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.715+0000 7fcdb6b2b640 1 -- 172.21.15.27:0/4290385263 wait complete. 2024-01-15T11:34:08.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.715+0000 7fcdb6b2b640 1 Processor -- start 2024-01-15T11:34:08.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcdb6b2b640 1 -- start start 2024-01-15T11:34:08.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcdb6b2b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdb00b4c40 0x7fcdb0159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:08.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcdb6b2b640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcdb00d10e0 0x7fcdb00cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:08.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcdb6b2b640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcdb015d2a0 0x7fcdb0152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:08.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcdb6b2b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb00cc2a0 con 0x7fcdb00b4c40 2024-01-15T11:34:08.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcdb6b2b640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb015aa10 con 0x7fcdb015d2a0 2024-01-15T11:34:08.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcdb6b2b640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb0159e00 con 0x7fcdb00d10e0 2024-01-15T11:34:08.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcdb5b29640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdb00b4c40 0x7fcdb0159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:08.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcdb5b29640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdb00b4c40 0x7fcdb0159700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38904/0 (socket says 172.21.15.27:38904) 2024-01-15T11:34:08.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcdb5b29640 1 -- 172.21.15.27:0/1933276920 learned_addr learned my addr 172.21.15.27:0/1933276920 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:08.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcdb632a640 1 --2- 172.21.15.27:0/1933276920 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcdb015d2a0 0x7fcdb0152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:08.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcdb5328640 1 --2- 172.21.15.27:0/1933276920 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcdb00d10e0 0x7fcdb00cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:08.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcdb5b29640 1 -- 172.21.15.27:0/1933276920 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcdb00d10e0 msgr2=0x7fcdb00cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:08.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcdb5b29640 1 --2- 172.21.15.27:0/1933276920 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcdb00d10e0 0x7fcdb00cbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:08.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcdb5b29640 1 -- 172.21.15.27:0/1933276920 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcdb015d2a0 msgr2=0x7fcdb0152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:08.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcdb5b29640 1 --2- 172.21.15.27:0/1933276920 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcdb015d2a0 0x7fcdb0152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:08.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcdb5b29640 1 -- 172.21.15.27:0/1933276920 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda0009420 con 0x7fcdb00b4c40 2024-01-15T11:34:08.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcdb5328640 1 --2- 172.21.15.27:0/1933276920 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcdb00d10e0 0x7fcdb00cbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:34:08.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcdb632a640 1 --2- 172.21.15.27:0/1933276920 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcdb015d2a0 0x7fcdb0152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:34:08.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcdb5b29640 1 --2- 172.21.15.27:0/1933276920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdb00b4c40 0x7fcdb0159700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcdac00c530 tx=0x7fcdac00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:08.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcda67fc640 1 -- 172.21.15.27:0/1933276920 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac005220 con 0x7fcdb00b4c40 2024-01-15T11:34:08.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcda67fc640 1 -- 172.21.15.27:0/1933276920 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdac005380 con 0x7fcdb00b4c40 2024-01-15T11:34:08.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcda67fc640 1 -- 172.21.15.27:0/1933276920 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac007270 con 0x7fcdb00b4c40 2024-01-15T11:34:08.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcdb6b2b640 1 -- 172.21.15.27:0/1933276920 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb015a0e0 con 0x7fcdb00b4c40 2024-01-15T11:34:08.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcdb6b2b640 1 -- 172.21.15.27:0/1933276920 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb015a6a0 con 0x7fcdb00b4c40 2024-01-15T11:34:08.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.719+0000 7fcdb6b2b640 1 -- 172.21.15.27:0/1933276920 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb0074990 con 0x7fcdb00b4c40 2024-01-15T11:34:08.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.723+0000 7fcda67fc640 1 -- 172.21.15.27:0/1933276920 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fcdac0073d0 con 0x7fcdb00b4c40 2024-01-15T11:34:08.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.723+0000 7fcda67fc640 1 --2- 172.21.15.27:0/1933276920 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fcd940668f0 0x7fcd94068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:08.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.723+0000 7fcda67fc640 1 -- 172.21.15.27:0/1933276920 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcdac0839e0 con 0x7fcdb00b4c40 2024-01-15T11:34:08.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.723+0000 7fcdb5328640 1 --2- 172.21.15.27:0/1933276920 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fcd940668f0 0x7fcd94068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:08.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.723+0000 7fcdb5328640 1 --2- 172.21.15.27:0/1933276920 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fcd940668f0 0x7fcd94068db0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcda00ae000 tx=0x7fcda0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:08.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.727+0000 7fcda67fc640 1 -- 172.21.15.27:0/1933276920 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcdac050f60 con 0x7fcdb00b4c40 2024-01-15T11:34:08.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.943+0000 7fcdb6b2b640 1 -- 172.21.15.27:0/1933276920 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fcdb00b31a0 con 0x7fcdb00b4c40 2024-01-15T11:34:08.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.947+0000 7fcda67fc640 1 -- 172.21.15.27:0/1933276920 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcdac054580 con 0x7fcdb00b4c40 2024-01-15T11:34:08.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.947+0000 7fcdb6b2b640 1 -- 172.21.15.27:0/1933276920 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fcd940668f0 msgr2=0x7fcd94068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:08.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.947+0000 7fcdb6b2b640 1 --2- 172.21.15.27:0/1933276920 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fcd940668f0 0x7fcd94068db0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcda00ae000 tx=0x7fcda0008040 comp rx=0 tx=0).stop 2024-01-15T11:34:08.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.947+0000 7fcdb6b2b640 1 -- 172.21.15.27:0/1933276920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdb00b4c40 msgr2=0x7fcdb0159700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:08.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.947+0000 7fcdb6b2b640 1 --2- 172.21.15.27:0/1933276920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdb00b4c40 0x7fcdb0159700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcdac00c530 tx=0x7fcdac00c9f0 comp rx=0 tx=0).stop 2024-01-15T11:34:08.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.947+0000 7fcdb6b2b640 1 -- 172.21.15.27:0/1933276920 shutdown_connections 2024-01-15T11:34:08.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.947+0000 7fcdb6b2b640 1 --2- 172.21.15.27:0/1933276920 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fcd940668f0 0x7fcd94068db0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:08.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.947+0000 7fcdb6b2b640 1 --2- 172.21.15.27:0/1933276920 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcdb015d2a0 0x7fcdb0152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:08.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.947+0000 7fcdb6b2b640 1 --2- 172.21.15.27:0/1933276920 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcdb00d10e0 0x7fcdb00cbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:08.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.947+0000 7fcdb6b2b640 1 --2- 172.21.15.27:0/1933276920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcdb00b4c40 0x7fcdb0159700 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:08.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.947+0000 7fcdb6b2b640 1 -- 172.21.15.27:0/1933276920 >> 172.21.15.27:0/1933276920 conn(0x7fcdb00668a0 msgr2=0x7fcdb00b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:08.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.947+0000 7fcdb6b2b640 1 -- 172.21.15.27:0/1933276920 shutdown_connections 2024-01-15T11:34:08.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:08.947+0000 7fcdb6b2b640 1 -- 172.21.15.27:0/1933276920 wait complete. 2024-01-15T11:34:08.971 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:34:09.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.111+0000 7f25be580640 1 Processor -- start 2024-01-15T11:34:09.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.111+0000 7f25be580640 1 -- start start 2024-01-15T11:34:09.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.115+0000 7f25be580640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f25b815d7b0 0x7f25b80d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:09.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.115+0000 7f25be580640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b80cefd0 con 0x7f25b80d2080 2024-01-15T11:34:09.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.115+0000 7f25be580640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b80cf2b0 con 0x7f25b80cead0 2024-01-15T11:34:09.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.115+0000 7f25be580640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b806b3f0 con 0x7f25b815d7b0 2024-01-15T11:34:09.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.115+0000 7f25bcb1d640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f25b80d2080 0x7f25b806bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45950/0 (socket says 172.21.15.27:45950) 2024-01-15T11:34:09.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.115+0000 7f25bcb1d640 1 -- 172.21.15.27:0/925908833 learned_addr learned my addr 172.21.15.27:0/925908833 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:09.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.115+0000 7f25b7fff640 1 --2- 172.21.15.27:0/925908833 >> v2:172.21.15.93:3300/0 conn(0x7f25b815d7b0 0x7f25b80d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:09.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.115+0000 7f25b6ffd640 1 -- 172.21.15.27:0/925908833 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019837062 0 0) 0x7f25b80cefd0 con 0x7f25b80d2080 2024-01-15T11:34:09.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.115+0000 7f25b6ffd640 1 -- 172.21.15.27:0/925908833 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25a0003530 con 0x7f25b80d2080 2024-01-15T11:34:09.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.115+0000 7f25b7fff640 1 -- 172.21.15.27:0/925908833 >> v1:172.21.15.93:6789/0 conn(0x7f25b80cead0 legacy=0x7f25b80d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:09.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.115+0000 7f25b7fff640 1 -- 172.21.15.27:0/925908833 >> v1:172.21.15.27:6789/0 conn(0x7f25b80d2080 legacy=0x7f25b806bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:09.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.115+0000 7f25b7fff640 1 -- 172.21.15.27:0/925908833 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b806b6d0 con 0x7f25b815d7b0 2024-01-15T11:34:09.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.119+0000 7f25b7fff640 1 --2- 172.21.15.27:0/925908833 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25b815d7b0 0x7f25b80d10d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f25a80097c0 tx=0x7f25a801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c78cae2eabcf821e server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:09.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.119+0000 7f25b6ffd640 1 -- 172.21.15.27:0/925908833 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a8004230 con 0x7f25b815d7b0 2024-01-15T11:34:09.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.119+0000 7f25b6ffd640 1 -- 172.21.15.27:0/925908833 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a80a7050 con 0x7f25b815d7b0 2024-01-15T11:34:09.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.119+0000 7f25b6ffd640 1 -- 172.21.15.27:0/925908833 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a8003620 con 0x7f25b815d7b0 2024-01-15T11:34:09.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.119+0000 7f25be580640 1 -- 172.21.15.27:0/925908833 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25b815d7b0 msgr2=0x7f25b80d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:09.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.119+0000 7f25be580640 1 --2- 172.21.15.27:0/925908833 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25b815d7b0 0x7f25b80d10d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f25a80097c0 tx=0x7f25a801c330 comp rx=0 tx=0).stop 2024-01-15T11:34:09.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.119+0000 7f25be580640 1 -- 172.21.15.27:0/925908833 shutdown_connections 2024-01-15T11:34:09.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.119+0000 7f25be580640 1 --2- 172.21.15.27:0/925908833 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25b815d7b0 0x7f25b80d10d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.119+0000 7f25be580640 1 -- 172.21.15.27:0/925908833 >> 172.21.15.27:0/925908833 conn(0x7f25b80d33b0 msgr2=0x7f25b80d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:09.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.119+0000 7f25be580640 1 -- 172.21.15.27:0/925908833 shutdown_connections 2024-01-15T11:34:09.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.119+0000 7f25be580640 1 -- 172.21.15.27:0/925908833 wait complete. 2024-01-15T11:34:09.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.119+0000 7f25be580640 1 Processor -- start 2024-01-15T11:34:09.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.119+0000 7f25be580640 1 -- start start 2024-01-15T11:34:09.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.119+0000 7f25be580640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25b80cead0 0x7f25b80b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:09.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.119+0000 7f25be580640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25b80d2080 0x7f25b81518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:09.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.123+0000 7f25be580640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25b815d7b0 0x7f25b8151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:09.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.123+0000 7f25be580640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b80c7c70 con 0x7f25b80d2080 2024-01-15T11:34:09.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.123+0000 7f25be580640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b8152360 con 0x7f25b815d7b0 2024-01-15T11:34:09.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.123+0000 7f25be580640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b80c6ff0 con 0x7f25b80cead0 2024-01-15T11:34:09.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.123+0000 7f25b77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25b80d2080 0x7f25b81518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:09.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.123+0000 7f25b77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25b80d2080 0x7f25b81518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38918/0 (socket says 172.21.15.27:38918) 2024-01-15T11:34:09.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.123+0000 7f25b77fe640 1 -- 172.21.15.27:0/3898490820 learned_addr learned my addr 172.21.15.27:0/3898490820 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:09.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.123+0000 7f25bcb1d640 1 --2- 172.21.15.27:0/3898490820 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25b815d7b0 0x7f25b8151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:09.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.123+0000 7f25b7fff640 1 --2- 172.21.15.27:0/3898490820 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25b80cead0 0x7f25b80b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:09.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.123+0000 7f25b77fe640 1 -- 172.21.15.27:0/3898490820 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25b80cead0 msgr2=0x7f25b80b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:09.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.123+0000 7f25b77fe640 1 --2- 172.21.15.27:0/3898490820 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25b80cead0 0x7f25b80b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.123+0000 7f25b77fe640 1 -- 172.21.15.27:0/3898490820 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25b815d7b0 msgr2=0x7f25b8151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:09.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.123+0000 7f25b77fe640 1 --2- 172.21.15.27:0/3898490820 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25b815d7b0 0x7f25b8151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.123+0000 7f25b77fe640 1 -- 172.21.15.27:0/3898490820 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a8009420 con 0x7f25b80d2080 2024-01-15T11:34:09.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.123+0000 7f25b77fe640 1 --2- 172.21.15.27:0/3898490820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25b80d2080 0x7f25b81518e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f25ac00c390 tx=0x7f25ac00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:09.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.123+0000 7f25b4ff9640 1 -- 172.21.15.27:0/3898490820 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0052d0 con 0x7f25b80d2080 2024-01-15T11:34:09.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.123+0000 7f25b4ff9640 1 -- 172.21.15.27:0/3898490820 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ac005430 con 0x7f25b80d2080 2024-01-15T11:34:09.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.123+0000 7f25b4ff9640 1 -- 172.21.15.27:0/3898490820 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac003820 con 0x7f25b80d2080 2024-01-15T11:34:09.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.123+0000 7f25be580640 1 -- 172.21.15.27:0/3898490820 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b80c72d0 con 0x7f25b80d2080 2024-01-15T11:34:09.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.123+0000 7f25be580640 1 -- 172.21.15.27:0/3898490820 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b80c7890 con 0x7f25b80d2080 2024-01-15T11:34:09.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.123+0000 7f25be580640 1 -- 172.21.15.27:0/3898490820 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b80c7db0 con 0x7f25b80d2080 2024-01-15T11:34:09.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.123+0000 7f25b4ff9640 1 -- 172.21.15.27:0/3898490820 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f25ac003980 con 0x7f25b80d2080 2024-01-15T11:34:09.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.127+0000 7f25b4ff9640 1 --2- 172.21.15.27:0/3898490820 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f25a40668f0 0x7f25a4068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:09.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.127+0000 7f25b4ff9640 1 -- 172.21.15.27:0/3898490820 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f25ac083680 con 0x7f25b80d2080 2024-01-15T11:34:09.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.127+0000 7f25b7fff640 1 --2- 172.21.15.27:0/3898490820 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f25a40668f0 0x7f25a4068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:09.129 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.127+0000 7f25b7fff640 1 --2- 172.21.15.27:0/3898490820 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f25a40668f0 0x7f25a4068db0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f25a80ad000 tx=0x7f25a80a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:09.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.131+0000 7f25b4ff9640 1 -- 172.21.15.27:0/3898490820 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f25b80c7db0 con 0x7f25b80d2080 2024-01-15T11:34:09.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.287+0000 7f25be580640 1 -- 172.21.15.27:0/3898490820 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25b80c7db0 con 0x7f25b80d2080 2024-01-15T11:34:09.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.291+0000 7f25b4ff9640 1 -- 172.21.15.27:0/3898490820 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+12773 (secure 0 0 0) 0x7f25b80c7db0 con 0x7f25b80d2080 2024-01-15T11:34:09.293 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:34:09.293 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":31,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:34:06.159800+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:34:09.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.291+0000 7f25be580640 1 -- 172.21.15.27:0/3898490820 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f25a40668f0 msgr2=0x7f25a4068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:09.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.291+0000 7f25be580640 1 --2- 172.21.15.27:0/3898490820 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f25a40668f0 0x7f25a4068db0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f25a80ad000 tx=0x7f25a80a6000 comp rx=0 tx=0).stop 2024-01-15T11:34:09.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.291+0000 7f25be580640 1 -- 172.21.15.27:0/3898490820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25b80d2080 msgr2=0x7f25b81518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:09.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.291+0000 7f25be580640 1 --2- 172.21.15.27:0/3898490820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25b80d2080 0x7f25b81518e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f25ac00c390 tx=0x7f25ac00c850 comp rx=0 tx=0).stop 2024-01-15T11:34:09.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.291+0000 7f25be580640 1 -- 172.21.15.27:0/3898490820 shutdown_connections 2024-01-15T11:34:09.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.291+0000 7f25be580640 1 --2- 172.21.15.27:0/3898490820 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f25a40668f0 0x7f25a4068db0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.291+0000 7f25be580640 1 --2- 172.21.15.27:0/3898490820 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25b815d7b0 0x7f25b8151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.291+0000 7f25be580640 1 --2- 172.21.15.27:0/3898490820 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f25b80d2080 0x7f25b81518e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.291+0000 7f25be580640 1 --2- 172.21.15.27:0/3898490820 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25b80cead0 0x7f25b80b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.291+0000 7f25be580640 1 -- 172.21.15.27:0/3898490820 >> 172.21.15.27:0/3898490820 conn(0x7f25b80d33b0 msgr2=0x7f25b8155a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:09.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.291+0000 7f25be580640 1 -- 172.21.15.27:0/3898490820 shutdown_connections 2024-01-15T11:34:09.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.291+0000 7f25be580640 1 -- 172.21.15.27:0/3898490820 wait complete. 2024-01-15T11:34:09.314 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T11:33:08.134662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T11:34:09.315 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T11:34:09.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.459+0000 7fe79e432640 1 Processor -- start 2024-01-15T11:34:09.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.459+0000 7fe79e432640 1 -- start start 2024-01-15T11:34:09.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.459+0000 7fe79e432640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe798159f00 0x7fe7980ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:09.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.459+0000 7fe79e432640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe7980ae680 0x7fe7980cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:09.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.459+0000 7fe79e432640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe798072950 con 0x7fe7980cd920 2024-01-15T11:34:09.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.459+0000 7fe79e432640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79806e2b0 con 0x7fe798159f00 2024-01-15T11:34:09.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.459+0000 7fe79e432640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79806c6f0 con 0x7fe7980ae680 2024-01-15T11:34:09.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.459+0000 7fe7977fe640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe7980ae680 0x7fe7980cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:09.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.459+0000 7fe797fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe798159f00 0x7fe7980ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:09.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.459+0000 7fe79c9cf640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fe7980cd920 0x7fe79815d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.27:55456/0 (socket says 172.21.15.27:55456) 2024-01-15T11:34:09.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.459+0000 7fe797fff640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe798159f00 0x7fe7980ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.27:50522/0 (socket says 172.21.15.27:50522) 2024-01-15T11:34:09.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.459+0000 7fe79c9cf640 1 -- 172.21.15.27:0/1093040393 learned_addr learned my addr 172.21.15.27:0/1093040393 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:09.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.459+0000 7fe7977fe640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe7980ae680 0x7fe7980cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:49198/0 (socket says 172.21.15.27:49198) 2024-01-15T11:34:09.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.459+0000 7fe796ffd640 1 -- 172.21.15.27:0/1093040393 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79547205 0 0) 0x7fe798072950 con 0x7fe7980cd920 2024-01-15T11:34:09.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.459+0000 7fe796ffd640 1 -- 172.21.15.27:0/1093040393 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe780003530 con 0x7fe7980cd920 2024-01-15T11:34:09.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.459+0000 7fe797fff640 1 -- 172.21.15.27:0/1093040393 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe7980ae680 msgr2=0x7fe7980cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:09.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.459+0000 7fe797fff640 1 --2- 172.21.15.27:0/1093040393 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe7980ae680 0x7fe7980cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.459+0000 7fe797fff640 1 -- 172.21.15.27:0/1093040393 >> v1:172.21.15.93:6789/0 conn(0x7fe7980cd920 legacy=0x7fe79815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:09.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.459+0000 7fe797fff640 1 -- 172.21.15.27:0/1093040393 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79806e550 con 0x7fe798159f00 2024-01-15T11:34:09.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.459+0000 7fe7977fe640 1 --2- 172.21.15.27:0/1093040393 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe7980ae680 0x7fe7980cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:34:09.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.463+0000 7fe797fff640 1 --2- 172.21.15.27:0/1093040393 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe798159f00 0x7fe7980ccea0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe78800dbe0 tx=0x7fe788020790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e89ae51a80275cf server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:09.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.463+0000 7fe796ffd640 1 -- 172.21.15.27:0/1093040393 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78800d2d0 con 0x7fe798159f00 2024-01-15T11:34:09.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.463+0000 7fe796ffd640 1 -- 172.21.15.27:0/1093040393 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7880aa4e0 con 0x7fe798159f00 2024-01-15T11:34:09.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.463+0000 7fe796ffd640 1 -- 172.21.15.27:0/1093040393 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7880aa850 con 0x7fe798159f00 2024-01-15T11:34:09.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.463+0000 7fe79e432640 1 -- 172.21.15.27:0/1093040393 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe798159f00 msgr2=0x7fe7980ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:09.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.463+0000 7fe79e432640 1 --2- 172.21.15.27:0/1093040393 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe798159f00 0x7fe7980ccea0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe78800dbe0 tx=0x7fe788020790 comp rx=0 tx=0).stop 2024-01-15T11:34:09.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.463+0000 7fe79e432640 1 -- 172.21.15.27:0/1093040393 shutdown_connections 2024-01-15T11:34:09.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.463+0000 7fe79e432640 1 --2- 172.21.15.27:0/1093040393 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe7980ae680 0x7fe7980cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.463+0000 7fe79e432640 1 --2- 172.21.15.27:0/1093040393 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe798159f00 0x7fe7980ccea0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.463+0000 7fe79e432640 1 -- 172.21.15.27:0/1093040393 >> 172.21.15.27:0/1093040393 conn(0x7fe7980b0cb0 msgr2=0x7fe7980b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:09.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.463+0000 7fe79e432640 1 -- 172.21.15.27:0/1093040393 shutdown_connections 2024-01-15T11:34:09.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.463+0000 7fe79e432640 1 -- 172.21.15.27:0/1093040393 wait complete. 2024-01-15T11:34:09.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.467+0000 7fe79e432640 1 Processor -- start 2024-01-15T11:34:09.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.467+0000 7fe79e432640 1 -- start start 2024-01-15T11:34:09.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.467+0000 7fe79e432640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7980ae680 0x7fe798152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:09.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.467+0000 7fe79e432640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe7980cd920 0x7fe798158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:09.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.467+0000 7fe79e432640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe79809bf30 0x7fe798153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:09.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.467+0000 7fe79e432640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79809c6c0 con 0x7fe7980ae680 2024-01-15T11:34:09.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.467+0000 7fe79e432640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7981f4260 con 0x7fe79809bf30 2024-01-15T11:34:09.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.467+0000 7fe79e432640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7981f4540 con 0x7fe7980cd920 2024-01-15T11:34:09.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.467+0000 7fe797fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7980ae680 0x7fe798152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:09.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.467+0000 7fe797fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7980ae680 0x7fe798152d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38928/0 (socket says 172.21.15.27:38928) 2024-01-15T11:34:09.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.467+0000 7fe797fff640 1 -- 172.21.15.27:0/777213687 learned_addr learned my addr 172.21.15.27:0/777213687 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:09.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.467+0000 7fe7977fe640 1 --2- 172.21.15.27:0/777213687 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe7980cd920 0x7fe798158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:09.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.467+0000 7fe79c9cf640 1 --2- 172.21.15.27:0/777213687 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe79809bf30 0x7fe798153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:09.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.467+0000 7fe7977fe640 1 -- 172.21.15.27:0/777213687 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe79809bf30 msgr2=0x7fe798153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:09.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.467+0000 7fe7977fe640 1 --2- 172.21.15.27:0/777213687 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe79809bf30 0x7fe798153310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.467+0000 7fe7977fe640 1 -- 172.21.15.27:0/777213687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7980ae680 msgr2=0x7fe798152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:09.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.467+0000 7fe7977fe640 1 --2- 172.21.15.27:0/777213687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7980ae680 0x7fe798152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.467+0000 7fe7977fe640 1 -- 172.21.15.27:0/777213687 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c00b520 con 0x7fe7980cd920 2024-01-15T11:34:09.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.467+0000 7fe797fff640 1 --2- 172.21.15.27:0/777213687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7980ae680 0x7fe798152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:34:09.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.467+0000 7fe7977fe640 1 --2- 172.21.15.27:0/777213687 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe7980cd920 0x7fe798158f00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00ddf0 tx=0x7fe78c00c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:09.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.467+0000 7fe794ff9640 1 -- 172.21.15.27:0/777213687 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c004230 con 0x7fe7980cd920 2024-01-15T11:34:09.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.467+0000 7fe794ff9640 1 -- 172.21.15.27:0/777213687 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c004390 con 0x7fe7980cd920 2024-01-15T11:34:09.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.467+0000 7fe794ff9640 1 -- 172.21.15.27:0/777213687 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c003860 con 0x7fe7980cd920 2024-01-15T11:34:09.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.467+0000 7fe79e432640 1 -- 172.21.15.27:0/777213687 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe78800d8c0 con 0x7fe7980cd920 2024-01-15T11:34:09.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.467+0000 7fe79e432640 1 -- 172.21.15.27:0/777213687 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79809c3e0 con 0x7fe7980cd920 2024-01-15T11:34:09.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.471+0000 7fe79e432640 1 -- 172.21.15.27:0/777213687 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7980671f0 con 0x7fe7980cd920 2024-01-15T11:34:09.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.471+0000 7fe794ff9640 1 -- 172.21.15.27:0/777213687 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fe78c0039c0 con 0x7fe7980cd920 2024-01-15T11:34:09.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.471+0000 7fe794ff9640 1 --2- 172.21.15.27:0/777213687 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fe7840668f0 0x7fe784068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:09.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.471+0000 7fe794ff9640 1 -- 172.21.15.27:0/777213687 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe78c084e20 con 0x7fe7980cd920 2024-01-15T11:34:09.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.471+0000 7fe797fff640 1 --2- 172.21.15.27:0/777213687 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fe7840668f0 0x7fe784068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:09.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.471+0000 7fe797fff640 1 --2- 172.21.15.27:0/777213687 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fe7840668f0 0x7fe784068db0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe7981568d0 tx=0x7fe7880ab000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:09.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.475+0000 7fe794ff9640 1 -- 172.21.15.27:0/777213687 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe78c0524d0 con 0x7fe7980cd920 2024-01-15T11:34:09.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.635+0000 7fe79e432640 1 -- 172.21.15.27:0/777213687 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe7981f4a60 con 0x7fe7980cd920 2024-01-15T11:34:09.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.635+0000 7fe794ff9640 1 -- 172.21.15.27:0/777213687 <== mon.2 v2:172.21.15.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe7981f4a60 con 0x7fe7980cd920 2024-01-15T11:34:09.637 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-15T11:34:09.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.635+0000 7fe79e432640 1 -- 172.21.15.27:0/777213687 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fe7840668f0 msgr2=0x7fe784068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:09.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.635+0000 7fe79e432640 1 --2- 172.21.15.27:0/777213687 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fe7840668f0 0x7fe784068db0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe7981568d0 tx=0x7fe7880ab000 comp rx=0 tx=0).stop 2024-01-15T11:34:09.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.635+0000 7fe79e432640 1 -- 172.21.15.27:0/777213687 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe7980cd920 msgr2=0x7fe798158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:09.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.635+0000 7fe79e432640 1 --2- 172.21.15.27:0/777213687 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe7980cd920 0x7fe798158f00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00ddf0 tx=0x7fe78c00c7b0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.635+0000 7fe79e432640 1 -- 172.21.15.27:0/777213687 shutdown_connections 2024-01-15T11:34:09.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.635+0000 7fe79e432640 1 --2- 172.21.15.27:0/777213687 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fe7840668f0 0x7fe784068db0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.635+0000 7fe79e432640 1 --2- 172.21.15.27:0/777213687 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe79809bf30 0x7fe798153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.635+0000 7fe79e432640 1 --2- 172.21.15.27:0/777213687 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe7980cd920 0x7fe798158f00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.635+0000 7fe79e432640 1 --2- 172.21.15.27:0/777213687 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe7980ae680 0x7fe798152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.635+0000 7fe79e432640 1 -- 172.21.15.27:0/777213687 >> 172.21.15.27:0/777213687 conn(0x7fe7980b0cb0 msgr2=0x7fe798070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:09.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.635+0000 7fe79e432640 1 -- 172.21.15.27:0/777213687 shutdown_connections 2024-01-15T11:34:09.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.635+0000 7fe79e432640 1 -- 172.21.15.27:0/777213687 wait complete. 2024-01-15T11:34:09.659 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-15T11:34:09.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.799+0000 7fad63ddf640 1 Processor -- start 2024-01-15T11:34:09.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.799+0000 7fad63ddf640 1 -- start start 2024-01-15T11:34:09.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.799+0000 7fad63ddf640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fad5c159080 0x7fad5c06d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:09.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.799+0000 7fad63ddf640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fad5c15bf80 0x7fad5c071a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:09.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.799+0000 7fad63ddf640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5c071f50 con 0x7fad5c0715b0 2024-01-15T11:34:09.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.799+0000 7fad63ddf640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad5c0af1a0 con 0x7fad5c15bf80 2024-01-15T11:34:09.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.799+0000 7fad63ddf640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c15c450 con 0x7fad5c159080 2024-01-15T11:34:09.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.799+0000 7fad6237c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fad5c15bf80 0x7fad5c071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:09.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.799+0000 7fad61b7b640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fad5c159080 0x7fad5c06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:09.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.799+0000 7fad6137a640 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fad5c0715b0 0x7fad5c15b870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.27:55460/0 (socket says 172.21.15.27:55460) 2024-01-15T11:34:09.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.799+0000 7fad6137a640 1 -- 172.21.15.27:0/3916997558 learned_addr learned my addr 172.21.15.27:0/3916997558 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:09.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.803+0000 7fad60b79640 1 -- 172.21.15.27:0/3916997558 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060203685 0 0) 0x7fad5c071f50 con 0x7fad5c0715b0 2024-01-15T11:34:09.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.803+0000 7fad60b79640 1 -- 172.21.15.27:0/3916997558 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad48003530 con 0x7fad5c0715b0 2024-01-15T11:34:09.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.803+0000 7fad6237c640 1 -- 172.21.15.27:0/3916997558 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fad5c159080 msgr2=0x7fad5c06d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:09.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.803+0000 7fad6237c640 1 --2- 172.21.15.27:0/3916997558 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fad5c159080 0x7fad5c06d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.803+0000 7fad6237c640 1 -- 172.21.15.27:0/3916997558 >> v1:172.21.15.93:6789/0 conn(0x7fad5c0715b0 legacy=0x7fad5c15b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:09.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.803+0000 7fad6237c640 1 -- 172.21.15.27:0/3916997558 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c15c730 con 0x7fad5c15bf80 2024-01-15T11:34:09.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.803+0000 7fad61b7b640 1 --2- 172.21.15.27:0/3916997558 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fad5c159080 0x7fad5c06d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:34:09.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.803+0000 7fad6237c640 1 --2- 172.21.15.27:0/3916997558 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad5c15bf80 0x7fad5c071a10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fad54009d90 tx=0x7fad5401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be0bb270ebb437cb server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:09.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.803+0000 7fad60b79640 1 -- 172.21.15.27:0/3916997558 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad540a59e0 con 0x7fad5c15bf80 2024-01-15T11:34:09.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.803+0000 7fad60b79640 1 -- 172.21.15.27:0/3916997558 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad540a5b40 con 0x7fad5c15bf80 2024-01-15T11:34:09.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.803+0000 7fad60b79640 1 -- 172.21.15.27:0/3916997558 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad540ad440 con 0x7fad5c15bf80 2024-01-15T11:34:09.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.803+0000 7fad63ddf640 1 -- 172.21.15.27:0/3916997558 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad5c15bf80 msgr2=0x7fad5c071a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:09.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.803+0000 7fad63ddf640 1 --2- 172.21.15.27:0/3916997558 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad5c15bf80 0x7fad5c071a10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fad54009d90 tx=0x7fad5401c920 comp rx=0 tx=0).stop 2024-01-15T11:34:09.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.807+0000 7fad63ddf640 1 -- 172.21.15.27:0/3916997558 shutdown_connections 2024-01-15T11:34:09.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.807+0000 7fad63ddf640 1 --2- 172.21.15.27:0/3916997558 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad5c15bf80 0x7fad5c071a10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.807+0000 7fad63ddf640 1 --2- 172.21.15.27:0/3916997558 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fad5c159080 0x7fad5c06d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.807+0000 7fad63ddf640 1 -- 172.21.15.27:0/3916997558 >> 172.21.15.27:0/3916997558 conn(0x7fad5c0b1e40 msgr2=0x7fad5c070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:09.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.807+0000 7fad63ddf640 1 -- 172.21.15.27:0/3916997558 shutdown_connections 2024-01-15T11:34:09.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.807+0000 7fad63ddf640 1 -- 172.21.15.27:0/3916997558 wait complete. 2024-01-15T11:34:09.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.807+0000 7fad63ddf640 1 Processor -- start 2024-01-15T11:34:09.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.807+0000 7fad63ddf640 1 -- start start 2024-01-15T11:34:09.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.807+0000 7fad63ddf640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad5c0715b0 0x7fad5c15af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:09.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.807+0000 7fad63ddf640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fad5c159080 0x7fad5c14ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:09.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.807+0000 7fad63ddf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad5c15bf80 0x7fad5c142770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:09.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.807+0000 7fad63ddf640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c1f90f0 con 0x7fad5c15bf80 2024-01-15T11:34:09.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.807+0000 7fad63ddf640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c0b1280 con 0x7fad5c0715b0 2024-01-15T11:34:09.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.807+0000 7fad63ddf640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c1f9340 con 0x7fad5c159080 2024-01-15T11:34:09.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.807+0000 7fad6237c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad5c15bf80 0x7fad5c142770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:09.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.807+0000 7fad6237c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad5c15bf80 0x7fad5c142770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38940/0 (socket says 172.21.15.27:38940) 2024-01-15T11:34:09.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.807+0000 7fad6237c640 1 -- 172.21.15.27:0/1203688425 learned_addr learned my addr 172.21.15.27:0/1203688425 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:09.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.807+0000 7fad6137a640 1 --2- 172.21.15.27:0/1203688425 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fad5c159080 0x7fad5c14ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:09.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.807+0000 7fad61b7b640 1 --2- 172.21.15.27:0/1203688425 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad5c0715b0 0x7fad5c15af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:09.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.807+0000 7fad6237c640 1 -- 172.21.15.27:0/1203688425 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fad5c159080 msgr2=0x7fad5c14ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:09.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.807+0000 7fad6237c640 1 --2- 172.21.15.27:0/1203688425 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fad5c159080 0x7fad5c14ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.807+0000 7fad6237c640 1 -- 172.21.15.27:0/1203688425 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad5c0715b0 msgr2=0x7fad5c15af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:09.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.807+0000 7fad6237c640 1 --2- 172.21.15.27:0/1203688425 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad5c0715b0 0x7fad5c15af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.807+0000 7fad6237c640 1 -- 172.21.15.27:0/1203688425 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad58009420 con 0x7fad5c15bf80 2024-01-15T11:34:09.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.807+0000 7fad61b7b640 1 --2- 172.21.15.27:0/1203688425 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad5c0715b0 0x7fad5c15af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:34:09.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.811+0000 7fad6237c640 1 --2- 172.21.15.27:0/1203688425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad5c15bf80 0x7fad5c142770 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fad5401a550 tx=0x7fad540196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:09.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.811+0000 7fad527fc640 1 -- 172.21.15.27:0/1203688425 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54004240 con 0x7fad5c15bf80 2024-01-15T11:34:09.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.811+0000 7fad527fc640 1 -- 172.21.15.27:0/1203688425 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad540043a0 con 0x7fad5c15bf80 2024-01-15T11:34:09.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.811+0000 7fad527fc640 1 -- 172.21.15.27:0/1203688425 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54004790 con 0x7fad5c15bf80 2024-01-15T11:34:09.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.811+0000 7fad63ddf640 1 -- 172.21.15.27:0/1203688425 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad54009a70 con 0x7fad5c15bf80 2024-01-15T11:34:09.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.811+0000 7fad63ddf640 1 -- 172.21.15.27:0/1203688425 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5c1f9900 con 0x7fad5c15bf80 2024-01-15T11:34:09.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.811+0000 7fad63ddf640 1 -- 172.21.15.27:0/1203688425 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5c1f9af0 con 0x7fad5c15bf80 2024-01-15T11:34:09.814 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.811+0000 7fad527fc640 1 -- 172.21.15.27:0/1203688425 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fad540b4030 con 0x7fad5c15bf80 2024-01-15T11:34:09.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.811+0000 7fad527fc640 1 --2- 172.21.15.27:0/1203688425 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fad400668f0 0x7fad40068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:09.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.811+0000 7fad527fc640 1 -- 172.21.15.27:0/1203688425 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fad5411f3a0 con 0x7fad5c15bf80 2024-01-15T11:34:09.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.811+0000 7fad61b7b640 1 --2- 172.21.15.27:0/1203688425 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fad400668f0 0x7fad40068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:09.816 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.815+0000 7fad61b7b640 1 --2- 172.21.15.27:0/1203688425 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fad400668f0 0x7fad40068db0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fad58009fd0 tx=0x7fad58009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:09.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.815+0000 7fad527fc640 1 -- 172.21.15.27:0/1203688425 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fad540ecaf0 con 0x7fad5c15bf80 2024-01-15T11:34:09.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.979+0000 7fad63ddf640 1 -- 172.21.15.27:0/1203688425 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fad5c04e850 con 0x7fad5c15bf80 2024-01-15T11:34:09.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.979+0000 7fad527fc640 1 -- 172.21.15.27:0/1203688425 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+65 (secure 0 0 0) 0x7fad540f0110 con 0x7fad5c15bf80 2024-01-15T11:34:09.982 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:34:09.982 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2024-01-15T11:34:09.982 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:09.982 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 1, 2024-01-15T11:34:09.982 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": ".mgr" 2024-01-15T11:34:09.982 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:09.982 INFO:teuthology.orchestra.run.smithi027.stdout:] 2024-01-15T11:34:09.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.979+0000 7fad63ddf640 1 -- 172.21.15.27:0/1203688425 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fad400668f0 msgr2=0x7fad40068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:09.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.979+0000 7fad63ddf640 1 --2- 172.21.15.27:0/1203688425 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fad400668f0 0x7fad40068db0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fad58009fd0 tx=0x7fad58009190 comp rx=0 tx=0).stop 2024-01-15T11:34:09.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.979+0000 7fad63ddf640 1 -- 172.21.15.27:0/1203688425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad5c15bf80 msgr2=0x7fad5c142770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:09.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.979+0000 7fad63ddf640 1 --2- 172.21.15.27:0/1203688425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad5c15bf80 0x7fad5c142770 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fad5401a550 tx=0x7fad540196c0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.979+0000 7fad63ddf640 1 -- 172.21.15.27:0/1203688425 shutdown_connections 2024-01-15T11:34:09.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.979+0000 7fad63ddf640 1 --2- 172.21.15.27:0/1203688425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fad5c15bf80 0x7fad5c142770 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.979+0000 7fad63ddf640 1 --2- 172.21.15.27:0/1203688425 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fad5c159080 0x7fad5c14ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.979+0000 7fad63ddf640 1 --2- 172.21.15.27:0/1203688425 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fad400668f0 0x7fad40068db0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.979+0000 7fad63ddf640 1 --2- 172.21.15.27:0/1203688425 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad5c0715b0 0x7fad5c15af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:09.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.979+0000 7fad63ddf640 1 -- 172.21.15.27:0/1203688425 >> 172.21.15.27:0/1203688425 conn(0x7fad5c0b1e40 msgr2=0x7fad5c15e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:09.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.979+0000 7fad63ddf640 1 -- 172.21.15.27:0/1203688425 shutdown_connections 2024-01-15T11:34:09.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:09.983+0000 7fad63ddf640 1 -- 172.21.15.27:0/1203688425 wait complete. 2024-01-15T11:34:10.003 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-15T11:34:10.003 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-15T11:34:10.150 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.147+0000 7f6d70c9c640 1 Processor -- start 2024-01-15T11:34:10.151 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.147+0000 7f6d70c9c640 1 -- start start 2024-01-15T11:34:10.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.147+0000 7f6d70c9c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6d6c06e3f0 0x7f6d6c15f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:10.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.147+0000 7f6d70c9c640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d6c0ce5d0 0x7f6d6c15bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:10.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.147+0000 7f6d70c9c640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d6c159630 con 0x7f6d6c0cb9b0 2024-01-15T11:34:10.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.147+0000 7f6d70c9c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6c06e860 con 0x7f6d6c06e3f0 2024-01-15T11:34:10.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.147+0000 7f6d70c9c640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c15bba0 con 0x7f6d6c0ce5d0 2024-01-15T11:34:10.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d6a59c640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f6d6c0cb9b0 0x7f6d6c0cbd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45954/0 (socket says 172.21.15.27:45954) 2024-01-15T11:34:10.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d6a59c640 1 -- 172.21.15.27:0/614335393 learned_addr learned my addr 172.21.15.27:0/614335393 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:10.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d63fff640 1 --2- 172.21.15.27:0/614335393 >> v2:172.21.15.93:3300/0 conn(0x7f6d6c06e3f0 0x7f6d6c15f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:10.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d6ad9d640 1 --2- 172.21.15.27:0/614335393 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d6c0ce5d0 0x7f6d6c15bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:10.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d69d9b640 1 -- 172.21.15.27:0/614335393 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3294941669 0 0) 0x7f6d6c159630 con 0x7f6d6c0cb9b0 2024-01-15T11:34:10.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d69d9b640 1 -- 172.21.15.27:0/614335393 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d58003530 con 0x7f6d6c0cb9b0 2024-01-15T11:34:10.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d69d9b640 1 -- 172.21.15.27:0/614335393 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3268646817 0 0) 0x7f6d58003530 con 0x7f6d6c0cb9b0 2024-01-15T11:34:10.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d69d9b640 1 -- 172.21.15.27:0/614335393 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d6c0ce5d0 msgr2=0x7f6d6c15bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:10.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d69d9b640 1 --2- 172.21.15.27:0/614335393 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d6c0ce5d0 0x7f6d6c15bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:10.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d69d9b640 1 -- 172.21.15.27:0/614335393 >> v2:172.21.15.93:3300/0 conn(0x7f6d6c06e3f0 msgr2=0x7f6d6c15f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:10.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d69d9b640 1 --2- 172.21.15.27:0/614335393 >> v2:172.21.15.93:3300/0 conn(0x7f6d6c06e3f0 0x7f6d6c15f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:10.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d69d9b640 1 -- 172.21.15.27:0/614335393 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c15f6d0 con 0x7f6d6c0cb9b0 2024-01-15T11:34:10.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d69d9b640 1 -- 172.21.15.27:0/614335393 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1394381265 0 0) 0x7f6d5c001680 con 0x7f6d6c0cb9b0 2024-01-15T11:34:10.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d69d9b640 1 -- 172.21.15.27:0/614335393 >> v1:172.21.15.27:6789/0 conn(0x7f6d6c0cb9b0 legacy=0x7f6d6c0cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:10.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d69d9b640 1 --2- 172.21.15.27:0/614335393 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d58003980 0x7f6d58003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:10.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d69d9b640 1 --2- 172.21.15.27:0/614335393 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d580047d0 0x7f6d58004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:10.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d69d9b640 1 --2- 172.21.15.27:0/614335393 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d6c0ce5d0 0x7f6d58005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:10.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d69d9b640 1 -- 172.21.15.27:0/614335393 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c06e860 con 0x7f6d580047d0 2024-01-15T11:34:10.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d69d9b640 1 -- 172.21.15.27:0/614335393 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5800b990 con 0x7f6d58003980 2024-01-15T11:34:10.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d69d9b640 1 -- 172.21.15.27:0/614335393 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5800bad0 con 0x7f6d6c0ce5d0 2024-01-15T11:34:10.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d63fff640 1 --2- 172.21.15.27:0/614335393 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d580047d0 0x7f6d58004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:10.155 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d6a59c640 1 --2- 172.21.15.27:0/614335393 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d58003980 0x7f6d58003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:10.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d6ad9d640 1 --2- 172.21.15.27:0/614335393 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d6c0ce5d0 0x7f6d58005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:10.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d63fff640 1 -- 172.21.15.27:0/614335393 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d6c0ce5d0 msgr2=0x7f6d58005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:10.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d63fff640 1 --2- 172.21.15.27:0/614335393 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d6c0ce5d0 0x7f6d58005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:10.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d63fff640 1 -- 172.21.15.27:0/614335393 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d58003980 msgr2=0x7f6d58003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:10.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d63fff640 1 --2- 172.21.15.27:0/614335393 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d58003980 0x7f6d58003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:10.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.151+0000 7f6d63fff640 1 -- 172.21.15.27:0/614335393 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d58003530 con 0x7f6d580047d0 2024-01-15T11:34:10.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.155+0000 7f6d63fff640 1 --2- 172.21.15.27:0/614335393 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d580047d0 0x7f6d58004c50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009ae0 tx=0x7f6d5401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ba3982a144c738 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:10.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.155+0000 7f6d69d9b640 1 -- 172.21.15.27:0/614335393 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d540a55a0 con 0x7f6d580047d0 2024-01-15T11:34:10.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.155+0000 7f6d69d9b640 1 -- 172.21.15.27:0/614335393 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d540a5700 con 0x7f6d580047d0 2024-01-15T11:34:10.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.155+0000 7f6d69d9b640 1 -- 172.21.15.27:0/614335393 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d540a5ab0 con 0x7f6d580047d0 2024-01-15T11:34:10.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.155+0000 7f6d70c9c640 1 -- 172.21.15.27:0/614335393 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d580047d0 msgr2=0x7f6d58004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:10.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.155+0000 7f6d70c9c640 1 --2- 172.21.15.27:0/614335393 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d580047d0 0x7f6d58004c50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009ae0 tx=0x7f6d5401ca90 comp rx=0 tx=0).stop 2024-01-15T11:34:10.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.155+0000 7f6d6ad9d640 1 -- 172.21.15.27:0/614335393 reap_dead start 2024-01-15T11:34:10.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.159+0000 7f6d70c9c640 1 -- 172.21.15.27:0/614335393 shutdown_connections 2024-01-15T11:34:10.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.159+0000 7f6d70c9c640 1 -- 172.21.15.27:0/614335393 >> 172.21.15.27:0/614335393 conn(0x7f6d6c0b0cb0 msgr2=0x7f6d6c0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:10.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.159+0000 7f6d70c9c640 1 -- 172.21.15.27:0/614335393 shutdown_connections 2024-01-15T11:34:10.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.159+0000 7f6d70c9c640 1 -- 172.21.15.27:0/614335393 wait complete. 2024-01-15T11:34:10.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.159+0000 7f6d70c9c640 1 Processor -- start 2024-01-15T11:34:10.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.159+0000 7f6d70c9c640 1 -- start start 2024-01-15T11:34:10.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.159+0000 7f6d70c9c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d580047d0 0x7f6d6c158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:10.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.159+0000 7f6d70c9c640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d6c1f4320 0x7f6d6c0c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:10.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.159+0000 7f6d70c9c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d6c0c9490 0x7f6d6c15cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:10.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.159+0000 7f6d70c9c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c1585c0 con 0x7f6d6c0c9490 2024-01-15T11:34:10.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.159+0000 7f6d70c9c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c159a50 con 0x7f6d580047d0 2024-01-15T11:34:10.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.159+0000 7f6d70c9c640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c0c99a0 con 0x7f6d6c1f4320 2024-01-15T11:34:10.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.159+0000 7f6d6ad9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d6c0c9490 0x7f6d6c15cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:10.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.159+0000 7f6d6ad9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d6c0c9490 0x7f6d6c15cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38954/0 (socket says 172.21.15.27:38954) 2024-01-15T11:34:10.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.159+0000 7f6d6ad9d640 1 -- 172.21.15.27:0/1534136461 learned_addr learned my addr 172.21.15.27:0/1534136461 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:10.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.159+0000 7f6d63fff640 1 --2- 172.21.15.27:0/1534136461 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d6c1f4320 0x7f6d6c0c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:10.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.159+0000 7f6d6a59c640 1 --2- 172.21.15.27:0/1534136461 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d580047d0 0x7f6d6c158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:10.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.159+0000 7f6d6ad9d640 1 -- 172.21.15.27:0/1534136461 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d6c1f4320 msgr2=0x7f6d6c0c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:10.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.159+0000 7f6d6ad9d640 1 --2- 172.21.15.27:0/1534136461 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d6c1f4320 0x7f6d6c0c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:10.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.159+0000 7f6d6ad9d640 1 -- 172.21.15.27:0/1534136461 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d580047d0 msgr2=0x7f6d6c158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:10.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.159+0000 7f6d6ad9d640 1 --2- 172.21.15.27:0/1534136461 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d580047d0 0x7f6d6c158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:10.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.159+0000 7f6d6ad9d640 1 -- 172.21.15.27:0/1534136461 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c0c9c80 con 0x7f6d6c0c9490 2024-01-15T11:34:10.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.159+0000 7f6d6a59c640 1 --2- 172.21.15.27:0/1534136461 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d580047d0 0x7f6d6c158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:34:10.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.163+0000 7f6d6ad9d640 1 --2- 172.21.15.27:0/1534136461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d6c0c9490 0x7f6d6c15cf20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c0ce9b0 tx=0x7f6d6400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:10.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.163+0000 7f6d62ffd640 1 -- 172.21.15.27:0/1534136461 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6400e040 con 0x7f6d6c0c9490 2024-01-15T11:34:10.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.163+0000 7f6d62ffd640 1 -- 172.21.15.27:0/1534136461 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6400f040 con 0x7f6d6c0c9490 2024-01-15T11:34:10.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.163+0000 7f6d62ffd640 1 -- 172.21.15.27:0/1534136461 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d64015670 con 0x7f6d6c0c9490 2024-01-15T11:34:10.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.163+0000 7f6d70c9c640 1 -- 172.21.15.27:0/1534136461 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d6c159400 con 0x7f6d6c0c9490 2024-01-15T11:34:10.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.163+0000 7f6d70c9c640 1 -- 172.21.15.27:0/1534136461 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d6c0b3860 con 0x7f6d6c0c9490 2024-01-15T11:34:10.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.163+0000 7f6d70c9c640 1 -- 172.21.15.27:0/1534136461 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d6c0671f0 con 0x7f6d6c0c9490 2024-01-15T11:34:10.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.163+0000 7f6d62ffd640 1 -- 172.21.15.27:0/1534136461 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f6d640157d0 con 0x7f6d6c0c9490 2024-01-15T11:34:10.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.163+0000 7f6d62ffd640 1 --2- 172.21.15.27:0/1534136461 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6d4c066920 0x7f6d4c068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:10.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.163+0000 7f6d62ffd640 1 -- 172.21.15.27:0/1534136461 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6d640847b0 con 0x7f6d6c0c9490 2024-01-15T11:34:10.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.163+0000 7f6d6a59c640 1 --2- 172.21.15.27:0/1534136461 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6d4c066920 0x7f6d4c068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:10.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.167+0000 7f6d6a59c640 1 --2- 172.21.15.27:0/1534136461 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6d4c066920 0x7f6d4c068de0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c0b3bf0 tx=0x7f6d5c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:10.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.167+0000 7f6d62ffd640 1 -- 172.21.15.27:0/1534136461 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6d64051ca0 con 0x7f6d6c0c9490 2024-01-15T11:34:10.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:10.327+0000 7f6d70c9c640 1 -- 172.21.15.27:0/1534136461 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6d6c0c9e70 con 0x7f6d6c0c9490 2024-01-15T11:34:11.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.159+0000 7f6d62ffd640 1 -- 172.21.15.27:0/1534136461 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6d640552c0 con 0x7f6d6c0c9490 2024-01-15T11:34:11.162 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' created 2024-01-15T11:34:11.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.163+0000 7f6d70c9c640 1 -- 172.21.15.27:0/1534136461 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6d4c066920 msgr2=0x7f6d4c068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:11.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.163+0000 7f6d70c9c640 1 --2- 172.21.15.27:0/1534136461 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6d4c066920 0x7f6d4c068de0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c0b3bf0 tx=0x7f6d5c009040 comp rx=0 tx=0).stop 2024-01-15T11:34:11.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.163+0000 7f6d70c9c640 1 -- 172.21.15.27:0/1534136461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d6c0c9490 msgr2=0x7f6d6c15cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:11.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.163+0000 7f6d70c9c640 1 --2- 172.21.15.27:0/1534136461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d6c0c9490 0x7f6d6c15cf20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c0ce9b0 tx=0x7f6d6400f580 comp rx=0 tx=0).stop 2024-01-15T11:34:11.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.163+0000 7f6d70c9c640 1 -- 172.21.15.27:0/1534136461 shutdown_connections 2024-01-15T11:34:11.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.163+0000 7f6d70c9c640 1 --2- 172.21.15.27:0/1534136461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6d6c0c9490 0x7f6d6c15cf20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:11.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.163+0000 7f6d70c9c640 1 --2- 172.21.15.27:0/1534136461 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d6c1f4320 0x7f6d6c0c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:11.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.163+0000 7f6d70c9c640 1 --2- 172.21.15.27:0/1534136461 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6d4c066920 0x7f6d4c068de0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:11.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.163+0000 7f6d70c9c640 1 --2- 172.21.15.27:0/1534136461 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d580047d0 0x7f6d6c158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:11.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.163+0000 7f6d70c9c640 1 -- 172.21.15.27:0/1534136461 >> 172.21.15.27:0/1534136461 conn(0x7f6d6c0b0cb0 msgr2=0x7f6d6c0af8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:11.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.163+0000 7f6d70c9c640 1 -- 172.21.15.27:0/1534136461 shutdown_connections 2024-01-15T11:34:11.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.163+0000 7f6d70c9c640 1 -- 172.21.15.27:0/1534136461 wait complete. 2024-01-15T11:34:11.194 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-15T11:34:11.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.343+0000 7f059199d640 1 Processor -- start 2024-01-15T11:34:11.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.347+0000 7f059199d640 1 -- start start 2024-01-15T11:34:11.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.347+0000 7f059199d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f058c146820 0x7f058c070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:11.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.347+0000 7f059199d640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f058c15eb50 0x7f058c0b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:11.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.347+0000 7f059199d640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058c147190 con 0x7f058c0b4210 2024-01-15T11:34:11.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.347+0000 7f059199d640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058c0b4be0 con 0x7f058c146820 2024-01-15T11:34:11.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.347+0000 7f059199d640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058c146c00 con 0x7f058c15eb50 2024-01-15T11:34:11.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.347+0000 7f0583fff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f058c0b4210 0x7f058c161180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45960/0 (socket says 172.21.15.27:45960) 2024-01-15T11:34:11.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.347+0000 7f0583fff640 1 -- 172.21.15.27:0/3250772594 learned_addr learned my addr 172.21.15.27:0/3250772594 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:11.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.347+0000 7f058affd640 1 --2- 172.21.15.27:0/3250772594 >> v2:172.21.15.93:3300/0 conn(0x7f058c146820 0x7f058c070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:11.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.347+0000 7f058b7fe640 1 --2- 172.21.15.27:0/3250772594 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f058c15eb50 0x7f058c0b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:11.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.347+0000 7f058a7fc640 1 -- 172.21.15.27:0/3250772594 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2401933067 0 0) 0x7f058c147190 con 0x7f058c0b4210 2024-01-15T11:34:11.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.347+0000 7f058a7fc640 1 -- 172.21.15.27:0/3250772594 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0578003530 con 0x7f058c0b4210 2024-01-15T11:34:11.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.347+0000 7f058affd640 1 -- 172.21.15.27:0/3250772594 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f058c15eb50 msgr2=0x7f058c0b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:11.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.347+0000 7f058affd640 1 --2- 172.21.15.27:0/3250772594 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f058c15eb50 0x7f058c0b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:11.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.347+0000 7f058affd640 1 -- 172.21.15.27:0/3250772594 >> v1:172.21.15.27:6789/0 conn(0x7f058c0b4210 legacy=0x7f058c161180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:11.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.347+0000 7f058affd640 1 -- 172.21.15.27:0/3250772594 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c06d030 con 0x7f058c146820 2024-01-15T11:34:11.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.351+0000 7f058affd640 1 --2- 172.21.15.27:0/3250772594 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f058c146820 0x7f058c070a50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f057c0097c0 tx=0x7f057c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8993fb057e3cb8c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:11.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.351+0000 7f058a7fc640 1 -- 172.21.15.27:0/3250772594 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c0ab600 con 0x7f058c146820 2024-01-15T11:34:11.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.351+0000 7f058a7fc640 1 -- 172.21.15.27:0/3250772594 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057c0a7050 con 0x7f058c146820 2024-01-15T11:34:11.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.351+0000 7f058a7fc640 1 -- 172.21.15.27:0/3250772594 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c0ab980 con 0x7f058c146820 2024-01-15T11:34:11.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.351+0000 7f059199d640 1 -- 172.21.15.27:0/3250772594 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f058c146820 msgr2=0x7f058c070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:11.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.351+0000 7f059199d640 1 --2- 172.21.15.27:0/3250772594 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f058c146820 0x7f058c070a50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f057c0097c0 tx=0x7f057c01c450 comp rx=0 tx=0).stop 2024-01-15T11:34:11.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.351+0000 7f059199d640 1 -- 172.21.15.27:0/3250772594 shutdown_connections 2024-01-15T11:34:11.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.351+0000 7f059199d640 1 --2- 172.21.15.27:0/3250772594 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f058c15eb50 0x7f058c0b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:11.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.351+0000 7f059199d640 1 --2- 172.21.15.27:0/3250772594 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f058c146820 0x7f058c070a50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:11.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.351+0000 7f059199d640 1 -- 172.21.15.27:0/3250772594 >> 172.21.15.27:0/3250772594 conn(0x7f058c0b2f10 msgr2=0x7f058c0b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:11.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.351+0000 7f059199d640 1 -- 172.21.15.27:0/3250772594 shutdown_connections 2024-01-15T11:34:11.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.351+0000 7f059199d640 1 -- 172.21.15.27:0/3250772594 wait complete. 2024-01-15T11:34:11.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f059199d640 1 Processor -- start 2024-01-15T11:34:11.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f059199d640 1 -- start start 2024-01-15T11:34:11.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f059199d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f058c0b4210 0x7f058c139370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:11.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f059199d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f058c146820 0x7f058c13fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:11.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f059199d640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f058c15eb50 0x7f058c15b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:11.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f059199d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c139950 con 0x7f058c0b4210 2024-01-15T11:34:11.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f059199d640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c13ae20 con 0x7f058c146820 2024-01-15T11:34:11.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f059199d640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058c13b050 con 0x7f058c15eb50 2024-01-15T11:34:11.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f058affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f058c0b4210 0x7f058c139370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:11.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f058affd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f058c0b4210 0x7f058c139370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38964/0 (socket says 172.21.15.27:38964) 2024-01-15T11:34:11.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f058affd640 1 -- 172.21.15.27:0/439998079 learned_addr learned my addr 172.21.15.27:0/439998079 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:11.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f058b7fe640 1 --2- 172.21.15.27:0/439998079 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f058c15eb50 0x7f058c15b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:11.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f0583fff640 1 --2- 172.21.15.27:0/439998079 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f058c146820 0x7f058c13fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:11.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f058affd640 1 -- 172.21.15.27:0/439998079 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f058c15eb50 msgr2=0x7f058c15b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:11.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f058affd640 1 --2- 172.21.15.27:0/439998079 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f058c15eb50 0x7f058c15b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:11.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f058affd640 1 -- 172.21.15.27:0/439998079 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f058c146820 msgr2=0x7f058c13fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:11.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f058affd640 1 --2- 172.21.15.27:0/439998079 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f058c146820 0x7f058c13fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:11.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f058affd640 1 -- 172.21.15.27:0/439998079 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057c009420 con 0x7f058c0b4210 2024-01-15T11:34:11.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f0583fff640 1 --2- 172.21.15.27:0/439998079 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f058c146820 0x7f058c13fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:34:11.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f058affd640 1 --2- 172.21.15.27:0/439998079 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f058c0b4210 0x7f058c139370 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f057c01a080 tx=0x7f057c0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:11.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f0588ff9640 1 -- 172.21.15.27:0/439998079 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c0b4400 con 0x7f058c0b4210 2024-01-15T11:34:11.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f0588ff9640 1 -- 172.21.15.27:0/439998079 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057c0b4580 con 0x7f058c0b4210 2024-01-15T11:34:11.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f0588ff9640 1 -- 172.21.15.27:0/439998079 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c0b4930 con 0x7f058c0b4210 2024-01-15T11:34:11.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f059199d640 1 -- 172.21.15.27:0/439998079 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058c13b330 con 0x7f058c0b4210 2024-01-15T11:34:11.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f059199d640 1 -- 172.21.15.27:0/439998079 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f058c15ab80 con 0x7f058c0b4210 2024-01-15T11:34:11.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.355+0000 7f059199d640 1 -- 172.21.15.27:0/439998079 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f058c15a4c0 con 0x7f058c0b4210 2024-01-15T11:34:11.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.359+0000 7f0588ff9640 1 -- 172.21.15.27:0/439998079 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f057c0b2040 con 0x7f058c0b4210 2024-01-15T11:34:11.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.359+0000 7f0588ff9640 1 --2- 172.21.15.27:0/439998079 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f056c0668f0 0x7f056c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:11.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.359+0000 7f0588ff9640 1 -- 172.21.15.27:0/439998079 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f057c11e9b0 con 0x7f058c0b4210 2024-01-15T11:34:11.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.359+0000 7f0583fff640 1 --2- 172.21.15.27:0/439998079 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f056c0668f0 0x7f056c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:11.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.359+0000 7f0583fff640 1 --2- 172.21.15.27:0/439998079 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f056c0668f0 0x7f056c068db0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f058c145ea0 tx=0x7f0574009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:11.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.363+0000 7f0588ff9640 1 -- 172.21.15.27:0/439998079 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f057c0ebe40 con 0x7f058c0b4210 2024-01-15T11:34:11.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:11.519+0000 7f059199d640 1 -- 172.21.15.27:0/439998079 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f058c15a8a0 con 0x7f058c0b4210 2024-01-15T11:34:12.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.167+0000 7f0588ff9640 1 -- 172.21.15.27:0/439998079 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7f058c15a8a0 con 0x7f058c0b4210 2024-01-15T11:34:12.169 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' created 2024-01-15T11:34:12.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.167+0000 7f059199d640 1 -- 172.21.15.27:0/439998079 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f056c0668f0 msgr2=0x7f056c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:12.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.167+0000 7f059199d640 1 --2- 172.21.15.27:0/439998079 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f056c0668f0 0x7f056c068db0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f058c145ea0 tx=0x7f0574009040 comp rx=0 tx=0).stop 2024-01-15T11:34:12.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.167+0000 7f059199d640 1 -- 172.21.15.27:0/439998079 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f058c0b4210 msgr2=0x7f058c139370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:12.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.167+0000 7f059199d640 1 --2- 172.21.15.27:0/439998079 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f058c0b4210 0x7f058c139370 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f057c01a080 tx=0x7f057c0191f0 comp rx=0 tx=0).stop 2024-01-15T11:34:12.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.167+0000 7f059199d640 1 -- 172.21.15.27:0/439998079 shutdown_connections 2024-01-15T11:34:12.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.167+0000 7f059199d640 1 --2- 172.21.15.27:0/439998079 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f058c15eb50 0x7f058c15b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:12.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.167+0000 7f059199d640 1 --2- 172.21.15.27:0/439998079 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f056c0668f0 0x7f056c068db0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:12.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.167+0000 7f059199d640 1 --2- 172.21.15.27:0/439998079 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f058c146820 0x7f058c13fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:12.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.167+0000 7f059199d640 1 --2- 172.21.15.27:0/439998079 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f058c0b4210 0x7f058c139370 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:12.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.167+0000 7f059199d640 1 -- 172.21.15.27:0/439998079 >> 172.21.15.27:0/439998079 conn(0x7f058c0b2f10 msgr2=0x7f058c13c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:12.173 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.167+0000 7f059199d640 1 -- 172.21.15.27:0/439998079 shutdown_connections 2024-01-15T11:34:12.173 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.167+0000 7f059199d640 1 -- 172.21.15.27:0/439998079 wait complete. 2024-01-15T11:34:12.210 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-15T11:34:12.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.355+0000 7f57ab29a640 1 Processor -- start 2024-01-15T11:34:12.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.355+0000 7f57ab29a640 1 -- start start 2024-01-15T11:34:12.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.355+0000 7f57ab29a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f57a40c5b00 0x7f57a40cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:12.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.355+0000 7f57ab29a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f57a415a880 0x7f57a40cb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:12.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.355+0000 7f57ab29a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a40b2ae0 con 0x7f57a415a4a0 2024-01-15T11:34:12.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.355+0000 7f57ab29a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a40cf380 con 0x7f57a40c5b00 2024-01-15T11:34:12.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.355+0000 7f57ab29a640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a40cf660 con 0x7f57a415a880 2024-01-15T11:34:12.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.355+0000 7f57a8835640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f57a40c5b00 0x7f57a40cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:12.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.355+0000 7f57a8835640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f57a40c5b00 0x7f57a40cec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38968/0 (socket says 172.21.15.27:38968) 2024-01-15T11:34:12.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.355+0000 7f57a8835640 1 -- 172.21.15.27:0/1258149146 learned_addr learned my addr 172.21.15.27:0/1258149146 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:12.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.355+0000 7f57a9837640 1 --2- 172.21.15.27:0/1258149146 >> v2:172.21.15.93:3300/0 conn(0x7f57a415a880 0x7f57a40cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:12.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.355+0000 7f57a8835640 1 -- 172.21.15.27:0/1258149146 >> v2:172.21.15.93:3300/0 conn(0x7f57a415a880 msgr2=0x7f57a40cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:12.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.355+0000 7f57a8835640 1 --2- 172.21.15.27:0/1258149146 >> v2:172.21.15.93:3300/0 conn(0x7f57a415a880 0x7f57a40cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:12.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.355+0000 7f57a8835640 1 -- 172.21.15.27:0/1258149146 >> v1:172.21.15.93:6789/0 conn(0x7f57a415a4a0 legacy=0x7f57a40c53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:12.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.355+0000 7f57a8835640 1 -- 172.21.15.27:0/1258149146 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a40ca910 con 0x7f57a40c5b00 2024-01-15T11:34:12.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.355+0000 7f57a9837640 1 --2- 172.21.15.27:0/1258149146 >> v2:172.21.15.93:3300/0 conn(0x7f57a415a880 0x7f57a40cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:34:12.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.359+0000 7f57a8835640 1 --2- 172.21.15.27:0/1258149146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57a40c5b00 0x7f57a40cec80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f57a40c5190 tx=0x7f579401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e96b76c376f54f5 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:12.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.359+0000 7f579bfff640 1 -- 172.21.15.27:0/1258149146 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57940aa5f0 con 0x7f57a40c5b00 2024-01-15T11:34:12.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.359+0000 7f579bfff640 1 -- 172.21.15.27:0/1258149146 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57940aa750 con 0x7f57a40c5b00 2024-01-15T11:34:12.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.359+0000 7f579bfff640 1 -- 172.21.15.27:0/1258149146 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57940aaae0 con 0x7f57a40c5b00 2024-01-15T11:34:12.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.359+0000 7f57ab29a640 1 -- 172.21.15.27:0/1258149146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57a40c5b00 msgr2=0x7f57a40cec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:12.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.359+0000 7f57ab29a640 1 --2- 172.21.15.27:0/1258149146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57a40c5b00 0x7f57a40cec80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f57a40c5190 tx=0x7f579401c470 comp rx=0 tx=0).stop 2024-01-15T11:34:12.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.359+0000 7f57ab29a640 1 -- 172.21.15.27:0/1258149146 shutdown_connections 2024-01-15T11:34:12.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.359+0000 7f57ab29a640 1 --2- 172.21.15.27:0/1258149146 >> v2:172.21.15.93:3300/0 conn(0x7f57a415a880 0x7f57a40cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:12.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.359+0000 7f57ab29a640 1 --2- 172.21.15.27:0/1258149146 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57a40c5b00 0x7f57a40cec80 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:12.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.359+0000 7f57ab29a640 1 -- 172.21.15.27:0/1258149146 >> 172.21.15.27:0/1258149146 conn(0x7f57a40b1d50 msgr2=0x7f57a40b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:12.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.359+0000 7f57ab29a640 1 -- 172.21.15.27:0/1258149146 shutdown_connections 2024-01-15T11:34:12.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.359+0000 7f57ab29a640 1 -- 172.21.15.27:0/1258149146 wait complete. 2024-01-15T11:34:12.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.363+0000 7f57ab29a640 1 Processor -- start 2024-01-15T11:34:12.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.363+0000 7f57ab29a640 1 -- start start 2024-01-15T11:34:12.368 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.363+0000 7f57ab29a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57a40c5b00 0x7f57a40d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:12.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.363+0000 7f57ab29a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57a415a4a0 0x7f57a40b5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:12.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.363+0000 7f57ab29a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57a415a880 0x7f57a414e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:12.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.363+0000 7f57ab29a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a40b2e10 con 0x7f57a415a880 2024-01-15T11:34:12.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.363+0000 7f57ab29a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a40b5b30 con 0x7f57a40c5b00 2024-01-15T11:34:12.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.363+0000 7f57ab29a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a40b3060 con 0x7f57a415a4a0 2024-01-15T11:34:12.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.363+0000 7f57a9837640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57a415a880 0x7f57a414e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:12.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.363+0000 7f57a9837640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57a415a880 0x7f57a414e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38978/0 (socket says 172.21.15.27:38978) 2024-01-15T11:34:12.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.363+0000 7f57a9837640 1 -- 172.21.15.27:0/3266488754 learned_addr learned my addr 172.21.15.27:0/3266488754 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:12.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.363+0000 7f57a9036640 1 --2- 172.21.15.27:0/3266488754 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57a40c5b00 0x7f57a40d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:12.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.363+0000 7f57a8835640 1 --2- 172.21.15.27:0/3266488754 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57a415a4a0 0x7f57a40b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:12.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.363+0000 7f57a9837640 1 -- 172.21.15.27:0/3266488754 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57a415a4a0 msgr2=0x7f57a40b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:12.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.363+0000 7f57a9837640 1 --2- 172.21.15.27:0/3266488754 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57a415a4a0 0x7f57a40b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:12.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.363+0000 7f57a9837640 1 -- 172.21.15.27:0/3266488754 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57a40c5b00 msgr2=0x7f57a40d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:12.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.363+0000 7f57a9837640 1 --2- 172.21.15.27:0/3266488754 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57a40c5b00 0x7f57a40d0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:12.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.363+0000 7f57a9837640 1 -- 172.21.15.27:0/3266488754 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57940094d0 con 0x7f57a415a880 2024-01-15T11:34:12.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.363+0000 7f57a9837640 1 --2- 172.21.15.27:0/3266488754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57a415a880 0x7f57a414e1a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f579c007ef0 tx=0x7f579c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:12.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.363+0000 7f5799ffb640 1 -- 172.21.15.27:0/3266488754 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c003ba0 con 0x7f57a415a880 2024-01-15T11:34:12.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.363+0000 7f5799ffb640 1 -- 172.21.15.27:0/3266488754 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579c00f040 con 0x7f57a415a880 2024-01-15T11:34:12.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.363+0000 7f5799ffb640 1 -- 172.21.15.27:0/3266488754 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c00de80 con 0x7f57a415a880 2024-01-15T11:34:12.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.363+0000 7f57ab29a640 1 -- 172.21.15.27:0/3266488754 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a40b3340 con 0x7f57a415a880 2024-01-15T11:34:12.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.363+0000 7f57ab29a640 1 -- 172.21.15.27:0/3266488754 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a40b3b40 con 0x7f57a415a880 2024-01-15T11:34:12.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.367+0000 7f57ab29a640 1 -- 172.21.15.27:0/3266488754 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a404e850 con 0x7f57a415a880 2024-01-15T11:34:12.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.367+0000 7f5799ffb640 1 -- 172.21.15.27:0/3266488754 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f579c004030 con 0x7f57a415a880 2024-01-15T11:34:12.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.367+0000 7f5799ffb640 1 --2- 172.21.15.27:0/3266488754 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5788066920 0x7f5788068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:12.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.367+0000 7f5799ffb640 1 -- 172.21.15.27:0/3266488754 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f579c0846e0 con 0x7f57a415a880 2024-01-15T11:34:12.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.367+0000 7f57a9036640 1 --2- 172.21.15.27:0/3266488754 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5788066920 0x7f5788068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:12.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.367+0000 7f57a9036640 1 --2- 172.21.15.27:0/3266488754 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5788066920 0x7f5788068de0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f57a406f3e0 tx=0x7f57a0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:12.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.371+0000 7f5799ffb640 1 -- 172.21.15.27:0/3266488754 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f579c051990 con 0x7f57a415a880 2024-01-15T11:34:12.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:12.563+0000 7f57ab29a640 1 -- 172.21.15.27:0/3266488754 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f57a40b37f0 con 0x7f57a415a880 2024-01-15T11:34:12.973 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:34:12.978 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:34:13.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.191+0000 7f5799ffb640 1 -- 172.21.15.27:0/3266488754 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f579c054fb0 con 0x7f57a415a880 2024-01-15T11:34:13.201 INFO:teuthology.orchestra.run.smithi027.stderr:new fs with metadata pool 4 and data pool 5 2024-01-15T11:34:13.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.211+0000 7f57ab29a640 1 -- 172.21.15.27:0/3266488754 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5788066920 msgr2=0x7f5788068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:13.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.211+0000 7f57ab29a640 1 --2- 172.21.15.27:0/3266488754 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5788066920 0x7f5788068de0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f57a406f3e0 tx=0x7f57a0009040 comp rx=0 tx=0).stop 2024-01-15T11:34:13.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.211+0000 7f57ab29a640 1 -- 172.21.15.27:0/3266488754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57a415a880 msgr2=0x7f57a414e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:13.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.211+0000 7f57ab29a640 1 --2- 172.21.15.27:0/3266488754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57a415a880 0x7f57a414e1a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f579c007ef0 tx=0x7f579c00d4a0 comp rx=0 tx=0).stop 2024-01-15T11:34:13.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.211+0000 7f57ab29a640 1 -- 172.21.15.27:0/3266488754 shutdown_connections 2024-01-15T11:34:13.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.215+0000 7f57ab29a640 1 --2- 172.21.15.27:0/3266488754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f57a415a880 0x7f57a414e1a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:13.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.215+0000 7f57ab29a640 1 --2- 172.21.15.27:0/3266488754 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57a415a4a0 0x7f57a40b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:13.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.215+0000 7f57ab29a640 1 --2- 172.21.15.27:0/3266488754 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5788066920 0x7f5788068de0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:13.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.215+0000 7f57ab29a640 1 --2- 172.21.15.27:0/3266488754 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57a40c5b00 0x7f57a40d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:13.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.215+0000 7f57ab29a640 1 -- 172.21.15.27:0/3266488754 >> 172.21.15.27:0/3266488754 conn(0x7f57a40b1d50 msgr2=0x7f57a4153330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:13.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.215+0000 7f57ab29a640 1 -- 172.21.15.27:0/3266488754 shutdown_connections 2024-01-15T11:34:13.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.215+0000 7f57ab29a640 1 -- 172.21.15.27:0/3266488754 wait complete. 2024-01-15T11:34:13.240 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:34:13.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.379+0000 7fa252c32640 1 Processor -- start 2024-01-15T11:34:13.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.379+0000 7fa252c32640 1 -- start start 2024-01-15T11:34:13.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.383+0000 7fa252c32640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa24c144c80 0x7fa24c0abf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:13.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.383+0000 7fa252c32640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa24c070df0 0x7fa24c06c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:13.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.383+0000 7fa252c32640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa24c145060 con 0x7fa24c0ac460 2024-01-15T11:34:13.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.383+0000 7fa252c32640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24c071fd0 con 0x7fa24c144c80 2024-01-15T11:34:13.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.383+0000 7fa252c32640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24c0ac8c0 con 0x7fa24c070df0 2024-01-15T11:34:13.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.383+0000 7fa2509ce640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa24c144c80 0x7fa24c0abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:13.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.383+0000 7fa24bfff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fa24c0ac460 0x7fa24c0706e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45962/0 (socket says 172.21.15.27:45962) 2024-01-15T11:34:13.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.383+0000 7fa24bfff640 1 -- 172.21.15.27:0/1862170151 learned_addr learned my addr 172.21.15.27:0/1862170151 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:13.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.383+0000 7fa2511cf640 1 --2- 172.21.15.27:0/1862170151 >> v2:172.21.15.93:3300/0 conn(0x7fa24c070df0 0x7fa24c06c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:13.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.383+0000 7fa2509ce640 1 -- 172.21.15.27:0/1862170151 >> v2:172.21.15.93:3300/0 conn(0x7fa24c070df0 msgr2=0x7fa24c06c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:13.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.383+0000 7fa2509ce640 1 --2- 172.21.15.27:0/1862170151 >> v2:172.21.15.93:3300/0 conn(0x7fa24c070df0 0x7fa24c06c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:13.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.383+0000 7fa2509ce640 1 -- 172.21.15.27:0/1862170151 >> v1:172.21.15.27:6789/0 conn(0x7fa24c0ac460 legacy=0x7fa24c0706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:13.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.383+0000 7fa2509ce640 1 -- 172.21.15.27:0/1862170151 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24c071450 con 0x7fa24c144c80 2024-01-15T11:34:13.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.383+0000 7fa2511cf640 1 --2- 172.21.15.27:0/1862170151 >> v2:172.21.15.93:3300/0 conn(0x7fa24c070df0 0x7fa24c06c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:34:13.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.387+0000 7fa2509ce640 1 --2- 172.21.15.27:0/1862170151 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa24c144c80 0x7fa24c0abf20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa24c0ce840 tx=0x7fa24001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8ac6894fb62d89 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:13.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.387+0000 7fa24b7fe640 1 -- 172.21.15.27:0/1862170151 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa240004230 con 0x7fa24c144c80 2024-01-15T11:34:13.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.387+0000 7fa24b7fe640 1 -- 172.21.15.27:0/1862170151 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2400a7050 con 0x7fa24c144c80 2024-01-15T11:34:13.389 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.387+0000 7fa24b7fe640 1 -- 172.21.15.27:0/1862170151 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa240003620 con 0x7fa24c144c80 2024-01-15T11:34:13.390 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.387+0000 7fa252c32640 1 -- 172.21.15.27:0/1862170151 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa24c144c80 msgr2=0x7fa24c0abf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:13.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.387+0000 7fa252c32640 1 --2- 172.21.15.27:0/1862170151 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa24c144c80 0x7fa24c0abf20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa24c0ce840 tx=0x7fa24001c460 comp rx=0 tx=0).stop 2024-01-15T11:34:13.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.387+0000 7fa252c32640 1 -- 172.21.15.27:0/1862170151 shutdown_connections 2024-01-15T11:34:13.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.387+0000 7fa252c32640 1 --2- 172.21.15.27:0/1862170151 >> v2:172.21.15.93:3300/0 conn(0x7fa24c070df0 0x7fa24c06c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:13.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.387+0000 7fa252c32640 1 --2- 172.21.15.27:0/1862170151 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa24c144c80 0x7fa24c0abf20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:13.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.387+0000 7fa252c32640 1 -- 172.21.15.27:0/1862170151 >> 172.21.15.27:0/1862170151 conn(0x7fa24c0b0c40 msgr2=0x7fa24c0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:13.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.387+0000 7fa252c32640 1 -- 172.21.15.27:0/1862170151 shutdown_connections 2024-01-15T11:34:13.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.387+0000 7fa252c32640 1 -- 172.21.15.27:0/1862170151 wait complete. 2024-01-15T11:34:13.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.387+0000 7fa252c32640 1 Processor -- start 2024-01-15T11:34:13.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.387+0000 7fa252c32640 1 -- start start 2024-01-15T11:34:13.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.391+0000 7fa252c32640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa24c070df0 0x7fa24c15a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:13.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.391+0000 7fa252c32640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa24c0ac460 0x7fa24c157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:13.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.391+0000 7fa252c32640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa24c144c80 0x7fa24c1425b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:13.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.391+0000 7fa252c32640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c153950 con 0x7fa24c0ac460 2024-01-15T11:34:13.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.391+0000 7fa252c32640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c0b3550 con 0x7fa24c144c80 2024-01-15T11:34:13.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.391+0000 7fa252c32640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c0b3830 con 0x7fa24c070df0 2024-01-15T11:34:13.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.391+0000 7fa24bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa24c0ac460 0x7fa24c157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:13.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.391+0000 7fa24bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa24c0ac460 0x7fa24c157730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38996/0 (socket says 172.21.15.27:38996) 2024-01-15T11:34:13.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.391+0000 7fa24bfff640 1 -- 172.21.15.27:0/3180274438 learned_addr learned my addr 172.21.15.27:0/3180274438 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:13.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.391+0000 7fa2511cf640 1 --2- 172.21.15.27:0/3180274438 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa24c144c80 0x7fa24c1425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:13.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.391+0000 7fa2509ce640 1 --2- 172.21.15.27:0/3180274438 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa24c070df0 0x7fa24c15a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:13.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.391+0000 7fa24bfff640 1 -- 172.21.15.27:0/3180274438 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa24c070df0 msgr2=0x7fa24c15a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:13.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.391+0000 7fa24bfff640 1 --2- 172.21.15.27:0/3180274438 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa24c070df0 0x7fa24c15a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:13.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.391+0000 7fa24bfff640 1 -- 172.21.15.27:0/3180274438 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa24c144c80 msgr2=0x7fa24c1425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:13.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.391+0000 7fa24bfff640 1 --2- 172.21.15.27:0/3180274438 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa24c144c80 0x7fa24c1425b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:13.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.391+0000 7fa24bfff640 1 -- 172.21.15.27:0/3180274438 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa240009420 con 0x7fa24c0ac460 2024-01-15T11:34:13.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.391+0000 7fa24bfff640 1 --2- 172.21.15.27:0/3180274438 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa24c0ac460 0x7fa24c157730 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa23800c500 tx=0x7fa23800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:13.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.391+0000 7fa2497fa640 1 -- 172.21.15.27:0/3180274438 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa238005cf0 con 0x7fa24c0ac460 2024-01-15T11:34:13.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.391+0000 7fa2497fa640 1 -- 172.21.15.27:0/3180274438 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa238005e50 con 0x7fa24c0ac460 2024-01-15T11:34:13.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.391+0000 7fa2497fa640 1 -- 172.21.15.27:0/3180274438 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2380072f0 con 0x7fa24c0ac460 2024-01-15T11:34:13.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.391+0000 7fa252c32640 1 -- 172.21.15.27:0/3180274438 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24c0b3b10 con 0x7fa24c0ac460 2024-01-15T11:34:13.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.391+0000 7fa252c32640 1 -- 172.21.15.27:0/3180274438 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24c15ab40 con 0x7fa24c0ac460 2024-01-15T11:34:13.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.391+0000 7fa252c32640 1 -- 172.21.15.27:0/3180274438 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24c0b1ba0 con 0x7fa24c0ac460 2024-01-15T11:34:13.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.395+0000 7fa2497fa640 1 -- 172.21.15.27:0/3180274438 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fa238007450 con 0x7fa24c0ac460 2024-01-15T11:34:13.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.395+0000 7fa2497fa640 1 --2- 172.21.15.27:0/3180274438 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa2300668f0 0x7fa230068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:13.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.395+0000 7fa2497fa640 1 -- 172.21.15.27:0/3180274438 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa238083990 con 0x7fa24c0ac460 2024-01-15T11:34:13.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.395+0000 7fa2509ce640 1 --2- 172.21.15.27:0/3180274438 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa2300668f0 0x7fa230068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:13.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.395+0000 7fa2509ce640 1 --2- 172.21.15.27:0/3180274438 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa2300668f0 0x7fa230068db0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa2400ad000 tx=0x7fa2400a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:13.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.399+0000 7fa2497fa640 1 -- 172.21.15.27:0/3180274438 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa238050be0 con 0x7fa24c0ac460 2024-01-15T11:34:13.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.555+0000 7fa252c32640 1 -- 172.21.15.27:0/3180274438 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa24c04e850 con 0x7fa24c0ac460 2024-01-15T11:34:13.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.555+0000 7fa2497fa640 1 -- 172.21.15.27:0/3180274438 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16438 (secure 0 0 0) 0x7fa238017020 con 0x7fa24c0ac460 2024-01-15T11:34:13.560 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:34:13.560 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":34,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:34:12.569816+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-15T11:34:10.377236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-15T11:34:11.569141+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:34:13.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.559+0000 7fa252c32640 1 -- 172.21.15.27:0/3180274438 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa2300668f0 msgr2=0x7fa230068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:13.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.559+0000 7fa252c32640 1 --2- 172.21.15.27:0/3180274438 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa2300668f0 0x7fa230068db0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa2400ad000 tx=0x7fa2400a6000 comp rx=0 tx=0).stop 2024-01-15T11:34:13.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.559+0000 7fa252c32640 1 -- 172.21.15.27:0/3180274438 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa24c0ac460 msgr2=0x7fa24c157730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:13.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.559+0000 7fa252c32640 1 --2- 172.21.15.27:0/3180274438 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa24c0ac460 0x7fa24c157730 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa23800c500 tx=0x7fa23800c9c0 comp rx=0 tx=0).stop 2024-01-15T11:34:13.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.559+0000 7fa252c32640 1 -- 172.21.15.27:0/3180274438 shutdown_connections 2024-01-15T11:34:13.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.559+0000 7fa252c32640 1 --2- 172.21.15.27:0/3180274438 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa2300668f0 0x7fa230068db0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:13.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.559+0000 7fa252c32640 1 --2- 172.21.15.27:0/3180274438 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa24c144c80 0x7fa24c1425b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:13.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.559+0000 7fa252c32640 1 --2- 172.21.15.27:0/3180274438 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa24c0ac460 0x7fa24c157730 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:13.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.559+0000 7fa252c32640 1 --2- 172.21.15.27:0/3180274438 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa24c070df0 0x7fa24c15a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:13.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.559+0000 7fa252c32640 1 -- 172.21.15.27:0/3180274438 >> 172.21.15.27:0/3180274438 conn(0x7fa24c0b0c40 msgr2=0x7fa24c0b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:13.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.559+0000 7fa252c32640 1 -- 172.21.15.27:0/3180274438 shutdown_connections 2024-01-15T11:34:13.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.559+0000 7fa252c32640 1 -- 172.21.15.27:0/3180274438 wait complete. 2024-01-15T11:34:13.581 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:34:13.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.719+0000 7f783899d640 1 Processor -- start 2024-01-15T11:34:13.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.723+0000 7f783899d640 1 -- start start 2024-01-15T11:34:13.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.723+0000 7f783899d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7834143ae0 0x7f78340b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:13.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.723+0000 7f783899d640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f78340ae3d0 0x7f783406e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:13.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.723+0000 7f783899d640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78340ae7f0 con 0x7f783406dfd0 2024-01-15T11:34:13.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.723+0000 7f783899d640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f783406e980 con 0x7f7834143ae0 2024-01-15T11:34:13.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.723+0000 7f783899d640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78340b2480 con 0x7f78340ae3d0 2024-01-15T11:34:13.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.723+0000 7f782bfff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f783406dfd0 0x7f78340adcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45966/0 (socket says 172.21.15.27:45966) 2024-01-15T11:34:13.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.723+0000 7f783259c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f7834143ae0 0x7f78340b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:13.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.723+0000 7f782bfff640 1 -- 172.21.15.27:0/2147993099 learned_addr learned my addr 172.21.15.27:0/2147993099 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:13.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.723+0000 7f7832d9d640 1 --2- 172.21.15.27:0/2147993099 >> v2:172.21.15.93:3300/0 conn(0x7f78340ae3d0 0x7f783406e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:13.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.723+0000 7f783259c640 1 -- 172.21.15.27:0/2147993099 >> v2:172.21.15.93:3300/0 conn(0x7f78340ae3d0 msgr2=0x7f783406e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:13.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.723+0000 7f783259c640 1 --2- 172.21.15.27:0/2147993099 >> v2:172.21.15.93:3300/0 conn(0x7f78340ae3d0 0x7f783406e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:13.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.723+0000 7f783259c640 1 -- 172.21.15.27:0/2147993099 >> v1:172.21.15.27:6789/0 conn(0x7f783406dfd0 legacy=0x7f78340adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:13.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.723+0000 7f7831d9b640 1 -- 172.21.15.27:0/2147993099 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3132270733 0 0) 0x7f78340ae7f0 con 0x7f783406dfd0 2024-01-15T11:34:13.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.723+0000 7f783259c640 1 -- 172.21.15.27:0/2147993099 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7834070670 con 0x7f7834143ae0 2024-01-15T11:34:13.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.727+0000 7f783259c640 1 --2- 172.21.15.27:0/2147993099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7834143ae0 0x7f78340b1f40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7834072ad0 tx=0x7f782401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c0f522bf3adab4 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:13.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.727+0000 7f7831d9b640 1 -- 172.21.15.27:0/2147993099 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78240a7070 con 0x7f7834143ae0 2024-01-15T11:34:13.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.727+0000 7f7831d9b640 1 -- 172.21.15.27:0/2147993099 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78240ab430 con 0x7f7834143ae0 2024-01-15T11:34:13.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.727+0000 7f7831d9b640 1 -- 172.21.15.27:0/2147993099 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78240ab7c0 con 0x7f7834143ae0 2024-01-15T11:34:13.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.727+0000 7f783899d640 1 -- 172.21.15.27:0/2147993099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7834143ae0 msgr2=0x7f78340b1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:13.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.727+0000 7f783899d640 1 --2- 172.21.15.27:0/2147993099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7834143ae0 0x7f78340b1f40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7834072ad0 tx=0x7f782401c430 comp rx=0 tx=0).stop 2024-01-15T11:34:13.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.727+0000 7f783899d640 1 -- 172.21.15.27:0/2147993099 shutdown_connections 2024-01-15T11:34:13.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.727+0000 7f783899d640 1 --2- 172.21.15.27:0/2147993099 >> v2:172.21.15.93:3300/0 conn(0x7f78340ae3d0 0x7f783406e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:13.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.727+0000 7f783899d640 1 --2- 172.21.15.27:0/2147993099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7834143ae0 0x7f78340b1f40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:13.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.727+0000 7f783899d640 1 -- 172.21.15.27:0/2147993099 >> 172.21.15.27:0/2147993099 conn(0x7f78340b0c40 msgr2=0x7f78340b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:13.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.727+0000 7f783899d640 1 -- 172.21.15.27:0/2147993099 shutdown_connections 2024-01-15T11:34:13.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.727+0000 7f783899d640 1 -- 172.21.15.27:0/2147993099 wait complete. 2024-01-15T11:34:13.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.727+0000 7f783899d640 1 Processor -- start 2024-01-15T11:34:13.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.731+0000 7f783899d640 1 -- start start 2024-01-15T11:34:13.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.731+0000 7f783899d640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f783406dfd0 0x7f7834099e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:13.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.731+0000 7f783899d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78340ae3d0 0x7f783415b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:13.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.731+0000 7f783899d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7834143ae0 0x7f783415d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:13.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.731+0000 7f783899d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783415cbb0 con 0x7f78340ae3d0 2024-01-15T11:34:13.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.731+0000 7f783899d640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783415d580 con 0x7f7834143ae0 2024-01-15T11:34:13.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.731+0000 7f783899d640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f783415bfa0 con 0x7f783406dfd0 2024-01-15T11:34:13.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.731+0000 7f782bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78340ae3d0 0x7f783415b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:13.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.731+0000 7f782bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78340ae3d0 0x7f783415b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39012/0 (socket says 172.21.15.27:39012) 2024-01-15T11:34:13.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.731+0000 7f782bfff640 1 -- 172.21.15.27:0/137714685 learned_addr learned my addr 172.21.15.27:0/137714685 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:13.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.731+0000 7f783259c640 1 --2- 172.21.15.27:0/137714685 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f783406dfd0 0x7f7834099e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:13.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.731+0000 7f7832d9d640 1 --2- 172.21.15.27:0/137714685 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7834143ae0 0x7f783415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:13.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.731+0000 7f782bfff640 1 -- 172.21.15.27:0/137714685 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f783406dfd0 msgr2=0x7f7834099e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:13.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.731+0000 7f782bfff640 1 --2- 172.21.15.27:0/137714685 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f783406dfd0 0x7f7834099e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:13.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.731+0000 7f782bfff640 1 -- 172.21.15.27:0/137714685 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7834143ae0 msgr2=0x7f783415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:13.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.731+0000 7f782bfff640 1 --2- 172.21.15.27:0/137714685 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7834143ae0 0x7f783415d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:13.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.731+0000 7f782bfff640 1 -- 172.21.15.27:0/137714685 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7824009420 con 0x7f78340ae3d0 2024-01-15T11:34:13.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.731+0000 7f782bfff640 1 --2- 172.21.15.27:0/137714685 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78340ae3d0 0x7f783415b8c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f781c0011f0 tx=0x7f781c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:13.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.731+0000 7f782affd640 1 -- 172.21.15.27:0/137714685 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c0074e0 con 0x7f78340ae3d0 2024-01-15T11:34:13.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.731+0000 7f782affd640 1 -- 172.21.15.27:0/137714685 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781c007640 con 0x7f78340ae3d0 2024-01-15T11:34:13.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.731+0000 7f783899d640 1 -- 172.21.15.27:0/137714685 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f783415c280 con 0x7f78340ae3d0 2024-01-15T11:34:13.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.731+0000 7f782affd640 1 -- 172.21.15.27:0/137714685 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c004a10 con 0x7f78340ae3d0 2024-01-15T11:34:13.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.731+0000 7f783899d640 1 -- 172.21.15.27:0/137714685 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f783415c840 con 0x7f78340ae3d0 2024-01-15T11:34:13.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.731+0000 7f783899d640 1 -- 172.21.15.27:0/137714685 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f783415cd60 con 0x7f78340ae3d0 2024-01-15T11:34:13.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.735+0000 7f782affd640 1 -- 172.21.15.27:0/137714685 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f781c004b70 con 0x7f78340ae3d0 2024-01-15T11:34:13.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.735+0000 7f782affd640 1 --2- 172.21.15.27:0/137714685 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f78140668f0 0x7f7814068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:13.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.735+0000 7f782affd640 1 -- 172.21.15.27:0/137714685 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f781c083940 con 0x7f78340ae3d0 2024-01-15T11:34:13.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.735+0000 7f783259c640 1 --2- 172.21.15.27:0/137714685 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f78140668f0 0x7f7814068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:13.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.735+0000 7f783259c640 1 --2- 172.21.15.27:0/137714685 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f78140668f0 0x7f7814068db0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f78240af000 tx=0x7f78240a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:13.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.739+0000 7f782affd640 1 -- 172.21.15.27:0/137714685 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f783415cd60 con 0x7f78340ae3d0 2024-01-15T11:34:13.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.895+0000 7f783899d640 1 -- 172.21.15.27:0/137714685 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f783404e850 con 0x7f78340ae3d0 2024-01-15T11:34:13.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.895+0000 7f782affd640 1 -- 172.21.15.27:0/137714685 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16438 (secure 0 0 0) 0x7f781c018020 con 0x7f78340ae3d0 2024-01-15T11:34:13.899 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:34:13.900 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":34,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:34:12.569816+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-15T11:34:10.377236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-15T11:34:11.569141+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:34:13.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.899+0000 7f783899d640 1 -- 172.21.15.27:0/137714685 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f78140668f0 msgr2=0x7f7814068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:13.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.899+0000 7f783899d640 1 --2- 172.21.15.27:0/137714685 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f78140668f0 0x7f7814068db0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f78240af000 tx=0x7f78240a7000 comp rx=0 tx=0).stop 2024-01-15T11:34:13.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.899+0000 7f783899d640 1 -- 172.21.15.27:0/137714685 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78340ae3d0 msgr2=0x7f783415b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:13.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.899+0000 7f783899d640 1 --2- 172.21.15.27:0/137714685 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78340ae3d0 0x7f783415b8c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f781c0011f0 tx=0x7f781c00c9b0 comp rx=0 tx=0).stop 2024-01-15T11:34:13.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.899+0000 7f783899d640 1 -- 172.21.15.27:0/137714685 shutdown_connections 2024-01-15T11:34:13.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.899+0000 7f783899d640 1 --2- 172.21.15.27:0/137714685 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f78140668f0 0x7f7814068db0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:13.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.899+0000 7f783899d640 1 --2- 172.21.15.27:0/137714685 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7834143ae0 0x7f783415d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:13.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.899+0000 7f783899d640 1 --2- 172.21.15.27:0/137714685 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f78340ae3d0 0x7f783415b8c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:13.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.899+0000 7f783899d640 1 --2- 172.21.15.27:0/137714685 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f783406dfd0 0x7f7834099e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:13.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.899+0000 7f783899d640 1 -- 172.21.15.27:0/137714685 >> 172.21.15.27:0/137714685 conn(0x7f78340b0c40 msgr2=0x7f783406cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:13.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.899+0000 7f783899d640 1 -- 172.21.15.27:0/137714685 shutdown_connections 2024-01-15T11:34:13.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:13.899+0000 7f783899d640 1 -- 172.21.15.27:0/137714685 wait complete. 2024-01-15T11:34:13.921 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-15T11:34:14.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.063+0000 7fcf4a9a7640 1 Processor -- start 2024-01-15T11:34:14.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.063+0000 7fcf4a9a7640 1 -- start start 2024-01-15T11:34:14.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.067+0000 7fcf4a9a7640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fcf4413f8f0 0x7fcf4406c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:14.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.067+0000 7fcf4a9a7640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf441406c0 con 0x7fcf4413cf80 2024-01-15T11:34:14.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.067+0000 7fcf4a9a7640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf4415dd20 con 0x7fcf4406c790 2024-01-15T11:34:14.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.067+0000 7fcf4a9a7640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4406cc20 con 0x7fcf4413f8f0 2024-01-15T11:34:14.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.067+0000 7fcf499a5640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fcf4413cf80 0x7fcf4413ffb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45976/0 (socket says 172.21.15.27:45976) 2024-01-15T11:34:14.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.067+0000 7fcf499a5640 1 -- 172.21.15.27:0/2263782710 learned_addr learned my addr 172.21.15.27:0/2263782710 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:14.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.067+0000 7fcf491a4640 1 --2- 172.21.15.27:0/2263782710 >> v2:172.21.15.93:3300/0 conn(0x7fcf4413f8f0 0x7fcf4406c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:14.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.067+0000 7fcf489a3640 1 -- 172.21.15.27:0/2263782710 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518601201 0 0) 0x7fcf441406c0 con 0x7fcf4413cf80 2024-01-15T11:34:14.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.067+0000 7fcf489a3640 1 -- 172.21.15.27:0/2263782710 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf30003530 con 0x7fcf4413cf80 2024-01-15T11:34:14.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.067+0000 7fcf491a4640 1 -- 172.21.15.27:0/2263782710 >> v1:172.21.15.93:6789/0 conn(0x7fcf4406c790 legacy=0x7fcf440cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:14.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.067+0000 7fcf491a4640 1 -- 172.21.15.27:0/2263782710 >> v1:172.21.15.27:6789/0 conn(0x7fcf4413cf80 legacy=0x7fcf4413ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:14.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.067+0000 7fcf491a4640 1 -- 172.21.15.27:0/2263782710 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4415e000 con 0x7fcf4413f8f0 2024-01-15T11:34:14.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.071+0000 7fcf491a4640 1 --2- 172.21.15.27:0/2263782710 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf4413f8f0 0x7fcf4406c250 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcf340097c0 tx=0x7fcf3401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54d052c21e928fac server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:14.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.071+0000 7fcf489a3640 1 -- 172.21.15.27:0/2263782710 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf340ac620 con 0x7fcf4413f8f0 2024-01-15T11:34:14.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.071+0000 7fcf489a3640 1 -- 172.21.15.27:0/2263782710 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf340ac780 con 0x7fcf4413f8f0 2024-01-15T11:34:14.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.071+0000 7fcf489a3640 1 -- 172.21.15.27:0/2263782710 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf340acb10 con 0x7fcf4413f8f0 2024-01-15T11:34:14.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.071+0000 7fcf4a9a7640 1 -- 172.21.15.27:0/2263782710 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf4413f8f0 msgr2=0x7fcf4406c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:14.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.071+0000 7fcf4a9a7640 1 --2- 172.21.15.27:0/2263782710 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf4413f8f0 0x7fcf4406c250 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcf340097c0 tx=0x7fcf3401c3c0 comp rx=0 tx=0).stop 2024-01-15T11:34:14.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.071+0000 7fcf4a9a7640 1 -- 172.21.15.27:0/2263782710 shutdown_connections 2024-01-15T11:34:14.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.071+0000 7fcf4a9a7640 1 --2- 172.21.15.27:0/2263782710 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf4413f8f0 0x7fcf4406c250 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:14.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.071+0000 7fcf4a9a7640 1 -- 172.21.15.27:0/2263782710 >> 172.21.15.27:0/2263782710 conn(0x7fcf4406df30 msgr2=0x7fcf4406a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:14.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.071+0000 7fcf4a9a7640 1 -- 172.21.15.27:0/2263782710 shutdown_connections 2024-01-15T11:34:14.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.071+0000 7fcf4a9a7640 1 -- 172.21.15.27:0/2263782710 wait complete. 2024-01-15T11:34:14.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.071+0000 7fcf4a9a7640 1 Processor -- start 2024-01-15T11:34:14.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.071+0000 7fcf4a9a7640 1 -- start start 2024-01-15T11:34:14.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf4a9a7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf4406c790 0x7fcf44137f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:14.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf4a9a7640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcf4413cf80 0x7fcf440716b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:14.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf4a9a7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf4413f8f0 0x7fcf441f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:14.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf4a9a7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4414c940 con 0x7fcf4406c790 2024-01-15T11:34:14.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf4a9a7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf441397d0 con 0x7fcf4413f8f0 2024-01-15T11:34:14.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf4a9a7640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf441394f0 con 0x7fcf4413cf80 2024-01-15T11:34:14.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf499a5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf4406c790 0x7fcf44137f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:14.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf499a5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf4406c790 0x7fcf44137f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:39018/0 (socket says 172.21.15.27:39018) 2024-01-15T11:34:14.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf499a5640 1 -- 172.21.15.27:0/1508133751 learned_addr learned my addr 172.21.15.27:0/1508133751 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:14.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf491a4640 1 --2- 172.21.15.27:0/1508133751 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcf4413cf80 0x7fcf440716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:14.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf4a1a6640 1 --2- 172.21.15.27:0/1508133751 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf4413f8f0 0x7fcf441f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:14.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf499a5640 1 -- 172.21.15.27:0/1508133751 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcf4413cf80 msgr2=0x7fcf440716b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:14.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf499a5640 1 --2- 172.21.15.27:0/1508133751 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcf4413cf80 0x7fcf440716b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:14.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf499a5640 1 -- 172.21.15.27:0/1508133751 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf4413f8f0 msgr2=0x7fcf441f4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:14.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf499a5640 1 --2- 172.21.15.27:0/1508133751 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf4413f8f0 0x7fcf441f4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:14.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf499a5640 1 -- 172.21.15.27:0/1508133751 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf34009420 con 0x7fcf4406c790 2024-01-15T11:34:14.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf491a4640 1 --2- 172.21.15.27:0/1508133751 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcf4413cf80 0x7fcf440716b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:34:14.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf4a1a6640 1 --2- 172.21.15.27:0/1508133751 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf4413f8f0 0x7fcf441f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:34:14.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf499a5640 1 --2- 172.21.15.27:0/1508133751 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf4406c790 0x7fcf44137f90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcf4000c4d0 tx=0x7fcf4000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:14.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf3a7fc640 1 -- 172.21.15.27:0/1508133751 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40005cf0 con 0x7fcf4406c790 2024-01-15T11:34:14.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf3a7fc640 1 -- 172.21.15.27:0/1508133751 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf40005e50 con 0x7fcf4406c790 2024-01-15T11:34:14.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf3a7fc640 1 -- 172.21.15.27:0/1508133751 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40007270 con 0x7fcf4406c790 2024-01-15T11:34:14.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf4a9a7640 1 -- 172.21.15.27:0/1508133751 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4414c2f0 con 0x7fcf4406c790 2024-01-15T11:34:14.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf4a9a7640 1 -- 172.21.15.27:0/1508133751 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4413bf20 con 0x7fcf4406c790 2024-01-15T11:34:14.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf4a9a7640 1 -- 172.21.15.27:0/1508133751 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf44074990 con 0x7fcf4406c790 2024-01-15T11:34:14.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.075+0000 7fcf3a7fc640 1 -- 172.21.15.27:0/1508133751 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fcf400073d0 con 0x7fcf4406c790 2024-01-15T11:34:14.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.079+0000 7fcf3a7fc640 1 --2- 172.21.15.27:0/1508133751 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fcf28066920 0x7fcf28068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:14.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.079+0000 7fcf3a7fc640 1 -- 172.21.15.27:0/1508133751 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf40083880 con 0x7fcf4406c790 2024-01-15T11:34:14.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.079+0000 7fcf491a4640 1 --2- 172.21.15.27:0/1508133751 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fcf28066920 0x7fcf28068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:14.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.079+0000 7fcf491a4640 1 --2- 172.21.15.27:0/1508133751 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fcf28066920 0x7fcf28068de0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcf340ae000 tx=0x7fcf34008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:14.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.083+0000 7fcf3a7fc640 1 -- 172.21.15.27:0/1508133751 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcf40050b60 con 0x7fcf4406c790 2024-01-15T11:34:14.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:14.271+0000 7fcf4a9a7640 1 -- 172.21.15.27:0/1508133751 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcf4406d2f0 con 0x7fcf4406c790 2024-01-15T11:34:15.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.207+0000 7fcf3a7fc640 1 -- 172.21.15.27:0/1508133751 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcf400170b0 con 0x7fcf4406c790 2024-01-15T11:34:15.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.207+0000 7fcf4a9a7640 1 -- 172.21.15.27:0/1508133751 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fcf28066920 msgr2=0x7fcf28068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:15.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.207+0000 7fcf4a9a7640 1 --2- 172.21.15.27:0/1508133751 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fcf28066920 0x7fcf28068de0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcf340ae000 tx=0x7fcf34008040 comp rx=0 tx=0).stop 2024-01-15T11:34:15.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.207+0000 7fcf4a9a7640 1 -- 172.21.15.27:0/1508133751 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf4406c790 msgr2=0x7fcf44137f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:15.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.207+0000 7fcf4a9a7640 1 --2- 172.21.15.27:0/1508133751 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf4406c790 0x7fcf44137f90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcf4000c4d0 tx=0x7fcf4000c990 comp rx=0 tx=0).stop 2024-01-15T11:34:15.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.207+0000 7fcf4a9a7640 1 -- 172.21.15.27:0/1508133751 shutdown_connections 2024-01-15T11:34:15.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.207+0000 7fcf4a9a7640 1 --2- 172.21.15.27:0/1508133751 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fcf28066920 0x7fcf28068de0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:15.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.207+0000 7fcf4a9a7640 1 --2- 172.21.15.27:0/1508133751 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf4413f8f0 0x7fcf441f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:15.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.207+0000 7fcf4a9a7640 1 --2- 172.21.15.27:0/1508133751 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcf4413cf80 0x7fcf440716b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:15.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.207+0000 7fcf4a9a7640 1 --2- 172.21.15.27:0/1508133751 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcf4406c790 0x7fcf44137f90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:15.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.207+0000 7fcf4a9a7640 1 -- 172.21.15.27:0/1508133751 >> 172.21.15.27:0/1508133751 conn(0x7fcf4406df30 msgr2=0x7fcf4413e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:15.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.207+0000 7fcf4a9a7640 1 -- 172.21.15.27:0/1508133751 shutdown_connections 2024-01-15T11:34:15.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.207+0000 7fcf4a9a7640 1 -- 172.21.15.27:0/1508133751 wait complete. 2024-01-15T11:34:15.235 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-15T11:34:15.235 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-15T11:34:15.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.383+0000 7f99e829a640 1 Processor -- start 2024-01-15T11:34:15.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.383+0000 7f99e829a640 1 -- start start 2024-01-15T11:34:15.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.383+0000 7f99e829a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f99e0146820 0x7f99e0070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:15.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.383+0000 7f99e829a640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e0147190 con 0x7f99e015eb50 2024-01-15T11:34:15.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.383+0000 7f99e829a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e006d030 con 0x7f99e00b4210 2024-01-15T11:34:15.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.383+0000 7f99e829a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e0161fa0 con 0x7f99e0146820 2024-01-15T11:34:15.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.383+0000 7f99e6837640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f99e015eb50 0x7f99e0161890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:60032/0 (socket says 172.21.15.27:60032) 2024-01-15T11:34:15.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.383+0000 7f99e6837640 1 -- 172.21.15.27:0/84860094 learned_addr learned my addr 172.21.15.27:0/84860094 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:15.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.383+0000 7f99e6036640 1 --2- 172.21.15.27:0/84860094 >> v2:172.21.15.27:3300/0 conn(0x7f99e0146820 0x7f99e0070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:15.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.383+0000 7f99e6036640 1 -- 172.21.15.27:0/84860094 >> v1:172.21.15.93:6789/0 conn(0x7f99e00b4210 legacy=0x7f99e0161180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:15.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.383+0000 7f99e6036640 1 -- 172.21.15.27:0/84860094 >> v1:172.21.15.27:6789/0 conn(0x7f99e015eb50 legacy=0x7f99e0161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:15.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.383+0000 7f99e6036640 1 -- 172.21.15.27:0/84860094 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e0146c00 con 0x7f99e0146820 2024-01-15T11:34:15.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.387+0000 7f99e6036640 1 --2- 172.21.15.27:0/84860094 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99e0146820 0x7f99e0070a50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f99e0146df0 tx=0x7f99dc01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb10456dc63edd67 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:15.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.387+0000 7f99e5034640 1 -- 172.21.15.27:0/84860094 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc0ab610 con 0x7f99e0146820 2024-01-15T11:34:15.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.387+0000 7f99e5034640 1 -- 172.21.15.27:0/84860094 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99dc0ab770 con 0x7f99e0146820 2024-01-15T11:34:15.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.387+0000 7f99e5034640 1 -- 172.21.15.27:0/84860094 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc0abb00 con 0x7f99e0146820 2024-01-15T11:34:15.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.387+0000 7f99e829a640 1 -- 172.21.15.27:0/84860094 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99e0146820 msgr2=0x7f99e0070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:15.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.387+0000 7f99e829a640 1 --2- 172.21.15.27:0/84860094 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99e0146820 0x7f99e0070a50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f99e0146df0 tx=0x7f99dc01c410 comp rx=0 tx=0).stop 2024-01-15T11:34:15.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.387+0000 7f99e829a640 1 -- 172.21.15.27:0/84860094 shutdown_connections 2024-01-15T11:34:15.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.387+0000 7f99e829a640 1 --2- 172.21.15.27:0/84860094 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99e0146820 0x7f99e0070a50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:15.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.387+0000 7f99e829a640 1 -- 172.21.15.27:0/84860094 >> 172.21.15.27:0/84860094 conn(0x7f99e00b2f10 msgr2=0x7f99e00b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:15.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.387+0000 7f99e829a640 1 -- 172.21.15.27:0/84860094 shutdown_connections 2024-01-15T11:34:15.392 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.387+0000 7f99e829a640 1 -- 172.21.15.27:0/84860094 wait complete. 2024-01-15T11:34:15.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.391+0000 7f99e829a640 1 Processor -- start 2024-01-15T11:34:15.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.391+0000 7f99e829a640 1 -- start start 2024-01-15T11:34:15.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.391+0000 7f99e829a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99e00b4210 0x7f99e015d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:15.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.391+0000 7f99e829a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f99e0146820 0x7f99e0134ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:15.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.391+0000 7f99e829a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99e015eb50 0x7f99e0135420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:15.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.391+0000 7f99e829a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e015d590 con 0x7f99e00b4210 2024-01-15T11:34:15.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.391+0000 7f99e829a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e0139e10 con 0x7f99e015eb50 2024-01-15T11:34:15.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.391+0000 7f99e829a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e0132480 con 0x7f99e0146820 2024-01-15T11:34:15.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.391+0000 7f99e6036640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99e00b4210 0x7f99e015d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:15.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.391+0000 7f99e6036640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99e00b4210 0x7f99e015d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38356/0 (socket says 172.21.15.27:38356) 2024-01-15T11:34:15.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.391+0000 7f99e6036640 1 -- 172.21.15.27:0/3009816100 learned_addr learned my addr 172.21.15.27:0/3009816100 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:15.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.391+0000 7f99e5835640 1 --2- 172.21.15.27:0/3009816100 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f99e0146820 0x7f99e0134ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:15.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.391+0000 7f99e6837640 1 --2- 172.21.15.27:0/3009816100 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99e015eb50 0x7f99e0135420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:15.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.391+0000 7f99e6036640 1 -- 172.21.15.27:0/3009816100 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f99e0146820 msgr2=0x7f99e0134ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:15.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.391+0000 7f99e6036640 1 --2- 172.21.15.27:0/3009816100 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f99e0146820 0x7f99e0134ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:15.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.391+0000 7f99e6036640 1 -- 172.21.15.27:0/3009816100 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99e015eb50 msgr2=0x7f99e0135420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:15.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.391+0000 7f99e6036640 1 --2- 172.21.15.27:0/3009816100 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99e015eb50 0x7f99e0135420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:15.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.391+0000 7f99e6036640 1 -- 172.21.15.27:0/3009816100 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc009420 con 0x7f99e00b4210 2024-01-15T11:34:15.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.391+0000 7f99e6837640 1 --2- 172.21.15.27:0/3009816100 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99e015eb50 0x7f99e0135420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:34:15.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.391+0000 7f99e6036640 1 --2- 172.21.15.27:0/3009816100 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99e00b4210 0x7f99e015d050 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f99dc01a040 tx=0x7f99dc01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:15.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.395+0000 7f99d6ffd640 1 -- 172.21.15.27:0/3009816100 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc0b5810 con 0x7f99e00b4210 2024-01-15T11:34:15.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.395+0000 7f99d6ffd640 1 -- 172.21.15.27:0/3009816100 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99dc0b5990 con 0x7f99e00b4210 2024-01-15T11:34:15.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.395+0000 7f99d6ffd640 1 -- 172.21.15.27:0/3009816100 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc0b5d40 con 0x7f99e00b4210 2024-01-15T11:34:15.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.395+0000 7f99e829a640 1 -- 172.21.15.27:0/3009816100 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e0132760 con 0x7f99e00b4210 2024-01-15T11:34:15.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.395+0000 7f99e829a640 1 -- 172.21.15.27:0/3009816100 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e0132d20 con 0x7f99e00b4210 2024-01-15T11:34:15.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.395+0000 7f99e829a640 1 -- 172.21.15.27:0/3009816100 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e004e850 con 0x7f99e00b4210 2024-01-15T11:34:15.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.395+0000 7f99d6ffd640 1 -- 172.21.15.27:0/3009816100 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f99dc0b4390 con 0x7f99e00b4210 2024-01-15T11:34:15.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.395+0000 7f99d6ffd640 1 --2- 172.21.15.27:0/3009816100 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f99c40668f0 0x7f99c4068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:15.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.395+0000 7f99d6ffd640 1 -- 172.21.15.27:0/3009816100 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99dc11ecd0 con 0x7f99e00b4210 2024-01-15T11:34:15.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.395+0000 7f99e5835640 1 --2- 172.21.15.27:0/3009816100 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f99c40668f0 0x7f99c4068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:15.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.395+0000 7f99e5835640 1 --2- 172.21.15.27:0/3009816100 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f99c40668f0 0x7f99c4068db0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f99e0134e70 tx=0x7f99d0009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:15.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.399+0000 7f99d6ffd640 1 -- 172.21.15.27:0/3009816100 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f99dc0ebfb0 con 0x7f99e00b4210 2024-01-15T11:34:15.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:15.587+0000 7f99e829a640 1 -- 172.21.15.27:0/3009816100 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f99e00d1f00 con 0x7f99e00b4210 2024-01-15T11:34:16.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.215+0000 7f99d6ffd640 1 -- 172.21.15.27:0/3009816100 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f99dc0ef5d0 con 0x7f99e00b4210 2024-01-15T11:34:16.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.219+0000 7f99e829a640 1 -- 172.21.15.27:0/3009816100 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f99c40668f0 msgr2=0x7f99c4068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:16.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.219+0000 7f99e829a640 1 --2- 172.21.15.27:0/3009816100 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f99c40668f0 0x7f99c4068db0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f99e0134e70 tx=0x7f99d0009060 comp rx=0 tx=0).stop 2024-01-15T11:34:16.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.219+0000 7f99e829a640 1 -- 172.21.15.27:0/3009816100 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99e00b4210 msgr2=0x7f99e015d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:16.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.219+0000 7f99e829a640 1 --2- 172.21.15.27:0/3009816100 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99e00b4210 0x7f99e015d050 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f99dc01a040 tx=0x7f99dc01ac50 comp rx=0 tx=0).stop 2024-01-15T11:34:16.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.219+0000 7f99e829a640 1 -- 172.21.15.27:0/3009816100 shutdown_connections 2024-01-15T11:34:16.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.219+0000 7f99e829a640 1 --2- 172.21.15.27:0/3009816100 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f99c40668f0 0x7f99c4068db0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:16.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.219+0000 7f99e829a640 1 --2- 172.21.15.27:0/3009816100 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99e015eb50 0x7f99e0135420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:16.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.219+0000 7f99e829a640 1 --2- 172.21.15.27:0/3009816100 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f99e0146820 0x7f99e0134ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:16.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.219+0000 7f99e829a640 1 --2- 172.21.15.27:0/3009816100 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f99e00b4210 0x7f99e015d050 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:16.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.219+0000 7f99e829a640 1 -- 172.21.15.27:0/3009816100 >> 172.21.15.27:0/3009816100 conn(0x7f99e00b2f10 msgr2=0x7f99e013a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:16.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.219+0000 7f99e829a640 1 -- 172.21.15.27:0/3009816100 shutdown_connections 2024-01-15T11:34:16.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.219+0000 7f99e829a640 1 -- 172.21.15.27:0/3009816100 wait complete. 2024-01-15T11:34:16.246 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-15T11:34:16.246 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-15T11:34:16.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.391+0000 7f443ff0f640 1 Processor -- start 2024-01-15T11:34:16.393 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.391+0000 7f443ff0f640 1 -- start start 2024-01-15T11:34:16.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.391+0000 7f443ff0f640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f443815d7b0 0x7f44380d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:16.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.391+0000 7f443ff0f640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f44380cead0 0x7f44380d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:16.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.391+0000 7f443ff0f640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44380d22c0 con 0x7f44380d1eb0 2024-01-15T11:34:16.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.391+0000 7f443ff0f640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44380cefd0 con 0x7f443815d7b0 2024-01-15T11:34:16.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.391+0000 7f443ff0f640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44380cf2b0 con 0x7f44380cead0 2024-01-15T11:34:16.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.391+0000 7f443e4ac640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f44380d1eb0 0x7f44380cfc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:60042/0 (socket says 172.21.15.27:60042) 2024-01-15T11:34:16.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.391+0000 7f443dcab640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f443815d7b0 0x7f44380d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:16.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.391+0000 7f443e4ac640 1 -- 172.21.15.27:0/1771747987 learned_addr learned my addr 172.21.15.27:0/1771747987 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:16.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.391+0000 7f443d4aa640 1 --2- 172.21.15.27:0/1771747987 >> v2:172.21.15.93:3300/0 conn(0x7f44380cead0 0x7f44380d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:16.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.391+0000 7f443dcab640 1 -- 172.21.15.27:0/1771747987 >> v2:172.21.15.93:3300/0 conn(0x7f44380cead0 msgr2=0x7f44380d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:16.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.391+0000 7f443dcab640 1 --2- 172.21.15.27:0/1771747987 >> v2:172.21.15.93:3300/0 conn(0x7f44380cead0 0x7f44380d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:16.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.391+0000 7f443dcab640 1 -- 172.21.15.27:0/1771747987 >> v1:172.21.15.27:6789/0 conn(0x7f44380d1eb0 legacy=0x7f44380cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:16.396 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.391+0000 7f443dcab640 1 -- 172.21.15.27:0/1771747987 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443806b3f0 con 0x7f443815d7b0 2024-01-15T11:34:16.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.395+0000 7f443dcab640 1 --2- 172.21.15.27:0/1771747987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f443815d7b0 0x7f44380d10d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f443808ba60 tx=0x7f443401c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e575f3bd2fd5e923 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:16.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.395+0000 7f443cca9640 1 -- 172.21.15.27:0/1771747987 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44340ac640 con 0x7f443815d7b0 2024-01-15T11:34:16.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.395+0000 7f443cca9640 1 -- 172.21.15.27:0/1771747987 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44340ac7a0 con 0x7f443815d7b0 2024-01-15T11:34:16.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.395+0000 7f443cca9640 1 -- 172.21.15.27:0/1771747987 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44340acb30 con 0x7f443815d7b0 2024-01-15T11:34:16.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.395+0000 7f443ff0f640 1 -- 172.21.15.27:0/1771747987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f443815d7b0 msgr2=0x7f44380d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:16.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.395+0000 7f443ff0f640 1 --2- 172.21.15.27:0/1771747987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f443815d7b0 0x7f44380d10d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f443808ba60 tx=0x7f443401c310 comp rx=0 tx=0).stop 2024-01-15T11:34:16.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.395+0000 7f443ff0f640 1 -- 172.21.15.27:0/1771747987 shutdown_connections 2024-01-15T11:34:16.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.395+0000 7f443ff0f640 1 --2- 172.21.15.27:0/1771747987 >> v2:172.21.15.93:3300/0 conn(0x7f44380cead0 0x7f44380d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:16.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.395+0000 7f443ff0f640 1 --2- 172.21.15.27:0/1771747987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f443815d7b0 0x7f44380d10d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:16.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.395+0000 7f443ff0f640 1 -- 172.21.15.27:0/1771747987 >> 172.21.15.27:0/1771747987 conn(0x7f44380d33b0 msgr2=0x7f44380d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:16.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.395+0000 7f443ff0f640 1 -- 172.21.15.27:0/1771747987 shutdown_connections 2024-01-15T11:34:16.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.395+0000 7f443ff0f640 1 -- 172.21.15.27:0/1771747987 wait complete. 2024-01-15T11:34:16.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.399+0000 7f443ff0f640 1 Processor -- start 2024-01-15T11:34:16.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.399+0000 7f443ff0f640 1 -- start start 2024-01-15T11:34:16.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.399+0000 7f443ff0f640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44380cead0 0x7f44380c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:16.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.399+0000 7f443ff0f640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f44380d1eb0 0x7f44380cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:16.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.399+0000 7f443ff0f640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f443815d7b0 0x7f44381548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:16.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.399+0000 7f443ff0f640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44380cc130 con 0x7f443815d7b0 2024-01-15T11:34:16.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.399+0000 7f443ff0f640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44380c9410 con 0x7f44380cead0 2024-01-15T11:34:16.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.399+0000 7f443ff0f640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4438154e00 con 0x7f44380d1eb0 2024-01-15T11:34:16.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.399+0000 7f443e4ac640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f443815d7b0 0x7f44381548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:16.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.399+0000 7f443dcab640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44380cead0 0x7f44380c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:16.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.399+0000 7f443e4ac640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f443815d7b0 0x7f44381548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38362/0 (socket says 172.21.15.27:38362) 2024-01-15T11:34:16.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.399+0000 7f443e4ac640 1 -- 172.21.15.27:0/3921863905 learned_addr learned my addr 172.21.15.27:0/3921863905 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:16.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.399+0000 7f443d4aa640 1 --2- 172.21.15.27:0/3921863905 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f44380d1eb0 0x7f44380cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:16.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.399+0000 7f443e4ac640 1 -- 172.21.15.27:0/3921863905 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f44380d1eb0 msgr2=0x7f44380cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:16.403 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.399+0000 7f443e4ac640 1 --2- 172.21.15.27:0/3921863905 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f44380d1eb0 0x7f44380cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:16.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.399+0000 7f443e4ac640 1 -- 172.21.15.27:0/3921863905 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44380cead0 msgr2=0x7f44380c9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:16.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.399+0000 7f443e4ac640 1 --2- 172.21.15.27:0/3921863905 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44380cead0 0x7f44380c9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:16.404 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.399+0000 7f443e4ac640 1 -- 172.21.15.27:0/3921863905 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4434009420 con 0x7f443815d7b0 2024-01-15T11:34:16.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.399+0000 7f443e4ac640 1 --2- 172.21.15.27:0/3921863905 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f443815d7b0 0x7f44381548c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f443000caa0 tx=0x7f443000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:16.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.399+0000 7f442e7fc640 1 -- 172.21.15.27:0/3921863905 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443000ab40 con 0x7f443815d7b0 2024-01-15T11:34:16.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.399+0000 7f442e7fc640 1 -- 172.21.15.27:0/3921863905 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443000aca0 con 0x7f443815d7b0 2024-01-15T11:34:16.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.399+0000 7f442e7fc640 1 -- 172.21.15.27:0/3921863905 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4430012600 con 0x7f443815d7b0 2024-01-15T11:34:16.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.399+0000 7f443ff0f640 1 -- 172.21.15.27:0/3921863905 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44380cb520 con 0x7f443815d7b0 2024-01-15T11:34:16.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.399+0000 7f443ff0f640 1 -- 172.21.15.27:0/3921863905 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44380cbae0 con 0x7f443815d7b0 2024-01-15T11:34:16.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.403+0000 7f443ff0f640 1 -- 172.21.15.27:0/3921863905 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44380cc2c0 con 0x7f443815d7b0 2024-01-15T11:34:16.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.403+0000 7f442e7fc640 1 -- 172.21.15.27:0/3921863905 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f4430007070 con 0x7f443815d7b0 2024-01-15T11:34:16.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.403+0000 7f442e7fc640 1 --2- 172.21.15.27:0/3921863905 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f441c0668f0 0x7f441c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:16.406 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.403+0000 7f442e7fc640 1 -- 172.21.15.27:0/3921863905 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4430084160 con 0x7f443815d7b0 2024-01-15T11:34:16.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.403+0000 7f443dcab640 1 --2- 172.21.15.27:0/3921863905 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f441c0668f0 0x7f441c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:16.407 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.403+0000 7f443dcab640 1 --2- 172.21.15.27:0/3921863905 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f441c0668f0 0x7f441c068db0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f44340ae000 tx=0x7f4434008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:16.410 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.407+0000 7f442e7fc640 1 -- 172.21.15.27:0/3921863905 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4430051440 con 0x7f443815d7b0 2024-01-15T11:34:16.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.595+0000 7f443ff0f640 1 -- 172.21.15.27:0/3921863905 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f443804e850 con 0x7f443815d7b0 2024-01-15T11:34:16.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.595+0000 7f442e7fc640 1 -- 172.21.15.27:0/3921863905 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4907 (secure 0 0 0) 0x7f4430054a60 con 0x7f443815d7b0 2024-01-15T11:34:16.600 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:34:16.600 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/586691059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":586691059},{"type":"v1","addr":"172.21.15.93:6835","nonce":586691059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4811,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/213641846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":213641846},{"type":"v1","addr":"172.21.15.93:6837","nonce":213641846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5067,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/1958435006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":1958435006},{"type":"v1","addr":"172.21.15.27:6834","nonce":1958435006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-15T11:34:12.570285+0000","modified":"2024-01-15T11:34:15.593039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/1732204565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":1732204565},{"type":"v1","addr":"172.21.15.27:6835","nonce":1732204565}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-15T11:34:16.600 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 17 2024-01-15T11:34:16.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.599+0000 7f443ff0f640 1 -- 172.21.15.27:0/3921863905 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f441c0668f0 msgr2=0x7f441c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:16.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.599+0000 7f443ff0f640 1 --2- 172.21.15.27:0/3921863905 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f441c0668f0 0x7f441c068db0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f44340ae000 tx=0x7f4434008040 comp rx=0 tx=0).stop 2024-01-15T11:34:16.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.599+0000 7f443ff0f640 1 -- 172.21.15.27:0/3921863905 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f443815d7b0 msgr2=0x7f44381548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:16.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.599+0000 7f443ff0f640 1 --2- 172.21.15.27:0/3921863905 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f443815d7b0 0x7f44381548c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f443000caa0 tx=0x7f443000cf60 comp rx=0 tx=0).stop 2024-01-15T11:34:16.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.599+0000 7f443ff0f640 1 -- 172.21.15.27:0/3921863905 shutdown_connections 2024-01-15T11:34:16.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.599+0000 7f443ff0f640 1 --2- 172.21.15.27:0/3921863905 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f443815d7b0 0x7f44381548c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:16.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.599+0000 7f443ff0f640 1 --2- 172.21.15.27:0/3921863905 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f44380d1eb0 0x7f44380cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:16.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.599+0000 7f443ff0f640 1 --2- 172.21.15.27:0/3921863905 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f441c0668f0 0x7f441c068db0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:16.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.599+0000 7f443ff0f640 1 --2- 172.21.15.27:0/3921863905 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44380cead0 0x7f44380c9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:16.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.599+0000 7f443ff0f640 1 -- 172.21.15.27:0/3921863905 >> 172.21.15.27:0/3921863905 conn(0x7f44380d33b0 msgr2=0x7f44380b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:16.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.599+0000 7f443ff0f640 1 -- 172.21.15.27:0/3921863905 shutdown_connections 2024-01-15T11:34:16.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.599+0000 7f443ff0f640 1 -- 172.21.15.27:0/3921863905 wait complete. 2024-01-15T11:34:16.620 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:34:16.762 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.759+0000 7f4fa4a79640 1 Processor -- start 2024-01-15T11:34:16.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.759+0000 7f4fa4a79640 1 -- start start 2024-01-15T11:34:16.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.759+0000 7f4fa4a79640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4fa006dfd0 0x7f4fa006e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:16.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.763+0000 7f4fa4a79640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f4fa00adcc0 0x7f4fa00ae110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:16.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.763+0000 7f4fa4a79640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa006e950 con 0x7f4fa0143ae0 2024-01-15T11:34:16.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.763+0000 7f4fa4a79640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa0070670 con 0x7f4fa00adcc0 2024-01-15T11:34:16.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.763+0000 7f4fa4a79640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa0070950 con 0x7f4fa006dfd0 2024-01-15T11:34:16.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.763+0000 7f4f9e59c640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f4fa0143ae0 0x7f4fa00b1f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:60044/0 (socket says 172.21.15.27:60044) 2024-01-15T11:34:16.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.763+0000 7f4f9e59c640 1 -- 172.21.15.27:0/2428932122 learned_addr learned my addr 172.21.15.27:0/2428932122 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:16.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.763+0000 7f4f9ed9d640 1 --2- 172.21.15.27:0/2428932122 >> v2:172.21.15.27:3300/0 conn(0x7f4fa00adcc0 0x7f4fa00ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:16.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.763+0000 7f4f9dd9b640 1 --2- 172.21.15.27:0/2428932122 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4fa006dfd0 0x7f4fa006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:16.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.763+0000 7f4f9ed9d640 1 -- 172.21.15.27:0/2428932122 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4fa006dfd0 msgr2=0x7f4fa006e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:16.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.763+0000 7f4f9d59a640 1 -- 172.21.15.27:0/2428932122 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583353661 0 0) 0x7f4fa006e950 con 0x7f4fa0143ae0 2024-01-15T11:34:16.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.763+0000 7f4f9ed9d640 1 --2- 172.21.15.27:0/2428932122 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4fa006dfd0 0x7f4fa006e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:16.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.763+0000 7f4f9ed9d640 1 -- 172.21.15.27:0/2428932122 >> v1:172.21.15.27:6789/0 conn(0x7f4fa0143ae0 legacy=0x7f4fa00b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:16.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.763+0000 7f4f9ed9d640 1 -- 172.21.15.27:0/2428932122 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa0070c30 con 0x7f4fa00adcc0 2024-01-15T11:34:16.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.763+0000 7f4f9dd9b640 1 --2- 172.21.15.27:0/2428932122 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4fa006dfd0 0x7f4fa006e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:34:16.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.763+0000 7f4f9ed9d640 1 --2- 172.21.15.27:0/2428932122 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4fa00adcc0 0x7f4fa00ae110 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4f98009d90 tx=0x7f4f9801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=959a36b92896e179 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:16.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.763+0000 7f4f9d59a640 1 -- 172.21.15.27:0/2428932122 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f980a59e0 con 0x7f4fa00adcc0 2024-01-15T11:34:16.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.763+0000 7f4f9d59a640 1 -- 172.21.15.27:0/2428932122 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f980a5b40 con 0x7f4fa00adcc0 2024-01-15T11:34:16.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.763+0000 7f4f9d59a640 1 -- 172.21.15.27:0/2428932122 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f980ad440 con 0x7f4fa00adcc0 2024-01-15T11:34:16.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.767+0000 7f4fa4a79640 1 -- 172.21.15.27:0/2428932122 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4fa00adcc0 msgr2=0x7f4fa00ae110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:16.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.767+0000 7f4fa4a79640 1 --2- 172.21.15.27:0/2428932122 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4fa00adcc0 0x7f4fa00ae110 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4f98009d90 tx=0x7f4f9801c920 comp rx=0 tx=0).stop 2024-01-15T11:34:16.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.767+0000 7f4fa4a79640 1 -- 172.21.15.27:0/2428932122 shutdown_connections 2024-01-15T11:34:16.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.767+0000 7f4fa4a79640 1 --2- 172.21.15.27:0/2428932122 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4fa00adcc0 0x7f4fa00ae110 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:16.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.767+0000 7f4fa4a79640 1 --2- 172.21.15.27:0/2428932122 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4fa006dfd0 0x7f4fa006e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:16.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.767+0000 7f4fa4a79640 1 -- 172.21.15.27:0/2428932122 >> 172.21.15.27:0/2428932122 conn(0x7f4fa00b0c40 msgr2=0x7f4fa00b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:16.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.767+0000 7f4fa4a79640 1 -- 172.21.15.27:0/2428932122 shutdown_connections 2024-01-15T11:34:16.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.767+0000 7f4fa4a79640 1 -- 172.21.15.27:0/2428932122 wait complete. 2024-01-15T11:34:16.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.767+0000 7f4fa4a79640 1 Processor -- start 2024-01-15T11:34:16.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.767+0000 7f4fa4a79640 1 -- start start 2024-01-15T11:34:16.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.767+0000 7f4fa4a79640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4fa006dfd0 0x7f4fa0159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:16.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.767+0000 7f4fa4a79640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4fa00adcc0 0x7f4fa015c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:16.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.767+0000 7f4fa4a79640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4fa0143ae0 0x7f4fa009c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:16.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.767+0000 7f4fa4a79640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa012e620 con 0x7f4fa006dfd0 2024-01-15T11:34:16.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.767+0000 7f4fa4a79640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa012eba0 con 0x7f4fa00adcc0 2024-01-15T11:34:16.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.767+0000 7f4fa4a79640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa015cbb0 con 0x7f4fa0143ae0 2024-01-15T11:34:16.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.767+0000 7f4f9e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4fa006dfd0 0x7f4fa0159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:16.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.767+0000 7f4f9e59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4fa006dfd0 0x7f4fa0159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38382/0 (socket says 172.21.15.27:38382) 2024-01-15T11:34:16.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.767+0000 7f4f9e59c640 1 -- 172.21.15.27:0/166693129 learned_addr learned my addr 172.21.15.27:0/166693129 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:16.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.771+0000 7f4f9e59c640 1 -- 172.21.15.27:0/166693129 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4fa0143ae0 msgr2=0x7f4fa009c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:16.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.771+0000 7f4f9e59c640 1 --2- 172.21.15.27:0/166693129 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4fa0143ae0 0x7f4fa009c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.771+0000 7f4f9dd9b640 1 --2- 172.21.15.27:0/166693129 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4fa00adcc0 0x7f4fa015c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.771+0000 7f4f9e59c640 1 -- 172.21.15.27:0/166693129 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4fa00adcc0 msgr2=0x7f4fa015c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.771+0000 7f4f9e59c640 1 --2- 172.21.15.27:0/166693129 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4fa00adcc0 0x7f4fa015c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.771+0000 7f4f9e59c640 1 -- 172.21.15.27:0/166693129 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f98009a70 con 0x7f4fa006dfd0 2024-01-15T11:34:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.771+0000 7f4f9dd9b640 1 --2- 172.21.15.27:0/166693129 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4fa00adcc0 0x7f4fa015c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:34:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.771+0000 7f4f9e59c640 1 --2- 172.21.15.27:0/166693129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4fa006dfd0 0x7f4fa0159a90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000c480 tx=0x7f4f9000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.771+0000 7f4f8effd640 1 -- 172.21.15.27:0/166693129 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f900074e0 con 0x7f4fa006dfd0 2024-01-15T11:34:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.771+0000 7f4f8effd640 1 -- 172.21.15.27:0/166693129 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f90007660 con 0x7f4fa006dfd0 2024-01-15T11:34:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.771+0000 7f4f8effd640 1 -- 172.21.15.27:0/166693129 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f90004a30 con 0x7f4fa006dfd0 2024-01-15T11:34:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.771+0000 7f4fa4a79640 1 -- 172.21.15.27:0/166693129 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa015ce90 con 0x7f4fa006dfd0 2024-01-15T11:34:16.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.771+0000 7f4fa4a79640 1 -- 172.21.15.27:0/166693129 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa0159fd0 con 0x7f4fa006dfd0 2024-01-15T11:34:16.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.771+0000 7f4fa4a79640 1 -- 172.21.15.27:0/166693129 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa004e850 con 0x7f4fa006dfd0 2024-01-15T11:34:16.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.771+0000 7f4f8effd640 1 -- 172.21.15.27:0/166693129 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f4f90004b90 con 0x7f4fa006dfd0 2024-01-15T11:34:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.771+0000 7f4f8effd640 1 --2- 172.21.15.27:0/166693129 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4f800668f0 0x7f4f80068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.771+0000 7f4f8effd640 1 -- 172.21.15.27:0/166693129 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f90083540 con 0x7f4fa006dfd0 2024-01-15T11:34:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.775+0000 7f4f9dd9b640 1 --2- 172.21.15.27:0/166693129 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4f800668f0 0x7f4f80068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.775+0000 7f4f9dd9b640 1 --2- 172.21.15.27:0/166693129 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4f800668f0 0x7f4f80068db0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4fa006c660 tx=0x7f4f94008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:16.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.775+0000 7f4f8effd640 1 -- 172.21.15.27:0/166693129 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4f90054280 con 0x7f4fa006dfd0 2024-01-15T11:34:16.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.935+0000 7f4fa4a79640 1 -- 172.21.15.27:0/166693129 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4fa015d080 con 0x7f4fa006dfd0 2024-01-15T11:34:16.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.935+0000 7f4f8effd640 1 -- 172.21.15.27:0/166693129 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16425 (secure 0 0 0) 0x7f4fa015d080 con 0x7f4fa006dfd0 2024-01-15T11:34:16.939 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:34:16.939 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":35,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:34:14.173005+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-15T11:34:10.377236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-15T11:34:11.569141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:34:16.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.939+0000 7f4fa4a79640 1 -- 172.21.15.27:0/166693129 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4f800668f0 msgr2=0x7f4f80068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:16.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.939+0000 7f4fa4a79640 1 --2- 172.21.15.27:0/166693129 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4f800668f0 0x7f4f80068db0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4fa006c660 tx=0x7f4f94008040 comp rx=0 tx=0).stop 2024-01-15T11:34:16.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.939+0000 7f4fa4a79640 1 -- 172.21.15.27:0/166693129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4fa006dfd0 msgr2=0x7f4fa0159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:16.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.939+0000 7f4fa4a79640 1 --2- 172.21.15.27:0/166693129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4fa006dfd0 0x7f4fa0159a90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000c480 tx=0x7f4f9000c940 comp rx=0 tx=0).stop 2024-01-15T11:34:16.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.939+0000 7f4fa4a79640 1 -- 172.21.15.27:0/166693129 shutdown_connections 2024-01-15T11:34:16.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.939+0000 7f4fa4a79640 1 --2- 172.21.15.27:0/166693129 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4fa0143ae0 0x7f4fa009c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:16.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.939+0000 7f4fa4a79640 1 --2- 172.21.15.27:0/166693129 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f4f800668f0 0x7f4f80068db0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:16.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.939+0000 7f4fa4a79640 1 --2- 172.21.15.27:0/166693129 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4fa00adcc0 0x7f4fa015c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:16.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.939+0000 7f4fa4a79640 1 --2- 172.21.15.27:0/166693129 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4fa006dfd0 0x7f4fa0159a90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:16.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.939+0000 7f4fa4a79640 1 -- 172.21.15.27:0/166693129 >> 172.21.15.27:0/166693129 conn(0x7f4fa00b0c40 msgr2=0x7f4fa00b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:16.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.939+0000 7f4fa4a79640 1 -- 172.21.15.27:0/166693129 shutdown_connections 2024-01-15T11:34:16.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:16.939+0000 7f4fa4a79640 1 -- 172.21.15.27:0/166693129 wait complete. 2024-01-15T11:34:16.960 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-15T11:34:16.960 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-15T11:34:17.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.099+0000 7f6dfddf5640 1 Processor -- start 2024-01-15T11:34:17.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.099+0000 7f6dfddf5640 1 -- start start 2024-01-15T11:34:17.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.099+0000 7f6dfddf5640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6df8070730 0x7f6df806bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:17.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.103+0000 7f6dfddf5640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df815dba0 con 0x7f6df8147040 2024-01-15T11:34:17.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.103+0000 7f6dfddf5640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df806c860 con 0x7f6df8146c60 2024-01-15T11:34:17.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.103+0000 7f6dfddf5640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df806d100 con 0x7f6df8070730 2024-01-15T11:34:17.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.103+0000 7f6df7fff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f6df8147040 0x7f6df806c050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:60046/0 (socket says 172.21.15.27:60046) 2024-01-15T11:34:17.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.103+0000 7f6df7fff640 1 -- 172.21.15.27:0/3868756733 learned_addr learned my addr 172.21.15.27:0/3868756733 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:17.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.103+0000 7f6df6ffd640 1 --2- 172.21.15.27:0/3868756733 >> v2:172.21.15.93:3300/0 conn(0x7f6df8070730 0x7f6df806bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:17.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.103+0000 7f6df6ffd640 1 -- 172.21.15.27:0/3868756733 >> v1:172.21.15.93:6789/0 conn(0x7f6df8146c60 legacy=0x7f6df8070020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:17.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.103+0000 7f6df67fc640 1 -- 172.21.15.27:0/3868756733 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1358609564 0 0) 0x7f6df815dba0 con 0x7f6df8147040 2024-01-15T11:34:17.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.103+0000 7f6df6ffd640 1 -- 172.21.15.27:0/3868756733 >> v1:172.21.15.27:6789/0 conn(0x7f6df8147040 legacy=0x7f6df806c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:17.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.103+0000 7f6df6ffd640 1 -- 172.21.15.27:0/3868756733 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df806cb40 con 0x7f6df8070730 2024-01-15T11:34:17.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.103+0000 7f6df6ffd640 1 --2- 172.21.15.27:0/3868756733 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6df8070730 0x7f6df806bb10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6dec0097c0 tx=0x7f6dec01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af23621dbb7235dd server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:17.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.107+0000 7f6df67fc640 1 -- 172.21.15.27:0/3868756733 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec0ab650 con 0x7f6df8070730 2024-01-15T11:34:17.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.107+0000 7f6df67fc640 1 -- 172.21.15.27:0/3868756733 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dec0ab7b0 con 0x7f6df8070730 2024-01-15T11:34:17.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.107+0000 7f6df67fc640 1 -- 172.21.15.27:0/3868756733 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec0abb40 con 0x7f6df8070730 2024-01-15T11:34:17.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.107+0000 7f6dfddf5640 1 -- 172.21.15.27:0/3868756733 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6df8070730 msgr2=0x7f6df806bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:17.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.107+0000 7f6dfddf5640 1 --2- 172.21.15.27:0/3868756733 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6df8070730 0x7f6df806bb10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6dec0097c0 tx=0x7f6dec01c450 comp rx=0 tx=0).stop 2024-01-15T11:34:17.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.107+0000 7f6dfddf5640 1 -- 172.21.15.27:0/3868756733 shutdown_connections 2024-01-15T11:34:17.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.107+0000 7f6dfddf5640 1 --2- 172.21.15.27:0/3868756733 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6df8070730 0x7f6df806bb10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:17.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.107+0000 7f6dfddf5640 1 -- 172.21.15.27:0/3868756733 >> 172.21.15.27:0/3868756733 conn(0x7f6df80b2ea0 msgr2=0x7f6df80b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:17.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.107+0000 7f6dfddf5640 1 -- 172.21.15.27:0/3868756733 shutdown_connections 2024-01-15T11:34:17.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.107+0000 7f6dfddf5640 1 -- 172.21.15.27:0/3868756733 wait complete. 2024-01-15T11:34:17.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.107+0000 7f6dfddf5640 1 Processor -- start 2024-01-15T11:34:17.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.107+0000 7f6dfddf5640 1 -- start start 2024-01-15T11:34:17.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.107+0000 7f6dfddf5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6df8070730 0x7f6df813af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:17.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.107+0000 7f6dfddf5640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6df8146c60 0x7f6df813a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:17.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.107+0000 7f6dfddf5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6df8147040 0x7f6df813fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:17.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.107+0000 7f6dfddf5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df813f820 con 0x7f6df8070730 2024-01-15T11:34:17.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.107+0000 7f6dfddf5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df813ec10 con 0x7f6df8147040 2024-01-15T11:34:17.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.107+0000 7f6dfddf5640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df813eef0 con 0x7f6df8146c60 2024-01-15T11:34:17.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.107+0000 7f6df77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6df8070730 0x7f6df813af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:17.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.107+0000 7f6df77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6df8070730 0x7f6df813af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38392/0 (socket says 172.21.15.27:38392) 2024-01-15T11:34:17.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.107+0000 7f6df77fe640 1 -- 172.21.15.27:0/1428946948 learned_addr learned my addr 172.21.15.27:0/1428946948 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:17.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.111+0000 7f6df7fff640 1 --2- 172.21.15.27:0/1428946948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6df8147040 0x7f6df813fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:17.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.111+0000 7f6df6ffd640 1 --2- 172.21.15.27:0/1428946948 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6df8146c60 0x7f6df813a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:17.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.111+0000 7f6df77fe640 1 -- 172.21.15.27:0/1428946948 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6df8146c60 msgr2=0x7f6df813a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:17.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.111+0000 7f6df77fe640 1 --2- 172.21.15.27:0/1428946948 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6df8146c60 0x7f6df813a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:17.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.111+0000 7f6df77fe640 1 -- 172.21.15.27:0/1428946948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6df8147040 msgr2=0x7f6df813fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:17.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.111+0000 7f6df77fe640 1 --2- 172.21.15.27:0/1428946948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6df8147040 0x7f6df813fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:17.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.111+0000 7f6df77fe640 1 -- 172.21.15.27:0/1428946948 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dec009420 con 0x7f6df8070730 2024-01-15T11:34:17.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.111+0000 7f6df77fe640 1 --2- 172.21.15.27:0/1428946948 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6df8070730 0x7f6df813af10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6de800c500 tx=0x7f6de800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:17.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.111+0000 7f6ddffff640 1 -- 172.21.15.27:0/1428946948 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de8005220 con 0x7f6df8070730 2024-01-15T11:34:17.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.111+0000 7f6ddffff640 1 -- 172.21.15.27:0/1428946948 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de8005380 con 0x7f6df8070730 2024-01-15T11:34:17.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.111+0000 7f6dfddf5640 1 -- 172.21.15.27:0/1428946948 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df813f1d0 con 0x7f6df8070730 2024-01-15T11:34:17.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.111+0000 7f6ddffff640 1 -- 172.21.15.27:0/1428946948 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de8007270 con 0x7f6df8070730 2024-01-15T11:34:17.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.111+0000 7f6dfddf5640 1 -- 172.21.15.27:0/1428946948 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df813b450 con 0x7f6df8070730 2024-01-15T11:34:17.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.111+0000 7f6dfddf5640 1 -- 172.21.15.27:0/1428946948 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df8067a40 con 0x7f6df8070730 2024-01-15T11:34:17.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.111+0000 7f6ddffff640 1 -- 172.21.15.27:0/1428946948 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f6de80073d0 con 0x7f6df8070730 2024-01-15T11:34:17.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.111+0000 7f6ddffff640 1 --2- 172.21.15.27:0/1428946948 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6de4066920 0x7f6de4068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:17.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.111+0000 7f6ddffff640 1 -- 172.21.15.27:0/1428946948 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6de8083de0 con 0x7f6df8070730 2024-01-15T11:34:17.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.115+0000 7f6df6ffd640 1 --2- 172.21.15.27:0/1428946948 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6de4066920 0x7f6de4068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:17.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.115+0000 7f6df6ffd640 1 --2- 172.21.15.27:0/1428946948 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6de4066920 0x7f6de4068de0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6dec0af000 tx=0x7f6dec0a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:17.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.115+0000 7f6ddffff640 1 -- 172.21.15.27:0/1428946948 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6de8050f90 con 0x7f6df8070730 2024-01-15T11:34:17.155 INFO:tasks.ceph.mds.c.smithi027.stderr:2024-01-15T11:34:17.151+0000 7ff426251640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-15T11:34:17.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.271+0000 7f6dfddf5640 1 -- 172.21.15.27:0/1428946948 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6df813f960 con 0x7f6de4066920 2024-01-15T11:34:17.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.279+0000 7f6ddffff640 1 -- 172.21.15.27:0/1428946948 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276633 (secure 0 0 0) 0x7f6dec0aba20 con 0x7f6de4066920 2024-01-15T11:34:17.287 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:34:17.290 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-01-15T11:34:17.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.283+0000 7f6dfddf5640 1 -- 172.21.15.27:0/1428946948 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6de4066920 msgr2=0x7f6de4068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:17.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.283+0000 7f6dfddf5640 1 --2- 172.21.15.27:0/1428946948 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6de4066920 0x7f6de4068de0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6dec0af000 tx=0x7f6dec0a7000 comp rx=0 tx=0).stop 2024-01-15T11:34:17.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.283+0000 7f6dfddf5640 1 -- 172.21.15.27:0/1428946948 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6df8070730 msgr2=0x7f6df813af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:17.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.283+0000 7f6dfddf5640 1 --2- 172.21.15.27:0/1428946948 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6df8070730 0x7f6df813af10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6de800c500 tx=0x7f6de800c9c0 comp rx=0 tx=0).stop 2024-01-15T11:34:17.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.283+0000 7f6dfddf5640 1 -- 172.21.15.27:0/1428946948 shutdown_connections 2024-01-15T11:34:17.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.283+0000 7f6dfddf5640 1 --2- 172.21.15.27:0/1428946948 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6de4066920 0x7f6de4068de0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:17.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.283+0000 7f6dfddf5640 1 --2- 172.21.15.27:0/1428946948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6df8147040 0x7f6df813fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:17.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.283+0000 7f6dfddf5640 1 --2- 172.21.15.27:0/1428946948 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6df8146c60 0x7f6df813a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:17.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.283+0000 7f6dfddf5640 1 --2- 172.21.15.27:0/1428946948 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6df8070730 0x7f6df813af10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:17.292 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.283+0000 7f6dfddf5640 1 -- 172.21.15.27:0/1428946948 >> 172.21.15.27:0/1428946948 conn(0x7f6df80b2ea0 msgr2=0x7f6df81442f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:17.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.283+0000 7f6dfddf5640 1 -- 172.21.15.27:0/1428946948 shutdown_connections 2024-01-15T11:34:17.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.283+0000 7f6dfddf5640 1 -- 172.21.15.27:0/1428946948 wait complete. 2024-01-15T11:34:17.307 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-01-15T11:34:16.078352+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":58,"acting":58,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224220,"kb_used_data":3900,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750500,"statfs":{"total":773094113280,"available":772864512000,"internally_reserved":0,"allocated":3993600,"data_stored":2231639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.916077"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.172633+0000","last_change":"2024-01-15T11:34:11.172633+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.172633+0000","last_undegraded":"2024-01-15T11:34:11.172633+0000","last_fullsized":"2024-01-15T11:34:11.172633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.165178+0000","last_change":"2024-01-15T11:34:11.165178+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.165178+0000","last_undegraded":"2024-01-15T11:34:11.165178+0000","last_fullsized":"2024-01-15T11:34:11.165178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.165397+0000","last_change":"2024-01-15T11:34:11.165397+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.165397+0000","last_undegraded":"2024-01-15T11:34:11.165397+0000","last_fullsized":"2024-01-15T11:34:11.165397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.165111+0000","last_change":"2024-01-15T11:34:11.165111+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.165111+0000","last_undegraded":"2024-01-15T11:34:11.165111+0000","last_fullsized":"2024-01-15T11:34:11.165111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.169106+0000","last_change":"2024-01-15T11:34:11.169106+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.169106+0000","last_undegraded":"2024-01-15T11:34:11.169106+0000","last_fullsized":"2024-01-15T11:34:11.169106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.167927+0000","last_change":"2024-01-15T11:34:11.167927+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.167927+0000","last_undegraded":"2024-01-15T11:34:11.167927+0000","last_fullsized":"2024-01-15T11:34:11.167927+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.164537+0000","last_change":"2024-01-15T11:34:11.164537+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.164537+0000","last_undegraded":"2024-01-15T11:34:11.164537+0000","last_fullsized":"2024-01-15T11:34:11.164537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.167727+0000","last_change":"2024-01-15T11:34:11.167727+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.167727+0000","last_undegraded":"2024-01-15T11:34:11.167727+0000","last_fullsized":"2024-01-15T11:34:11.167727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:11.156862+0000","last_change":"2024-01-15T11:34:11.156862+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.156862+0000","last_undegraded":"2024-01-15T11:34:11.156862+0000","last_fullsized":"2024-01-15T11:34:11.156862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:11.156862+0000","last_change":"2024-01-15T11:34:11.156862+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.156862+0000","last_undegraded":"2024-01-15T11:34:11.156862+0000","last_fullsized":"2024-01-15T11:34:11.156862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.171454+0000","last_change":"2024-01-15T11:34:11.171454+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.171454+0000","last_undegraded":"2024-01-15T11:34:11.171454+0000","last_fullsized":"2024-01-15T11:34:11.171454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.168827+0000","last_change":"2024-01-15T11:34:11.168827+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.168827+0000","last_undegraded":"2024-01-15T11:34:11.168827+0000","last_fullsized":"2024-01-15T11:34:11.168827+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.168202+0000","last_change":"2024-01-15T11:34:11.168202+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.168202+0000","last_undegraded":"2024-01-15T11:34:11.168202+0000","last_fullsized":"2024-01-15T11:34:11.168202+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.164498+0000","last_change":"2024-01-15T11:34:11.164498+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.164498+0000","last_undegraded":"2024-01-15T11:34:11.164498+0000","last_fullsized":"2024-01-15T11:34:11.164498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.164388+0000","last_change":"2024-01-15T11:34:11.164388+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.164388+0000","last_undegraded":"2024-01-15T11:34:11.164388+0000","last_fullsized":"2024-01-15T11:34:11.164388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.164922+0000","last_change":"2024-01-15T11:34:11.164922+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.164922+0000","last_undegraded":"2024-01-15T11:34:11.164922+0000","last_fullsized":"2024-01-15T11:34:11.164922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.164810+0000","last_change":"2024-01-15T11:34:11.164810+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.164810+0000","last_undegraded":"2024-01-15T11:34:11.164810+0000","last_fullsized":"2024-01-15T11:34:11.164810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.167267+0000","last_change":"2024-01-15T11:34:11.167267+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.167267+0000","last_undegraded":"2024-01-15T11:34:11.167267+0000","last_fullsized":"2024-01-15T11:34:11.167267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.171923+0000","last_change":"2024-01-15T11:34:11.171923+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.171923+0000","last_undegraded":"2024-01-15T11:34:11.171923+0000","last_fullsized":"2024-01-15T11:34:11.171923+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.174276+0000","last_change":"2024-01-15T11:34:11.174276+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.174276+0000","last_undegraded":"2024-01-15T11:34:11.174276+0000","last_fullsized":"2024-01-15T11:34:11.174276+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:11.156862+0000","last_change":"2024-01-15T11:34:11.156862+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.156862+0000","last_undegraded":"2024-01-15T11:34:11.156862+0000","last_fullsized":"2024-01-15T11:34:11.156862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.167331+0000","last_change":"2024-01-15T11:34:11.167331+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.167331+0000","last_undegraded":"2024-01-15T11:34:11.167331+0000","last_fullsized":"2024-01-15T11:34:11.167331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.171245+0000","last_change":"2024-01-15T11:34:11.171245+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.171245+0000","last_undegraded":"2024-01-15T11:34:11.171245+0000","last_fullsized":"2024-01-15T11:34:11.171245+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.170857+0000","last_change":"2024-01-15T11:34:11.170857+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.170857+0000","last_undegraded":"2024-01-15T11:34:11.170857+0000","last_fullsized":"2024-01-15T11:34:11.170857+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.168396+0000","last_change":"2024-01-15T11:34:11.168396+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.168396+0000","last_undegraded":"2024-01-15T11:34:11.168396+0000","last_fullsized":"2024-01-15T11:34:11.168396+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:11.156862+0000","last_change":"2024-01-15T11:34:11.156862+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.156862+0000","last_undegraded":"2024-01-15T11:34:11.156862+0000","last_fullsized":"2024-01-15T11:34:11.156862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.168331+0000","last_change":"2024-01-15T11:34:11.168331+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.168331+0000","last_undegraded":"2024-01-15T11:34:11.168331+0000","last_fullsized":"2024-01-15T11:34:11.168331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.169430+0000","last_change":"2024-01-15T11:34:11.169430+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.169430+0000","last_undegraded":"2024-01-15T11:34:11.169430+0000","last_fullsized":"2024-01-15T11:34:11.169430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.168333+0000","last_change":"2024-01-15T11:34:11.168333+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.168333+0000","last_undegraded":"2024-01-15T11:34:11.168333+0000","last_fullsized":"2024-01-15T11:34:11.168333+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.167271+0000","last_change":"2024-01-15T11:34:11.167271+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.167271+0000","last_undegraded":"2024-01-15T11:34:11.167271+0000","last_fullsized":"2024-01-15T11:34:11.167271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.164384+0000","last_change":"2024-01-15T11:34:11.164384+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.164384+0000","last_undegraded":"2024-01-15T11:34:11.164384+0000","last_fullsized":"2024-01-15T11:34:11.164384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.170981+0000","last_change":"2024-01-15T11:34:11.170981+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.170981+0000","last_undegraded":"2024-01-15T11:34:11.170981+0000","last_fullsized":"2024-01-15T11:34:11.170981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T11:34:06.167510+0000","last_change":"2024-01-15T11:33:09.200536+0000","last_active":"2024-01-15T11:34:06.167510+0000","last_peered":"2024-01-15T11:34:06.167510+0000","last_clean":"2024-01-15T11:34:06.167510+0000","last_became_active":"2024-01-15T11:33:09.199051+0000","last_became_peered":"2024-01-15T11:33:09.199051+0000","last_unstale":"2024-01-15T11:34:06.167510+0000","last_undegraded":"2024-01-15T11:34:06.167510+0000","last_fullsized":"2024-01-15T11:34:06.167510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:08.185347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:08.185347+0000","last_clean_scrub_stamp":"2024-01-15T11:33:08.185347+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:04:15.799885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.72799999999999998}]},{"osd":1,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.879},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.78900000000000003}]},{"osd":2,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.745},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.63300000000000001}]},{"osd":3,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.76500000000000001}]},{"osd":4,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1,"5min":1,"15min":1},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.60499999999999998}]},{"osd":5,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.85699999999999998}]},{"osd":6,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.80900000000000005}]}]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.73999999999999999}]},{"osd":1,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.85399999999999998}]},{"osd":2,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.83699999999999997}]},{"osd":3,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.82099999999999995}]},{"osd":4,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.50700000000000001}]},{"osd":5,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.66200000000000003}]},{"osd":7,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.60099999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.72499999999999998}]},{"osd":1,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.496}]},{"osd":2,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.621}]},{"osd":3,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.69399999999999995}]},{"osd":5,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.51700000000000002}]},{"osd":6,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.65400000000000003}]},{"osd":7,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.57499999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.43099999999999999}]},{"osd":1,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.373}]},{"osd":2,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.49399999999999999}]},{"osd":4,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.72599999999999998}]},{"osd":5,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.624},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.63500000000000001}]},{"osd":7,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.68400000000000005}]}]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":2.9140000000000001,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":3.2519999999999998,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.47099999999999997}]},{"osd":1,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":3.1080000000000001,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":0.41999999999999998}]},{"osd":3,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":3.722,"5min":3.722,"15min":3.722},"last":0.371},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":3.508,"5min":3.508,"15min":3.508},"last":0.51900000000000002}]},{"osd":4,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":3.5539999999999998,"5min":3.5539999999999998,"15min":3.5539999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"last":0.59099999999999997}]},{"osd":5,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":3.5899999999999999,"5min":3.5899999999999999,"15min":3.5899999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.617,"5min":3.617,"15min":3.617},"last":0.60599999999999998}]},{"osd":6,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":3.1899999999999999,"5min":3.1899999999999999,"15min":3.1899999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":3.6459999999999999,"5min":3.6459999999999999,"15min":3.6459999999999999},"last":0.58099999999999996}]},{"osd":7,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.8340000000000001,"5min":3.8340000000000001,"15min":3.8340000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":3.7799999999999998,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":0.65500000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":946176,"data_stored":722458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.42799999999999999}]},{"osd":2,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.46600000000000003}]},{"osd":3,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.499},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.41099999999999998}]},{"osd":4,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.55900000000000005}]},{"osd":5,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.8279999999999998,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":0.78000000000000003}]},{"osd":6,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.749},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":0.73399999999999999}]},{"osd":7,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.81299999999999994}]}]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":4.3230000000000004,"5min":4.3230000000000004,"15min":4.3230000000000004},"last":0.49099999999999999}]},{"osd":2,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":4.2800000000000002,"5min":4.2800000000000002,"15min":4.2800000000000002},"last":0.62}]},{"osd":3,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.55900000000000005}]},{"osd":4,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":4.4340000000000002,"5min":4.4340000000000002,"15min":4.4340000000000002},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.82799999999999996}]},{"osd":5,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.74199999999999999}]},{"osd":6,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":0.75700000000000001}]},{"osd":7,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.77700000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":933888,"data_stored":716641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.63200000000000001}]},{"osd":1,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.66200000000000003}]},{"osd":2,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.79000000000000004}]},{"osd":3,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.69599999999999995}]},{"osd":4,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.75600000000000001}]},{"osd":6,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.77300000000000002}]},{"osd":7,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.88400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-15T11:34:17.312 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-15T11:34:17.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.487+0000 7f5fe8617640 1 Processor -- start 2024-01-15T11:34:17.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.487+0000 7f5fe8617640 1 -- start start 2024-01-15T11:34:17.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.487+0000 7f5fe8617640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5fe00cead0 0x7f5fe00d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:17.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.487+0000 7f5fe8617640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe00d22c0 con 0x7f5fe00d1eb0 2024-01-15T11:34:17.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.487+0000 7f5fe8617640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe00cefd0 con 0x7f5fe015d7b0 2024-01-15T11:34:17.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.487+0000 7f5fe8617640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe00d17e0 con 0x7f5fe00cead0 2024-01-15T11:34:17.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.487+0000 7f5fe5bb2640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5fe00cead0 0x7f5fe00d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:17.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.487+0000 7f5fe6bb4640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f5fe00d1eb0 0x7f5fe006bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:60058/0 (socket says 172.21.15.27:60058) 2024-01-15T11:34:17.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.487+0000 7f5fe6bb4640 1 -- 172.21.15.27:0/4223765390 learned_addr learned my addr 172.21.15.27:0/4223765390 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:17.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.487+0000 7f5fe53b1640 1 -- 172.21.15.27:0/4223765390 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107694933 0 0) 0x7f5fe00d22c0 con 0x7f5fe00d1eb0 2024-01-15T11:34:17.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.487+0000 7f5fe53b1640 1 -- 172.21.15.27:0/4223765390 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fcc003530 con 0x7f5fe00d1eb0 2024-01-15T11:34:17.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.487+0000 7f5fe5bb2640 1 -- 172.21.15.27:0/4223765390 >> v1:172.21.15.93:6789/0 conn(0x7f5fe015d7b0 legacy=0x7f5fe00d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:17.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.487+0000 7f5fe5bb2640 1 -- 172.21.15.27:0/4223765390 >> v1:172.21.15.27:6789/0 conn(0x7f5fe00d1eb0 legacy=0x7f5fe006bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:17.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.487+0000 7f5fe5bb2640 1 -- 172.21.15.27:0/4223765390 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe00cf2b0 con 0x7f5fe00cead0 2024-01-15T11:34:17.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.491+0000 7f5fe5bb2640 1 --2- 172.21.15.27:0/4223765390 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fe00cead0 0x7f5fe00d1970 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00097c0 tx=0x7f5fd001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb8105d2797b563 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:17.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.491+0000 7f5fe53b1640 1 -- 172.21.15.27:0/4223765390 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00ab600 con 0x7f5fe00cead0 2024-01-15T11:34:17.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.491+0000 7f5fe53b1640 1 -- 172.21.15.27:0/4223765390 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd00a7050 con 0x7f5fe00cead0 2024-01-15T11:34:17.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.491+0000 7f5fe53b1640 1 -- 172.21.15.27:0/4223765390 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00ab980 con 0x7f5fe00cead0 2024-01-15T11:34:17.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.491+0000 7f5fe8617640 1 -- 172.21.15.27:0/4223765390 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fe00cead0 msgr2=0x7f5fe00d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:17.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.491+0000 7f5fe8617640 1 --2- 172.21.15.27:0/4223765390 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fe00cead0 0x7f5fe00d1970 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00097c0 tx=0x7f5fd001c330 comp rx=0 tx=0).stop 2024-01-15T11:34:17.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.491+0000 7f5fe8617640 1 -- 172.21.15.27:0/4223765390 shutdown_connections 2024-01-15T11:34:17.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.491+0000 7f5fe8617640 1 --2- 172.21.15.27:0/4223765390 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fe00cead0 0x7f5fe00d1970 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:17.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.491+0000 7f5fe8617640 1 -- 172.21.15.27:0/4223765390 >> 172.21.15.27:0/4223765390 conn(0x7f5fe00d33b0 msgr2=0x7f5fe00d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:17.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.491+0000 7f5fe8617640 1 -- 172.21.15.27:0/4223765390 shutdown_connections 2024-01-15T11:34:17.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.491+0000 7f5fe8617640 1 -- 172.21.15.27:0/4223765390 wait complete. 2024-01-15T11:34:17.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.495+0000 7f5fe8617640 1 Processor -- start 2024-01-15T11:34:17.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.495+0000 7f5fe8617640 1 -- start start 2024-01-15T11:34:17.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.495+0000 7f5fe8617640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fe00cead0 0x7f5fe00c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:17.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.495+0000 7f5fe8617640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5fe00d1eb0 0x7f5fe0151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:17.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.495+0000 7f5fe8617640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5fe015d7b0 0x7f5fe00b6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:17.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.495+0000 7f5fe8617640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00b8410 con 0x7f5fe00cead0 2024-01-15T11:34:17.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.495+0000 7f5fe8617640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00b86f0 con 0x7f5fe015d7b0 2024-01-15T11:34:17.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.495+0000 7f5fe8617640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00b89d0 con 0x7f5fe00d1eb0 2024-01-15T11:34:17.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.495+0000 7f5fe63b3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fe00cead0 0x7f5fe00c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:17.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.495+0000 7f5fe63b3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fe00cead0 0x7f5fe00c8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38408/0 (socket says 172.21.15.27:38408) 2024-01-15T11:34:17.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.495+0000 7f5fe63b3640 1 -- 172.21.15.27:0/735164401 learned_addr learned my addr 172.21.15.27:0/735164401 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:17.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.495+0000 7f5fe63b3640 1 -- 172.21.15.27:0/735164401 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5fe00d1eb0 msgr2=0x7f5fe0151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:17.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.495+0000 7f5fe63b3640 1 --2- 172.21.15.27:0/735164401 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5fe00d1eb0 0x7f5fe0151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:17.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.495+0000 7f5fe63b3640 1 -- 172.21.15.27:0/735164401 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5fe015d7b0 msgr2=0x7f5fe00b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:17.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.495+0000 7f5fe6bb4640 1 --2- 172.21.15.27:0/735164401 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5fe015d7b0 0x7f5fe00b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:17.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.495+0000 7f5fe63b3640 1 --2- 172.21.15.27:0/735164401 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5fe015d7b0 0x7f5fe00b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:17.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.495+0000 7f5fe63b3640 1 -- 172.21.15.27:0/735164401 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd0009420 con 0x7f5fe00cead0 2024-01-15T11:34:17.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.495+0000 7f5fe6bb4640 1 --2- 172.21.15.27:0/735164401 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5fe015d7b0 0x7f5fe00b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:34:17.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.495+0000 7f5fe63b3640 1 --2- 172.21.15.27:0/735164401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fe00cead0 0x7f5fe00c8390 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00c3c0 tx=0x7f5fdc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:17.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.495+0000 7f5fd6ffd640 1 -- 172.21.15.27:0/735164401 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc0052d0 con 0x7f5fe00cead0 2024-01-15T11:34:17.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.495+0000 7f5fd6ffd640 1 -- 172.21.15.27:0/735164401 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fdc005430 con 0x7f5fe00cead0 2024-01-15T11:34:17.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.495+0000 7f5fd6ffd640 1 -- 172.21.15.27:0/735164401 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc003840 con 0x7f5fe00cead0 2024-01-15T11:34:17.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.495+0000 7f5fe8617640 1 -- 172.21.15.27:0/735164401 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe00b60f0 con 0x7f5fe00cead0 2024-01-15T11:34:17.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.495+0000 7f5fe8617640 1 -- 172.21.15.27:0/735164401 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe00b8030 con 0x7f5fe00cead0 2024-01-15T11:34:17.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.499+0000 7f5fe8617640 1 -- 172.21.15.27:0/735164401 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe004e850 con 0x7f5fe00cead0 2024-01-15T11:34:17.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.499+0000 7f5fd6ffd640 1 -- 172.21.15.27:0/735164401 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f5fdc0039a0 con 0x7f5fe00cead0 2024-01-15T11:34:17.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.499+0000 7f5fd6ffd640 1 --2- 172.21.15.27:0/735164401 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5fc40668f0 0x7f5fc4068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:17.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.499+0000 7f5fd6ffd640 1 -- 172.21.15.27:0/735164401 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5fdc083970 con 0x7f5fe00cead0 2024-01-15T11:34:17.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.499+0000 7f5fe5bb2640 1 --2- 172.21.15.27:0/735164401 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5fc40668f0 0x7f5fc4068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:17.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.503+0000 7f5fe5bb2640 1 --2- 172.21.15.27:0/735164401 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5fc40668f0 0x7f5fc4068db0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00ad000 tx=0x7f5fd0004740 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:17.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.503+0000 7f5fd6ffd640 1 -- 172.21.15.27:0/735164401 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5fdc050ba0 con 0x7f5fe00cead0 2024-01-15T11:34:17.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.655+0000 7f5fe8617640 1 -- 172.21.15.27:0/735164401 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5fe00b5f70 con 0x7f5fc40668f0 2024-01-15T11:34:17.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.663+0000 7f5fd6ffd640 1 -- 172.21.15.27:0/735164401 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276633 (secure 0 0 0) 0x7f5fd00aa3a0 con 0x7f5fc40668f0 2024-01-15T11:34:17.670 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:34:17.672 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-01-15T11:34:17.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.667+0000 7f5fe8617640 1 -- 172.21.15.27:0/735164401 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5fc40668f0 msgr2=0x7f5fc4068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:17.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.667+0000 7f5fe8617640 1 --2- 172.21.15.27:0/735164401 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5fc40668f0 0x7f5fc4068db0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00ad000 tx=0x7f5fd0004740 comp rx=0 tx=0).stop 2024-01-15T11:34:17.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.667+0000 7f5fe8617640 1 -- 172.21.15.27:0/735164401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fe00cead0 msgr2=0x7f5fe00c8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:17.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.667+0000 7f5fe8617640 1 --2- 172.21.15.27:0/735164401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fe00cead0 0x7f5fe00c8390 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00c3c0 tx=0x7f5fdc00c880 comp rx=0 tx=0).stop 2024-01-15T11:34:17.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.667+0000 7f5fe8617640 1 -- 172.21.15.27:0/735164401 shutdown_connections 2024-01-15T11:34:17.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.667+0000 7f5fe8617640 1 --2- 172.21.15.27:0/735164401 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5fc40668f0 0x7f5fc4068db0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:17.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.667+0000 7f5fe8617640 1 --2- 172.21.15.27:0/735164401 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5fe015d7b0 0x7f5fe00b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:17.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.667+0000 7f5fe8617640 1 --2- 172.21.15.27:0/735164401 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5fe00d1eb0 0x7f5fe0151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:17.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.667+0000 7f5fe8617640 1 --2- 172.21.15.27:0/735164401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5fe00cead0 0x7f5fe00c8390 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:17.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.667+0000 7f5fe8617640 1 -- 172.21.15.27:0/735164401 >> 172.21.15.27:0/735164401 conn(0x7f5fe00d33b0 msgr2=0x7f5fe00d10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:17.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.667+0000 7f5fe8617640 1 -- 172.21.15.27:0/735164401 shutdown_connections 2024-01-15T11:34:17.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.667+0000 7f5fe8617640 1 -- 172.21.15.27:0/735164401 wait complete. 2024-01-15T11:34:17.689 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-01-15T11:34:16.078352+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":58,"acting":58,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224220,"kb_used_data":3900,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750500,"statfs":{"total":773094113280,"available":772864512000,"internally_reserved":0,"allocated":3993600,"data_stored":2231639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.916077"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.172633+0000","last_change":"2024-01-15T11:34:11.172633+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.172633+0000","last_undegraded":"2024-01-15T11:34:11.172633+0000","last_fullsized":"2024-01-15T11:34:11.172633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.165178+0000","last_change":"2024-01-15T11:34:11.165178+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.165178+0000","last_undegraded":"2024-01-15T11:34:11.165178+0000","last_fullsized":"2024-01-15T11:34:11.165178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.165397+0000","last_change":"2024-01-15T11:34:11.165397+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.165397+0000","last_undegraded":"2024-01-15T11:34:11.165397+0000","last_fullsized":"2024-01-15T11:34:11.165397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.165111+0000","last_change":"2024-01-15T11:34:11.165111+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.165111+0000","last_undegraded":"2024-01-15T11:34:11.165111+0000","last_fullsized":"2024-01-15T11:34:11.165111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.169106+0000","last_change":"2024-01-15T11:34:11.169106+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.169106+0000","last_undegraded":"2024-01-15T11:34:11.169106+0000","last_fullsized":"2024-01-15T11:34:11.169106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.167927+0000","last_change":"2024-01-15T11:34:11.167927+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.167927+0000","last_undegraded":"2024-01-15T11:34:11.167927+0000","last_fullsized":"2024-01-15T11:34:11.167927+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.164537+0000","last_change":"2024-01-15T11:34:11.164537+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.164537+0000","last_undegraded":"2024-01-15T11:34:11.164537+0000","last_fullsized":"2024-01-15T11:34:11.164537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.167727+0000","last_change":"2024-01-15T11:34:11.167727+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.167727+0000","last_undegraded":"2024-01-15T11:34:11.167727+0000","last_fullsized":"2024-01-15T11:34:11.167727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:11.156862+0000","last_change":"2024-01-15T11:34:11.156862+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.156862+0000","last_undegraded":"2024-01-15T11:34:11.156862+0000","last_fullsized":"2024-01-15T11:34:11.156862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:11.156862+0000","last_change":"2024-01-15T11:34:11.156862+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.156862+0000","last_undegraded":"2024-01-15T11:34:11.156862+0000","last_fullsized":"2024-01-15T11:34:11.156862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.171454+0000","last_change":"2024-01-15T11:34:11.171454+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.171454+0000","last_undegraded":"2024-01-15T11:34:11.171454+0000","last_fullsized":"2024-01-15T11:34:11.171454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.168827+0000","last_change":"2024-01-15T11:34:11.168827+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.168827+0000","last_undegraded":"2024-01-15T11:34:11.168827+0000","last_fullsized":"2024-01-15T11:34:11.168827+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.168202+0000","last_change":"2024-01-15T11:34:11.168202+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.168202+0000","last_undegraded":"2024-01-15T11:34:11.168202+0000","last_fullsized":"2024-01-15T11:34:11.168202+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.164498+0000","last_change":"2024-01-15T11:34:11.164498+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.164498+0000","last_undegraded":"2024-01-15T11:34:11.164498+0000","last_fullsized":"2024-01-15T11:34:11.164498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.164388+0000","last_change":"2024-01-15T11:34:11.164388+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.164388+0000","last_undegraded":"2024-01-15T11:34:11.164388+0000","last_fullsized":"2024-01-15T11:34:11.164388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.164922+0000","last_change":"2024-01-15T11:34:11.164922+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.164922+0000","last_undegraded":"2024-01-15T11:34:11.164922+0000","last_fullsized":"2024-01-15T11:34:11.164922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.164810+0000","last_change":"2024-01-15T11:34:11.164810+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.164810+0000","last_undegraded":"2024-01-15T11:34:11.164810+0000","last_fullsized":"2024-01-15T11:34:11.164810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.167267+0000","last_change":"2024-01-15T11:34:11.167267+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.167267+0000","last_undegraded":"2024-01-15T11:34:11.167267+0000","last_fullsized":"2024-01-15T11:34:11.167267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.171923+0000","last_change":"2024-01-15T11:34:11.171923+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.171923+0000","last_undegraded":"2024-01-15T11:34:11.171923+0000","last_fullsized":"2024-01-15T11:34:11.171923+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.174276+0000","last_change":"2024-01-15T11:34:11.174276+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.174276+0000","last_undegraded":"2024-01-15T11:34:11.174276+0000","last_fullsized":"2024-01-15T11:34:11.174276+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:11.156862+0000","last_change":"2024-01-15T11:34:11.156862+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.156862+0000","last_undegraded":"2024-01-15T11:34:11.156862+0000","last_fullsized":"2024-01-15T11:34:11.156862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.167331+0000","last_change":"2024-01-15T11:34:11.167331+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.167331+0000","last_undegraded":"2024-01-15T11:34:11.167331+0000","last_fullsized":"2024-01-15T11:34:11.167331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.171245+0000","last_change":"2024-01-15T11:34:11.171245+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.171245+0000","last_undegraded":"2024-01-15T11:34:11.171245+0000","last_fullsized":"2024-01-15T11:34:11.171245+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.170857+0000","last_change":"2024-01-15T11:34:11.170857+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.170857+0000","last_undegraded":"2024-01-15T11:34:11.170857+0000","last_fullsized":"2024-01-15T11:34:11.170857+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.168396+0000","last_change":"2024-01-15T11:34:11.168396+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.168396+0000","last_undegraded":"2024-01-15T11:34:11.168396+0000","last_fullsized":"2024-01-15T11:34:11.168396+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:11.156862+0000","last_change":"2024-01-15T11:34:11.156862+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.156862+0000","last_undegraded":"2024-01-15T11:34:11.156862+0000","last_fullsized":"2024-01-15T11:34:11.156862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.168331+0000","last_change":"2024-01-15T11:34:11.168331+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.168331+0000","last_undegraded":"2024-01-15T11:34:11.168331+0000","last_fullsized":"2024-01-15T11:34:11.168331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.169430+0000","last_change":"2024-01-15T11:34:11.169430+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.169430+0000","last_undegraded":"2024-01-15T11:34:11.169430+0000","last_fullsized":"2024-01-15T11:34:11.169430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.168333+0000","last_change":"2024-01-15T11:34:11.168333+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.168333+0000","last_undegraded":"2024-01-15T11:34:11.168333+0000","last_fullsized":"2024-01-15T11:34:11.168333+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.167271+0000","last_change":"2024-01-15T11:34:11.167271+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.167271+0000","last_undegraded":"2024-01-15T11:34:11.167271+0000","last_fullsized":"2024-01-15T11:34:11.167271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.164384+0000","last_change":"2024-01-15T11:34:11.164384+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.164384+0000","last_undegraded":"2024-01-15T11:34:11.164384+0000","last_fullsized":"2024-01-15T11:34:11.164384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.170981+0000","last_change":"2024-01-15T11:34:11.170981+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.170981+0000","last_undegraded":"2024-01-15T11:34:11.170981+0000","last_fullsized":"2024-01-15T11:34:11.170981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T11:34:06.167510+0000","last_change":"2024-01-15T11:33:09.200536+0000","last_active":"2024-01-15T11:34:06.167510+0000","last_peered":"2024-01-15T11:34:06.167510+0000","last_clean":"2024-01-15T11:34:06.167510+0000","last_became_active":"2024-01-15T11:33:09.199051+0000","last_became_peered":"2024-01-15T11:33:09.199051+0000","last_unstale":"2024-01-15T11:34:06.167510+0000","last_undegraded":"2024-01-15T11:34:06.167510+0000","last_fullsized":"2024-01-15T11:34:06.167510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:08.185347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:08.185347+0000","last_clean_scrub_stamp":"2024-01-15T11:33:08.185347+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:04:15.799885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.72799999999999998}]},{"osd":1,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.879},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.78900000000000003}]},{"osd":2,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.745},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.63300000000000001}]},{"osd":3,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.76500000000000001}]},{"osd":4,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1,"5min":1,"15min":1},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.60499999999999998}]},{"osd":5,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.85699999999999998}]},{"osd":6,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.80900000000000005}]}]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.73999999999999999}]},{"osd":1,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.85399999999999998}]},{"osd":2,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.83699999999999997}]},{"osd":3,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.82099999999999995}]},{"osd":4,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.50700000000000001}]},{"osd":5,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.66200000000000003}]},{"osd":7,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.60099999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.72499999999999998}]},{"osd":1,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.496}]},{"osd":2,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.621}]},{"osd":3,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.69399999999999995}]},{"osd":5,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.51700000000000002}]},{"osd":6,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.65400000000000003}]},{"osd":7,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.57499999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.43099999999999999}]},{"osd":1,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.373}]},{"osd":2,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.49399999999999999}]},{"osd":4,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.72599999999999998}]},{"osd":5,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.624},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.63500000000000001}]},{"osd":7,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.68400000000000005}]}]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":2.9140000000000001,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":3.2519999999999998,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.47099999999999997}]},{"osd":1,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":3.1080000000000001,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":0.41999999999999998}]},{"osd":3,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":3.722,"5min":3.722,"15min":3.722},"last":0.371},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":3.508,"5min":3.508,"15min":3.508},"last":0.51900000000000002}]},{"osd":4,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":3.5539999999999998,"5min":3.5539999999999998,"15min":3.5539999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"last":0.59099999999999997}]},{"osd":5,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":3.5899999999999999,"5min":3.5899999999999999,"15min":3.5899999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.617,"5min":3.617,"15min":3.617},"last":0.60599999999999998}]},{"osd":6,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":3.1899999999999999,"5min":3.1899999999999999,"15min":3.1899999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":3.6459999999999999,"5min":3.6459999999999999,"15min":3.6459999999999999},"last":0.58099999999999996}]},{"osd":7,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.8340000000000001,"5min":3.8340000000000001,"15min":3.8340000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":3.7799999999999998,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":0.65500000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":946176,"data_stored":722458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.42799999999999999}]},{"osd":2,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.46600000000000003}]},{"osd":3,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.499},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.41099999999999998}]},{"osd":4,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.55900000000000005}]},{"osd":5,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.8279999999999998,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":0.78000000000000003}]},{"osd":6,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.749},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":0.73399999999999999}]},{"osd":7,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.81299999999999994}]}]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":4.3230000000000004,"5min":4.3230000000000004,"15min":4.3230000000000004},"last":0.49099999999999999}]},{"osd":2,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":4.2800000000000002,"5min":4.2800000000000002,"15min":4.2800000000000002},"last":0.62}]},{"osd":3,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.55900000000000005}]},{"osd":4,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":4.4340000000000002,"5min":4.4340000000000002,"15min":4.4340000000000002},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.82799999999999996}]},{"osd":5,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.74199999999999999}]},{"osd":6,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":0.75700000000000001}]},{"osd":7,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.77700000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":933888,"data_stored":716641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.63200000000000001}]},{"osd":1,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.66200000000000003}]},{"osd":2,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.79000000000000004}]},{"osd":3,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.69599999999999995}]},{"osd":4,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.75600000000000001}]},{"osd":6,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.77300000000000002}]},{"osd":7,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.88400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-15T11:34:17.693 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-15T11:34:17.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.871+0000 7f605efe7640 1 Processor -- start 2024-01-15T11:34:17.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.871+0000 7f605efe7640 1 -- start start 2024-01-15T11:34:17.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.871+0000 7f605efe7640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f60580b39c0 0x7f605806c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:17.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.871+0000 7f605efe7640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f605806cf90 con 0x7f605815f540 2024-01-15T11:34:17.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.871+0000 7f605efe7640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60580b2650 con 0x7f605806cb70 2024-01-15T11:34:17.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.871+0000 7f605efe7640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60580b2920 con 0x7f60580b39c0 2024-01-15T11:34:17.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.871+0000 7f6057fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f60580b39c0 0x7f605806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:17.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.871+0000 7f605cd83640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f605815f540 0x7f60580b1f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:60062/0 (socket says 172.21.15.27:60062) 2024-01-15T11:34:17.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.871+0000 7f605cd83640 1 -- 172.21.15.27:0/712784413 learned_addr learned my addr 172.21.15.27:0/712784413 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:17.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.871+0000 7f6057fff640 1 -- 172.21.15.27:0/712784413 >> v1:172.21.15.93:6789/0 conn(0x7f605806cb70 legacy=0x7f6058070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:17.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.871+0000 7f6057fff640 1 -- 172.21.15.27:0/712784413 >> v1:172.21.15.27:6789/0 conn(0x7f605815f540 legacy=0x7f60580b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:17.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.871+0000 7f60577fe640 1 -- 172.21.15.27:0/712784413 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 212299411 0 0) 0x7f605806cf90 con 0x7f605815f540 2024-01-15T11:34:17.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.871+0000 7f6057fff640 1 -- 172.21.15.27:0/712784413 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60580b2c00 con 0x7f60580b39c0 2024-01-15T11:34:17.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.875+0000 7f6057fff640 1 --2- 172.21.15.27:0/712784413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60580b39c0 0x7f605806c630 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f60440097c0 tx=0x7f604401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3822292f34f3f31c server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:17.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.875+0000 7f60577fe640 1 -- 172.21.15.27:0/712784413 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60440ad680 con 0x7f60580b39c0 2024-01-15T11:34:17.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.875+0000 7f60577fe640 1 -- 172.21.15.27:0/712784413 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60440ad7e0 con 0x7f60580b39c0 2024-01-15T11:34:17.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.875+0000 7f60577fe640 1 -- 172.21.15.27:0/712784413 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60440adb70 con 0x7f60580b39c0 2024-01-15T11:34:17.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.875+0000 7f605efe7640 1 -- 172.21.15.27:0/712784413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60580b39c0 msgr2=0x7f605806c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:17.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.875+0000 7f605efe7640 1 --2- 172.21.15.27:0/712784413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60580b39c0 0x7f605806c630 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f60440097c0 tx=0x7f604401c380 comp rx=0 tx=0).stop 2024-01-15T11:34:17.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.875+0000 7f605efe7640 1 -- 172.21.15.27:0/712784413 shutdown_connections 2024-01-15T11:34:17.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.875+0000 7f605efe7640 1 --2- 172.21.15.27:0/712784413 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f60580b39c0 0x7f605806c630 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:17.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.875+0000 7f605efe7640 1 -- 172.21.15.27:0/712784413 >> 172.21.15.27:0/712784413 conn(0x7f60580b0c40 msgr2=0x7f60580b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:17.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.875+0000 7f605efe7640 1 -- 172.21.15.27:0/712784413 shutdown_connections 2024-01-15T11:34:17.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.875+0000 7f605efe7640 1 -- 172.21.15.27:0/712784413 wait complete. 2024-01-15T11:34:17.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.879+0000 7f605efe7640 1 Processor -- start 2024-01-15T11:34:17.881 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.879+0000 7f605efe7640 1 -- start start 2024-01-15T11:34:17.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.879+0000 7f605efe7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f605806cb70 0x7f605815d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:17.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.879+0000 7f605efe7640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60580b39c0 0x7f60580ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:17.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.879+0000 7f605efe7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f605815f540 0x7f60580adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:17.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.879+0000 7f605efe7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605815eb10 con 0x7f605815f540 2024-01-15T11:34:17.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.879+0000 7f605efe7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6058153cc0 con 0x7f605806cb70 2024-01-15T11:34:17.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.879+0000 7f605efe7640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605815de90 con 0x7f60580b39c0 2024-01-15T11:34:17.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.879+0000 7f605d584640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f605815f540 0x7f60580adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:17.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.879+0000 7f605d584640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f605815f540 0x7f60580adb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38426/0 (socket says 172.21.15.27:38426) 2024-01-15T11:34:17.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.879+0000 7f605d584640 1 -- 172.21.15.27:0/2614762015 learned_addr learned my addr 172.21.15.27:0/2614762015 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:17.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.879+0000 7f605cd83640 1 --2- 172.21.15.27:0/2614762015 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f605806cb70 0x7f605815d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:17.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.879+0000 7f6057fff640 1 --2- 172.21.15.27:0/2614762015 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60580b39c0 0x7f60580ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:17.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.879+0000 7f605d584640 1 -- 172.21.15.27:0/2614762015 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60580b39c0 msgr2=0x7f60580ad5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:17.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.879+0000 7f605d584640 1 --2- 172.21.15.27:0/2614762015 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60580b39c0 0x7f60580ad5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:17.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.879+0000 7f605d584640 1 -- 172.21.15.27:0/2614762015 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f605806cb70 msgr2=0x7f605815d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:17.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.879+0000 7f605d584640 1 --2- 172.21.15.27:0/2614762015 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f605806cb70 0x7f605815d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:17.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.879+0000 7f605d584640 1 -- 172.21.15.27:0/2614762015 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6044009420 con 0x7f605815f540 2024-01-15T11:34:17.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.879+0000 7f605d584640 1 --2- 172.21.15.27:0/2614762015 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f605815f540 0x7f60580adb00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f605000b970 tx=0x7f605000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:17.885 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.879+0000 7f60557fa640 1 -- 172.21.15.27:0/2614762015 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605000cb40 con 0x7f605815f540 2024-01-15T11:34:17.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.879+0000 7f60557fa640 1 -- 172.21.15.27:0/2614762015 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605000cca0 con 0x7f605815f540 2024-01-15T11:34:17.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.879+0000 7f60557fa640 1 -- 172.21.15.27:0/2614762015 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6050014680 con 0x7f605815f540 2024-01-15T11:34:17.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.879+0000 7f605efe7640 1 -- 172.21.15.27:0/2614762015 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605815e170 con 0x7f605815f540 2024-01-15T11:34:17.886 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.883+0000 7f605efe7640 1 -- 172.21.15.27:0/2614762015 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605815e730 con 0x7f605815f540 2024-01-15T11:34:17.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.883+0000 7f605efe7640 1 -- 172.21.15.27:0/2614762015 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f605815ec50 con 0x7f605815f540 2024-01-15T11:34:17.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.883+0000 7f60557fa640 1 -- 172.21.15.27:0/2614762015 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f605001d3b0 con 0x7f605815f540 2024-01-15T11:34:17.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.883+0000 7f60557fa640 1 --2- 172.21.15.27:0/2614762015 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f603c0668f0 0x7f603c068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:17.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.883+0000 7f60557fa640 1 -- 172.21.15.27:0/2614762015 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6050084180 con 0x7f605815f540 2024-01-15T11:34:17.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.883+0000 7f605cd83640 1 --2- 172.21.15.27:0/2614762015 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f603c0668f0 0x7f603c068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:17.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.883+0000 7f605cd83640 1 --2- 172.21.15.27:0/2614762015 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f603c0668f0 0x7f603c068db0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f604c007fd0 tx=0x7f604c007d60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:17.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:17.887+0000 7f60557fa640 1 -- 172.21.15.27:0/2614762015 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f605815ec50 con 0x7f605815f540 2024-01-15T11:34:18.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.039+0000 7f605efe7640 1 -- 172.21.15.27:0/2614762015 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f605816f430 con 0x7f603c0668f0 2024-01-15T11:34:18.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.047+0000 7f60557fa640 1 -- 172.21.15.27:0/2614762015 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276633 (secure 0 0 0) 0x7f604c004c80 con 0x7f603c0668f0 2024-01-15T11:34:18.053 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:34:18.055 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-01-15T11:34:18.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.051+0000 7f605efe7640 1 -- 172.21.15.27:0/2614762015 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f603c0668f0 msgr2=0x7f603c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:18.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.051+0000 7f605efe7640 1 --2- 172.21.15.27:0/2614762015 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f603c0668f0 0x7f603c068db0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f604c007fd0 tx=0x7f604c007d60 comp rx=0 tx=0).stop 2024-01-15T11:34:18.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.051+0000 7f605efe7640 1 -- 172.21.15.27:0/2614762015 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f605815f540 msgr2=0x7f60580adb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:18.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.051+0000 7f605efe7640 1 --2- 172.21.15.27:0/2614762015 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f605815f540 0x7f60580adb00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f605000b970 tx=0x7f605000be30 comp rx=0 tx=0).stop 2024-01-15T11:34:18.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.051+0000 7f605efe7640 1 -- 172.21.15.27:0/2614762015 shutdown_connections 2024-01-15T11:34:18.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.051+0000 7f605efe7640 1 --2- 172.21.15.27:0/2614762015 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f605815f540 0x7f60580adb00 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.051+0000 7f605efe7640 1 --2- 172.21.15.27:0/2614762015 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60580b39c0 0x7f60580ad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.051+0000 7f605efe7640 1 --2- 172.21.15.27:0/2614762015 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f603c0668f0 0x7f603c068db0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.051+0000 7f605efe7640 1 --2- 172.21.15.27:0/2614762015 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f605806cb70 0x7f605815d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.051+0000 7f605efe7640 1 -- 172.21.15.27:0/2614762015 >> 172.21.15.27:0/2614762015 conn(0x7f60580b0c40 msgr2=0x7f6058162490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:18.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.051+0000 7f605efe7640 1 -- 172.21.15.27:0/2614762015 shutdown_connections 2024-01-15T11:34:18.057 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.051+0000 7f605efe7640 1 -- 172.21.15.27:0/2614762015 wait complete. 2024-01-15T11:34:18.074 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-01-15T11:34:16.078352+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":58,"acting":58,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224220,"kb_used_data":3900,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750500,"statfs":{"total":773094113280,"available":772864512000,"internally_reserved":0,"allocated":3993600,"data_stored":2231639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.916077"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.172633+0000","last_change":"2024-01-15T11:34:11.172633+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.172633+0000","last_undegraded":"2024-01-15T11:34:11.172633+0000","last_fullsized":"2024-01-15T11:34:11.172633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.165178+0000","last_change":"2024-01-15T11:34:11.165178+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.165178+0000","last_undegraded":"2024-01-15T11:34:11.165178+0000","last_fullsized":"2024-01-15T11:34:11.165178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.165397+0000","last_change":"2024-01-15T11:34:11.165397+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.165397+0000","last_undegraded":"2024-01-15T11:34:11.165397+0000","last_fullsized":"2024-01-15T11:34:11.165397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.165111+0000","last_change":"2024-01-15T11:34:11.165111+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.165111+0000","last_undegraded":"2024-01-15T11:34:11.165111+0000","last_fullsized":"2024-01-15T11:34:11.165111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.169106+0000","last_change":"2024-01-15T11:34:11.169106+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.169106+0000","last_undegraded":"2024-01-15T11:34:11.169106+0000","last_fullsized":"2024-01-15T11:34:11.169106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.167927+0000","last_change":"2024-01-15T11:34:11.167927+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.167927+0000","last_undegraded":"2024-01-15T11:34:11.167927+0000","last_fullsized":"2024-01-15T11:34:11.167927+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.164537+0000","last_change":"2024-01-15T11:34:11.164537+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.164537+0000","last_undegraded":"2024-01-15T11:34:11.164537+0000","last_fullsized":"2024-01-15T11:34:11.164537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.167727+0000","last_change":"2024-01-15T11:34:11.167727+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.167727+0000","last_undegraded":"2024-01-15T11:34:11.167727+0000","last_fullsized":"2024-01-15T11:34:11.167727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:11.156862+0000","last_change":"2024-01-15T11:34:11.156862+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.156862+0000","last_undegraded":"2024-01-15T11:34:11.156862+0000","last_fullsized":"2024-01-15T11:34:11.156862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:11.156862+0000","last_change":"2024-01-15T11:34:11.156862+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.156862+0000","last_undegraded":"2024-01-15T11:34:11.156862+0000","last_fullsized":"2024-01-15T11:34:11.156862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.171454+0000","last_change":"2024-01-15T11:34:11.171454+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.171454+0000","last_undegraded":"2024-01-15T11:34:11.171454+0000","last_fullsized":"2024-01-15T11:34:11.171454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.168827+0000","last_change":"2024-01-15T11:34:11.168827+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.168827+0000","last_undegraded":"2024-01-15T11:34:11.168827+0000","last_fullsized":"2024-01-15T11:34:11.168827+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.168202+0000","last_change":"2024-01-15T11:34:11.168202+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.168202+0000","last_undegraded":"2024-01-15T11:34:11.168202+0000","last_fullsized":"2024-01-15T11:34:11.168202+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.164498+0000","last_change":"2024-01-15T11:34:11.164498+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.164498+0000","last_undegraded":"2024-01-15T11:34:11.164498+0000","last_fullsized":"2024-01-15T11:34:11.164498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.164388+0000","last_change":"2024-01-15T11:34:11.164388+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.164388+0000","last_undegraded":"2024-01-15T11:34:11.164388+0000","last_fullsized":"2024-01-15T11:34:11.164388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.164922+0000","last_change":"2024-01-15T11:34:11.164922+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.164922+0000","last_undegraded":"2024-01-15T11:34:11.164922+0000","last_fullsized":"2024-01-15T11:34:11.164922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.164810+0000","last_change":"2024-01-15T11:34:11.164810+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.164810+0000","last_undegraded":"2024-01-15T11:34:11.164810+0000","last_fullsized":"2024-01-15T11:34:11.164810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.167267+0000","last_change":"2024-01-15T11:34:11.167267+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.167267+0000","last_undegraded":"2024-01-15T11:34:11.167267+0000","last_fullsized":"2024-01-15T11:34:11.167267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.171923+0000","last_change":"2024-01-15T11:34:11.171923+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.171923+0000","last_undegraded":"2024-01-15T11:34:11.171923+0000","last_fullsized":"2024-01-15T11:34:11.171923+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.174276+0000","last_change":"2024-01-15T11:34:11.174276+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.174276+0000","last_undegraded":"2024-01-15T11:34:11.174276+0000","last_fullsized":"2024-01-15T11:34:11.174276+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:11.156862+0000","last_change":"2024-01-15T11:34:11.156862+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.156862+0000","last_undegraded":"2024-01-15T11:34:11.156862+0000","last_fullsized":"2024-01-15T11:34:11.156862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.167331+0000","last_change":"2024-01-15T11:34:11.167331+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.167331+0000","last_undegraded":"2024-01-15T11:34:11.167331+0000","last_fullsized":"2024-01-15T11:34:11.167331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.171245+0000","last_change":"2024-01-15T11:34:11.171245+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.171245+0000","last_undegraded":"2024-01-15T11:34:11.171245+0000","last_fullsized":"2024-01-15T11:34:11.171245+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.170857+0000","last_change":"2024-01-15T11:34:11.170857+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.170857+0000","last_undegraded":"2024-01-15T11:34:11.170857+0000","last_fullsized":"2024-01-15T11:34:11.170857+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.168396+0000","last_change":"2024-01-15T11:34:11.168396+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.168396+0000","last_undegraded":"2024-01-15T11:34:11.168396+0000","last_fullsized":"2024-01-15T11:34:11.168396+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:11.156862+0000","last_change":"2024-01-15T11:34:11.156862+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.156862+0000","last_undegraded":"2024-01-15T11:34:11.156862+0000","last_fullsized":"2024-01-15T11:34:11.156862+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.168331+0000","last_change":"2024-01-15T11:34:11.168331+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.168331+0000","last_undegraded":"2024-01-15T11:34:11.168331+0000","last_fullsized":"2024-01-15T11:34:11.168331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.169430+0000","last_change":"2024-01-15T11:34:11.169430+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.169430+0000","last_undegraded":"2024-01-15T11:34:11.169430+0000","last_fullsized":"2024-01-15T11:34:11.169430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.168333+0000","last_change":"2024-01-15T11:34:11.168333+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.168333+0000","last_undegraded":"2024-01-15T11:34:11.168333+0000","last_fullsized":"2024-01-15T11:34:11.168333+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.167271+0000","last_change":"2024-01-15T11:34:11.167271+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.167271+0000","last_undegraded":"2024-01-15T11:34:11.167271+0000","last_fullsized":"2024-01-15T11:34:11.167271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.164384+0000","last_change":"2024-01-15T11:34:11.164384+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.164384+0000","last_undegraded":"2024-01-15T11:34:11.164384+0000","last_fullsized":"2024-01-15T11:34:11.164384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-15T11:34:12.163802+0000","last_change":"2024-01-15T11:34:12.163802+0000","last_active":"2024-01-15T11:34:12.163802+0000","last_peered":"2024-01-15T11:34:12.163802+0000","last_clean":"2024-01-15T11:34:12.163802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:12.163802+0000","last_undegraded":"2024-01-15T11:34:12.163802+0000","last_fullsized":"2024-01-15T11:34:12.163802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-01-15T11:34:11.170981+0000","last_change":"2024-01-15T11:34:11.170981+0000","last_active":"2024-01-15T11:34:11.156862+0000","last_peered":"2024-01-15T11:34:11.156862+0000","last_clean":"2024-01-15T11:34:11.156862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-15T11:34:11.170981+0000","last_undegraded":"2024-01-15T11:34:11.170981+0000","last_fullsized":"2024-01-15T11:34:11.170981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-01-15T11:34:06.167510+0000","last_change":"2024-01-15T11:33:09.200536+0000","last_active":"2024-01-15T11:34:06.167510+0000","last_peered":"2024-01-15T11:34:06.167510+0000","last_clean":"2024-01-15T11:34:06.167510+0000","last_became_active":"2024-01-15T11:33:09.199051+0000","last_became_peered":"2024-01-15T11:33:09.199051+0000","last_unstale":"2024-01-15T11:34:06.167510+0000","last_undegraded":"2024-01-15T11:34:06.167510+0000","last_fullsized":"2024-01-15T11:34:06.167510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:08.185347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:08.185347+0000","last_clean_scrub_stamp":"2024-01-15T11:33:08.185347+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:04:15.799885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.72799999999999998}]},{"osd":1,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.879},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.78900000000000003}]},{"osd":2,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.745},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.63300000000000001}]},{"osd":3,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.76500000000000001}]},{"osd":4,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1,"5min":1,"15min":1},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.60499999999999998}]},{"osd":5,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.85699999999999998}]},{"osd":6,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.80900000000000005}]}]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.73999999999999999}]},{"osd":1,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.85399999999999998}]},{"osd":2,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.83699999999999997}]},{"osd":3,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.82099999999999995}]},{"osd":4,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.50700000000000001}]},{"osd":5,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.66200000000000003}]},{"osd":7,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.60099999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.72499999999999998}]},{"osd":1,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.496}]},{"osd":2,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.621}]},{"osd":3,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.69399999999999995}]},{"osd":5,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.51700000000000002}]},{"osd":6,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.65400000000000003}]},{"osd":7,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.57499999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.43099999999999999}]},{"osd":1,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.373}]},{"osd":2,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.49399999999999999}]},{"osd":4,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.72599999999999998}]},{"osd":5,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.624},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.63500000000000001}]},{"osd":7,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.68400000000000005}]}]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":2.9140000000000001,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":3.2519999999999998,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.47099999999999997}]},{"osd":1,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":3.1080000000000001,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":0.41999999999999998}]},{"osd":3,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":3.722,"5min":3.722,"15min":3.722},"last":0.371},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":3.508,"5min":3.508,"15min":3.508},"last":0.51900000000000002}]},{"osd":4,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":3.5539999999999998,"5min":3.5539999999999998,"15min":3.5539999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"last":0.59099999999999997}]},{"osd":5,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":3.5899999999999999,"5min":3.5899999999999999,"15min":3.5899999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.617,"5min":3.617,"15min":3.617},"last":0.60599999999999998}]},{"osd":6,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":3.1899999999999999,"5min":3.1899999999999999,"15min":3.1899999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":3.6459999999999999,"5min":3.6459999999999999,"15min":3.6459999999999999},"last":0.58099999999999996}]},{"osd":7,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.8340000000000001,"5min":3.8340000000000001,"15min":3.8340000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":3.7799999999999998,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":0.65500000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":946176,"data_stored":722458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.42799999999999999}]},{"osd":2,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.46600000000000003}]},{"osd":3,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.499},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.41099999999999998}]},{"osd":4,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.55900000000000005}]},{"osd":5,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.8279999999999998,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":0.78000000000000003}]},{"osd":6,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.749},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":0.73399999999999999}]},{"osd":7,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.81299999999999994}]}]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":4.3230000000000004,"5min":4.3230000000000004,"15min":4.3230000000000004},"last":0.49099999999999999}]},{"osd":2,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":4.2800000000000002,"5min":4.2800000000000002,"15min":4.2800000000000002},"last":0.62}]},{"osd":3,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.55900000000000005}]},{"osd":4,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":4.4340000000000002,"5min":4.4340000000000002,"15min":4.4340000000000002},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.82799999999999996}]},{"osd":5,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.74199999999999999}]},{"osd":6,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":0.75700000000000001}]},{"osd":7,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.77700000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":933888,"data_stored":716641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.63200000000000001}]},{"osd":1,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.66200000000000003}]},{"osd":2,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.79000000000000004}]},{"osd":3,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.69599999999999995}]},{"osd":4,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.75600000000000001}]},{"osd":6,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.77300000000000002}]},{"osd":7,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.88400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-15T11:34:18.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-01-15T11:34:18.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-01-15T11:34:18.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-01-15T11:34:18.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-01-15T11:34:18.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-01-15T11:34:18.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-01-15T11:34:18.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-01-15T11:34:18.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-01-15T11:34:18.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-01-15T11:34:18.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-01-15T11:34:18.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-01-15T11:34:18.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-01-15T11:34:18.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-01-15T11:34:18.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-01-15T11:34:18.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-01-15T11:34:18.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-01-15T11:34:18.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-01-15T11:34:18.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-01-15T11:34:18.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-01-15T11:34:18.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-01-15T11:34:18.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-01-15T11:34:18.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-01-15T11:34:18.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-01-15T11:34:18.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-01-15T11:34:18.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-01-15T11:34:18.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-01-15T11:34:18.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-01-15T11:34:18.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-01-15T11:34:18.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-01-15T11:34:18.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-01-15T11:34:18.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-01-15T11:34:18.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-01-15T11:34:18.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-01-15T11:34:18.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-01-15T11:34:18.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.172633+0000', 'last_change': '2024-01-15T11:34:11.172633+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.172633+0000', 'last_undegraded': '2024-01-15T11:34:11.172633+0000', 'last_fullsized': '2024-01-15T11:34:11.172633+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-15T11:34:18.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-01-15T11:34:18.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-01-15T11:34:18.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.165178+0000', 'last_change': '2024-01-15T11:34:11.165178+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.165178+0000', 'last_undegraded': '2024-01-15T11:34:11.165178+0000', 'last_fullsized': '2024-01-15T11:34:11.165178+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-15T11:34:18.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-01-15T11:34:18.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-01-15T11:34:18.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.165397+0000', 'last_change': '2024-01-15T11:34:11.165397+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.165397+0000', 'last_undegraded': '2024-01-15T11:34:11.165397+0000', 'last_fullsized': '2024-01-15T11:34:11.165397+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-15T11:34:18.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-01-15T11:34:18.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-01-15T11:34:18.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.165111+0000', 'last_change': '2024-01-15T11:34:11.165111+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.165111+0000', 'last_undegraded': '2024-01-15T11:34:11.165111+0000', 'last_fullsized': '2024-01-15T11:34:11.165111+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-15T11:34:18.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-01-15T11:34:18.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-01-15T11:34:18.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.169106+0000', 'last_change': '2024-01-15T11:34:11.169106+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.169106+0000', 'last_undegraded': '2024-01-15T11:34:11.169106+0000', 'last_fullsized': '2024-01-15T11:34:11.169106+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-15T11:34:18.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-01-15T11:34:18.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-01-15T11:34:18.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.167927+0000', 'last_change': '2024-01-15T11:34:11.167927+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.167927+0000', 'last_undegraded': '2024-01-15T11:34:11.167927+0000', 'last_fullsized': '2024-01-15T11:34:11.167927+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-15T11:34:18.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-01-15T11:34:18.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-01-15T11:34:18.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.164537+0000', 'last_change': '2024-01-15T11:34:11.164537+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.164537+0000', 'last_undegraded': '2024-01-15T11:34:11.164537+0000', 'last_fullsized': '2024-01-15T11:34:11.164537+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-15T11:34:18.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-01-15T11:34:18.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-01-15T11:34:18.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.167727+0000', 'last_change': '2024-01-15T11:34:11.167727+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.167727+0000', 'last_undegraded': '2024-01-15T11:34:11.167727+0000', 'last_fullsized': '2024-01-15T11:34:11.167727+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-15T11:34:18.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-01-15T11:34:18.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-01-15T11:34:18.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:11.156862+0000', 'last_change': '2024-01-15T11:34:11.156862+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.156862+0000', 'last_undegraded': '2024-01-15T11:34:11.156862+0000', 'last_fullsized': '2024-01-15T11:34:11.156862+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-01-15T11:34:18.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-01-15T11:34:18.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:11.156862+0000', 'last_change': '2024-01-15T11:34:11.156862+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.156862+0000', 'last_undegraded': '2024-01-15T11:34:11.156862+0000', 'last_fullsized': '2024-01-15T11:34:11.156862+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-01-15T11:34:18.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-01-15T11:34:18.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.171454+0000', 'last_change': '2024-01-15T11:34:11.171454+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.171454+0000', 'last_undegraded': '2024-01-15T11:34:11.171454+0000', 'last_fullsized': '2024-01-15T11:34:11.171454+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-15T11:34:18.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-01-15T11:34:18.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-01-15T11:34:18.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.168827+0000', 'last_change': '2024-01-15T11:34:11.168827+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.168827+0000', 'last_undegraded': '2024-01-15T11:34:11.168827+0000', 'last_fullsized': '2024-01-15T11:34:11.168827+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-15T11:34:18.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-01-15T11:34:18.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-01-15T11:34:18.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.168202+0000', 'last_change': '2024-01-15T11:34:11.168202+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.168202+0000', 'last_undegraded': '2024-01-15T11:34:11.168202+0000', 'last_fullsized': '2024-01-15T11:34:11.168202+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-15T11:34:18.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-01-15T11:34:18.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-01-15T11:34:18.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.164498+0000', 'last_change': '2024-01-15T11:34:11.164498+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.164498+0000', 'last_undegraded': '2024-01-15T11:34:11.164498+0000', 'last_fullsized': '2024-01-15T11:34:11.164498+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-15T11:34:18.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-01-15T11:34:18.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-01-15T11:34:18.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.164388+0000', 'last_change': '2024-01-15T11:34:11.164388+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.164388+0000', 'last_undegraded': '2024-01-15T11:34:11.164388+0000', 'last_fullsized': '2024-01-15T11:34:11.164388+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-15T11:34:18.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-01-15T11:34:18.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-01-15T11:34:18.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.164922+0000', 'last_change': '2024-01-15T11:34:11.164922+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.164922+0000', 'last_undegraded': '2024-01-15T11:34:11.164922+0000', 'last_fullsized': '2024-01-15T11:34:11.164922+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-15T11:34:18.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-01-15T11:34:18.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-01-15T11:34:18.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.164810+0000', 'last_change': '2024-01-15T11:34:11.164810+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.164810+0000', 'last_undegraded': '2024-01-15T11:34:11.164810+0000', 'last_fullsized': '2024-01-15T11:34:11.164810+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-15T11:34:18.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-01-15T11:34:18.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-01-15T11:34:18.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.167267+0000', 'last_change': '2024-01-15T11:34:11.167267+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.167267+0000', 'last_undegraded': '2024-01-15T11:34:11.167267+0000', 'last_fullsized': '2024-01-15T11:34:11.167267+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-15T11:34:18.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-01-15T11:34:18.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-01-15T11:34:18.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.171923+0000', 'last_change': '2024-01-15T11:34:11.171923+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.171923+0000', 'last_undegraded': '2024-01-15T11:34:11.171923+0000', 'last_fullsized': '2024-01-15T11:34:11.171923+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-15T11:34:18.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-01-15T11:34:18.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-01-15T11:34:18.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.174276+0000', 'last_change': '2024-01-15T11:34:11.174276+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.174276+0000', 'last_undegraded': '2024-01-15T11:34:11.174276+0000', 'last_fullsized': '2024-01-15T11:34:11.174276+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-15T11:34:18.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-01-15T11:34:18.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-01-15T11:34:18.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:11.156862+0000', 'last_change': '2024-01-15T11:34:11.156862+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.156862+0000', 'last_undegraded': '2024-01-15T11:34:11.156862+0000', 'last_fullsized': '2024-01-15T11:34:11.156862+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-01-15T11:34:18.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-01-15T11:34:18.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.167331+0000', 'last_change': '2024-01-15T11:34:11.167331+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.167331+0000', 'last_undegraded': '2024-01-15T11:34:11.167331+0000', 'last_fullsized': '2024-01-15T11:34:11.167331+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-15T11:34:18.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-01-15T11:34:18.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-01-15T11:34:18.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.171245+0000', 'last_change': '2024-01-15T11:34:11.171245+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.171245+0000', 'last_undegraded': '2024-01-15T11:34:11.171245+0000', 'last_fullsized': '2024-01-15T11:34:11.171245+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-15T11:34:18.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-01-15T11:34:18.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-01-15T11:34:18.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.170857+0000', 'last_change': '2024-01-15T11:34:11.170857+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.170857+0000', 'last_undegraded': '2024-01-15T11:34:11.170857+0000', 'last_fullsized': '2024-01-15T11:34:11.170857+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-15T11:34:18.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-01-15T11:34:18.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-01-15T11:34:18.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.168396+0000', 'last_change': '2024-01-15T11:34:11.168396+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.168396+0000', 'last_undegraded': '2024-01-15T11:34:11.168396+0000', 'last_fullsized': '2024-01-15T11:34:11.168396+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-15T11:34:18.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-01-15T11:34:18.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-01-15T11:34:18.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:11.156862+0000', 'last_change': '2024-01-15T11:34:11.156862+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.156862+0000', 'last_undegraded': '2024-01-15T11:34:11.156862+0000', 'last_fullsized': '2024-01-15T11:34:11.156862+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-01-15T11:34:18.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-01-15T11:34:18.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.168331+0000', 'last_change': '2024-01-15T11:34:11.168331+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.168331+0000', 'last_undegraded': '2024-01-15T11:34:11.168331+0000', 'last_fullsized': '2024-01-15T11:34:11.168331+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-15T11:34:18.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-01-15T11:34:18.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-01-15T11:34:18.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.169430+0000', 'last_change': '2024-01-15T11:34:11.169430+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.169430+0000', 'last_undegraded': '2024-01-15T11:34:11.169430+0000', 'last_fullsized': '2024-01-15T11:34:11.169430+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-15T11:34:18.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-01-15T11:34:18.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-01-15T11:34:18.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.168333+0000', 'last_change': '2024-01-15T11:34:11.168333+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.168333+0000', 'last_undegraded': '2024-01-15T11:34:11.168333+0000', 'last_fullsized': '2024-01-15T11:34:11.168333+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-15T11:34:18.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-01-15T11:34:18.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-01-15T11:34:18.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.167271+0000', 'last_change': '2024-01-15T11:34:11.167271+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.167271+0000', 'last_undegraded': '2024-01-15T11:34:11.167271+0000', 'last_fullsized': '2024-01-15T11:34:11.167271+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-15T11:34:18.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-01-15T11:34:18.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-01-15T11:34:18.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.164384+0000', 'last_change': '2024-01-15T11:34:11.164384+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.164384+0000', 'last_undegraded': '2024-01-15T11:34:11.164384+0000', 'last_fullsized': '2024-01-15T11:34:11.164384+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-15T11:34:18.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-01-15T11:34:18.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-15T11:34:12.163802+0000', 'last_change': '2024-01-15T11:34:12.163802+0000', 'last_active': '2024-01-15T11:34:12.163802+0000', 'last_peered': '2024-01-15T11:34:12.163802+0000', 'last_clean': '2024-01-15T11:34:12.163802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:12.163802+0000', 'last_undegraded': '2024-01-15T11:34:12.163802+0000', 'last_fullsized': '2024-01-15T11:34:12.163802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:12.163802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-15T11:34:18.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-01-15T11:34:18.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-01-15T11:34:11.170981+0000', 'last_change': '2024-01-15T11:34:11.170981+0000', 'last_active': '2024-01-15T11:34:11.156862+0000', 'last_peered': '2024-01-15T11:34:11.156862+0000', 'last_clean': '2024-01-15T11:34:11.156862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-15T11:34:11.170981+0000', 'last_undegraded': '2024-01-15T11:34:11.170981+0000', 'last_fullsized': '2024-01-15T11:34:11.170981+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'last_clean_scrub_stamp': '2024-01-15T11:34:11.156862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-15T11:34:18.096 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-15T11:34:18.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.255+0000 7f127a972640 1 Processor -- start 2024-01-15T11:34:18.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.255+0000 7f127a972640 1 -- start start 2024-01-15T11:34:18.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.255+0000 7f127a972640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1274144c80 0x7f12740abf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:18.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.255+0000 7f127a972640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f12740ac460 0x7f12740706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:18.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.255+0000 7f127a972640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1274070c20 0x7f127415eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:18.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.259+0000 7f127a972640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1274145060 con 0x7f1274144c80 2024-01-15T11:34:18.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.259+0000 7f127a972640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1274071fd0 con 0x7f12740ac460 2024-01-15T11:34:18.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.259+0000 7f127a972640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12740ac8c0 con 0x7f1274070c20 2024-01-15T11:34:18.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.259+0000 7f1273fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1274144c80 0x7f12740abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:18.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.259+0000 7f1273fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f1274144c80 0x7f12740abf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38440/0 (socket says 172.21.15.27:38440) 2024-01-15T11:34:18.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.259+0000 7f1273fff640 1 -- 172.21.15.27:0/3132368928 learned_addr learned my addr 172.21.15.27:0/3132368928 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:18.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.259+0000 7f1278f0f640 1 --2- 172.21.15.27:0/3132368928 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1274070c20 0x7f127415eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:18.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.259+0000 7f12737fe640 1 --2- 172.21.15.27:0/3132368928 >> v2:172.21.15.93:3300/0 conn(0x7f12740ac460 0x7f12740706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:18.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.259+0000 7f1273fff640 1 -- 172.21.15.27:0/3132368928 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1274070c20 msgr2=0x7f127415eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:18.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.259+0000 7f1273fff640 1 --2- 172.21.15.27:0/3132368928 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1274070c20 0x7f127415eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.259+0000 7f1273fff640 1 -- 172.21.15.27:0/3132368928 >> v2:172.21.15.93:3300/0 conn(0x7f12740ac460 msgr2=0x7f12740706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:18.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.259+0000 7f1273fff640 1 --2- 172.21.15.27:0/3132368928 >> v2:172.21.15.93:3300/0 conn(0x7f12740ac460 0x7f12740706e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.259+0000 7f1273fff640 1 -- 172.21.15.27:0/3132368928 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1274071450 con 0x7f1274144c80 2024-01-15T11:34:18.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.259+0000 7f1273fff640 1 --2- 172.21.15.27:0/3132368928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1274144c80 0x7f12740abf20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1274072d10 tx=0x7f126401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a6fe7b0e7ed450 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:18.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.259+0000 7f1272ffd640 1 -- 172.21.15.27:0/3132368928 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12640ab600 con 0x7f1274144c80 2024-01-15T11:34:18.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.263+0000 7f1272ffd640 1 -- 172.21.15.27:0/3132368928 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12640a7050 con 0x7f1274144c80 2024-01-15T11:34:18.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.263+0000 7f1272ffd640 1 -- 172.21.15.27:0/3132368928 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12640ab980 con 0x7f1274144c80 2024-01-15T11:34:18.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.263+0000 7f127a972640 1 -- 172.21.15.27:0/3132368928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1274144c80 msgr2=0x7f12740abf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:18.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.263+0000 7f127a972640 1 --2- 172.21.15.27:0/3132368928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1274144c80 0x7f12740abf20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1274072d10 tx=0x7f126401c210 comp rx=0 tx=0).stop 2024-01-15T11:34:18.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.263+0000 7f127a972640 1 -- 172.21.15.27:0/3132368928 shutdown_connections 2024-01-15T11:34:18.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.263+0000 7f127a972640 1 --2- 172.21.15.27:0/3132368928 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1274070c20 0x7f127415eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.263+0000 7f127a972640 1 --2- 172.21.15.27:0/3132368928 >> v2:172.21.15.93:3300/0 conn(0x7f12740ac460 0x7f12740706e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.263+0000 7f127a972640 1 --2- 172.21.15.27:0/3132368928 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1274144c80 0x7f12740abf20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.263+0000 7f127a972640 1 -- 172.21.15.27:0/3132368928 >> 172.21.15.27:0/3132368928 conn(0x7f12740b0c40 msgr2=0x7f12740b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:18.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.263+0000 7f127a972640 1 -- 172.21.15.27:0/3132368928 shutdown_connections 2024-01-15T11:34:18.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.263+0000 7f127a972640 1 -- 172.21.15.27:0/3132368928 wait complete. 2024-01-15T11:34:18.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.263+0000 7f127a972640 1 Processor -- start 2024-01-15T11:34:18.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.263+0000 7f127a972640 1 -- start start 2024-01-15T11:34:18.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.263+0000 7f127a972640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1274070c20 0x7f127415aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:18.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.263+0000 7f127a972640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f12740ac460 0x7f127409b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:18.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.263+0000 7f127a972640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1274144c80 0x7f127413dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:18.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.263+0000 7f127a972640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127413c2b0 con 0x7f12740ac460 2024-01-15T11:34:18.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.263+0000 7f127a972640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127413dc00 con 0x7f1274070c20 2024-01-15T11:34:18.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.263+0000 7f127a972640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127409a440 con 0x7f1274144c80 2024-01-15T11:34:18.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.263+0000 7f12737fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f12740ac460 0x7f127409b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:18.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.263+0000 7f12737fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f12740ac460 0x7f127409b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38446/0 (socket says 172.21.15.27:38446) 2024-01-15T11:34:18.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.263+0000 7f12737fe640 1 -- 172.21.15.27:0/2425957678 learned_addr learned my addr 172.21.15.27:0/2425957678 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:18.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.263+0000 7f1273fff640 1 --2- 172.21.15.27:0/2425957678 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1274070c20 0x7f127415aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:18.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.263+0000 7f1278f0f640 1 --2- 172.21.15.27:0/2425957678 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1274144c80 0x7f127413dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:18.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.267+0000 7f12737fe640 1 -- 172.21.15.27:0/2425957678 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1274144c80 msgr2=0x7f127413dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:18.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.267+0000 7f12737fe640 1 --2- 172.21.15.27:0/2425957678 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1274144c80 0x7f127413dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.267+0000 7f12737fe640 1 -- 172.21.15.27:0/2425957678 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1274070c20 msgr2=0x7f127415aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:18.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.267+0000 7f12737fe640 1 --2- 172.21.15.27:0/2425957678 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1274070c20 0x7f127415aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.267+0000 7f12737fe640 1 -- 172.21.15.27:0/2425957678 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12640094d0 con 0x7f12740ac460 2024-01-15T11:34:18.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.267+0000 7f12737fe640 1 --2- 172.21.15.27:0/2425957678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f12740ac460 0x7f127409b900 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f126800d800 tx=0x7f126800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:18.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.267+0000 7f1270ff9640 1 -- 172.21.15.27:0/2425957678 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126800b6c0 con 0x7f12740ac460 2024-01-15T11:34:18.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.267+0000 7f1270ff9640 1 -- 172.21.15.27:0/2425957678 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126800b820 con 0x7f12740ac460 2024-01-15T11:34:18.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.267+0000 7f127a972640 1 -- 172.21.15.27:0/2425957678 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127415b430 con 0x7f12740ac460 2024-01-15T11:34:18.270 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.267+0000 7f1270ff9640 1 -- 172.21.15.27:0/2425957678 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126800bb90 con 0x7f12740ac460 2024-01-15T11:34:18.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.267+0000 7f127a972640 1 -- 172.21.15.27:0/2425957678 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127409ac50 con 0x7f12740ac460 2024-01-15T11:34:18.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.267+0000 7f127a972640 1 -- 172.21.15.27:0/2425957678 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12740b1ba0 con 0x7f12740ac460 2024-01-15T11:34:18.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.267+0000 7f1270ff9640 1 -- 172.21.15.27:0/2425957678 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f126800bcf0 con 0x7f12740ac460 2024-01-15T11:34:18.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.267+0000 7f1270ff9640 1 --2- 172.21.15.27:0/2425957678 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f12600668f0 0x7f1260068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:18.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.267+0000 7f1270ff9640 1 -- 172.21.15.27:0/2425957678 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12680848b0 con 0x7f12740ac460 2024-01-15T11:34:18.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.267+0000 7f1273fff640 1 --2- 172.21.15.27:0/2425957678 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f12600668f0 0x7f1260068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:18.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.271+0000 7f1273fff640 1 --2- 172.21.15.27:0/2425957678 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f12600668f0 0x7f1260068db0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f12640ad000 tx=0x7f12640a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:18.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.271+0000 7f1270ff9640 1 -- 172.21.15.27:0/2425957678 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1268051b10 con 0x7f12740ac460 2024-01-15T11:34:18.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.487+0000 7f127a972640 1 -- 172.21.15.27:0/2425957678 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f127404e850 con 0x7f12740ac460 2024-01-15T11:34:18.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.487+0000 7f1270ff9640 1 -- 172.21.15.27:0/2425957678 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1559 (secure 0 0 0) 0x7f1268055130 con 0x7f12740ac460 2024-01-15T11:34:18.492 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:34:18.492 INFO:teuthology.orchestra.run.smithi027.stdout:{"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":83,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":35,"num_osds":8,"num_up_osds":8,"osd_up_since":1705318386,"num_in_osds":8,"osd_in_since":1705318377,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":229990400,"bytes_avail":772864122880,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5070}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-01-15T11:34:08.076938+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-15T11:34:18.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.491+0000 7f127a972640 1 -- 172.21.15.27:0/2425957678 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f12600668f0 msgr2=0x7f1260068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:18.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.491+0000 7f127a972640 1 --2- 172.21.15.27:0/2425957678 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f12600668f0 0x7f1260068db0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f12640ad000 tx=0x7f12640a6000 comp rx=0 tx=0).stop 2024-01-15T11:34:18.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.491+0000 7f127a972640 1 -- 172.21.15.27:0/2425957678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f12740ac460 msgr2=0x7f127409b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:18.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.491+0000 7f127a972640 1 --2- 172.21.15.27:0/2425957678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f12740ac460 0x7f127409b900 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f126800d800 tx=0x7f126800dcc0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.491+0000 7f127a972640 1 -- 172.21.15.27:0/2425957678 shutdown_connections 2024-01-15T11:34:18.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.491+0000 7f127a972640 1 --2- 172.21.15.27:0/2425957678 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1274144c80 0x7f127413dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.491+0000 7f127a972640 1 --2- 172.21.15.27:0/2425957678 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f12740ac460 0x7f127409b900 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.491+0000 7f127a972640 1 --2- 172.21.15.27:0/2425957678 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f12600668f0 0x7f1260068db0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.491+0000 7f127a972640 1 --2- 172.21.15.27:0/2425957678 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1274070c20 0x7f127415aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.491+0000 7f127a972640 1 -- 172.21.15.27:0/2425957678 >> 172.21.15.27:0/2425957678 conn(0x7f12740b0c40 msgr2=0x7f12740af6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:18.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.491+0000 7f127a972640 1 -- 172.21.15.27:0/2425957678 shutdown_connections 2024-01-15T11:34:18.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.491+0000 7f127a972640 1 -- 172.21.15.27:0/2425957678 wait complete. 2024-01-15T11:34:18.514 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-15T11:34:18.514 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-15T11:34:18.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca45cd6640 1 Processor -- start 2024-01-15T11:34:18.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca45cd6640 1 -- start start 2024-01-15T11:34:18.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca45cd6640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca4015d7b0 0x7fca400d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:18.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca45cd6640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fca400d2080 0x7fca4006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:18.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca45cd6640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca400cefd0 con 0x7fca400cead0 2024-01-15T11:34:18.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca45cd6640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca400cf2b0 con 0x7fca400d2080 2024-01-15T11:34:18.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca45cd6640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4006b3f0 con 0x7fca4015d7b0 2024-01-15T11:34:18.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3effd640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fca400cead0 0x7fca400d1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:60064/0 (socket says 172.21.15.27:60064) 2024-01-15T11:34:18.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3effd640 1 -- 172.21.15.27:0/3342342674 learned_addr learned my addr 172.21.15.27:0/3342342674 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:18.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3ffff640 1 --2- 172.21.15.27:0/3342342674 >> v2:172.21.15.93:3300/0 conn(0x7fca400d2080 0x7fca4006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:18.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3f7fe640 1 --2- 172.21.15.27:0/3342342674 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca4015d7b0 0x7fca400d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:18.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3e7fc640 1 -- 172.21.15.27:0/3342342674 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987334927 0 0) 0x7fca400cefd0 con 0x7fca400cead0 2024-01-15T11:34:18.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3e7fc640 1 -- 172.21.15.27:0/3342342674 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca28003530 con 0x7fca400cead0 2024-01-15T11:34:18.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3e7fc640 1 -- 172.21.15.27:0/3342342674 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 965543148 0 0) 0x7fca28003530 con 0x7fca400cead0 2024-01-15T11:34:18.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3e7fc640 1 -- 172.21.15.27:0/3342342674 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca4015d7b0 msgr2=0x7fca400d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:18.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3e7fc640 1 --2- 172.21.15.27:0/3342342674 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca4015d7b0 0x7fca400d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3e7fc640 1 -- 172.21.15.27:0/3342342674 >> v2:172.21.15.93:3300/0 conn(0x7fca400d2080 msgr2=0x7fca4006bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:18.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3e7fc640 1 --2- 172.21.15.27:0/3342342674 >> v2:172.21.15.93:3300/0 conn(0x7fca400d2080 0x7fca4006bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3e7fc640 1 -- 172.21.15.27:0/3342342674 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4006b6d0 con 0x7fca400cead0 2024-01-15T11:34:18.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3e7fc640 1 -- 172.21.15.27:0/3342342674 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1394381265 0 0) 0x7fca34001680 con 0x7fca400cead0 2024-01-15T11:34:18.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3e7fc640 1 -- 172.21.15.27:0/3342342674 >> v1:172.21.15.27:6789/0 conn(0x7fca400cead0 legacy=0x7fca400d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:18.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3e7fc640 1 --2- 172.21.15.27:0/3342342674 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca28003980 0x7fca28003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:18.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3e7fc640 1 --2- 172.21.15.27:0/3342342674 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca4015d7b0 0x7fca280047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:18.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3e7fc640 1 --2- 172.21.15.27:0/3342342674 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca28004d10 0x7fca28005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:18.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3e7fc640 1 -- 172.21.15.27:0/3342342674 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca400cf2b0 con 0x7fca28003980 2024-01-15T11:34:18.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3e7fc640 1 -- 172.21.15.27:0/3342342674 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4006b3f0 con 0x7fca28004d10 2024-01-15T11:34:18.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3e7fc640 1 -- 172.21.15.27:0/3342342674 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2800ba10 con 0x7fca4015d7b0 2024-01-15T11:34:18.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3ffff640 1 --2- 172.21.15.27:0/3342342674 >> v2:172.21.15.93:3300/0 conn(0x7fca400d2080 0x7fca4006bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:34:18.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3f7fe640 1 --2- 172.21.15.27:0/3342342674 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca28003980 0x7fca28003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:18.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3effd640 1 --2- 172.21.15.27:0/3342342674 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca4015d7b0 0x7fca280047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:18.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3ffff640 1 --2- 172.21.15.27:0/3342342674 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca28004d10 0x7fca28005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:18.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3f7fe640 1 -- 172.21.15.27:0/3342342674 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca4015d7b0 msgr2=0x7fca280047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:18.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3f7fe640 1 --2- 172.21.15.27:0/3342342674 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca4015d7b0 0x7fca280047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3f7fe640 1 -- 172.21.15.27:0/3342342674 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca28004d10 msgr2=0x7fca28005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:18.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3f7fe640 1 --2- 172.21.15.27:0/3342342674 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca28004d10 0x7fca28005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3f7fe640 1 -- 172.21.15.27:0/3342342674 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca28003530 con 0x7fca28003980 2024-01-15T11:34:18.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.655+0000 7fca3effd640 1 --2- 172.21.15.27:0/3342342674 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca4015d7b0 0x7fca280047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:34:18.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.659+0000 7fca3f7fe640 1 --2- 172.21.15.27:0/3342342674 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca28003980 0x7fca28003da0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fca30009ae0 tx=0x7fca3001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c8950d0842fd1 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:18.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.659+0000 7fca3e7fc640 1 -- 172.21.15.27:0/3342342674 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca300a55b0 con 0x7fca28003980 2024-01-15T11:34:18.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.659+0000 7fca3e7fc640 1 -- 172.21.15.27:0/3342342674 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca300a5710 con 0x7fca28003980 2024-01-15T11:34:18.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.659+0000 7fca3e7fc640 1 -- 172.21.15.27:0/3342342674 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca300a5ac0 con 0x7fca28003980 2024-01-15T11:34:18.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.659+0000 7fca45cd6640 1 -- 172.21.15.27:0/3342342674 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca28003980 msgr2=0x7fca28003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:18.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.659+0000 7fca45cd6640 1 --2- 172.21.15.27:0/3342342674 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca28003980 0x7fca28003da0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fca30009ae0 tx=0x7fca3001c9c0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.659+0000 7fca3ffff640 1 -- 172.21.15.27:0/3342342674 reap_dead start 2024-01-15T11:34:18.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.659+0000 7fca45cd6640 1 -- 172.21.15.27:0/3342342674 shutdown_connections 2024-01-15T11:34:18.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.659+0000 7fca45cd6640 1 -- 172.21.15.27:0/3342342674 >> 172.21.15.27:0/3342342674 conn(0x7fca400d33b0 msgr2=0x7fca400d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:18.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.659+0000 7fca45cd6640 1 -- 172.21.15.27:0/3342342674 shutdown_connections 2024-01-15T11:34:18.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.659+0000 7fca45cd6640 1 -- 172.21.15.27:0/3342342674 wait complete. 2024-01-15T11:34:18.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.663+0000 7fca45cd6640 1 Processor -- start 2024-01-15T11:34:18.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.663+0000 7fca45cd6640 1 -- start start 2024-01-15T11:34:18.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.663+0000 7fca45cd6640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca28003980 0x7fca400c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:18.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.663+0000 7fca45cd6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca401549a0 0x7fca400c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:18.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.663+0000 7fca45cd6640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca400ca480 0x7fca400c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:18.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.663+0000 7fca45cd6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca400cbe90 con 0x7fca401549a0 2024-01-15T11:34:18.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.663+0000 7fca45cd6640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca400cb370 con 0x7fca28003980 2024-01-15T11:34:18.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.663+0000 7fca45cd6640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca40154fd0 con 0x7fca400ca480 2024-01-15T11:34:18.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.663+0000 7fca3effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca401549a0 0x7fca400c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:18.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.663+0000 7fca3effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca401549a0 0x7fca400c7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38452/0 (socket says 172.21.15.27:38452) 2024-01-15T11:34:18.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.663+0000 7fca3effd640 1 -- 172.21.15.27:0/1637070513 learned_addr learned my addr 172.21.15.27:0/1637070513 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:18.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.663+0000 7fca3ffff640 1 --2- 172.21.15.27:0/1637070513 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca400ca480 0x7fca400c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:18.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.663+0000 7fca3f7fe640 1 --2- 172.21.15.27:0/1637070513 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca28003980 0x7fca400c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:18.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.663+0000 7fca3effd640 1 -- 172.21.15.27:0/1637070513 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca400ca480 msgr2=0x7fca400c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:18.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.663+0000 7fca3effd640 1 --2- 172.21.15.27:0/1637070513 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca400ca480 0x7fca400c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.663+0000 7fca3effd640 1 -- 172.21.15.27:0/1637070513 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca28003980 msgr2=0x7fca400c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:18.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.663+0000 7fca3effd640 1 --2- 172.21.15.27:0/1637070513 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca28003980 0x7fca400c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.663+0000 7fca3effd640 1 -- 172.21.15.27:0/1637070513 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca400cb5f0 con 0x7fca401549a0 2024-01-15T11:34:18.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.663+0000 7fca3effd640 1 --2- 172.21.15.27:0/1637070513 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca401549a0 0x7fca400c7a20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fca3400e790 tx=0x7fca3400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:18.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.663+0000 7fca27fff640 1 -- 172.21.15.27:0/1637070513 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3400eea0 con 0x7fca401549a0 2024-01-15T11:34:18.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.667+0000 7fca27fff640 1 -- 172.21.15.27:0/1637070513 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3400c8d0 con 0x7fca401549a0 2024-01-15T11:34:18.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.667+0000 7fca27fff640 1 -- 172.21.15.27:0/1637070513 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3400cc60 con 0x7fca401549a0 2024-01-15T11:34:18.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.667+0000 7fca45cd6640 1 -- 172.21.15.27:0/1637070513 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca400cb8d0 con 0x7fca401549a0 2024-01-15T11:34:18.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.667+0000 7fca45cd6640 1 -- 172.21.15.27:0/1637070513 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca400c6fc0 con 0x7fca401549a0 2024-01-15T11:34:18.672 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.667+0000 7fca45cd6640 1 -- 172.21.15.27:0/1637070513 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca400c71b0 con 0x7fca401549a0 2024-01-15T11:34:18.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.667+0000 7fca27fff640 1 -- 172.21.15.27:0/1637070513 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fca3401d460 con 0x7fca401549a0 2024-01-15T11:34:18.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.667+0000 7fca27fff640 1 --2- 172.21.15.27:0/1637070513 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fca2c066920 0x7fca2c068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:18.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.667+0000 7fca27fff640 1 -- 172.21.15.27:0/1637070513 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca340843d0 con 0x7fca401549a0 2024-01-15T11:34:18.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.667+0000 7fca3f7fe640 1 --2- 172.21.15.27:0/1637070513 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fca2c066920 0x7fca2c068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:18.673 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.671+0000 7fca3f7fe640 1 --2- 172.21.15.27:0/1637070513 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fca2c066920 0x7fca2c068de0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fca300af000 tx=0x7fca300046d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:18.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.671+0000 7fca27fff640 1 -- 172.21.15.27:0/1637070513 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fca34051620 con 0x7fca401549a0 2024-01-15T11:34:18.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.831+0000 7fca45cd6640 1 -- 172.21.15.27:0/1637070513 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca4004e850 con 0x7fca2c066920 2024-01-15T11:34:18.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.839+0000 7fca27fff640 1 -- 172.21.15.27:0/1637070513 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288916 (secure 0 0 0) 0x7fca4004e850 con 0x7fca2c066920 2024-01-15T11:34:18.846 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:34:18.848 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-01-15T11:34:18.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.843+0000 7fca45cd6640 1 -- 172.21.15.27:0/1637070513 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fca2c066920 msgr2=0x7fca2c068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:18.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.843+0000 7fca45cd6640 1 --2- 172.21.15.27:0/1637070513 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fca2c066920 0x7fca2c068de0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fca300af000 tx=0x7fca300046d0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.843+0000 7fca45cd6640 1 -- 172.21.15.27:0/1637070513 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca401549a0 msgr2=0x7fca400c7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:18.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.843+0000 7fca45cd6640 1 --2- 172.21.15.27:0/1637070513 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca401549a0 0x7fca400c7a20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fca3400e790 tx=0x7fca3400ec50 comp rx=0 tx=0).stop 2024-01-15T11:34:18.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.843+0000 7fca45cd6640 1 -- 172.21.15.27:0/1637070513 shutdown_connections 2024-01-15T11:34:18.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.843+0000 7fca45cd6640 1 --2- 172.21.15.27:0/1637070513 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca400ca480 0x7fca400c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.843+0000 7fca45cd6640 1 --2- 172.21.15.27:0/1637070513 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca401549a0 0x7fca400c7a20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.843+0000 7fca45cd6640 1 --2- 172.21.15.27:0/1637070513 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fca2c066920 0x7fca2c068de0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.843+0000 7fca45cd6640 1 --2- 172.21.15.27:0/1637070513 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca28003980 0x7fca400c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:18.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.843+0000 7fca45cd6640 1 -- 172.21.15.27:0/1637070513 >> 172.21.15.27:0/1637070513 conn(0x7fca400d33b0 msgr2=0x7fca400d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:18.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.843+0000 7fca45cd6640 1 -- 172.21.15.27:0/1637070513 shutdown_connections 2024-01-15T11:34:18.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:18.843+0000 7fca45cd6640 1 -- 172.21.15.27:0/1637070513 wait complete. 2024-01-15T11:34:18.866 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-01-15T11:34:18.078707+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224600,"kb_used_data":4252,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750120,"statfs":{"total":773094113280,"available":772864122880,"internally_reserved":0,"allocated":4354048,"data_stored":2390776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001078"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.203254+0000","last_change":"2024-01-15T11:34:13.187174+0000","last_active":"2024-01-15T11:34:15.203254+0000","last_peered":"2024-01-15T11:34:15.203254+0000","last_clean":"2024-01-15T11:34:15.203254+0000","last_became_active":"2024-01-15T11:34:13.186887+0000","last_became_peered":"2024-01-15T11:34:13.186887+0000","last_unstale":"2024-01-15T11:34:15.203254+0000","last_undegraded":"2024-01-15T11:34:15.203254+0000","last_fullsized":"2024-01-15T11:34:15.203254+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:08:48.281735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.315082+0000","last_change":"2024-01-15T11:34:13.210492+0000","last_active":"2024-01-15T11:34:15.315082+0000","last_peered":"2024-01-15T11:34:15.315082+0000","last_clean":"2024-01-15T11:34:15.315082+0000","last_became_active":"2024-01-15T11:34:13.210226+0000","last_became_peered":"2024-01-15T11:34:13.210226+0000","last_unstale":"2024-01-15T11:34:15.315082+0000","last_undegraded":"2024-01-15T11:34:15.315082+0000","last_fullsized":"2024-01-15T11:34:15.315082+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:17:49.972594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.246313+0000","last_change":"2024-01-15T11:34:13.202962+0000","last_active":"2024-01-15T11:34:16.246313+0000","last_peered":"2024-01-15T11:34:16.246313+0000","last_clean":"2024-01-15T11:34:16.246313+0000","last_became_active":"2024-01-15T11:34:13.202687+0000","last_became_peered":"2024-01-15T11:34:13.202687+0000","last_unstale":"2024-01-15T11:34:16.246313+0000","last_undegraded":"2024-01-15T11:34:16.246313+0000","last_fullsized":"2024-01-15T11:34:16.246313+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:59:39.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.182805+0000","last_change":"2024-01-15T11:34:13.188832+0000","last_active":"2024-01-15T11:34:14.182805+0000","last_peered":"2024-01-15T11:34:14.182805+0000","last_clean":"2024-01-15T11:34:14.182805+0000","last_became_active":"2024-01-15T11:34:13.188024+0000","last_became_peered":"2024-01-15T11:34:13.188024+0000","last_unstale":"2024-01-15T11:34:14.182805+0000","last_undegraded":"2024-01-15T11:34:14.182805+0000","last_fullsized":"2024-01-15T11:34:14.182805+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:01:42.329760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.314899+0000","last_change":"2024-01-15T11:34:13.217159+0000","last_active":"2024-01-15T11:34:15.314899+0000","last_peered":"2024-01-15T11:34:15.314899+0000","last_clean":"2024-01-15T11:34:15.314899+0000","last_became_active":"2024-01-15T11:34:13.214592+0000","last_became_peered":"2024-01-15T11:34:13.214592+0000","last_unstale":"2024-01-15T11:34:15.314899+0000","last_undegraded":"2024-01-15T11:34:15.314899+0000","last_fullsized":"2024-01-15T11:34:15.314899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:43:30.567712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.184359+0000","last_change":"2024-01-15T11:34:13.196031+0000","last_active":"2024-01-15T11:34:14.184359+0000","last_peered":"2024-01-15T11:34:14.184359+0000","last_clean":"2024-01-15T11:34:14.184359+0000","last_became_active":"2024-01-15T11:34:13.195761+0000","last_became_peered":"2024-01-15T11:34:13.195761+0000","last_unstale":"2024-01-15T11:34:14.184359+0000","last_undegraded":"2024-01-15T11:34:14.184359+0000","last_fullsized":"2024-01-15T11:34:14.184359+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:16:57.268143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.202631+0000","last_change":"2024-01-15T11:34:13.206164+0000","last_active":"2024-01-15T11:34:15.202631+0000","last_peered":"2024-01-15T11:34:15.202631+0000","last_clean":"2024-01-15T11:34:15.202631+0000","last_became_active":"2024-01-15T11:34:13.205927+0000","last_became_peered":"2024-01-15T11:34:13.205927+0000","last_unstale":"2024-01-15T11:34:15.202631+0000","last_undegraded":"2024-01-15T11:34:15.202631+0000","last_fullsized":"2024-01-15T11:34:15.202631+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:15:01.831994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.202581+0000","last_change":"2024-01-15T11:34:13.198353+0000","last_active":"2024-01-15T11:34:15.202581+0000","last_peered":"2024-01-15T11:34:15.202581+0000","last_clean":"2024-01-15T11:34:15.202581+0000","last_became_active":"2024-01-15T11:34:13.195357+0000","last_became_peered":"2024-01-15T11:34:13.195357+0000","last_unstale":"2024-01-15T11:34:15.202581+0000","last_undegraded":"2024-01-15T11:34:15.202581+0000","last_fullsized":"2024-01-15T11:34:15.202581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:13:08.307514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.246455+0000","last_change":"2024-01-15T11:34:13.207678+0000","last_active":"2024-01-15T11:34:16.246455+0000","last_peered":"2024-01-15T11:34:16.246455+0000","last_clean":"2024-01-15T11:34:16.246455+0000","last_became_active":"2024-01-15T11:34:13.207415+0000","last_became_peered":"2024-01-15T11:34:13.207415+0000","last_unstale":"2024-01-15T11:34:16.246455+0000","last_undegraded":"2024-01-15T11:34:16.246455+0000","last_fullsized":"2024-01-15T11:34:16.246455+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:11:55.389638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.183398+0000","last_change":"2024-01-15T11:34:13.204822+0000","last_active":"2024-01-15T11:34:14.183398+0000","last_peered":"2024-01-15T11:34:14.183398+0000","last_clean":"2024-01-15T11:34:14.183398+0000","last_became_active":"2024-01-15T11:34:13.202784+0000","last_became_peered":"2024-01-15T11:34:13.202784+0000","last_unstale":"2024-01-15T11:34:14.183398+0000","last_undegraded":"2024-01-15T11:34:14.183398+0000","last_fullsized":"2024-01-15T11:34:14.183398+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:08:48.281735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.032011+0000","last_change":"2024-01-15T11:34:13.192157+0000","last_active":"2024-01-15T11:34:15.032011+0000","last_peered":"2024-01-15T11:34:15.032011+0000","last_clean":"2024-01-15T11:34:15.032011+0000","last_became_active":"2024-01-15T11:34:13.191627+0000","last_became_peered":"2024-01-15T11:34:13.191627+0000","last_unstale":"2024-01-15T11:34:15.032011+0000","last_undegraded":"2024-01-15T11:34:15.032011+0000","last_fullsized":"2024-01-15T11:34:15.032011+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:16:15.041858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.246296+0000","last_change":"2024-01-15T11:34:13.213652+0000","last_active":"2024-01-15T11:34:16.246296+0000","last_peered":"2024-01-15T11:34:16.246296+0000","last_clean":"2024-01-15T11:34:16.246296+0000","last_became_active":"2024-01-15T11:34:13.213251+0000","last_became_peered":"2024-01-15T11:34:13.213251+0000","last_unstale":"2024-01-15T11:34:16.246296+0000","last_undegraded":"2024-01-15T11:34:16.246296+0000","last_fullsized":"2024-01-15T11:34:16.246296+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:16:57.268143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.183632+0000","last_change":"2024-01-15T11:34:13.205526+0000","last_active":"2024-01-15T11:34:14.183632+0000","last_peered":"2024-01-15T11:34:14.183632+0000","last_clean":"2024-01-15T11:34:14.183632+0000","last_became_active":"2024-01-15T11:34:13.204398+0000","last_became_peered":"2024-01-15T11:34:13.204398+0000","last_unstale":"2024-01-15T11:34:14.183632+0000","last_undegraded":"2024-01-15T11:34:14.183632+0000","last_fullsized":"2024-01-15T11:34:14.183632+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:39:36.891383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.182330+0000","last_change":"2024-01-15T11:34:13.214112+0000","last_active":"2024-01-15T11:34:14.182330+0000","last_peered":"2024-01-15T11:34:14.182330+0000","last_clean":"2024-01-15T11:34:14.182330+0000","last_became_active":"2024-01-15T11:34:13.213772+0000","last_became_peered":"2024-01-15T11:34:13.213772+0000","last_unstale":"2024-01-15T11:34:14.182330+0000","last_undegraded":"2024-01-15T11:34:14.182330+0000","last_fullsized":"2024-01-15T11:34:14.182330+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:25:12.389022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.386009+0000","last_change":"2024-01-15T11:34:13.188020+0000","last_active":"2024-01-15T11:34:16.386009+0000","last_peered":"2024-01-15T11:34:16.386009+0000","last_clean":"2024-01-15T11:34:16.386009+0000","last_became_active":"2024-01-15T11:34:13.187781+0000","last_became_peered":"2024-01-15T11:34:13.187781+0000","last_unstale":"2024-01-15T11:34:16.386009+0000","last_undegraded":"2024-01-15T11:34:16.386009+0000","last_fullsized":"2024-01-15T11:34:16.386009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:48:21.391670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.386009+0000","last_change":"2024-01-15T11:34:13.199540+0000","last_active":"2024-01-15T11:34:16.386009+0000","last_peered":"2024-01-15T11:34:16.386009+0000","last_clean":"2024-01-15T11:34:16.386009+0000","last_became_active":"2024-01-15T11:34:13.199263+0000","last_became_peered":"2024-01-15T11:34:13.199263+0000","last_unstale":"2024-01-15T11:34:16.386009+0000","last_undegraded":"2024-01-15T11:34:16.386009+0000","last_fullsized":"2024-01-15T11:34:16.386009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:15:01.831994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.032288+0000","last_change":"2024-01-15T11:34:13.189594+0000","last_active":"2024-01-15T11:34:15.032288+0000","last_peered":"2024-01-15T11:34:15.032288+0000","last_clean":"2024-01-15T11:34:15.032288+0000","last_became_active":"2024-01-15T11:34:13.189245+0000","last_became_peered":"2024-01-15T11:34:13.189245+0000","last_unstale":"2024-01-15T11:34:15.032288+0000","last_undegraded":"2024-01-15T11:34:15.032288+0000","last_fullsized":"2024-01-15T11:34:15.032288+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:53:06.652895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.184693+0000","last_change":"2024-01-15T11:34:13.201369+0000","last_active":"2024-01-15T11:34:14.184693+0000","last_peered":"2024-01-15T11:34:14.184693+0000","last_clean":"2024-01-15T11:34:14.184693+0000","last_became_active":"2024-01-15T11:34:13.200766+0000","last_became_peered":"2024-01-15T11:34:13.200766+0000","last_unstale":"2024-01-15T11:34:14.184693+0000","last_undegraded":"2024-01-15T11:34:14.184693+0000","last_fullsized":"2024-01-15T11:34:14.184693+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:38:23.127448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.184480+0000","last_change":"2024-01-15T11:34:13.207372+0000","last_active":"2024-01-15T11:34:14.184480+0000","last_peered":"2024-01-15T11:34:14.184480+0000","last_clean":"2024-01-15T11:34:14.184480+0000","last_became_active":"2024-01-15T11:34:13.207078+0000","last_became_peered":"2024-01-15T11:34:13.207078+0000","last_unstale":"2024-01-15T11:34:14.184480+0000","last_undegraded":"2024-01-15T11:34:14.184480+0000","last_fullsized":"2024-01-15T11:34:14.184480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:46:46.301548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.183853+0000","last_change":"2024-01-15T11:34:13.206425+0000","last_active":"2024-01-15T11:34:14.183853+0000","last_peered":"2024-01-15T11:34:14.183853+0000","last_clean":"2024-01-15T11:34:14.183853+0000","last_became_active":"2024-01-15T11:34:13.206126+0000","last_became_peered":"2024-01-15T11:34:13.206126+0000","last_unstale":"2024-01-15T11:34:14.183853+0000","last_undegraded":"2024-01-15T11:34:14.183853+0000","last_fullsized":"2024-01-15T11:34:14.183853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:18:27.922370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.386309+0000","last_change":"2024-01-15T11:34:13.202834+0000","last_active":"2024-01-15T11:34:16.386309+0000","last_peered":"2024-01-15T11:34:16.386309+0000","last_clean":"2024-01-15T11:34:16.386309+0000","last_became_active":"2024-01-15T11:34:13.202554+0000","last_became_peered":"2024-01-15T11:34:13.202554+0000","last_unstale":"2024-01-15T11:34:16.386309+0000","last_undegraded":"2024-01-15T11:34:16.386309+0000","last_fullsized":"2024-01-15T11:34:16.386309+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:58:31.438696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.202717+0000","last_change":"2024-01-15T11:34:13.188537+0000","last_active":"2024-01-15T11:34:15.202717+0000","last_peered":"2024-01-15T11:34:15.202717+0000","last_clean":"2024-01-15T11:34:15.202717+0000","last_became_active":"2024-01-15T11:34:13.188230+0000","last_became_peered":"2024-01-15T11:34:13.188230+0000","last_unstale":"2024-01-15T11:34:15.202717+0000","last_undegraded":"2024-01-15T11:34:15.202717+0000","last_fullsized":"2024-01-15T11:34:15.202717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:25:12.389022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.183324+0000","last_change":"2024-01-15T11:34:13.206802+0000","last_active":"2024-01-15T11:34:14.183324+0000","last_peered":"2024-01-15T11:34:14.183324+0000","last_clean":"2024-01-15T11:34:14.183324+0000","last_became_active":"2024-01-15T11:34:13.206236+0000","last_became_peered":"2024-01-15T11:34:13.206236+0000","last_unstale":"2024-01-15T11:34:14.183324+0000","last_undegraded":"2024-01-15T11:34:14.183324+0000","last_fullsized":"2024-01-15T11:34:14.183324+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:50:36.686093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.202688+0000","last_change":"2024-01-15T11:34:13.200124+0000","last_active":"2024-01-15T11:34:15.202688+0000","last_peered":"2024-01-15T11:34:15.202688+0000","last_clean":"2024-01-15T11:34:15.202688+0000","last_became_active":"2024-01-15T11:34:13.199814+0000","last_became_peered":"2024-01-15T11:34:13.199814+0000","last_unstale":"2024-01-15T11:34:15.202688+0000","last_undegraded":"2024-01-15T11:34:15.202688+0000","last_fullsized":"2024-01-15T11:34:15.202688+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:47.338142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.184305+0000","last_change":"2024-01-15T11:34:13.190915+0000","last_active":"2024-01-15T11:34:14.184305+0000","last_peered":"2024-01-15T11:34:14.184305+0000","last_clean":"2024-01-15T11:34:14.184305+0000","last_became_active":"2024-01-15T11:34:13.190455+0000","last_became_peered":"2024-01-15T11:34:13.190455+0000","last_unstale":"2024-01-15T11:34:14.184305+0000","last_undegraded":"2024-01-15T11:34:14.184305+0000","last_fullsized":"2024-01-15T11:34:14.184305+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:41:00.632195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.184155+0000","last_change":"2024-01-15T11:34:13.203038+0000","last_active":"2024-01-15T11:34:14.184155+0000","last_peered":"2024-01-15T11:34:14.184155+0000","last_clean":"2024-01-15T11:34:14.184155+0000","last_became_active":"2024-01-15T11:34:13.202384+0000","last_became_peered":"2024-01-15T11:34:13.202384+0000","last_unstale":"2024-01-15T11:34:14.184155+0000","last_undegraded":"2024-01-15T11:34:14.184155+0000","last_fullsized":"2024-01-15T11:34:14.184155+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:17:19.205337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.314965+0000","last_change":"2024-01-15T11:34:13.212204+0000","last_active":"2024-01-15T11:34:15.314965+0000","last_peered":"2024-01-15T11:34:15.314965+0000","last_clean":"2024-01-15T11:34:15.314965+0000","last_became_active":"2024-01-15T11:34:13.211842+0000","last_became_peered":"2024-01-15T11:34:13.211842+0000","last_unstale":"2024-01-15T11:34:15.314965+0000","last_undegraded":"2024-01-15T11:34:15.314965+0000","last_fullsized":"2024-01-15T11:34:15.314965+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:09:33.462669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.203223+0000","last_change":"2024-01-15T11:34:13.199475+0000","last_active":"2024-01-15T11:34:15.203223+0000","last_peered":"2024-01-15T11:34:15.203223+0000","last_clean":"2024-01-15T11:34:15.203223+0000","last_became_active":"2024-01-15T11:34:13.199162+0000","last_became_peered":"2024-01-15T11:34:13.199162+0000","last_unstale":"2024-01-15T11:34:15.203223+0000","last_undegraded":"2024-01-15T11:34:15.203223+0000","last_fullsized":"2024-01-15T11:34:15.203223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:58:31.438696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.386241+0000","last_change":"2024-01-15T11:34:13.191034+0000","last_active":"2024-01-15T11:34:16.386241+0000","last_peered":"2024-01-15T11:34:16.386241+0000","last_clean":"2024-01-15T11:34:16.386241+0000","last_became_active":"2024-01-15T11:34:13.190761+0000","last_became_peered":"2024-01-15T11:34:13.190761+0000","last_unstale":"2024-01-15T11:34:16.386241+0000","last_undegraded":"2024-01-15T11:34:16.386241+0000","last_fullsized":"2024-01-15T11:34:16.386241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:31:31.628247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.386070+0000","last_change":"2024-01-15T11:34:13.191597+0000","last_active":"2024-01-15T11:34:16.386070+0000","last_peered":"2024-01-15T11:34:16.386070+0000","last_clean":"2024-01-15T11:34:16.386070+0000","last_became_active":"2024-01-15T11:34:13.190729+0000","last_became_peered":"2024-01-15T11:34:13.190729+0000","last_unstale":"2024-01-15T11:34:16.386070+0000","last_undegraded":"2024-01-15T11:34:16.386070+0000","last_fullsized":"2024-01-15T11:34:16.386070+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:25:12.389022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.202686+0000","last_change":"2024-01-15T11:34:13.199713+0000","last_active":"2024-01-15T11:34:15.202686+0000","last_peered":"2024-01-15T11:34:15.202686+0000","last_clean":"2024-01-15T11:34:15.202686+0000","last_became_active":"2024-01-15T11:34:13.199468+0000","last_became_peered":"2024-01-15T11:34:13.199468+0000","last_unstale":"2024-01-15T11:34:15.202686+0000","last_undegraded":"2024-01-15T11:34:15.202686+0000","last_fullsized":"2024-01-15T11:34:15.202686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:48:21.391670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.031831+0000","last_change":"2024-01-15T11:34:13.189413+0000","last_active":"2024-01-15T11:34:15.031831+0000","last_peered":"2024-01-15T11:34:15.031831+0000","last_clean":"2024-01-15T11:34:15.031831+0000","last_became_active":"2024-01-15T11:34:13.189137+0000","last_became_peered":"2024-01-15T11:34:13.189137+0000","last_unstale":"2024-01-15T11:34:15.031831+0000","last_undegraded":"2024-01-15T11:34:15.031831+0000","last_fullsized":"2024-01-15T11:34:15.031831+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:00:53.753118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.184225+0000","last_change":"2024-01-15T11:34:13.208812+0000","last_active":"2024-01-15T11:34:14.184225+0000","last_peered":"2024-01-15T11:34:14.184225+0000","last_clean":"2024-01-15T11:34:14.184225+0000","last_became_active":"2024-01-15T11:34:13.207976+0000","last_became_peered":"2024-01-15T11:34:13.207976+0000","last_unstale":"2024-01-15T11:34:14.184225+0000","last_undegraded":"2024-01-15T11:34:14.184225+0000","last_fullsized":"2024-01-15T11:34:14.184225+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:42:33.600258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.224934+0000","last_change":"2024-01-15T11:34:12.185418+0000","last_active":"2024-01-15T11:34:13.224934+0000","last_peered":"2024-01-15T11:34:13.224934+0000","last_clean":"2024-01-15T11:34:13.224934+0000","last_became_active":"2024-01-15T11:34:12.185007+0000","last_became_peered":"2024-01-15T11:34:12.185007+0000","last_unstale":"2024-01-15T11:34:13.224934+0000","last_undegraded":"2024-01-15T11:34:13.224934+0000","last_fullsized":"2024-01-15T11:34:13.224934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:29:58.714916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.203241+0000","last_change":"2024-01-15T11:34:13.210512+0000","last_active":"2024-01-15T11:34:15.203241+0000","last_peered":"2024-01-15T11:34:15.203241+0000","last_clean":"2024-01-15T11:34:15.203241+0000","last_became_active":"2024-01-15T11:34:13.208803+0000","last_became_peered":"2024-01-15T11:34:13.208803+0000","last_unstale":"2024-01-15T11:34:15.203241+0000","last_undegraded":"2024-01-15T11:34:15.203241+0000","last_fullsized":"2024-01-15T11:34:15.203241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:01:42.329760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.220215+0000","last_change":"2024-01-15T11:34:12.196282+0000","last_active":"2024-01-15T11:34:13.220215+0000","last_peered":"2024-01-15T11:34:13.220215+0000","last_clean":"2024-01-15T11:34:13.220215+0000","last_became_active":"2024-01-15T11:34:12.195692+0000","last_became_peered":"2024-01-15T11:34:12.195692+0000","last_unstale":"2024-01-15T11:34:13.220215+0000","last_undegraded":"2024-01-15T11:34:13.220215+0000","last_fullsized":"2024-01-15T11:34:13.220215+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:48:20.384729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.203252+0000","last_change":"2024-01-15T11:34:13.190861+0000","last_active":"2024-01-15T11:34:15.203252+0000","last_peered":"2024-01-15T11:34:15.203252+0000","last_clean":"2024-01-15T11:34:15.203252+0000","last_became_active":"2024-01-15T11:34:13.190489+0000","last_became_peered":"2024-01-15T11:34:13.190489+0000","last_unstale":"2024-01-15T11:34:15.203252+0000","last_undegraded":"2024-01-15T11:34:15.203252+0000","last_fullsized":"2024-01-15T11:34:15.203252+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:22:52.225158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.222403+0000","last_change":"2024-01-15T11:34:12.196983+0000","last_active":"2024-01-15T11:34:13.222403+0000","last_peered":"2024-01-15T11:34:13.222403+0000","last_clean":"2024-01-15T11:34:13.222403+0000","last_became_active":"2024-01-15T11:34:12.196674+0000","last_became_peered":"2024-01-15T11:34:12.196674+0000","last_unstale":"2024-01-15T11:34:13.222403+0000","last_undegraded":"2024-01-15T11:34:13.222403+0000","last_fullsized":"2024-01-15T11:34:13.222403+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:25:44.135792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.183849+0000","last_change":"2024-01-15T11:34:13.202720+0000","last_active":"2024-01-15T11:34:14.183849+0000","last_peered":"2024-01-15T11:34:14.183849+0000","last_clean":"2024-01-15T11:34:14.183849+0000","last_became_active":"2024-01-15T11:34:13.202336+0000","last_became_peered":"2024-01-15T11:34:13.202336+0000","last_unstale":"2024-01-15T11:34:14.183849+0000","last_undegraded":"2024-01-15T11:34:14.183849+0000","last_fullsized":"2024-01-15T11:34:14.183849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T11:41:53.407488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.220862+0000","last_change":"2024-01-15T11:34:12.193470+0000","last_active":"2024-01-15T11:34:13.220862+0000","last_peered":"2024-01-15T11:34:13.220862+0000","last_clean":"2024-01-15T11:34:13.220862+0000","last_became_active":"2024-01-15T11:34:12.193160+0000","last_became_peered":"2024-01-15T11:34:12.193160+0000","last_unstale":"2024-01-15T11:34:13.220862+0000","last_undegraded":"2024-01-15T11:34:13.220862+0000","last_fullsized":"2024-01-15T11:34:13.220862+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:13:07.300574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.246174+0000","last_change":"2024-01-15T11:34:13.213890+0000","last_active":"2024-01-15T11:34:16.246174+0000","last_peered":"2024-01-15T11:34:16.246174+0000","last_clean":"2024-01-15T11:34:16.246174+0000","last_became_active":"2024-01-15T11:34:13.213573+0000","last_became_peered":"2024-01-15T11:34:13.213573+0000","last_unstale":"2024-01-15T11:34:16.246174+0000","last_undegraded":"2024-01-15T11:34:16.246174+0000","last_fullsized":"2024-01-15T11:34:16.246174+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:25:45.142732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.224442+0000","last_change":"2024-01-15T11:34:12.193956+0000","last_active":"2024-01-15T11:34:13.224442+0000","last_peered":"2024-01-15T11:34:13.224442+0000","last_clean":"2024-01-15T11:34:13.224442+0000","last_became_active":"2024-01-15T11:34:12.193664+0000","last_became_peered":"2024-01-15T11:34:12.193664+0000","last_unstale":"2024-01-15T11:34:13.224442+0000","last_undegraded":"2024-01-15T11:34:13.224442+0000","last_fullsized":"2024-01-15T11:34:13.224442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:38:22.120508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.202830+0000","last_change":"2024-01-15T11:34:13.211762+0000","last_active":"2024-01-15T11:34:15.202830+0000","last_peered":"2024-01-15T11:34:15.202830+0000","last_clean":"2024-01-15T11:34:15.202830+0000","last_became_active":"2024-01-15T11:34:13.211476+0000","last_became_peered":"2024-01-15T11:34:13.211476+0000","last_unstale":"2024-01-15T11:34:15.202830+0000","last_undegraded":"2024-01-15T11:34:15.202830+0000","last_fullsized":"2024-01-15T11:34:15.202830+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:31:31.628247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.218102+0000","last_change":"2024-01-15T11:34:12.200145+0000","last_active":"2024-01-15T11:34:13.218102+0000","last_peered":"2024-01-15T11:34:13.218102+0000","last_clean":"2024-01-15T11:34:13.218102+0000","last_became_active":"2024-01-15T11:34:12.199887+0000","last_became_peered":"2024-01-15T11:34:12.199887+0000","last_unstale":"2024-01-15T11:34:13.218102+0000","last_undegraded":"2024-01-15T11:34:13.218102+0000","last_fullsized":"2024-01-15T11:34:13.218102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:05:05.188123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.246319+0000","last_change":"2024-01-15T11:34:13.214689+0000","last_active":"2024-01-15T11:34:16.246319+0000","last_peered":"2024-01-15T11:34:16.246319+0000","last_clean":"2024-01-15T11:34:16.246319+0000","last_became_active":"2024-01-15T11:34:13.214457+0000","last_became_peered":"2024-01-15T11:34:13.214457+0000","last_unstale":"2024-01-15T11:34:16.246319+0000","last_undegraded":"2024-01-15T11:34:16.246319+0000","last_fullsized":"2024-01-15T11:34:16.246319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:46:46.301548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.189605+0000","last_change":"2024-01-15T11:34:12.190838+0000","last_active":"2024-01-15T11:34:13.189605+0000","last_peered":"2024-01-15T11:34:13.189605+0000","last_clean":"2024-01-15T11:34:13.189605+0000","last_became_active":"2024-01-15T11:34:12.190468+0000","last_became_peered":"2024-01-15T11:34:12.190468+0000","last_unstale":"2024-01-15T11:34:13.189605+0000","last_undegraded":"2024-01-15T11:34:13.189605+0000","last_fullsized":"2024-01-15T11:34:13.189605+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:04:21.858375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.182438+0000","last_change":"2024-01-15T11:34:13.189444+0000","last_active":"2024-01-15T11:34:14.182438+0000","last_peered":"2024-01-15T11:34:14.182438+0000","last_clean":"2024-01-15T11:34:14.182438+0000","last_became_active":"2024-01-15T11:34:13.189015+0000","last_became_peered":"2024-01-15T11:34:13.189015+0000","last_unstale":"2024-01-15T11:34:14.182438+0000","last_undegraded":"2024-01-15T11:34:14.182438+0000","last_fullsized":"2024-01-15T11:34:14.182438+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:25:05.623725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.182953+0000","last_change":"2024-01-15T11:34:12.202470+0000","last_active":"2024-01-15T11:34:13.182953+0000","last_peered":"2024-01-15T11:34:13.182953+0000","last_clean":"2024-01-15T11:34:13.182953+0000","last_became_active":"2024-01-15T11:34:12.202206+0000","last_became_peered":"2024-01-15T11:34:12.202206+0000","last_unstale":"2024-01-15T11:34:13.182953+0000","last_undegraded":"2024-01-15T11:34:13.182953+0000","last_fullsized":"2024-01-15T11:34:13.182953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:59:38.728499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.032266+0000","last_change":"2024-01-15T11:34:13.210956+0000","last_active":"2024-01-15T11:34:15.032266+0000","last_peered":"2024-01-15T11:34:15.032266+0000","last_clean":"2024-01-15T11:34:15.032266+0000","last_became_active":"2024-01-15T11:34:13.210594+0000","last_became_peered":"2024-01-15T11:34:13.210594+0000","last_unstale":"2024-01-15T11:34:15.032266+0000","last_undegraded":"2024-01-15T11:34:15.032266+0000","last_fullsized":"2024-01-15T11:34:15.032266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:08:50.894327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.315111+0000","last_change":"2024-01-15T11:34:12.186580+0000","last_active":"2024-01-15T11:34:15.315111+0000","last_peered":"2024-01-15T11:34:15.315111+0000","last_clean":"2024-01-15T11:34:15.315111+0000","last_became_active":"2024-01-15T11:34:12.186289+0000","last_became_peered":"2024-01-15T11:34:12.186289+0000","last_unstale":"2024-01-15T11:34:15.315111+0000","last_undegraded":"2024-01-15T11:34:15.315111+0000","last_fullsized":"2024-01-15T11:34:15.315111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:59:36.109427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.184440+0000","last_change":"2024-01-15T11:34:13.219302+0000","last_active":"2024-01-15T11:34:14.184440+0000","last_peered":"2024-01-15T11:34:14.184440+0000","last_clean":"2024-01-15T11:34:14.184440+0000","last_became_active":"2024-01-15T11:34:13.218965+0000","last_became_peered":"2024-01-15T11:34:13.218965+0000","last_unstale":"2024-01-15T11:34:14.184440+0000","last_undegraded":"2024-01-15T11:34:14.184440+0000","last_fullsized":"2024-01-15T11:34:14.184440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:10:23.943080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.315081+0000","last_change":"2024-01-15T11:34:12.188270+0000","last_active":"2024-01-15T11:34:15.315081+0000","last_peered":"2024-01-15T11:34:15.315081+0000","last_clean":"2024-01-15T11:34:15.315081+0000","last_became_active":"2024-01-15T11:34:12.187681+0000","last_became_peered":"2024-01-15T11:34:12.187681+0000","last_unstale":"2024-01-15T11:34:15.315081+0000","last_undegraded":"2024-01-15T11:34:15.315081+0000","last_fullsized":"2024-01-15T11:34:15.315081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:21:17.396997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.182947+0000","last_change":"2024-01-15T11:34:13.189307+0000","last_active":"2024-01-15T11:34:14.182947+0000","last_peered":"2024-01-15T11:34:14.182947+0000","last_clean":"2024-01-15T11:34:14.182947+0000","last_became_active":"2024-01-15T11:34:13.188417+0000","last_became_peered":"2024-01-15T11:34:13.188417+0000","last_unstale":"2024-01-15T11:34:14.182947+0000","last_undegraded":"2024-01-15T11:34:14.182947+0000","last_fullsized":"2024-01-15T11:34:14.182947+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:22:52.225158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.220488+0000","last_change":"2024-01-15T11:34:12.203823+0000","last_active":"2024-01-15T11:34:13.220488+0000","last_peered":"2024-01-15T11:34:13.220488+0000","last_clean":"2024-01-15T11:34:13.220488+0000","last_became_active":"2024-01-15T11:34:12.201698+0000","last_became_peered":"2024-01-15T11:34:12.201698+0000","last_unstale":"2024-01-15T11:34:13.220488+0000","last_undegraded":"2024-01-15T11:34:13.220488+0000","last_fullsized":"2024-01-15T11:34:13.220488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:21:25.315052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.031959+0000","last_change":"2024-01-15T11:34:13.192598+0000","last_active":"2024-01-15T11:34:15.031959+0000","last_peered":"2024-01-15T11:34:15.031959+0000","last_clean":"2024-01-15T11:34:15.031959+0000","last_became_active":"2024-01-15T11:34:13.192009+0000","last_became_peered":"2024-01-15T11:34:13.192009+0000","last_unstale":"2024-01-15T11:34:15.031959+0000","last_undegraded":"2024-01-15T11:34:15.031959+0000","last_fullsized":"2024-01-15T11:34:15.031959+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:31:19.380117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.224253+0000","last_change":"2024-01-15T11:34:12.199088+0000","last_active":"2024-01-15T11:34:13.224253+0000","last_peered":"2024-01-15T11:34:13.224253+0000","last_clean":"2024-01-15T11:34:13.224253+0000","last_became_active":"2024-01-15T11:34:12.198805+0000","last_became_peered":"2024-01-15T11:34:12.198805+0000","last_unstale":"2024-01-15T11:34:13.224253+0000","last_undegraded":"2024-01-15T11:34:13.224253+0000","last_fullsized":"2024-01-15T11:34:13.224253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:59:38.728499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.183052+0000","last_change":"2024-01-15T11:34:13.208741+0000","last_active":"2024-01-15T11:34:14.183052+0000","last_peered":"2024-01-15T11:34:14.183052+0000","last_clean":"2024-01-15T11:34:14.183052+0000","last_became_active":"2024-01-15T11:34:13.208216+0000","last_became_peered":"2024-01-15T11:34:13.208216+0000","last_unstale":"2024-01-15T11:34:14.183052+0000","last_undegraded":"2024-01-15T11:34:14.183052+0000","last_fullsized":"2024-01-15T11:34:14.183052+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:41:59.081158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.221423+0000","last_change":"2024-01-15T11:34:12.197349+0000","last_active":"2024-01-15T11:34:13.221423+0000","last_peered":"2024-01-15T11:34:13.221423+0000","last_clean":"2024-01-15T11:34:13.221423+0000","last_became_active":"2024-01-15T11:34:12.197065+0000","last_became_peered":"2024-01-15T11:34:12.197065+0000","last_unstale":"2024-01-15T11:34:13.221423+0000","last_undegraded":"2024-01-15T11:34:13.221423+0000","last_fullsized":"2024-01-15T11:34:13.221423+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:34:38.263742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.182270+0000","last_change":"2024-01-15T11:34:13.201493+0000","last_active":"2024-01-15T11:34:14.182270+0000","last_peered":"2024-01-15T11:34:14.182270+0000","last_clean":"2024-01-15T11:34:14.182270+0000","last_became_active":"2024-01-15T11:34:13.201225+0000","last_became_peered":"2024-01-15T11:34:13.201225+0000","last_unstale":"2024-01-15T11:34:14.182270+0000","last_undegraded":"2024-01-15T11:34:14.182270+0000","last_fullsized":"2024-01-15T11:34:14.182270+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:47.338142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.183163+0000","last_change":"2024-01-15T11:34:12.198562+0000","last_active":"2024-01-15T11:34:13.183163+0000","last_peered":"2024-01-15T11:34:13.183163+0000","last_clean":"2024-01-15T11:34:13.183163+0000","last_became_active":"2024-01-15T11:34:12.198197+0000","last_became_peered":"2024-01-15T11:34:12.198197+0000","last_unstale":"2024-01-15T11:34:13.183163+0000","last_undegraded":"2024-01-15T11:34:13.183163+0000","last_fullsized":"2024-01-15T11:34:13.183163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:15:00.825053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.202831+0000","last_change":"2024-01-15T11:34:13.207298+0000","last_active":"2024-01-15T11:34:15.202831+0000","last_peered":"2024-01-15T11:34:15.202831+0000","last_clean":"2024-01-15T11:34:15.202831+0000","last_became_active":"2024-01-15T11:34:13.206947+0000","last_became_peered":"2024-01-15T11:34:13.206947+0000","last_unstale":"2024-01-15T11:34:15.202831+0000","last_undegraded":"2024-01-15T11:34:15.202831+0000","last_fullsized":"2024-01-15T11:34:15.202831+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:25:05.623725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.182607+0000","last_change":"2024-01-15T11:34:12.200165+0000","last_active":"2024-01-15T11:34:13.182607+0000","last_peered":"2024-01-15T11:34:13.182607+0000","last_clean":"2024-01-15T11:34:13.182607+0000","last_became_active":"2024-01-15T11:34:12.199867+0000","last_became_peered":"2024-01-15T11:34:12.199867+0000","last_unstale":"2024-01-15T11:34:13.182607+0000","last_undegraded":"2024-01-15T11:34:13.182607+0000","last_fullsized":"2024-01-15T11:34:13.182607+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:18:26.915430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.032140+0000","last_change":"2024-01-15T11:34:13.189515+0000","last_active":"2024-01-15T11:34:15.032140+0000","last_peered":"2024-01-15T11:34:15.032140+0000","last_clean":"2024-01-15T11:34:15.032140+0000","last_became_active":"2024-01-15T11:34:13.189208+0000","last_became_peered":"2024-01-15T11:34:13.189208+0000","last_unstale":"2024-01-15T11:34:15.032140+0000","last_undegraded":"2024-01-15T11:34:15.032140+0000","last_fullsized":"2024-01-15T11:34:15.032140+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:08:40.670494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.222035+0000","last_change":"2024-01-15T11:34:12.197318+0000","last_active":"2024-01-15T11:34:13.222035+0000","last_peered":"2024-01-15T11:34:13.222035+0000","last_clean":"2024-01-15T11:34:13.222035+0000","last_became_active":"2024-01-15T11:34:12.196969+0000","last_became_peered":"2024-01-15T11:34:12.196969+0000","last_unstale":"2024-01-15T11:34:13.222035+0000","last_undegraded":"2024-01-15T11:34:13.222035+0000","last_fullsized":"2024-01-15T11:34:13.222035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:14:22.234610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.032285+0000","last_change":"2024-01-15T11:34:13.192133+0000","last_active":"2024-01-15T11:34:15.032285+0000","last_peered":"2024-01-15T11:34:15.032285+0000","last_clean":"2024-01-15T11:34:15.032285+0000","last_became_active":"2024-01-15T11:34:13.191846+0000","last_became_peered":"2024-01-15T11:34:13.191846+0000","last_unstale":"2024-01-15T11:34:15.032285+0000","last_undegraded":"2024-01-15T11:34:15.032285+0000","last_fullsized":"2024-01-15T11:34:15.032285+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:14:05.398055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.221047+0000","last_change":"2024-01-15T11:34:12.198916+0000","last_active":"2024-01-15T11:34:13.221047+0000","last_peered":"2024-01-15T11:34:13.221047+0000","last_clean":"2024-01-15T11:34:13.221047+0000","last_became_active":"2024-01-15T11:34:12.198592+0000","last_became_peered":"2024-01-15T11:34:12.198592+0000","last_unstale":"2024-01-15T11:34:13.221047+0000","last_undegraded":"2024-01-15T11:34:13.221047+0000","last_fullsized":"2024-01-15T11:34:13.221047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:57:42.674907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.246458+0000","last_change":"2024-01-15T11:34:13.214802+0000","last_active":"2024-01-15T11:34:16.246458+0000","last_peered":"2024-01-15T11:34:16.246458+0000","last_clean":"2024-01-15T11:34:16.246458+0000","last_became_active":"2024-01-15T11:34:13.214472+0000","last_became_peered":"2024-01-15T11:34:13.214472+0000","last_unstale":"2024-01-15T11:34:16.246458+0000","last_undegraded":"2024-01-15T11:34:16.246458+0000","last_fullsized":"2024-01-15T11:34:16.246458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:38:23.127448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.221214+0000","last_change":"2024-01-15T11:34:12.199084+0000","last_active":"2024-01-15T11:34:13.221214+0000","last_peered":"2024-01-15T11:34:13.221214+0000","last_clean":"2024-01-15T11:34:13.221214+0000","last_became_active":"2024-01-15T11:34:12.198832+0000","last_became_peered":"2024-01-15T11:34:12.198832+0000","last_unstale":"2024-01-15T11:34:13.221214+0000","last_undegraded":"2024-01-15T11:34:13.221214+0000","last_fullsized":"2024-01-15T11:34:13.221214+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:50:35.679152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.314889+0000","last_change":"2024-01-15T11:34:13.207788+0000","last_active":"2024-01-15T11:34:15.314889+0000","last_peered":"2024-01-15T11:34:15.314889+0000","last_clean":"2024-01-15T11:34:15.314889+0000","last_became_active":"2024-01-15T11:34:13.207469+0000","last_became_peered":"2024-01-15T11:34:13.207469+0000","last_unstale":"2024-01-15T11:34:15.314889+0000","last_undegraded":"2024-01-15T11:34:15.314889+0000","last_fullsized":"2024-01-15T11:34:15.314889+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:03:24.760131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.220574+0000","last_change":"2024-01-15T11:34:12.196949+0000","last_active":"2024-01-15T11:34:13.220574+0000","last_peered":"2024-01-15T11:34:13.220574+0000","last_clean":"2024-01-15T11:34:13.220574+0000","last_became_active":"2024-01-15T11:34:12.196613+0000","last_became_peered":"2024-01-15T11:34:12.196613+0000","last_unstale":"2024-01-15T11:34:13.220574+0000","last_undegraded":"2024-01-15T11:34:13.220574+0000","last_fullsized":"2024-01-15T11:34:13.220574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:53:08.040480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.184579+0000","last_change":"2024-01-15T11:34:13.207271+0000","last_active":"2024-01-15T11:34:14.184579+0000","last_peered":"2024-01-15T11:34:14.184579+0000","last_clean":"2024-01-15T11:34:14.184579+0000","last_became_active":"2024-01-15T11:34:13.206971+0000","last_became_peered":"2024-01-15T11:34:13.206971+0000","last_unstale":"2024-01-15T11:34:14.184579+0000","last_undegraded":"2024-01-15T11:34:14.184579+0000","last_fullsized":"2024-01-15T11:34:14.184579+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:59:39.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.176906+0000","last_change":"2024-01-15T11:34:12.203316+0000","last_active":"2024-01-15T11:34:13.176906+0000","last_peered":"2024-01-15T11:34:13.176906+0000","last_clean":"2024-01-15T11:34:13.176906+0000","last_became_active":"2024-01-15T11:34:12.203025+0000","last_became_peered":"2024-01-15T11:34:12.203025+0000","last_unstale":"2024-01-15T11:34:13.176906+0000","last_undegraded":"2024-01-15T11:34:13.176906+0000","last_fullsized":"2024-01-15T11:34:13.176906+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:34:38.263742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.183186+0000","last_change":"2024-01-15T11:34:13.205338+0000","last_active":"2024-01-15T11:34:14.183186+0000","last_peered":"2024-01-15T11:34:14.183186+0000","last_clean":"2024-01-15T11:34:14.183186+0000","last_became_active":"2024-01-15T11:34:13.205040+0000","last_became_peered":"2024-01-15T11:34:13.205040+0000","last_unstale":"2024-01-15T11:34:14.183186+0000","last_undegraded":"2024-01-15T11:34:14.183186+0000","last_fullsized":"2024-01-15T11:34:14.183186+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:11:43.678012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.315022+0000","last_change":"2024-01-15T11:34:12.198932+0000","last_active":"2024-01-15T11:34:15.315022+0000","last_peered":"2024-01-15T11:34:15.315022+0000","last_clean":"2024-01-15T11:34:15.315022+0000","last_became_active":"2024-01-15T11:34:12.198650+0000","last_became_peered":"2024-01-15T11:34:12.198650+0000","last_unstale":"2024-01-15T11:34:15.315022+0000","last_undegraded":"2024-01-15T11:34:15.315022+0000","last_fullsized":"2024-01-15T11:34:15.315022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T11:50:21.130076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.314990+0000","last_change":"2024-01-15T11:34:13.217613+0000","last_active":"2024-01-15T11:34:15.314990+0000","last_peered":"2024-01-15T11:34:15.314990+0000","last_clean":"2024-01-15T11:34:15.314990+0000","last_became_active":"2024-01-15T11:34:13.217281+0000","last_became_peered":"2024-01-15T11:34:13.217281+0000","last_unstale":"2024-01-15T11:34:15.314990+0000","last_undegraded":"2024-01-15T11:34:15.314990+0000","last_fullsized":"2024-01-15T11:34:15.314990+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:50:09.437800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.183340+0000","last_change":"2024-01-15T11:34:12.197381+0000","last_active":"2024-01-15T11:34:13.183340+0000","last_peered":"2024-01-15T11:34:13.183340+0000","last_clean":"2024-01-15T11:34:13.183340+0000","last_became_active":"2024-01-15T11:34:12.197098+0000","last_became_peered":"2024-01-15T11:34:12.197098+0000","last_unstale":"2024-01-15T11:34:13.183340+0000","last_undegraded":"2024-01-15T11:34:13.183340+0000","last_fullsized":"2024-01-15T11:34:13.183340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:24:48.913101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.182926+0000","last_change":"2024-01-15T11:34:13.196692+0000","last_active":"2024-01-15T11:34:14.182926+0000","last_peered":"2024-01-15T11:34:14.182926+0000","last_clean":"2024-01-15T11:34:14.182926+0000","last_became_active":"2024-01-15T11:34:13.194167+0000","last_became_peered":"2024-01-15T11:34:13.194167+0000","last_unstale":"2024-01-15T11:34:14.182926+0000","last_undegraded":"2024-01-15T11:34:14.182926+0000","last_fullsized":"2024-01-15T11:34:14.182926+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:24:49.920042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.199757+0000","last_change":"2024-01-15T11:34:12.189277+0000","last_active":"2024-01-15T11:34:13.199757+0000","last_peered":"2024-01-15T11:34:13.199757+0000","last_clean":"2024-01-15T11:34:13.199757+0000","last_became_active":"2024-01-15T11:34:12.189015+0000","last_became_peered":"2024-01-15T11:34:12.189015+0000","last_unstale":"2024-01-15T11:34:13.199757+0000","last_undegraded":"2024-01-15T11:34:13.199757+0000","last_fullsized":"2024-01-15T11:34:13.199757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:06:23.507342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.246221+0000","last_change":"2024-01-15T11:34:13.214803+0000","last_active":"2024-01-15T11:34:16.246221+0000","last_peered":"2024-01-15T11:34:16.246221+0000","last_clean":"2024-01-15T11:34:16.246221+0000","last_became_active":"2024-01-15T11:34:13.214483+0000","last_became_peered":"2024-01-15T11:34:13.214483+0000","last_unstale":"2024-01-15T11:34:16.246221+0000","last_undegraded":"2024-01-15T11:34:16.246221+0000","last_fullsized":"2024-01-15T11:34:16.246221+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:57:43.681847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.182688+0000","last_change":"2024-01-15T11:34:12.182573+0000","last_active":"2024-01-15T11:34:13.182688+0000","last_peered":"2024-01-15T11:34:13.182688+0000","last_clean":"2024-01-15T11:34:13.182688+0000","last_became_active":"2024-01-15T11:34:12.182257+0000","last_became_peered":"2024-01-15T11:34:12.182257+0000","last_unstale":"2024-01-15T11:34:13.182688+0000","last_undegraded":"2024-01-15T11:34:13.182688+0000","last_fullsized":"2024-01-15T11:34:13.182688+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:10:22.936139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.184783+0000","last_change":"2024-01-15T11:34:13.203456+0000","last_active":"2024-01-15T11:34:14.184783+0000","last_peered":"2024-01-15T11:34:14.184783+0000","last_clean":"2024-01-15T11:34:14.184783+0000","last_became_active":"2024-01-15T11:34:13.203117+0000","last_became_peered":"2024-01-15T11:34:13.203117+0000","last_unstale":"2024-01-15T11:34:14.184783+0000","last_undegraded":"2024-01-15T11:34:14.184783+0000","last_fullsized":"2024-01-15T11:34:14.184783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:05:06.195063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.221872+0000","last_change":"2024-01-15T11:34:12.202396+0000","last_active":"2024-01-15T11:34:13.221872+0000","last_peered":"2024-01-15T11:34:13.221872+0000","last_clean":"2024-01-15T11:34:13.221872+0000","last_became_active":"2024-01-15T11:34:12.202073+0000","last_became_peered":"2024-01-15T11:34:12.202073+0000","last_unstale":"2024-01-15T11:34:13.221872+0000","last_undegraded":"2024-01-15T11:34:13.221872+0000","last_fullsized":"2024-01-15T11:34:13.221872+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:34:38.263742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.032404+0000","last_change":"2024-01-15T11:34:13.199884+0000","last_active":"2024-01-15T11:34:15.032404+0000","last_peered":"2024-01-15T11:34:15.032404+0000","last_clean":"2024-01-15T11:34:15.032404+0000","last_became_active":"2024-01-15T11:34:13.198747+0000","last_became_peered":"2024-01-15T11:34:13.198747+0000","last_unstale":"2024-01-15T11:34:15.032404+0000","last_undegraded":"2024-01-15T11:34:15.032404+0000","last_fullsized":"2024-01-15T11:34:15.032404+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:41:01.000604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.317003+0000","last_change":"2024-01-15T11:34:12.189679+0000","last_active":"2024-01-15T11:34:15.317003+0000","last_peered":"2024-01-15T11:34:15.317003+0000","last_clean":"2024-01-15T11:34:15.317003+0000","last_became_active":"2024-01-15T11:34:12.188240+0000","last_became_peered":"2024-01-15T11:34:12.188240+0000","last_unstale":"2024-01-15T11:34:15.317003+0000","last_undegraded":"2024-01-15T11:34:15.317003+0000","last_fullsized":"2024-01-15T11:34:15.317003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:19:15.522671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.184623+0000","last_change":"2024-01-15T11:34:13.209793+0000","last_active":"2024-01-15T11:34:14.184623+0000","last_peered":"2024-01-15T11:34:14.184623+0000","last_clean":"2024-01-15T11:34:14.184623+0000","last_became_active":"2024-01-15T11:34:13.208926+0000","last_became_peered":"2024-01-15T11:34:13.208926+0000","last_unstale":"2024-01-15T11:34:14.184623+0000","last_undegraded":"2024-01-15T11:34:14.184623+0000","last_fullsized":"2024-01-15T11:34:14.184623+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:11:55.389638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.194679+0000","last_change":"2024-01-15T11:34:12.192032+0000","last_active":"2024-01-15T11:34:13.194679+0000","last_peered":"2024-01-15T11:34:13.194679+0000","last_clean":"2024-01-15T11:34:13.194679+0000","last_became_active":"2024-01-15T11:34:12.191400+0000","last_became_peered":"2024-01-15T11:34:12.191400+0000","last_unstale":"2024-01-15T11:34:13.194679+0000","last_undegraded":"2024-01-15T11:34:13.194679+0000","last_fullsized":"2024-01-15T11:34:13.194679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:11:54.382698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.386041+0000","last_change":"2024-01-15T11:34:13.198360+0000","last_active":"2024-01-15T11:34:16.386041+0000","last_peered":"2024-01-15T11:34:16.386041+0000","last_clean":"2024-01-15T11:34:16.386041+0000","last_became_active":"2024-01-15T11:34:13.198017+0000","last_became_peered":"2024-01-15T11:34:13.198017+0000","last_unstale":"2024-01-15T11:34:16.386041+0000","last_undegraded":"2024-01-15T11:34:16.386041+0000","last_fullsized":"2024-01-15T11:34:16.386041+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:47.338142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.194743+0000","last_change":"2024-01-15T11:34:12.202286+0000","last_active":"2024-01-15T11:34:13.194743+0000","last_peered":"2024-01-15T11:34:13.194743+0000","last_clean":"2024-01-15T11:34:13.194743+0000","last_became_active":"2024-01-15T11:34:12.202004+0000","last_became_peered":"2024-01-15T11:34:12.202004+0000","last_unstale":"2024-01-15T11:34:13.194743+0000","last_undegraded":"2024-01-15T11:34:13.194743+0000","last_fullsized":"2024-01-15T11:34:13.194743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:38:22.120508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.182437+0000","last_change":"2024-01-15T11:34:13.199624+0000","last_active":"2024-01-15T11:34:14.182437+0000","last_peered":"2024-01-15T11:34:14.182437+0000","last_clean":"2024-01-15T11:34:14.182437+0000","last_became_active":"2024-01-15T11:34:13.199343+0000","last_became_peered":"2024-01-15T11:34:13.199343+0000","last_unstale":"2024-01-15T11:34:14.182437+0000","last_undegraded":"2024-01-15T11:34:14.182437+0000","last_fullsized":"2024-01-15T11:34:14.182437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:31:31.628247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.194817+0000","last_change":"2024-01-15T11:34:12.199466+0000","last_active":"2024-01-15T11:34:13.194817+0000","last_peered":"2024-01-15T11:34:13.194817+0000","last_clean":"2024-01-15T11:34:13.194817+0000","last_became_active":"2024-01-15T11:34:12.199170+0000","last_became_peered":"2024-01-15T11:34:12.199170+0000","last_unstale":"2024-01-15T11:34:13.194817+0000","last_undegraded":"2024-01-15T11:34:13.194817+0000","last_fullsized":"2024-01-15T11:34:13.194817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:05:05.188123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.182689+0000","last_change":"2024-01-15T11:34:13.194275+0000","last_active":"2024-01-15T11:34:14.182689+0000","last_peered":"2024-01-15T11:34:14.182689+0000","last_clean":"2024-01-15T11:34:14.182689+0000","last_became_active":"2024-01-15T11:34:13.193435+0000","last_became_peered":"2024-01-15T11:34:13.193435+0000","last_unstale":"2024-01-15T11:34:14.182689+0000","last_undegraded":"2024-01-15T11:34:14.182689+0000","last_fullsized":"2024-01-15T11:34:14.182689+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:58:31.438696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.184706+0000","last_change":"2024-01-15T11:34:12.197367+0000","last_active":"2024-01-15T11:34:13.184706+0000","last_peered":"2024-01-15T11:34:13.184706+0000","last_clean":"2024-01-15T11:34:13.184706+0000","last_became_active":"2024-01-15T11:34:12.197082+0000","last_became_peered":"2024-01-15T11:34:12.197082+0000","last_unstale":"2024-01-15T11:34:13.184706+0000","last_undegraded":"2024-01-15T11:34:13.184706+0000","last_fullsized":"2024-01-15T11:34:13.184706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:18:26.915430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.032270+0000","last_change":"2024-01-15T11:34:13.197324+0000","last_active":"2024-01-15T11:34:15.032270+0000","last_peered":"2024-01-15T11:34:15.032270+0000","last_clean":"2024-01-15T11:34:15.032270+0000","last_became_active":"2024-01-15T11:34:13.197090+0000","last_became_peered":"2024-01-15T11:34:13.197090+0000","last_unstale":"2024-01-15T11:34:15.032270+0000","last_undegraded":"2024-01-15T11:34:15.032270+0000","last_fullsized":"2024-01-15T11:34:15.032270+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:32:39.564148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.182799+0000","last_change":"2024-01-15T11:34:12.201561+0000","last_active":"2024-01-15T11:34:13.182799+0000","last_peered":"2024-01-15T11:34:13.182799+0000","last_clean":"2024-01-15T11:34:13.182799+0000","last_became_active":"2024-01-15T11:34:12.200889+0000","last_became_peered":"2024-01-15T11:34:12.200889+0000","last_unstale":"2024-01-15T11:34:13.182799+0000","last_undegraded":"2024-01-15T11:34:13.182799+0000","last_fullsized":"2024-01-15T11:34:13.182799+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:42:32.593318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.386269+0000","last_change":"2024-01-15T11:34:13.199270+0000","last_active":"2024-01-15T11:34:16.386269+0000","last_peered":"2024-01-15T11:34:16.386269+0000","last_clean":"2024-01-15T11:34:16.386269+0000","last_became_active":"2024-01-15T11:34:13.199026+0000","last_became_peered":"2024-01-15T11:34:13.199026+0000","last_unstale":"2024-01-15T11:34:16.386269+0000","last_undegraded":"2024-01-15T11:34:16.386269+0000","last_fullsized":"2024-01-15T11:34:16.386269+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:25:05.623725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.183783+0000","last_change":"2024-01-15T11:34:12.192107+0000","last_active":"2024-01-15T11:34:13.183783+0000","last_peered":"2024-01-15T11:34:13.183783+0000","last_clean":"2024-01-15T11:34:13.183783+0000","last_became_active":"2024-01-15T11:34:12.191840+0000","last_became_peered":"2024-01-15T11:34:12.191840+0000","last_unstale":"2024-01-15T11:34:13.183783+0000","last_undegraded":"2024-01-15T11:34:13.183783+0000","last_fullsized":"2024-01-15T11:34:13.183783+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:30:51.266296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":175,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.198657+0000","last_change":"2024-01-15T11:33:09.200536+0000","last_active":"2024-01-15T11:34:13.198657+0000","last_peered":"2024-01-15T11:34:13.198657+0000","last_clean":"2024-01-15T11:34:13.198657+0000","last_became_active":"2024-01-15T11:33:09.199051+0000","last_became_peered":"2024-01-15T11:33:09.199051+0000","last_unstale":"2024-01-15T11:34:13.198657+0000","last_undegraded":"2024-01-15T11:34:13.198657+0000","last_fullsized":"2024-01-15T11:34:13.198657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:08.185347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:08.185347+0000","last_clean_scrub_stamp":"2024-01-15T11:33:08.185347+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:04:15.799885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":151462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.54700000000000004}]},{"osd":1,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.64400000000000002}]},{"osd":2,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.63},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.53000000000000003}]},{"osd":3,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.55700000000000005}]},{"osd":4,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1,"5min":1,"15min":1},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.48399999999999999}]},{"osd":5,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.58699999999999997}]},{"osd":6,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.67100000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":153052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.68500000000000005}]},{"osd":1,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.78300000000000003}]},{"osd":2,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.60999999999999999}]},{"osd":3,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.879},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.86399999999999999}]},{"osd":4,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.81999999999999995}]},{"osd":5,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.96199999999999997}]},{"osd":7,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.83899999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":153074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.51300000000000001}]},{"osd":1,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.746},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.73699999999999999}]},{"osd":2,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.63900000000000001}]},{"osd":3,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.68200000000000005}]},{"osd":5,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.53400000000000003}]},{"osd":6,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.55700000000000005}]},{"osd":7,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.67000000000000004}]}]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":152216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.504}]},{"osd":1,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.59699999999999998}]},{"osd":2,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.64200000000000002}]},{"osd":4,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.95999999999999996}]},{"osd":5,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.73599999999999999}]},{"osd":6,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.876}]},{"osd":7,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.90200000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":151474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":2.9140000000000001,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":3.2519999999999998,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.46200000000000002}]},{"osd":1,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":3.1080000000000001,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":0.35999999999999999}]},{"osd":3,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":3.722,"5min":3.722,"15min":3.722},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":3.508,"5min":3.508,"15min":3.508},"last":0.44700000000000001}]},{"osd":4,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":3.5539999999999998,"5min":3.5539999999999998,"15min":3.5539999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"last":0.67000000000000004}]},{"osd":5,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":3.5899999999999999,"5min":3.5899999999999999,"15min":3.5899999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.617,"5min":3.617,"15min":3.617},"last":0.54300000000000004}]},{"osd":6,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":3.1899999999999999,"5min":3.1899999999999999,"15min":3.1899999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":3.6459999999999999,"5min":3.6459999999999999,"15min":3.6459999999999999},"last":0.61899999999999999}]},{"osd":7,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.8340000000000001,"5min":3.8340000000000001,"15min":3.8340000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":3.7799999999999998,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":0.65300000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":987136,"data_stored":741878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.54500000000000004}]},{"osd":2,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.94699999999999995}]},{"osd":3,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.621}]},{"osd":4,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.83599999999999997}]},{"osd":5,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.8279999999999998,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":0.90100000000000002}]},{"osd":6,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":0.74099999999999999}]},{"osd":7,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.70999999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":145230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":4.3230000000000004,"5min":4.3230000000000004,"15min":4.3230000000000004},"last":0.46100000000000002}]},{"osd":2,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":4.2800000000000002,"5min":4.2800000000000002,"15min":4.2800000000000002},"last":0.42299999999999999}]},{"osd":3,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.49299999999999999}]},{"osd":4,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":4.4340000000000002,"5min":4.4340000000000002,"15min":4.4340000000000002},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.80500000000000005}]},{"osd":5,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.67200000000000004}]},{"osd":6,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":0.65400000000000003}]},{"osd":7,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.76800000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":987136,"data_stored":742390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.71499999999999997}]},{"osd":1,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.505},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.65300000000000002}]},{"osd":2,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.73299999999999998}]},{"osd":3,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.60599999999999998}]},{"osd":4,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.55100000000000005}]},{"osd":6,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.68799999999999994}]},{"osd":7,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.69799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-15T11:34:21.876 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-15T11:34:22.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.026+0000 7f10cf4ad640 1 Processor -- start 2024-01-15T11:34:22.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.026+0000 7f10cf4ad640 1 -- start start 2024-01-15T11:34:22.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.026+0000 7f10cf4ad640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f10c8144c80 0x7f10c80abf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:22.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.030+0000 7f10cf4ad640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f10c80ac460 0x7f10c80706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:22.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.030+0000 7f10cf4ad640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f10c8070c20 0x7f10c815eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:22.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.030+0000 7f10cf4ad640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c8145060 con 0x7f10c8070c20 2024-01-15T11:34:22.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.030+0000 7f10cf4ad640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c8071fd0 con 0x7f10c80ac460 2024-01-15T11:34:22.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.030+0000 7f10cf4ad640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c80ac8c0 con 0x7f10c8144c80 2024-01-15T11:34:22.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.030+0000 7f10cda4a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f10c8070c20 0x7f10c815eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:22.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.030+0000 7f10cda4a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f10c8070c20 0x7f10c815eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38460/0 (socket says 172.21.15.27:38460) 2024-01-15T11:34:22.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.030+0000 7f10cda4a640 1 -- 172.21.15.27:0/715017622 learned_addr learned my addr 172.21.15.27:0/715017622 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:22.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.030+0000 7f10cca48640 1 --2- 172.21.15.27:0/715017622 >> v2:172.21.15.93:3300/0 conn(0x7f10c80ac460 0x7f10c80706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:22.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.030+0000 7f10cd249640 1 --2- 172.21.15.27:0/715017622 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f10c8144c80 0x7f10c80abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:22.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.030+0000 7f10cda4a640 1 -- 172.21.15.27:0/715017622 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f10c8144c80 msgr2=0x7f10c80abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:22.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.030+0000 7f10cda4a640 1 --2- 172.21.15.27:0/715017622 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f10c8144c80 0x7f10c80abf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.030+0000 7f10cda4a640 1 -- 172.21.15.27:0/715017622 >> v2:172.21.15.93:3300/0 conn(0x7f10c80ac460 msgr2=0x7f10c80706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:22.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.030+0000 7f10cda4a640 1 --2- 172.21.15.27:0/715017622 >> v2:172.21.15.93:3300/0 conn(0x7f10c80ac460 0x7f10c80706e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.030+0000 7f10cda4a640 1 -- 172.21.15.27:0/715017622 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c8071450 con 0x7f10c8070c20 2024-01-15T11:34:22.036 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.030+0000 7f10cda4a640 1 --2- 172.21.15.27:0/715017622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10c8070c20 0x7f10c815eed0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f10c806bf70 tx=0x7f10c001c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8649575ed8eaf21a server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:22.036 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.030+0000 7f10bffff640 1 -- 172.21.15.27:0/715017622 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c00a5560 con 0x7f10c8070c20 2024-01-15T11:34:22.036 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.034+0000 7f10bffff640 1 -- 172.21.15.27:0/715017622 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c00a56c0 con 0x7f10c8070c20 2024-01-15T11:34:22.036 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.034+0000 7f10bffff640 1 -- 172.21.15.27:0/715017622 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c00a5a50 con 0x7f10c8070c20 2024-01-15T11:34:22.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.034+0000 7f10cf4ad640 1 -- 172.21.15.27:0/715017622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10c8070c20 msgr2=0x7f10c815eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:22.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.034+0000 7f10cf4ad640 1 --2- 172.21.15.27:0/715017622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10c8070c20 0x7f10c815eed0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f10c806bf70 tx=0x7f10c001c6e0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.034+0000 7f10cf4ad640 1 -- 172.21.15.27:0/715017622 shutdown_connections 2024-01-15T11:34:22.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.034+0000 7f10cf4ad640 1 --2- 172.21.15.27:0/715017622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10c8070c20 0x7f10c815eed0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.034+0000 7f10cf4ad640 1 --2- 172.21.15.27:0/715017622 >> v2:172.21.15.93:3300/0 conn(0x7f10c80ac460 0x7f10c80706e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.034+0000 7f10cf4ad640 1 --2- 172.21.15.27:0/715017622 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f10c8144c80 0x7f10c80abf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.034+0000 7f10cf4ad640 1 -- 172.21.15.27:0/715017622 >> 172.21.15.27:0/715017622 conn(0x7f10c80b0c40 msgr2=0x7f10c80b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:22.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.034+0000 7f10cf4ad640 1 -- 172.21.15.27:0/715017622 shutdown_connections 2024-01-15T11:34:22.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.034+0000 7f10cf4ad640 1 -- 172.21.15.27:0/715017622 wait complete. 2024-01-15T11:34:22.038 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.034+0000 7f10cf4ad640 1 Processor -- start 2024-01-15T11:34:22.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.034+0000 7f10cf4ad640 1 -- start start 2024-01-15T11:34:22.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.034+0000 7f10cf4ad640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f10c8070c20 0x7f10c81f7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:22.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.034+0000 7f10cf4ad640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10c80ac460 0x7f10c81f78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:22.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.034+0000 7f10cf4ad640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10c8144c80 0x7f10c8143730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:22.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.034+0000 7f10cf4ad640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c81f6820 con 0x7f10c80ac460 2024-01-15T11:34:22.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.034+0000 7f10cf4ad640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c8155de0 con 0x7f10c8144c80 2024-01-15T11:34:22.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.034+0000 7f10cf4ad640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c80b2980 con 0x7f10c8070c20 2024-01-15T11:34:22.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.034+0000 7f10cca48640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10c80ac460 0x7f10c81f78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:22.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.034+0000 7f10cca48640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10c80ac460 0x7f10c81f78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38468/0 (socket says 172.21.15.27:38468) 2024-01-15T11:34:22.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.034+0000 7f10cca48640 1 -- 172.21.15.27:0/1768597293 learned_addr learned my addr 172.21.15.27:0/1768597293 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:22.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.038+0000 7f10cda4a640 1 --2- 172.21.15.27:0/1768597293 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10c8144c80 0x7f10c8143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:22.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.038+0000 7f10cd249640 1 --2- 172.21.15.27:0/1768597293 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f10c8070c20 0x7f10c81f7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:22.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.038+0000 7f10cca48640 1 -- 172.21.15.27:0/1768597293 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f10c8070c20 msgr2=0x7f10c81f7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:22.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.038+0000 7f10cca48640 1 --2- 172.21.15.27:0/1768597293 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f10c8070c20 0x7f10c81f7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.038+0000 7f10cca48640 1 -- 172.21.15.27:0/1768597293 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10c8144c80 msgr2=0x7f10c8143730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:22.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.038+0000 7f10cca48640 1 --2- 172.21.15.27:0/1768597293 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10c8144c80 0x7f10c8143730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.038+0000 7f10cca48640 1 -- 172.21.15.27:0/1768597293 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c0009b30 con 0x7f10c80ac460 2024-01-15T11:34:22.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.038+0000 7f10cca48640 1 --2- 172.21.15.27:0/1768597293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10c80ac460 0x7f10c81f78f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f10b800e8b0 tx=0x7f10b800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:22.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.038+0000 7f10bdffb640 1 -- 172.21.15.27:0/1768597293 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b800c940 con 0x7f10c80ac460 2024-01-15T11:34:22.042 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.038+0000 7f10bdffb640 1 -- 172.21.15.27:0/1768597293 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b800caa0 con 0x7f10c80ac460 2024-01-15T11:34:22.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.038+0000 7f10cf4ad640 1 -- 172.21.15.27:0/1768597293 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c80b2c60 con 0x7f10c80ac460 2024-01-15T11:34:22.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.038+0000 7f10bdffb640 1 -- 172.21.15.27:0/1768597293 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b800ce30 con 0x7f10c80ac460 2024-01-15T11:34:22.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.038+0000 7f10cf4ad640 1 -- 172.21.15.27:0/1768597293 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c80b2f40 con 0x7f10c80ac460 2024-01-15T11:34:22.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.038+0000 7f10cf4ad640 1 -- 172.21.15.27:0/1768597293 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c804e850 con 0x7f10c80ac460 2024-01-15T11:34:22.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.038+0000 7f10bdffb640 1 -- 172.21.15.27:0/1768597293 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f10b8013470 con 0x7f10c80ac460 2024-01-15T11:34:22.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.038+0000 7f10bdffb640 1 --2- 172.21.15.27:0/1768597293 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f10ac0668f0 0x7f10ac068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:22.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.042+0000 7f10bdffb640 1 -- 172.21.15.27:0/1768597293 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10b80844f0 con 0x7f10c80ac460 2024-01-15T11:34:22.044 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.042+0000 7f10cd249640 1 --2- 172.21.15.27:0/1768597293 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f10ac0668f0 0x7f10ac068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:22.045 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.042+0000 7f10cd249640 1 --2- 172.21.15.27:0/1768597293 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f10ac0668f0 0x7f10ac068db0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f10c4009ac0 tx=0x7f10c4009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:22.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.046+0000 7f10bdffb640 1 -- 172.21.15.27:0/1768597293 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f10b80517d0 con 0x7f10c80ac460 2024-01-15T11:34:22.206 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.202+0000 7f10cf4ad640 1 -- 172.21.15.27:0/1768597293 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f10c806c910 con 0x7f10ac0668f0 2024-01-15T11:34:22.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.210+0000 7f10bdffb640 1 -- 172.21.15.27:0/1768597293 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288889 (secure 0 0 0) 0x7f10c40119e0 con 0x7f10ac0668f0 2024-01-15T11:34:22.218 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:34:22.220 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-01-15T11:34:22.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.214+0000 7f10cf4ad640 1 -- 172.21.15.27:0/1768597293 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f10ac0668f0 msgr2=0x7f10ac068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:22.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.214+0000 7f10cf4ad640 1 --2- 172.21.15.27:0/1768597293 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f10ac0668f0 0x7f10ac068db0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f10c4009ac0 tx=0x7f10c4009190 comp rx=0 tx=0).stop 2024-01-15T11:34:22.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.214+0000 7f10cf4ad640 1 -- 172.21.15.27:0/1768597293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10c80ac460 msgr2=0x7f10c81f78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:22.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.214+0000 7f10cf4ad640 1 --2- 172.21.15.27:0/1768597293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10c80ac460 0x7f10c81f78f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f10b800e8b0 tx=0x7f10b800ed70 comp rx=0 tx=0).stop 2024-01-15T11:34:22.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.214+0000 7f10cf4ad640 1 -- 172.21.15.27:0/1768597293 shutdown_connections 2024-01-15T11:34:22.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.214+0000 7f10cf4ad640 1 --2- 172.21.15.27:0/1768597293 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f10ac0668f0 0x7f10ac068db0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.214+0000 7f10cf4ad640 1 --2- 172.21.15.27:0/1768597293 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f10c8144c80 0x7f10c8143730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.214+0000 7f10cf4ad640 1 --2- 172.21.15.27:0/1768597293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10c80ac460 0x7f10c81f78f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.214+0000 7f10cf4ad640 1 --2- 172.21.15.27:0/1768597293 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f10c8070c20 0x7f10c81f7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.214+0000 7f10cf4ad640 1 -- 172.21.15.27:0/1768597293 >> 172.21.15.27:0/1768597293 conn(0x7f10c80b0c40 msgr2=0x7f10c81642f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:22.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.214+0000 7f10cf4ad640 1 -- 172.21.15.27:0/1768597293 shutdown_connections 2024-01-15T11:34:22.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.214+0000 7f10cf4ad640 1 -- 172.21.15.27:0/1768597293 wait complete. 2024-01-15T11:34:22.237 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-01-15T11:34:22.079703+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224600,"kb_used_data":4252,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750120,"statfs":{"total":773094113280,"available":772864122880,"internally_reserved":0,"allocated":4354048,"data_stored":2390776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.904167"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.203254+0000","last_change":"2024-01-15T11:34:13.187174+0000","last_active":"2024-01-15T11:34:15.203254+0000","last_peered":"2024-01-15T11:34:15.203254+0000","last_clean":"2024-01-15T11:34:15.203254+0000","last_became_active":"2024-01-15T11:34:13.186887+0000","last_became_peered":"2024-01-15T11:34:13.186887+0000","last_unstale":"2024-01-15T11:34:15.203254+0000","last_undegraded":"2024-01-15T11:34:15.203254+0000","last_fullsized":"2024-01-15T11:34:15.203254+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:08:48.281735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.315082+0000","last_change":"2024-01-15T11:34:13.210492+0000","last_active":"2024-01-15T11:34:15.315082+0000","last_peered":"2024-01-15T11:34:15.315082+0000","last_clean":"2024-01-15T11:34:15.315082+0000","last_became_active":"2024-01-15T11:34:13.210226+0000","last_became_peered":"2024-01-15T11:34:13.210226+0000","last_unstale":"2024-01-15T11:34:15.315082+0000","last_undegraded":"2024-01-15T11:34:15.315082+0000","last_fullsized":"2024-01-15T11:34:15.315082+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:17:49.972594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.246313+0000","last_change":"2024-01-15T11:34:13.202962+0000","last_active":"2024-01-15T11:34:16.246313+0000","last_peered":"2024-01-15T11:34:16.246313+0000","last_clean":"2024-01-15T11:34:16.246313+0000","last_became_active":"2024-01-15T11:34:13.202687+0000","last_became_peered":"2024-01-15T11:34:13.202687+0000","last_unstale":"2024-01-15T11:34:16.246313+0000","last_undegraded":"2024-01-15T11:34:16.246313+0000","last_fullsized":"2024-01-15T11:34:16.246313+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:59:39.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.182805+0000","last_change":"2024-01-15T11:34:13.188832+0000","last_active":"2024-01-15T11:34:14.182805+0000","last_peered":"2024-01-15T11:34:14.182805+0000","last_clean":"2024-01-15T11:34:14.182805+0000","last_became_active":"2024-01-15T11:34:13.188024+0000","last_became_peered":"2024-01-15T11:34:13.188024+0000","last_unstale":"2024-01-15T11:34:14.182805+0000","last_undegraded":"2024-01-15T11:34:14.182805+0000","last_fullsized":"2024-01-15T11:34:14.182805+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:01:42.329760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.314899+0000","last_change":"2024-01-15T11:34:13.217159+0000","last_active":"2024-01-15T11:34:15.314899+0000","last_peered":"2024-01-15T11:34:15.314899+0000","last_clean":"2024-01-15T11:34:15.314899+0000","last_became_active":"2024-01-15T11:34:13.214592+0000","last_became_peered":"2024-01-15T11:34:13.214592+0000","last_unstale":"2024-01-15T11:34:15.314899+0000","last_undegraded":"2024-01-15T11:34:15.314899+0000","last_fullsized":"2024-01-15T11:34:15.314899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:43:30.567712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.184359+0000","last_change":"2024-01-15T11:34:13.196031+0000","last_active":"2024-01-15T11:34:14.184359+0000","last_peered":"2024-01-15T11:34:14.184359+0000","last_clean":"2024-01-15T11:34:14.184359+0000","last_became_active":"2024-01-15T11:34:13.195761+0000","last_became_peered":"2024-01-15T11:34:13.195761+0000","last_unstale":"2024-01-15T11:34:14.184359+0000","last_undegraded":"2024-01-15T11:34:14.184359+0000","last_fullsized":"2024-01-15T11:34:14.184359+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:16:57.268143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.202631+0000","last_change":"2024-01-15T11:34:13.206164+0000","last_active":"2024-01-15T11:34:15.202631+0000","last_peered":"2024-01-15T11:34:15.202631+0000","last_clean":"2024-01-15T11:34:15.202631+0000","last_became_active":"2024-01-15T11:34:13.205927+0000","last_became_peered":"2024-01-15T11:34:13.205927+0000","last_unstale":"2024-01-15T11:34:15.202631+0000","last_undegraded":"2024-01-15T11:34:15.202631+0000","last_fullsized":"2024-01-15T11:34:15.202631+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:15:01.831994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.202581+0000","last_change":"2024-01-15T11:34:13.198353+0000","last_active":"2024-01-15T11:34:15.202581+0000","last_peered":"2024-01-15T11:34:15.202581+0000","last_clean":"2024-01-15T11:34:15.202581+0000","last_became_active":"2024-01-15T11:34:13.195357+0000","last_became_peered":"2024-01-15T11:34:13.195357+0000","last_unstale":"2024-01-15T11:34:15.202581+0000","last_undegraded":"2024-01-15T11:34:15.202581+0000","last_fullsized":"2024-01-15T11:34:15.202581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:13:08.307514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.246455+0000","last_change":"2024-01-15T11:34:13.207678+0000","last_active":"2024-01-15T11:34:16.246455+0000","last_peered":"2024-01-15T11:34:16.246455+0000","last_clean":"2024-01-15T11:34:16.246455+0000","last_became_active":"2024-01-15T11:34:13.207415+0000","last_became_peered":"2024-01-15T11:34:13.207415+0000","last_unstale":"2024-01-15T11:34:16.246455+0000","last_undegraded":"2024-01-15T11:34:16.246455+0000","last_fullsized":"2024-01-15T11:34:16.246455+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:11:55.389638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.183398+0000","last_change":"2024-01-15T11:34:13.204822+0000","last_active":"2024-01-15T11:34:14.183398+0000","last_peered":"2024-01-15T11:34:14.183398+0000","last_clean":"2024-01-15T11:34:14.183398+0000","last_became_active":"2024-01-15T11:34:13.202784+0000","last_became_peered":"2024-01-15T11:34:13.202784+0000","last_unstale":"2024-01-15T11:34:14.183398+0000","last_undegraded":"2024-01-15T11:34:14.183398+0000","last_fullsized":"2024-01-15T11:34:14.183398+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:08:48.281735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.032011+0000","last_change":"2024-01-15T11:34:13.192157+0000","last_active":"2024-01-15T11:34:15.032011+0000","last_peered":"2024-01-15T11:34:15.032011+0000","last_clean":"2024-01-15T11:34:15.032011+0000","last_became_active":"2024-01-15T11:34:13.191627+0000","last_became_peered":"2024-01-15T11:34:13.191627+0000","last_unstale":"2024-01-15T11:34:15.032011+0000","last_undegraded":"2024-01-15T11:34:15.032011+0000","last_fullsized":"2024-01-15T11:34:15.032011+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:16:15.041858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.246296+0000","last_change":"2024-01-15T11:34:13.213652+0000","last_active":"2024-01-15T11:34:16.246296+0000","last_peered":"2024-01-15T11:34:16.246296+0000","last_clean":"2024-01-15T11:34:16.246296+0000","last_became_active":"2024-01-15T11:34:13.213251+0000","last_became_peered":"2024-01-15T11:34:13.213251+0000","last_unstale":"2024-01-15T11:34:16.246296+0000","last_undegraded":"2024-01-15T11:34:16.246296+0000","last_fullsized":"2024-01-15T11:34:16.246296+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:16:57.268143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.183632+0000","last_change":"2024-01-15T11:34:13.205526+0000","last_active":"2024-01-15T11:34:14.183632+0000","last_peered":"2024-01-15T11:34:14.183632+0000","last_clean":"2024-01-15T11:34:14.183632+0000","last_became_active":"2024-01-15T11:34:13.204398+0000","last_became_peered":"2024-01-15T11:34:13.204398+0000","last_unstale":"2024-01-15T11:34:14.183632+0000","last_undegraded":"2024-01-15T11:34:14.183632+0000","last_fullsized":"2024-01-15T11:34:14.183632+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:39:36.891383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.182330+0000","last_change":"2024-01-15T11:34:13.214112+0000","last_active":"2024-01-15T11:34:14.182330+0000","last_peered":"2024-01-15T11:34:14.182330+0000","last_clean":"2024-01-15T11:34:14.182330+0000","last_became_active":"2024-01-15T11:34:13.213772+0000","last_became_peered":"2024-01-15T11:34:13.213772+0000","last_unstale":"2024-01-15T11:34:14.182330+0000","last_undegraded":"2024-01-15T11:34:14.182330+0000","last_fullsized":"2024-01-15T11:34:14.182330+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:25:12.389022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.386009+0000","last_change":"2024-01-15T11:34:13.188020+0000","last_active":"2024-01-15T11:34:16.386009+0000","last_peered":"2024-01-15T11:34:16.386009+0000","last_clean":"2024-01-15T11:34:16.386009+0000","last_became_active":"2024-01-15T11:34:13.187781+0000","last_became_peered":"2024-01-15T11:34:13.187781+0000","last_unstale":"2024-01-15T11:34:16.386009+0000","last_undegraded":"2024-01-15T11:34:16.386009+0000","last_fullsized":"2024-01-15T11:34:16.386009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:48:21.391670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.386009+0000","last_change":"2024-01-15T11:34:13.199540+0000","last_active":"2024-01-15T11:34:16.386009+0000","last_peered":"2024-01-15T11:34:16.386009+0000","last_clean":"2024-01-15T11:34:16.386009+0000","last_became_active":"2024-01-15T11:34:13.199263+0000","last_became_peered":"2024-01-15T11:34:13.199263+0000","last_unstale":"2024-01-15T11:34:16.386009+0000","last_undegraded":"2024-01-15T11:34:16.386009+0000","last_fullsized":"2024-01-15T11:34:16.386009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:15:01.831994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.032288+0000","last_change":"2024-01-15T11:34:13.189594+0000","last_active":"2024-01-15T11:34:15.032288+0000","last_peered":"2024-01-15T11:34:15.032288+0000","last_clean":"2024-01-15T11:34:15.032288+0000","last_became_active":"2024-01-15T11:34:13.189245+0000","last_became_peered":"2024-01-15T11:34:13.189245+0000","last_unstale":"2024-01-15T11:34:15.032288+0000","last_undegraded":"2024-01-15T11:34:15.032288+0000","last_fullsized":"2024-01-15T11:34:15.032288+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:53:06.652895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.184693+0000","last_change":"2024-01-15T11:34:13.201369+0000","last_active":"2024-01-15T11:34:14.184693+0000","last_peered":"2024-01-15T11:34:14.184693+0000","last_clean":"2024-01-15T11:34:14.184693+0000","last_became_active":"2024-01-15T11:34:13.200766+0000","last_became_peered":"2024-01-15T11:34:13.200766+0000","last_unstale":"2024-01-15T11:34:14.184693+0000","last_undegraded":"2024-01-15T11:34:14.184693+0000","last_fullsized":"2024-01-15T11:34:14.184693+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:38:23.127448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.184480+0000","last_change":"2024-01-15T11:34:13.207372+0000","last_active":"2024-01-15T11:34:14.184480+0000","last_peered":"2024-01-15T11:34:14.184480+0000","last_clean":"2024-01-15T11:34:14.184480+0000","last_became_active":"2024-01-15T11:34:13.207078+0000","last_became_peered":"2024-01-15T11:34:13.207078+0000","last_unstale":"2024-01-15T11:34:14.184480+0000","last_undegraded":"2024-01-15T11:34:14.184480+0000","last_fullsized":"2024-01-15T11:34:14.184480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:46:46.301548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.183853+0000","last_change":"2024-01-15T11:34:13.206425+0000","last_active":"2024-01-15T11:34:14.183853+0000","last_peered":"2024-01-15T11:34:14.183853+0000","last_clean":"2024-01-15T11:34:14.183853+0000","last_became_active":"2024-01-15T11:34:13.206126+0000","last_became_peered":"2024-01-15T11:34:13.206126+0000","last_unstale":"2024-01-15T11:34:14.183853+0000","last_undegraded":"2024-01-15T11:34:14.183853+0000","last_fullsized":"2024-01-15T11:34:14.183853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:18:27.922370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.386309+0000","last_change":"2024-01-15T11:34:13.202834+0000","last_active":"2024-01-15T11:34:16.386309+0000","last_peered":"2024-01-15T11:34:16.386309+0000","last_clean":"2024-01-15T11:34:16.386309+0000","last_became_active":"2024-01-15T11:34:13.202554+0000","last_became_peered":"2024-01-15T11:34:13.202554+0000","last_unstale":"2024-01-15T11:34:16.386309+0000","last_undegraded":"2024-01-15T11:34:16.386309+0000","last_fullsized":"2024-01-15T11:34:16.386309+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:58:31.438696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.202717+0000","last_change":"2024-01-15T11:34:13.188537+0000","last_active":"2024-01-15T11:34:15.202717+0000","last_peered":"2024-01-15T11:34:15.202717+0000","last_clean":"2024-01-15T11:34:15.202717+0000","last_became_active":"2024-01-15T11:34:13.188230+0000","last_became_peered":"2024-01-15T11:34:13.188230+0000","last_unstale":"2024-01-15T11:34:15.202717+0000","last_undegraded":"2024-01-15T11:34:15.202717+0000","last_fullsized":"2024-01-15T11:34:15.202717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:25:12.389022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.183324+0000","last_change":"2024-01-15T11:34:13.206802+0000","last_active":"2024-01-15T11:34:14.183324+0000","last_peered":"2024-01-15T11:34:14.183324+0000","last_clean":"2024-01-15T11:34:14.183324+0000","last_became_active":"2024-01-15T11:34:13.206236+0000","last_became_peered":"2024-01-15T11:34:13.206236+0000","last_unstale":"2024-01-15T11:34:14.183324+0000","last_undegraded":"2024-01-15T11:34:14.183324+0000","last_fullsized":"2024-01-15T11:34:14.183324+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:50:36.686093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.202688+0000","last_change":"2024-01-15T11:34:13.200124+0000","last_active":"2024-01-15T11:34:15.202688+0000","last_peered":"2024-01-15T11:34:15.202688+0000","last_clean":"2024-01-15T11:34:15.202688+0000","last_became_active":"2024-01-15T11:34:13.199814+0000","last_became_peered":"2024-01-15T11:34:13.199814+0000","last_unstale":"2024-01-15T11:34:15.202688+0000","last_undegraded":"2024-01-15T11:34:15.202688+0000","last_fullsized":"2024-01-15T11:34:15.202688+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:47.338142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.184305+0000","last_change":"2024-01-15T11:34:13.190915+0000","last_active":"2024-01-15T11:34:14.184305+0000","last_peered":"2024-01-15T11:34:14.184305+0000","last_clean":"2024-01-15T11:34:14.184305+0000","last_became_active":"2024-01-15T11:34:13.190455+0000","last_became_peered":"2024-01-15T11:34:13.190455+0000","last_unstale":"2024-01-15T11:34:14.184305+0000","last_undegraded":"2024-01-15T11:34:14.184305+0000","last_fullsized":"2024-01-15T11:34:14.184305+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:41:00.632195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.184155+0000","last_change":"2024-01-15T11:34:13.203038+0000","last_active":"2024-01-15T11:34:14.184155+0000","last_peered":"2024-01-15T11:34:14.184155+0000","last_clean":"2024-01-15T11:34:14.184155+0000","last_became_active":"2024-01-15T11:34:13.202384+0000","last_became_peered":"2024-01-15T11:34:13.202384+0000","last_unstale":"2024-01-15T11:34:14.184155+0000","last_undegraded":"2024-01-15T11:34:14.184155+0000","last_fullsized":"2024-01-15T11:34:14.184155+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:17:19.205337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.314965+0000","last_change":"2024-01-15T11:34:13.212204+0000","last_active":"2024-01-15T11:34:15.314965+0000","last_peered":"2024-01-15T11:34:15.314965+0000","last_clean":"2024-01-15T11:34:15.314965+0000","last_became_active":"2024-01-15T11:34:13.211842+0000","last_became_peered":"2024-01-15T11:34:13.211842+0000","last_unstale":"2024-01-15T11:34:15.314965+0000","last_undegraded":"2024-01-15T11:34:15.314965+0000","last_fullsized":"2024-01-15T11:34:15.314965+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T23:09:33.462669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.203223+0000","last_change":"2024-01-15T11:34:13.199475+0000","last_active":"2024-01-15T11:34:15.203223+0000","last_peered":"2024-01-15T11:34:15.203223+0000","last_clean":"2024-01-15T11:34:15.203223+0000","last_became_active":"2024-01-15T11:34:13.199162+0000","last_became_peered":"2024-01-15T11:34:13.199162+0000","last_unstale":"2024-01-15T11:34:15.203223+0000","last_undegraded":"2024-01-15T11:34:15.203223+0000","last_fullsized":"2024-01-15T11:34:15.203223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:58:31.438696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.386241+0000","last_change":"2024-01-15T11:34:13.191034+0000","last_active":"2024-01-15T11:34:16.386241+0000","last_peered":"2024-01-15T11:34:16.386241+0000","last_clean":"2024-01-15T11:34:16.386241+0000","last_became_active":"2024-01-15T11:34:13.190761+0000","last_became_peered":"2024-01-15T11:34:13.190761+0000","last_unstale":"2024-01-15T11:34:16.386241+0000","last_undegraded":"2024-01-15T11:34:16.386241+0000","last_fullsized":"2024-01-15T11:34:16.386241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:31:31.628247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.386070+0000","last_change":"2024-01-15T11:34:13.191597+0000","last_active":"2024-01-15T11:34:16.386070+0000","last_peered":"2024-01-15T11:34:16.386070+0000","last_clean":"2024-01-15T11:34:16.386070+0000","last_became_active":"2024-01-15T11:34:13.190729+0000","last_became_peered":"2024-01-15T11:34:13.190729+0000","last_unstale":"2024-01-15T11:34:16.386070+0000","last_undegraded":"2024-01-15T11:34:16.386070+0000","last_fullsized":"2024-01-15T11:34:16.386070+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:25:12.389022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.202686+0000","last_change":"2024-01-15T11:34:13.199713+0000","last_active":"2024-01-15T11:34:15.202686+0000","last_peered":"2024-01-15T11:34:15.202686+0000","last_clean":"2024-01-15T11:34:15.202686+0000","last_became_active":"2024-01-15T11:34:13.199468+0000","last_became_peered":"2024-01-15T11:34:13.199468+0000","last_unstale":"2024-01-15T11:34:15.202686+0000","last_undegraded":"2024-01-15T11:34:15.202686+0000","last_fullsized":"2024-01-15T11:34:15.202686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:48:21.391670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.031831+0000","last_change":"2024-01-15T11:34:13.189413+0000","last_active":"2024-01-15T11:34:15.031831+0000","last_peered":"2024-01-15T11:34:15.031831+0000","last_clean":"2024-01-15T11:34:15.031831+0000","last_became_active":"2024-01-15T11:34:13.189137+0000","last_became_peered":"2024-01-15T11:34:13.189137+0000","last_unstale":"2024-01-15T11:34:15.031831+0000","last_undegraded":"2024-01-15T11:34:15.031831+0000","last_fullsized":"2024-01-15T11:34:15.031831+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:00:53.753118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.184225+0000","last_change":"2024-01-15T11:34:13.208812+0000","last_active":"2024-01-15T11:34:14.184225+0000","last_peered":"2024-01-15T11:34:14.184225+0000","last_clean":"2024-01-15T11:34:14.184225+0000","last_became_active":"2024-01-15T11:34:13.207976+0000","last_became_peered":"2024-01-15T11:34:13.207976+0000","last_unstale":"2024-01-15T11:34:14.184225+0000","last_undegraded":"2024-01-15T11:34:14.184225+0000","last_fullsized":"2024-01-15T11:34:14.184225+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:42:33.600258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.224934+0000","last_change":"2024-01-15T11:34:12.185418+0000","last_active":"2024-01-15T11:34:13.224934+0000","last_peered":"2024-01-15T11:34:13.224934+0000","last_clean":"2024-01-15T11:34:13.224934+0000","last_became_active":"2024-01-15T11:34:12.185007+0000","last_became_peered":"2024-01-15T11:34:12.185007+0000","last_unstale":"2024-01-15T11:34:13.224934+0000","last_undegraded":"2024-01-15T11:34:13.224934+0000","last_fullsized":"2024-01-15T11:34:13.224934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:29:58.714916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.203241+0000","last_change":"2024-01-15T11:34:13.210512+0000","last_active":"2024-01-15T11:34:15.203241+0000","last_peered":"2024-01-15T11:34:15.203241+0000","last_clean":"2024-01-15T11:34:15.203241+0000","last_became_active":"2024-01-15T11:34:13.208803+0000","last_became_peered":"2024-01-15T11:34:13.208803+0000","last_unstale":"2024-01-15T11:34:15.203241+0000","last_undegraded":"2024-01-15T11:34:15.203241+0000","last_fullsized":"2024-01-15T11:34:15.203241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:01:42.329760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.220215+0000","last_change":"2024-01-15T11:34:12.196282+0000","last_active":"2024-01-15T11:34:13.220215+0000","last_peered":"2024-01-15T11:34:13.220215+0000","last_clean":"2024-01-15T11:34:13.220215+0000","last_became_active":"2024-01-15T11:34:12.195692+0000","last_became_peered":"2024-01-15T11:34:12.195692+0000","last_unstale":"2024-01-15T11:34:13.220215+0000","last_undegraded":"2024-01-15T11:34:13.220215+0000","last_fullsized":"2024-01-15T11:34:13.220215+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:48:20.384729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.203252+0000","last_change":"2024-01-15T11:34:13.190861+0000","last_active":"2024-01-15T11:34:15.203252+0000","last_peered":"2024-01-15T11:34:15.203252+0000","last_clean":"2024-01-15T11:34:15.203252+0000","last_became_active":"2024-01-15T11:34:13.190489+0000","last_became_peered":"2024-01-15T11:34:13.190489+0000","last_unstale":"2024-01-15T11:34:15.203252+0000","last_undegraded":"2024-01-15T11:34:15.203252+0000","last_fullsized":"2024-01-15T11:34:15.203252+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:22:52.225158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.222403+0000","last_change":"2024-01-15T11:34:12.196983+0000","last_active":"2024-01-15T11:34:13.222403+0000","last_peered":"2024-01-15T11:34:13.222403+0000","last_clean":"2024-01-15T11:34:13.222403+0000","last_became_active":"2024-01-15T11:34:12.196674+0000","last_became_peered":"2024-01-15T11:34:12.196674+0000","last_unstale":"2024-01-15T11:34:13.222403+0000","last_undegraded":"2024-01-15T11:34:13.222403+0000","last_fullsized":"2024-01-15T11:34:13.222403+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:25:44.135792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.183849+0000","last_change":"2024-01-15T11:34:13.202720+0000","last_active":"2024-01-15T11:34:14.183849+0000","last_peered":"2024-01-15T11:34:14.183849+0000","last_clean":"2024-01-15T11:34:14.183849+0000","last_became_active":"2024-01-15T11:34:13.202336+0000","last_became_peered":"2024-01-15T11:34:13.202336+0000","last_unstale":"2024-01-15T11:34:14.183849+0000","last_undegraded":"2024-01-15T11:34:14.183849+0000","last_fullsized":"2024-01-15T11:34:14.183849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T11:41:53.407488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.220862+0000","last_change":"2024-01-15T11:34:12.193470+0000","last_active":"2024-01-15T11:34:13.220862+0000","last_peered":"2024-01-15T11:34:13.220862+0000","last_clean":"2024-01-15T11:34:13.220862+0000","last_became_active":"2024-01-15T11:34:12.193160+0000","last_became_peered":"2024-01-15T11:34:12.193160+0000","last_unstale":"2024-01-15T11:34:13.220862+0000","last_undegraded":"2024-01-15T11:34:13.220862+0000","last_fullsized":"2024-01-15T11:34:13.220862+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:13:07.300574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.246174+0000","last_change":"2024-01-15T11:34:13.213890+0000","last_active":"2024-01-15T11:34:16.246174+0000","last_peered":"2024-01-15T11:34:16.246174+0000","last_clean":"2024-01-15T11:34:16.246174+0000","last_became_active":"2024-01-15T11:34:13.213573+0000","last_became_peered":"2024-01-15T11:34:13.213573+0000","last_unstale":"2024-01-15T11:34:16.246174+0000","last_undegraded":"2024-01-15T11:34:16.246174+0000","last_fullsized":"2024-01-15T11:34:16.246174+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:25:45.142732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.224442+0000","last_change":"2024-01-15T11:34:12.193956+0000","last_active":"2024-01-15T11:34:13.224442+0000","last_peered":"2024-01-15T11:34:13.224442+0000","last_clean":"2024-01-15T11:34:13.224442+0000","last_became_active":"2024-01-15T11:34:12.193664+0000","last_became_peered":"2024-01-15T11:34:12.193664+0000","last_unstale":"2024-01-15T11:34:13.224442+0000","last_undegraded":"2024-01-15T11:34:13.224442+0000","last_fullsized":"2024-01-15T11:34:13.224442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:38:22.120508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.202830+0000","last_change":"2024-01-15T11:34:13.211762+0000","last_active":"2024-01-15T11:34:15.202830+0000","last_peered":"2024-01-15T11:34:15.202830+0000","last_clean":"2024-01-15T11:34:15.202830+0000","last_became_active":"2024-01-15T11:34:13.211476+0000","last_became_peered":"2024-01-15T11:34:13.211476+0000","last_unstale":"2024-01-15T11:34:15.202830+0000","last_undegraded":"2024-01-15T11:34:15.202830+0000","last_fullsized":"2024-01-15T11:34:15.202830+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:31:31.628247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.218102+0000","last_change":"2024-01-15T11:34:12.200145+0000","last_active":"2024-01-15T11:34:13.218102+0000","last_peered":"2024-01-15T11:34:13.218102+0000","last_clean":"2024-01-15T11:34:13.218102+0000","last_became_active":"2024-01-15T11:34:12.199887+0000","last_became_peered":"2024-01-15T11:34:12.199887+0000","last_unstale":"2024-01-15T11:34:13.218102+0000","last_undegraded":"2024-01-15T11:34:13.218102+0000","last_fullsized":"2024-01-15T11:34:13.218102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:05:05.188123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.246319+0000","last_change":"2024-01-15T11:34:13.214689+0000","last_active":"2024-01-15T11:34:16.246319+0000","last_peered":"2024-01-15T11:34:16.246319+0000","last_clean":"2024-01-15T11:34:16.246319+0000","last_became_active":"2024-01-15T11:34:13.214457+0000","last_became_peered":"2024-01-15T11:34:13.214457+0000","last_unstale":"2024-01-15T11:34:16.246319+0000","last_undegraded":"2024-01-15T11:34:16.246319+0000","last_fullsized":"2024-01-15T11:34:16.246319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:46:46.301548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.189605+0000","last_change":"2024-01-15T11:34:12.190838+0000","last_active":"2024-01-15T11:34:13.189605+0000","last_peered":"2024-01-15T11:34:13.189605+0000","last_clean":"2024-01-15T11:34:13.189605+0000","last_became_active":"2024-01-15T11:34:12.190468+0000","last_became_peered":"2024-01-15T11:34:12.190468+0000","last_unstale":"2024-01-15T11:34:13.189605+0000","last_undegraded":"2024-01-15T11:34:13.189605+0000","last_fullsized":"2024-01-15T11:34:13.189605+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:04:21.858375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.182438+0000","last_change":"2024-01-15T11:34:13.189444+0000","last_active":"2024-01-15T11:34:14.182438+0000","last_peered":"2024-01-15T11:34:14.182438+0000","last_clean":"2024-01-15T11:34:14.182438+0000","last_became_active":"2024-01-15T11:34:13.189015+0000","last_became_peered":"2024-01-15T11:34:13.189015+0000","last_unstale":"2024-01-15T11:34:14.182438+0000","last_undegraded":"2024-01-15T11:34:14.182438+0000","last_fullsized":"2024-01-15T11:34:14.182438+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:25:05.623725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.182953+0000","last_change":"2024-01-15T11:34:12.202470+0000","last_active":"2024-01-15T11:34:13.182953+0000","last_peered":"2024-01-15T11:34:13.182953+0000","last_clean":"2024-01-15T11:34:13.182953+0000","last_became_active":"2024-01-15T11:34:12.202206+0000","last_became_peered":"2024-01-15T11:34:12.202206+0000","last_unstale":"2024-01-15T11:34:13.182953+0000","last_undegraded":"2024-01-15T11:34:13.182953+0000","last_fullsized":"2024-01-15T11:34:13.182953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:59:38.728499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.032266+0000","last_change":"2024-01-15T11:34:13.210956+0000","last_active":"2024-01-15T11:34:15.032266+0000","last_peered":"2024-01-15T11:34:15.032266+0000","last_clean":"2024-01-15T11:34:15.032266+0000","last_became_active":"2024-01-15T11:34:13.210594+0000","last_became_peered":"2024-01-15T11:34:13.210594+0000","last_unstale":"2024-01-15T11:34:15.032266+0000","last_undegraded":"2024-01-15T11:34:15.032266+0000","last_fullsized":"2024-01-15T11:34:15.032266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:08:50.894327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.315111+0000","last_change":"2024-01-15T11:34:12.186580+0000","last_active":"2024-01-15T11:34:15.315111+0000","last_peered":"2024-01-15T11:34:15.315111+0000","last_clean":"2024-01-15T11:34:15.315111+0000","last_became_active":"2024-01-15T11:34:12.186289+0000","last_became_peered":"2024-01-15T11:34:12.186289+0000","last_unstale":"2024-01-15T11:34:15.315111+0000","last_undegraded":"2024-01-15T11:34:15.315111+0000","last_fullsized":"2024-01-15T11:34:15.315111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:59:36.109427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.184440+0000","last_change":"2024-01-15T11:34:13.219302+0000","last_active":"2024-01-15T11:34:14.184440+0000","last_peered":"2024-01-15T11:34:14.184440+0000","last_clean":"2024-01-15T11:34:14.184440+0000","last_became_active":"2024-01-15T11:34:13.218965+0000","last_became_peered":"2024-01-15T11:34:13.218965+0000","last_unstale":"2024-01-15T11:34:14.184440+0000","last_undegraded":"2024-01-15T11:34:14.184440+0000","last_fullsized":"2024-01-15T11:34:14.184440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:10:23.943080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.315081+0000","last_change":"2024-01-15T11:34:12.188270+0000","last_active":"2024-01-15T11:34:15.315081+0000","last_peered":"2024-01-15T11:34:15.315081+0000","last_clean":"2024-01-15T11:34:15.315081+0000","last_became_active":"2024-01-15T11:34:12.187681+0000","last_became_peered":"2024-01-15T11:34:12.187681+0000","last_unstale":"2024-01-15T11:34:15.315081+0000","last_undegraded":"2024-01-15T11:34:15.315081+0000","last_fullsized":"2024-01-15T11:34:15.315081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:21:17.396997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.182947+0000","last_change":"2024-01-15T11:34:13.189307+0000","last_active":"2024-01-15T11:34:14.182947+0000","last_peered":"2024-01-15T11:34:14.182947+0000","last_clean":"2024-01-15T11:34:14.182947+0000","last_became_active":"2024-01-15T11:34:13.188417+0000","last_became_peered":"2024-01-15T11:34:13.188417+0000","last_unstale":"2024-01-15T11:34:14.182947+0000","last_undegraded":"2024-01-15T11:34:14.182947+0000","last_fullsized":"2024-01-15T11:34:14.182947+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:22:52.225158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.220488+0000","last_change":"2024-01-15T11:34:12.203823+0000","last_active":"2024-01-15T11:34:13.220488+0000","last_peered":"2024-01-15T11:34:13.220488+0000","last_clean":"2024-01-15T11:34:13.220488+0000","last_became_active":"2024-01-15T11:34:12.201698+0000","last_became_peered":"2024-01-15T11:34:12.201698+0000","last_unstale":"2024-01-15T11:34:13.220488+0000","last_undegraded":"2024-01-15T11:34:13.220488+0000","last_fullsized":"2024-01-15T11:34:13.220488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:21:25.315052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.031959+0000","last_change":"2024-01-15T11:34:13.192598+0000","last_active":"2024-01-15T11:34:15.031959+0000","last_peered":"2024-01-15T11:34:15.031959+0000","last_clean":"2024-01-15T11:34:15.031959+0000","last_became_active":"2024-01-15T11:34:13.192009+0000","last_became_peered":"2024-01-15T11:34:13.192009+0000","last_unstale":"2024-01-15T11:34:15.031959+0000","last_undegraded":"2024-01-15T11:34:15.031959+0000","last_fullsized":"2024-01-15T11:34:15.031959+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:31:19.380117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.224253+0000","last_change":"2024-01-15T11:34:12.199088+0000","last_active":"2024-01-15T11:34:13.224253+0000","last_peered":"2024-01-15T11:34:13.224253+0000","last_clean":"2024-01-15T11:34:13.224253+0000","last_became_active":"2024-01-15T11:34:12.198805+0000","last_became_peered":"2024-01-15T11:34:12.198805+0000","last_unstale":"2024-01-15T11:34:13.224253+0000","last_undegraded":"2024-01-15T11:34:13.224253+0000","last_fullsized":"2024-01-15T11:34:13.224253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:59:38.728499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.183052+0000","last_change":"2024-01-15T11:34:13.208741+0000","last_active":"2024-01-15T11:34:14.183052+0000","last_peered":"2024-01-15T11:34:14.183052+0000","last_clean":"2024-01-15T11:34:14.183052+0000","last_became_active":"2024-01-15T11:34:13.208216+0000","last_became_peered":"2024-01-15T11:34:13.208216+0000","last_unstale":"2024-01-15T11:34:14.183052+0000","last_undegraded":"2024-01-15T11:34:14.183052+0000","last_fullsized":"2024-01-15T11:34:14.183052+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:41:59.081158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.221423+0000","last_change":"2024-01-15T11:34:12.197349+0000","last_active":"2024-01-15T11:34:13.221423+0000","last_peered":"2024-01-15T11:34:13.221423+0000","last_clean":"2024-01-15T11:34:13.221423+0000","last_became_active":"2024-01-15T11:34:12.197065+0000","last_became_peered":"2024-01-15T11:34:12.197065+0000","last_unstale":"2024-01-15T11:34:13.221423+0000","last_undegraded":"2024-01-15T11:34:13.221423+0000","last_fullsized":"2024-01-15T11:34:13.221423+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:34:38.263742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.182270+0000","last_change":"2024-01-15T11:34:13.201493+0000","last_active":"2024-01-15T11:34:14.182270+0000","last_peered":"2024-01-15T11:34:14.182270+0000","last_clean":"2024-01-15T11:34:14.182270+0000","last_became_active":"2024-01-15T11:34:13.201225+0000","last_became_peered":"2024-01-15T11:34:13.201225+0000","last_unstale":"2024-01-15T11:34:14.182270+0000","last_undegraded":"2024-01-15T11:34:14.182270+0000","last_fullsized":"2024-01-15T11:34:14.182270+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:47.338142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.183163+0000","last_change":"2024-01-15T11:34:12.198562+0000","last_active":"2024-01-15T11:34:13.183163+0000","last_peered":"2024-01-15T11:34:13.183163+0000","last_clean":"2024-01-15T11:34:13.183163+0000","last_became_active":"2024-01-15T11:34:12.198197+0000","last_became_peered":"2024-01-15T11:34:12.198197+0000","last_unstale":"2024-01-15T11:34:13.183163+0000","last_undegraded":"2024-01-15T11:34:13.183163+0000","last_fullsized":"2024-01-15T11:34:13.183163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:15:00.825053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.202831+0000","last_change":"2024-01-15T11:34:13.207298+0000","last_active":"2024-01-15T11:34:15.202831+0000","last_peered":"2024-01-15T11:34:15.202831+0000","last_clean":"2024-01-15T11:34:15.202831+0000","last_became_active":"2024-01-15T11:34:13.206947+0000","last_became_peered":"2024-01-15T11:34:13.206947+0000","last_unstale":"2024-01-15T11:34:15.202831+0000","last_undegraded":"2024-01-15T11:34:15.202831+0000","last_fullsized":"2024-01-15T11:34:15.202831+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:25:05.623725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.182607+0000","last_change":"2024-01-15T11:34:12.200165+0000","last_active":"2024-01-15T11:34:13.182607+0000","last_peered":"2024-01-15T11:34:13.182607+0000","last_clean":"2024-01-15T11:34:13.182607+0000","last_became_active":"2024-01-15T11:34:12.199867+0000","last_became_peered":"2024-01-15T11:34:12.199867+0000","last_unstale":"2024-01-15T11:34:13.182607+0000","last_undegraded":"2024-01-15T11:34:13.182607+0000","last_fullsized":"2024-01-15T11:34:13.182607+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:18:26.915430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.032140+0000","last_change":"2024-01-15T11:34:13.189515+0000","last_active":"2024-01-15T11:34:15.032140+0000","last_peered":"2024-01-15T11:34:15.032140+0000","last_clean":"2024-01-15T11:34:15.032140+0000","last_became_active":"2024-01-15T11:34:13.189208+0000","last_became_peered":"2024-01-15T11:34:13.189208+0000","last_unstale":"2024-01-15T11:34:15.032140+0000","last_undegraded":"2024-01-15T11:34:15.032140+0000","last_fullsized":"2024-01-15T11:34:15.032140+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:08:40.670494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.222035+0000","last_change":"2024-01-15T11:34:12.197318+0000","last_active":"2024-01-15T11:34:13.222035+0000","last_peered":"2024-01-15T11:34:13.222035+0000","last_clean":"2024-01-15T11:34:13.222035+0000","last_became_active":"2024-01-15T11:34:12.196969+0000","last_became_peered":"2024-01-15T11:34:12.196969+0000","last_unstale":"2024-01-15T11:34:13.222035+0000","last_undegraded":"2024-01-15T11:34:13.222035+0000","last_fullsized":"2024-01-15T11:34:13.222035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:14:22.234610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.032285+0000","last_change":"2024-01-15T11:34:13.192133+0000","last_active":"2024-01-15T11:34:15.032285+0000","last_peered":"2024-01-15T11:34:15.032285+0000","last_clean":"2024-01-15T11:34:15.032285+0000","last_became_active":"2024-01-15T11:34:13.191846+0000","last_became_peered":"2024-01-15T11:34:13.191846+0000","last_unstale":"2024-01-15T11:34:15.032285+0000","last_undegraded":"2024-01-15T11:34:15.032285+0000","last_fullsized":"2024-01-15T11:34:15.032285+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:14:05.398055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.221047+0000","last_change":"2024-01-15T11:34:12.198916+0000","last_active":"2024-01-15T11:34:13.221047+0000","last_peered":"2024-01-15T11:34:13.221047+0000","last_clean":"2024-01-15T11:34:13.221047+0000","last_became_active":"2024-01-15T11:34:12.198592+0000","last_became_peered":"2024-01-15T11:34:12.198592+0000","last_unstale":"2024-01-15T11:34:13.221047+0000","last_undegraded":"2024-01-15T11:34:13.221047+0000","last_fullsized":"2024-01-15T11:34:13.221047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:57:42.674907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.246458+0000","last_change":"2024-01-15T11:34:13.214802+0000","last_active":"2024-01-15T11:34:16.246458+0000","last_peered":"2024-01-15T11:34:16.246458+0000","last_clean":"2024-01-15T11:34:16.246458+0000","last_became_active":"2024-01-15T11:34:13.214472+0000","last_became_peered":"2024-01-15T11:34:13.214472+0000","last_unstale":"2024-01-15T11:34:16.246458+0000","last_undegraded":"2024-01-15T11:34:16.246458+0000","last_fullsized":"2024-01-15T11:34:16.246458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:38:23.127448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.221214+0000","last_change":"2024-01-15T11:34:12.199084+0000","last_active":"2024-01-15T11:34:13.221214+0000","last_peered":"2024-01-15T11:34:13.221214+0000","last_clean":"2024-01-15T11:34:13.221214+0000","last_became_active":"2024-01-15T11:34:12.198832+0000","last_became_peered":"2024-01-15T11:34:12.198832+0000","last_unstale":"2024-01-15T11:34:13.221214+0000","last_undegraded":"2024-01-15T11:34:13.221214+0000","last_fullsized":"2024-01-15T11:34:13.221214+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:50:35.679152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.314889+0000","last_change":"2024-01-15T11:34:13.207788+0000","last_active":"2024-01-15T11:34:15.314889+0000","last_peered":"2024-01-15T11:34:15.314889+0000","last_clean":"2024-01-15T11:34:15.314889+0000","last_became_active":"2024-01-15T11:34:13.207469+0000","last_became_peered":"2024-01-15T11:34:13.207469+0000","last_unstale":"2024-01-15T11:34:15.314889+0000","last_undegraded":"2024-01-15T11:34:15.314889+0000","last_fullsized":"2024-01-15T11:34:15.314889+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:03:24.760131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.220574+0000","last_change":"2024-01-15T11:34:12.196949+0000","last_active":"2024-01-15T11:34:13.220574+0000","last_peered":"2024-01-15T11:34:13.220574+0000","last_clean":"2024-01-15T11:34:13.220574+0000","last_became_active":"2024-01-15T11:34:12.196613+0000","last_became_peered":"2024-01-15T11:34:12.196613+0000","last_unstale":"2024-01-15T11:34:13.220574+0000","last_undegraded":"2024-01-15T11:34:13.220574+0000","last_fullsized":"2024-01-15T11:34:13.220574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T21:53:08.040480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.184579+0000","last_change":"2024-01-15T11:34:13.207271+0000","last_active":"2024-01-15T11:34:14.184579+0000","last_peered":"2024-01-15T11:34:14.184579+0000","last_clean":"2024-01-15T11:34:14.184579+0000","last_became_active":"2024-01-15T11:34:13.206971+0000","last_became_peered":"2024-01-15T11:34:13.206971+0000","last_unstale":"2024-01-15T11:34:14.184579+0000","last_undegraded":"2024-01-15T11:34:14.184579+0000","last_fullsized":"2024-01-15T11:34:14.184579+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:59:39.735439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.176906+0000","last_change":"2024-01-15T11:34:12.203316+0000","last_active":"2024-01-15T11:34:13.176906+0000","last_peered":"2024-01-15T11:34:13.176906+0000","last_clean":"2024-01-15T11:34:13.176906+0000","last_became_active":"2024-01-15T11:34:12.203025+0000","last_became_peered":"2024-01-15T11:34:12.203025+0000","last_unstale":"2024-01-15T11:34:13.176906+0000","last_undegraded":"2024-01-15T11:34:13.176906+0000","last_fullsized":"2024-01-15T11:34:13.176906+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:34:38.263742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.183186+0000","last_change":"2024-01-15T11:34:13.205338+0000","last_active":"2024-01-15T11:34:14.183186+0000","last_peered":"2024-01-15T11:34:14.183186+0000","last_clean":"2024-01-15T11:34:14.183186+0000","last_became_active":"2024-01-15T11:34:13.205040+0000","last_became_peered":"2024-01-15T11:34:13.205040+0000","last_unstale":"2024-01-15T11:34:14.183186+0000","last_undegraded":"2024-01-15T11:34:14.183186+0000","last_fullsized":"2024-01-15T11:34:14.183186+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:11:43.678012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.315022+0000","last_change":"2024-01-15T11:34:12.198932+0000","last_active":"2024-01-15T11:34:15.315022+0000","last_peered":"2024-01-15T11:34:15.315022+0000","last_clean":"2024-01-15T11:34:15.315022+0000","last_became_active":"2024-01-15T11:34:12.198650+0000","last_became_peered":"2024-01-15T11:34:12.198650+0000","last_unstale":"2024-01-15T11:34:15.315022+0000","last_undegraded":"2024-01-15T11:34:15.315022+0000","last_fullsized":"2024-01-15T11:34:15.315022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T11:50:21.130076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.314990+0000","last_change":"2024-01-15T11:34:13.217613+0000","last_active":"2024-01-15T11:34:15.314990+0000","last_peered":"2024-01-15T11:34:15.314990+0000","last_clean":"2024-01-15T11:34:15.314990+0000","last_became_active":"2024-01-15T11:34:13.217281+0000","last_became_peered":"2024-01-15T11:34:13.217281+0000","last_unstale":"2024-01-15T11:34:15.314990+0000","last_undegraded":"2024-01-15T11:34:15.314990+0000","last_fullsized":"2024-01-15T11:34:15.314990+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:50:09.437800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.183340+0000","last_change":"2024-01-15T11:34:12.197381+0000","last_active":"2024-01-15T11:34:13.183340+0000","last_peered":"2024-01-15T11:34:13.183340+0000","last_clean":"2024-01-15T11:34:13.183340+0000","last_became_active":"2024-01-15T11:34:12.197098+0000","last_became_peered":"2024-01-15T11:34:12.197098+0000","last_unstale":"2024-01-15T11:34:13.183340+0000","last_undegraded":"2024-01-15T11:34:13.183340+0000","last_fullsized":"2024-01-15T11:34:13.183340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:24:48.913101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.182926+0000","last_change":"2024-01-15T11:34:13.196692+0000","last_active":"2024-01-15T11:34:14.182926+0000","last_peered":"2024-01-15T11:34:14.182926+0000","last_clean":"2024-01-15T11:34:14.182926+0000","last_became_active":"2024-01-15T11:34:13.194167+0000","last_became_peered":"2024-01-15T11:34:13.194167+0000","last_unstale":"2024-01-15T11:34:14.182926+0000","last_undegraded":"2024-01-15T11:34:14.182926+0000","last_fullsized":"2024-01-15T11:34:14.182926+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:24:49.920042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.199757+0000","last_change":"2024-01-15T11:34:12.189277+0000","last_active":"2024-01-15T11:34:13.199757+0000","last_peered":"2024-01-15T11:34:13.199757+0000","last_clean":"2024-01-15T11:34:13.199757+0000","last_became_active":"2024-01-15T11:34:12.189015+0000","last_became_peered":"2024-01-15T11:34:12.189015+0000","last_unstale":"2024-01-15T11:34:13.199757+0000","last_undegraded":"2024-01-15T11:34:13.199757+0000","last_fullsized":"2024-01-15T11:34:13.199757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T20:06:23.507342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.246221+0000","last_change":"2024-01-15T11:34:13.214803+0000","last_active":"2024-01-15T11:34:16.246221+0000","last_peered":"2024-01-15T11:34:16.246221+0000","last_clean":"2024-01-15T11:34:16.246221+0000","last_became_active":"2024-01-15T11:34:13.214483+0000","last_became_peered":"2024-01-15T11:34:13.214483+0000","last_unstale":"2024-01-15T11:34:16.246221+0000","last_undegraded":"2024-01-15T11:34:16.246221+0000","last_fullsized":"2024-01-15T11:34:16.246221+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:57:43.681847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.182688+0000","last_change":"2024-01-15T11:34:12.182573+0000","last_active":"2024-01-15T11:34:13.182688+0000","last_peered":"2024-01-15T11:34:13.182688+0000","last_clean":"2024-01-15T11:34:13.182688+0000","last_became_active":"2024-01-15T11:34:12.182257+0000","last_became_peered":"2024-01-15T11:34:12.182257+0000","last_unstale":"2024-01-15T11:34:13.182688+0000","last_undegraded":"2024-01-15T11:34:13.182688+0000","last_fullsized":"2024-01-15T11:34:13.182688+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:10:22.936139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.184783+0000","last_change":"2024-01-15T11:34:13.203456+0000","last_active":"2024-01-15T11:34:14.184783+0000","last_peered":"2024-01-15T11:34:14.184783+0000","last_clean":"2024-01-15T11:34:14.184783+0000","last_became_active":"2024-01-15T11:34:13.203117+0000","last_became_peered":"2024-01-15T11:34:13.203117+0000","last_unstale":"2024-01-15T11:34:14.184783+0000","last_undegraded":"2024-01-15T11:34:14.184783+0000","last_fullsized":"2024-01-15T11:34:14.184783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:05:06.195063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.221872+0000","last_change":"2024-01-15T11:34:12.202396+0000","last_active":"2024-01-15T11:34:13.221872+0000","last_peered":"2024-01-15T11:34:13.221872+0000","last_clean":"2024-01-15T11:34:13.221872+0000","last_became_active":"2024-01-15T11:34:12.202073+0000","last_became_peered":"2024-01-15T11:34:12.202073+0000","last_unstale":"2024-01-15T11:34:13.221872+0000","last_undegraded":"2024-01-15T11:34:13.221872+0000","last_fullsized":"2024-01-15T11:34:13.221872+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T19:34:38.263742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.032404+0000","last_change":"2024-01-15T11:34:13.199884+0000","last_active":"2024-01-15T11:34:15.032404+0000","last_peered":"2024-01-15T11:34:15.032404+0000","last_clean":"2024-01-15T11:34:15.032404+0000","last_became_active":"2024-01-15T11:34:13.198747+0000","last_became_peered":"2024-01-15T11:34:13.198747+0000","last_unstale":"2024-01-15T11:34:15.032404+0000","last_undegraded":"2024-01-15T11:34:15.032404+0000","last_fullsized":"2024-01-15T11:34:15.032404+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T15:41:01.000604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.317003+0000","last_change":"2024-01-15T11:34:12.189679+0000","last_active":"2024-01-15T11:34:15.317003+0000","last_peered":"2024-01-15T11:34:15.317003+0000","last_clean":"2024-01-15T11:34:15.317003+0000","last_became_active":"2024-01-15T11:34:12.188240+0000","last_became_peered":"2024-01-15T11:34:12.188240+0000","last_unstale":"2024-01-15T11:34:15.317003+0000","last_undegraded":"2024-01-15T11:34:15.317003+0000","last_fullsized":"2024-01-15T11:34:15.317003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:19:15.522671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.184623+0000","last_change":"2024-01-15T11:34:13.209793+0000","last_active":"2024-01-15T11:34:14.184623+0000","last_peered":"2024-01-15T11:34:14.184623+0000","last_clean":"2024-01-15T11:34:14.184623+0000","last_became_active":"2024-01-15T11:34:13.208926+0000","last_became_peered":"2024-01-15T11:34:13.208926+0000","last_unstale":"2024-01-15T11:34:14.184623+0000","last_undegraded":"2024-01-15T11:34:14.184623+0000","last_fullsized":"2024-01-15T11:34:14.184623+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:11:55.389638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.194679+0000","last_change":"2024-01-15T11:34:12.192032+0000","last_active":"2024-01-15T11:34:13.194679+0000","last_peered":"2024-01-15T11:34:13.194679+0000","last_clean":"2024-01-15T11:34:13.194679+0000","last_became_active":"2024-01-15T11:34:12.191400+0000","last_became_peered":"2024-01-15T11:34:12.191400+0000","last_unstale":"2024-01-15T11:34:13.194679+0000","last_undegraded":"2024-01-15T11:34:13.194679+0000","last_fullsized":"2024-01-15T11:34:13.194679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:11:54.382698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.386041+0000","last_change":"2024-01-15T11:34:13.198360+0000","last_active":"2024-01-15T11:34:16.386041+0000","last_peered":"2024-01-15T11:34:16.386041+0000","last_clean":"2024-01-15T11:34:16.386041+0000","last_became_active":"2024-01-15T11:34:13.198017+0000","last_became_peered":"2024-01-15T11:34:13.198017+0000","last_unstale":"2024-01-15T11:34:16.386041+0000","last_undegraded":"2024-01-15T11:34:16.386041+0000","last_fullsized":"2024-01-15T11:34:16.386041+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T18:17:47.338142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.194743+0000","last_change":"2024-01-15T11:34:12.202286+0000","last_active":"2024-01-15T11:34:13.194743+0000","last_peered":"2024-01-15T11:34:13.194743+0000","last_clean":"2024-01-15T11:34:13.194743+0000","last_became_active":"2024-01-15T11:34:12.202004+0000","last_became_peered":"2024-01-15T11:34:12.202004+0000","last_unstale":"2024-01-15T11:34:13.194743+0000","last_undegraded":"2024-01-15T11:34:13.194743+0000","last_fullsized":"2024-01-15T11:34:13.194743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T17:38:22.120508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.182437+0000","last_change":"2024-01-15T11:34:13.199624+0000","last_active":"2024-01-15T11:34:14.182437+0000","last_peered":"2024-01-15T11:34:14.182437+0000","last_clean":"2024-01-15T11:34:14.182437+0000","last_became_active":"2024-01-15T11:34:13.199343+0000","last_became_peered":"2024-01-15T11:34:13.199343+0000","last_unstale":"2024-01-15T11:34:14.182437+0000","last_undegraded":"2024-01-15T11:34:14.182437+0000","last_fullsized":"2024-01-15T11:34:14.182437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:31:31.628247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.194817+0000","last_change":"2024-01-15T11:34:12.199466+0000","last_active":"2024-01-15T11:34:13.194817+0000","last_peered":"2024-01-15T11:34:13.194817+0000","last_clean":"2024-01-15T11:34:13.194817+0000","last_became_active":"2024-01-15T11:34:12.199170+0000","last_became_peered":"2024-01-15T11:34:12.199170+0000","last_unstale":"2024-01-15T11:34:13.194817+0000","last_undegraded":"2024-01-15T11:34:13.194817+0000","last_fullsized":"2024-01-15T11:34:13.194817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:05:05.188123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:14.182689+0000","last_change":"2024-01-15T11:34:13.194275+0000","last_active":"2024-01-15T11:34:14.182689+0000","last_peered":"2024-01-15T11:34:14.182689+0000","last_clean":"2024-01-15T11:34:14.182689+0000","last_became_active":"2024-01-15T11:34:13.193435+0000","last_became_peered":"2024-01-15T11:34:13.193435+0000","last_unstale":"2024-01-15T11:34:14.182689+0000","last_undegraded":"2024-01-15T11:34:14.182689+0000","last_fullsized":"2024-01-15T11:34:14.182689+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:58:31.438696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.184706+0000","last_change":"2024-01-15T11:34:12.197367+0000","last_active":"2024-01-15T11:34:13.184706+0000","last_peered":"2024-01-15T11:34:13.184706+0000","last_clean":"2024-01-15T11:34:13.184706+0000","last_became_active":"2024-01-15T11:34:12.197082+0000","last_became_peered":"2024-01-15T11:34:12.197082+0000","last_unstale":"2024-01-15T11:34:13.184706+0000","last_undegraded":"2024-01-15T11:34:13.184706+0000","last_fullsized":"2024-01-15T11:34:13.184706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T13:18:26.915430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:15.032270+0000","last_change":"2024-01-15T11:34:13.197324+0000","last_active":"2024-01-15T11:34:15.032270+0000","last_peered":"2024-01-15T11:34:15.032270+0000","last_clean":"2024-01-15T11:34:15.032270+0000","last_became_active":"2024-01-15T11:34:13.197090+0000","last_became_peered":"2024-01-15T11:34:13.197090+0000","last_unstale":"2024-01-15T11:34:15.032270+0000","last_undegraded":"2024-01-15T11:34:15.032270+0000","last_fullsized":"2024-01-15T11:34:15.032270+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T14:32:39.564148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.182799+0000","last_change":"2024-01-15T11:34:12.201561+0000","last_active":"2024-01-15T11:34:13.182799+0000","last_peered":"2024-01-15T11:34:13.182799+0000","last_clean":"2024-01-15T11:34:13.182799+0000","last_became_active":"2024-01-15T11:34:12.200889+0000","last_became_peered":"2024-01-15T11:34:12.200889+0000","last_unstale":"2024-01-15T11:34:13.182799+0000","last_undegraded":"2024-01-15T11:34:13.182799+0000","last_fullsized":"2024-01-15T11:34:13.182799+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:42:32.593318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-01-15T11:34:16.386269+0000","last_change":"2024-01-15T11:34:13.199270+0000","last_active":"2024-01-15T11:34:16.386269+0000","last_peered":"2024-01-15T11:34:16.386269+0000","last_clean":"2024-01-15T11:34:16.386269+0000","last_became_active":"2024-01-15T11:34:13.199026+0000","last_became_peered":"2024-01-15T11:34:13.199026+0000","last_unstale":"2024-01-15T11:34:16.386269+0000","last_undegraded":"2024-01-15T11:34:16.386269+0000","last_fullsized":"2024-01-15T11:34:16.386269+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:12.163802+0000","last_clean_scrub_stamp":"2024-01-15T11:34:12.163802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T12:25:05.623725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.183783+0000","last_change":"2024-01-15T11:34:12.192107+0000","last_active":"2024-01-15T11:34:13.183783+0000","last_peered":"2024-01-15T11:34:13.183783+0000","last_clean":"2024-01-15T11:34:13.183783+0000","last_became_active":"2024-01-15T11:34:12.191840+0000","last_became_peered":"2024-01-15T11:34:12.191840+0000","last_unstale":"2024-01-15T11:34:13.183783+0000","last_undegraded":"2024-01-15T11:34:13.183783+0000","last_fullsized":"2024-01-15T11:34:13.183783+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:34:11.156862+0000","last_clean_scrub_stamp":"2024-01-15T11:34:11.156862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T16:30:51.266296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":175,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-15T11:34:13.198657+0000","last_change":"2024-01-15T11:33:09.200536+0000","last_active":"2024-01-15T11:34:13.198657+0000","last_peered":"2024-01-15T11:34:13.198657+0000","last_clean":"2024-01-15T11:34:13.198657+0000","last_became_active":"2024-01-15T11:33:09.199051+0000","last_became_peered":"2024-01-15T11:33:09.199051+0000","last_unstale":"2024-01-15T11:34:13.198657+0000","last_undegraded":"2024-01-15T11:34:13.198657+0000","last_fullsized":"2024-01-15T11:34:13.198657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-15T11:33:08.185347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-15T11:33:08.185347+0000","last_clean_scrub_stamp":"2024-01-15T11:33:08.185347+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-16T22:04:15.799885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":151462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.54700000000000004}]},{"osd":1,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.64400000000000002}]},{"osd":2,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.63},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.53000000000000003}]},{"osd":3,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.55700000000000005}]},{"osd":4,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1,"5min":1,"15min":1},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.48399999999999999}]},{"osd":5,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.58699999999999997}]},{"osd":6,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.67100000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":153052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.68500000000000005}]},{"osd":1,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.78300000000000003}]},{"osd":2,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.60999999999999999}]},{"osd":3,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.879},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.86399999999999999}]},{"osd":4,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.81999999999999995}]},{"osd":5,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.96199999999999997}]},{"osd":7,"last update":"Mon Jan 15 11:34:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.83899999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":153074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.51300000000000001}]},{"osd":1,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.746},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.73699999999999999}]},{"osd":2,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.63900000000000001}]},{"osd":3,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.68200000000000005}]},{"osd":5,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.53400000000000003}]},{"osd":6,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.55700000000000005}]},{"osd":7,"last update":"Mon Jan 15 11:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.67000000000000004}]}]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":152216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.504}]},{"osd":1,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.59699999999999998}]},{"osd":2,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.64200000000000002}]},{"osd":4,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.95999999999999996}]},{"osd":5,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.73599999999999999}]},{"osd":6,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.876}]},{"osd":7,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.90200000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":151474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":2.9140000000000001,"5min":2.9140000000000001,"15min":2.9140000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":3.2519999999999998,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.46200000000000002}]},{"osd":1,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":3.1080000000000001,"5min":3.1080000000000001,"15min":3.1080000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":0.35999999999999999}]},{"osd":3,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":3.722,"5min":3.722,"15min":3.722},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":3.508,"5min":3.508,"15min":3.508},"last":0.44700000000000001}]},{"osd":4,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":3.5539999999999998,"5min":3.5539999999999998,"15min":3.5539999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"last":0.67000000000000004}]},{"osd":5,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":3.5899999999999999,"5min":3.5899999999999999,"15min":3.5899999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.617,"5min":3.617,"15min":3.617},"last":0.54300000000000004}]},{"osd":6,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":3.1899999999999999,"5min":3.1899999999999999,"15min":3.1899999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":3.6459999999999999,"5min":3.6459999999999999,"15min":3.6459999999999999},"last":0.61899999999999999}]},{"osd":7,"last update":"Mon Jan 15 11:34:06 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.8340000000000001,"5min":3.8340000000000001,"15min":3.8340000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":3.7799999999999998,"5min":3.7799999999999998,"15min":3.7799999999999998},"last":0.65300000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":987136,"data_stored":741878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.54500000000000004}]},{"osd":2,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":0.94699999999999995}]},{"osd":3,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.0920000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.621}]},{"osd":4,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.83599999999999997}]},{"osd":5,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.8279999999999998,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":0.90100000000000002}]},{"osd":6,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":0.74099999999999999}]},{"osd":7,"last update":"Mon Jan 15 11:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.70999999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":145230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":4.3230000000000004,"5min":4.3230000000000004,"15min":4.3230000000000004},"last":0.46100000000000002}]},{"osd":2,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":4.2800000000000002,"5min":4.2800000000000002,"15min":4.2800000000000002},"last":0.42299999999999999}]},{"osd":3,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.49299999999999999}]},{"osd":4,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":4.4340000000000002,"5min":4.4340000000000002,"15min":4.4340000000000002},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.80500000000000005}]},{"osd":5,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.67200000000000004}]},{"osd":6,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":0.65400000000000003}]},{"osd":7,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.76800000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542162,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":987136,"data_stored":742390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.75},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.70699999999999996}]},{"osd":1,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.82799999999999996}]},{"osd":2,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.61199999999999999}]},{"osd":3,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.66400000000000003}]},{"osd":4,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.78000000000000003}]},{"osd":6,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.873}]},{"osd":7,"last update":"Mon Jan 15 11:34:08 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.81299999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-15T11:34:22.242 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-15T11:34:22.242 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-15T11:34:22.429 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.426+0000 7fd3cca68640 1 Processor -- start 2024-01-15T11:34:22.430 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.426+0000 7fd3cca68640 1 -- start start 2024-01-15T11:34:22.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.426+0000 7fd3cca68640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd3c80cdfb0 0x7fd3c80abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:22.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.426+0000 7fd3cca68640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3c815a710 0x7fd3c80ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:22.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.426+0000 7fd3cca68640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c80ce8d0 con 0x7fd3c80cbd50 2024-01-15T11:34:22.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.426+0000 7fd3cca68640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c80cca80 con 0x7fd3c80cdfb0 2024-01-15T11:34:22.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.426+0000 7fd3cca68640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c80b2710 con 0x7fd3c815a710 2024-01-15T11:34:22.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.426+0000 7fd3c659c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd3c80cdfb0 0x7fd3c80abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:22.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.426+0000 7fd3c659c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd3c80cdfb0 0x7fd3c80abf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38484/0 (socket says 172.21.15.27:38484) 2024-01-15T11:34:22.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.426+0000 7fd3c659c640 1 -- 172.21.15.27:0/669322767 learned_addr learned my addr 172.21.15.27:0/669322767 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:22.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.426+0000 7fd3c5d9b640 1 --2- 172.21.15.27:0/669322767 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3c815a710 0x7fd3c80ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:22.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.426+0000 7fd3c659c640 1 -- 172.21.15.27:0/669322767 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3c815a710 msgr2=0x7fd3c80ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:22.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.426+0000 7fd3c659c640 1 --2- 172.21.15.27:0/669322767 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3c815a710 0x7fd3c80ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.426+0000 7fd3c659c640 1 -- 172.21.15.27:0/669322767 >> v1:172.21.15.93:6789/0 conn(0x7fd3c80cbd50 legacy=0x7fd3c80cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:22.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.426+0000 7fd3c659c640 1 -- 172.21.15.27:0/669322767 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c80b29f0 con 0x7fd3c80cdfb0 2024-01-15T11:34:22.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.430+0000 7fd3c659c640 1 --2- 172.21.15.27:0/669322767 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3c80cdfb0 0x7fd3c80abf90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8009870 tx=0x7fd3b801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41864608a6d2b51 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:22.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.430+0000 7fd3c559a640 1 -- 172.21.15.27:0/669322767 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b80aa670 con 0x7fd3c80cdfb0 2024-01-15T11:34:22.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.430+0000 7fd3c559a640 1 -- 172.21.15.27:0/669322767 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b80aa7d0 con 0x7fd3c80cdfb0 2024-01-15T11:34:22.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.430+0000 7fd3c559a640 1 -- 172.21.15.27:0/669322767 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b80aab60 con 0x7fd3c80cdfb0 2024-01-15T11:34:22.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.430+0000 7fd3cca68640 1 -- 172.21.15.27:0/669322767 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3c80cdfb0 msgr2=0x7fd3c80abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:22.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.430+0000 7fd3cca68640 1 --2- 172.21.15.27:0/669322767 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3c80cdfb0 0x7fd3c80abf90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8009870 tx=0x7fd3b801c510 comp rx=0 tx=0).stop 2024-01-15T11:34:22.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.430+0000 7fd3cca68640 1 -- 172.21.15.27:0/669322767 shutdown_connections 2024-01-15T11:34:22.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.430+0000 7fd3cca68640 1 --2- 172.21.15.27:0/669322767 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3c815a710 0x7fd3c80ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.430+0000 7fd3cca68640 1 --2- 172.21.15.27:0/669322767 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3c80cdfb0 0x7fd3c80abf90 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.430+0000 7fd3cca68640 1 -- 172.21.15.27:0/669322767 >> 172.21.15.27:0/669322767 conn(0x7fd3c80b0cb0 msgr2=0x7fd3c80b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:22.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.430+0000 7fd3cca68640 1 -- 172.21.15.27:0/669322767 shutdown_connections 2024-01-15T11:34:22.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.430+0000 7fd3cca68640 1 -- 172.21.15.27:0/669322767 wait complete. 2024-01-15T11:34:22.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.434+0000 7fd3cca68640 1 Processor -- start 2024-01-15T11:34:22.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.434+0000 7fd3cca68640 1 -- start start 2024-01-15T11:34:22.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.434+0000 7fd3cca68640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3c80cbd50 0x7fd3c8144970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:22.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.434+0000 7fd3cca68640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3c80cdfb0 0x7fd3c81536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:22.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.434+0000 7fd3cca68640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3c815a710 0x7fd3c815cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:22.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.434+0000 7fd3cca68640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c8154b30 con 0x7fd3c80cbd50 2024-01-15T11:34:22.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.434+0000 7fd3cca68640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c8144eb0 con 0x7fd3c815a710 2024-01-15T11:34:22.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.434+0000 7fd3cca68640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c8153f20 con 0x7fd3c80cdfb0 2024-01-15T11:34:22.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.434+0000 7fd3c659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3c80cbd50 0x7fd3c8144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:22.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.434+0000 7fd3c659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3c80cbd50 0x7fd3c8144970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38498/0 (socket says 172.21.15.27:38498) 2024-01-15T11:34:22.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.434+0000 7fd3c659c640 1 -- 172.21.15.27:0/1026227075 learned_addr learned my addr 172.21.15.27:0/1026227075 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:22.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.434+0000 7fd3c5d9b640 1 --2- 172.21.15.27:0/1026227075 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3c80cdfb0 0x7fd3c81536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:22.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.434+0000 7fd3c6d9d640 1 --2- 172.21.15.27:0/1026227075 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3c815a710 0x7fd3c815cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:22.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.434+0000 7fd3c659c640 1 -- 172.21.15.27:0/1026227075 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3c80cdfb0 msgr2=0x7fd3c81536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:22.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.434+0000 7fd3c659c640 1 --2- 172.21.15.27:0/1026227075 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3c80cdfb0 0x7fd3c81536d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.434+0000 7fd3c659c640 1 -- 172.21.15.27:0/1026227075 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3c815a710 msgr2=0x7fd3c815cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:22.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.434+0000 7fd3c659c640 1 --2- 172.21.15.27:0/1026227075 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3c815a710 0x7fd3c815cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.434+0000 7fd3c659c640 1 -- 172.21.15.27:0/1026227075 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b80094d0 con 0x7fd3c80cbd50 2024-01-15T11:34:22.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.434+0000 7fd3c6d9d640 1 --2- 172.21.15.27:0/1026227075 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3c815a710 0x7fd3c815cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:34:22.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.434+0000 7fd3c659c640 1 --2- 172.21.15.27:0/1026227075 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3c80cbd50 0x7fd3c8144970 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd3b80ac040 tx=0x7fd3b801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:22.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.434+0000 7fd3b6ffd640 1 -- 172.21.15.27:0/1026227075 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b80b3800 con 0x7fd3c80cbd50 2024-01-15T11:34:22.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.434+0000 7fd3b6ffd640 1 -- 172.21.15.27:0/1026227075 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b80b3980 con 0x7fd3c80cbd50 2024-01-15T11:34:22.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.434+0000 7fd3b6ffd640 1 -- 172.21.15.27:0/1026227075 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b80b3d30 con 0x7fd3c80cbd50 2024-01-15T11:34:22.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.434+0000 7fd3cca68640 1 -- 172.21.15.27:0/1026227075 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c8154200 con 0x7fd3c80cbd50 2024-01-15T11:34:22.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.434+0000 7fd3cca68640 1 -- 172.21.15.27:0/1026227075 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c81547c0 con 0x7fd3c80cbd50 2024-01-15T11:34:22.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.438+0000 7fd3cca68640 1 -- 172.21.15.27:0/1026227075 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c80671f0 con 0x7fd3c80cbd50 2024-01-15T11:34:22.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.438+0000 7fd3b6ffd640 1 -- 172.21.15.27:0/1026227075 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fd3b80b2380 con 0x7fd3c80cbd50 2024-01-15T11:34:22.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.438+0000 7fd3b6ffd640 1 --2- 172.21.15.27:0/1026227075 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd3a80668f0 0x7fd3a8068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:22.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.438+0000 7fd3b6ffd640 1 -- 172.21.15.27:0/1026227075 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3b811eda0 con 0x7fd3c80cbd50 2024-01-15T11:34:22.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.438+0000 7fd3c5d9b640 1 --2- 172.21.15.27:0/1026227075 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd3a80668f0 0x7fd3a8068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:22.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.438+0000 7fd3c5d9b640 1 --2- 172.21.15.27:0/1026227075 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd3a80668f0 0x7fd3a8068db0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8145220 tx=0x7fd3bc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:22.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.442+0000 7fd3b6ffd640 1 -- 172.21.15.27:0/1026227075 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd3b80ebf60 con 0x7fd3c80cbd50 2024-01-15T11:34:22.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.654+0000 7fd3cca68640 1 -- 172.21.15.27:0/1026227075 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd3c806b460 con 0x7fd3c80cbd50 2024-01-15T11:34:22.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.658+0000 7fd3b6ffd640 1 -- 172.21.15.27:0/1026227075 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7fd3b80c3020 con 0x7fd3c80cbd50 2024-01-15T11:34:22.661 INFO:teuthology.orchestra.run.smithi027.stdout:[client.0] 2024-01-15T11:34:22.661 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQC/F6Vlh3mVKBAAfHmOP/4KjAs9i7VdmSNMDA== 2024-01-15T11:34:22.661 INFO:teuthology.orchestra.run.smithi027.stdout: caps mds = "allow" 2024-01-15T11:34:22.661 INFO:teuthology.orchestra.run.smithi027.stdout: caps mon = "allow r" 2024-01-15T11:34:22.661 INFO:teuthology.orchestra.run.smithi027.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-01-15T11:34:22.662 INFO:teuthology.orchestra.run.smithi027.stderr:updated caps for client.0 2024-01-15T11:34:22.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.658+0000 7fd3cca68640 1 -- 172.21.15.27:0/1026227075 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd3a80668f0 msgr2=0x7fd3a8068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:22.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.658+0000 7fd3cca68640 1 --2- 172.21.15.27:0/1026227075 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd3a80668f0 0x7fd3a8068db0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8145220 tx=0x7fd3bc008040 comp rx=0 tx=0).stop 2024-01-15T11:34:22.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.658+0000 7fd3cca68640 1 -- 172.21.15.27:0/1026227075 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3c80cbd50 msgr2=0x7fd3c8144970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:22.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.658+0000 7fd3cca68640 1 --2- 172.21.15.27:0/1026227075 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3c80cbd50 0x7fd3c8144970 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd3b80ac040 tx=0x7fd3b801ad50 comp rx=0 tx=0).stop 2024-01-15T11:34:22.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.658+0000 7fd3cca68640 1 -- 172.21.15.27:0/1026227075 shutdown_connections 2024-01-15T11:34:22.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.658+0000 7fd3cca68640 1 --2- 172.21.15.27:0/1026227075 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd3a80668f0 0x7fd3a8068db0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.658+0000 7fd3cca68640 1 --2- 172.21.15.27:0/1026227075 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3c815a710 0x7fd3c815cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.658+0000 7fd3cca68640 1 --2- 172.21.15.27:0/1026227075 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3c80cdfb0 0x7fd3c81536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.658+0000 7fd3cca68640 1 --2- 172.21.15.27:0/1026227075 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3c80cbd50 0x7fd3c8144970 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.658+0000 7fd3cca68640 1 -- 172.21.15.27:0/1026227075 >> 172.21.15.27:0/1026227075 conn(0x7fd3c80b0cb0 msgr2=0x7fd3c8164a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:22.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.658+0000 7fd3cca68640 1 -- 172.21.15.27:0/1026227075 shutdown_connections 2024-01-15T11:34:22.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.658+0000 7fd3cca68640 1 -- 172.21.15.27:0/1026227075 wait complete. 2024-01-15T11:34:22.682 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-15T11:34:22.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.822+0000 7fc5e5a9c640 1 Processor -- start 2024-01-15T11:34:22.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.822+0000 7fc5e5a9c640 1 -- start start 2024-01-15T11:34:22.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.826+0000 7fc5e5a9c640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc5e0146c60 0x7fc5e0070020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:22.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.826+0000 7fc5e5a9c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc5e0147040 0x7fc5e0070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:22.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.826+0000 7fc5e5a9c640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc5e006bb10 0x7fc5e006bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:22.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.826+0000 7fc5e5a9c640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e006d100 con 0x7fc5e0147040 2024-01-15T11:34:22.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.826+0000 7fc5e5a9c640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e015dba0 con 0x7fc5e006bb10 2024-01-15T11:34:22.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.826+0000 7fc5e5a9c640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e006c860 con 0x7fc5e0146c60 2024-01-15T11:34:22.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.826+0000 7fc5deffd640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc5e0147040 0x7fc5e0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:22.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.826+0000 7fc5deffd640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc5e0147040 0x7fc5e0070560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38506/0 (socket says 172.21.15.27:38506) 2024-01-15T11:34:22.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.826+0000 7fc5deffd640 1 -- 172.21.15.27:0/1753802636 learned_addr learned my addr 172.21.15.27:0/1753802636 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:22.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.826+0000 7fc5deffd640 1 -- 172.21.15.27:0/1753802636 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc5e0146c60 msgr2=0x7fc5e0070020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:22.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.826+0000 7fc5deffd640 1 --2- 172.21.15.27:0/1753802636 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc5e0146c60 0x7fc5e0070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.826+0000 7fc5deffd640 1 -- 172.21.15.27:0/1753802636 >> v2:172.21.15.93:3300/0 conn(0x7fc5e006bb10 msgr2=0x7fc5e006bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:22.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.826+0000 7fc5dffff640 1 --2- 172.21.15.27:0/1753802636 >> v2:172.21.15.93:3300/0 conn(0x7fc5e006bb10 0x7fc5e006bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:22.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.826+0000 7fc5deffd640 1 --2- 172.21.15.27:0/1753802636 >> v2:172.21.15.93:3300/0 conn(0x7fc5e006bb10 0x7fc5e006bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.826+0000 7fc5deffd640 1 -- 172.21.15.27:0/1753802636 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e006cb40 con 0x7fc5e0147040 2024-01-15T11:34:22.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.826+0000 7fc5dffff640 1 --2- 172.21.15.27:0/1753802636 >> v2:172.21.15.93:3300/0 conn(0x7fc5e006bb10 0x7fc5e006bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:34:22.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.830+0000 7fc5deffd640 1 --2- 172.21.15.27:0/1753802636 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e0147040 0x7fc5e0070560 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0071060 tx=0x7fc5d401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2c6b5469c719c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:22.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.830+0000 7fc5de7fc640 1 -- 172.21.15.27:0/1753802636 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d40aa5f0 con 0x7fc5e0147040 2024-01-15T11:34:22.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.830+0000 7fc5de7fc640 1 -- 172.21.15.27:0/1753802636 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d40aa750 con 0x7fc5e0147040 2024-01-15T11:34:22.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.830+0000 7fc5de7fc640 1 -- 172.21.15.27:0/1753802636 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d40aaae0 con 0x7fc5e0147040 2024-01-15T11:34:22.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.830+0000 7fc5e5a9c640 1 -- 172.21.15.27:0/1753802636 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e0147040 msgr2=0x7fc5e0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:22.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.830+0000 7fc5e5a9c640 1 --2- 172.21.15.27:0/1753802636 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e0147040 0x7fc5e0070560 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0071060 tx=0x7fc5d401c4d0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.830+0000 7fc5e5a9c640 1 -- 172.21.15.27:0/1753802636 shutdown_connections 2024-01-15T11:34:22.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.830+0000 7fc5e5a9c640 1 --2- 172.21.15.27:0/1753802636 >> v2:172.21.15.93:3300/0 conn(0x7fc5e006bb10 0x7fc5e006bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.830+0000 7fc5e5a9c640 1 --2- 172.21.15.27:0/1753802636 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e0147040 0x7fc5e0070560 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.830+0000 7fc5e5a9c640 1 --2- 172.21.15.27:0/1753802636 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc5e0146c60 0x7fc5e0070020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.830+0000 7fc5e5a9c640 1 -- 172.21.15.27:0/1753802636 >> 172.21.15.27:0/1753802636 conn(0x7fc5e00b2ea0 msgr2=0x7fc5e00b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:22.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.830+0000 7fc5e5a9c640 1 -- 172.21.15.27:0/1753802636 shutdown_connections 2024-01-15T11:34:22.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.830+0000 7fc5e5a9c640 1 -- 172.21.15.27:0/1753802636 wait complete. 2024-01-15T11:34:22.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.830+0000 7fc5e5a9c640 1 Processor -- start 2024-01-15T11:34:22.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.830+0000 7fc5e5a9c640 1 -- start start 2024-01-15T11:34:22.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.834+0000 7fc5e5a9c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e006bb10 0x7fc5e015fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:22.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.834+0000 7fc5e5a9c640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc5e0146c60 0x7fc5e013baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:22.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.834+0000 7fc5e5a9c640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5e0147040 0x7fc5e013c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:22.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.834+0000 7fc5e5a9c640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e015e4c0 con 0x7fc5e006bb10 2024-01-15T11:34:22.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.834+0000 7fc5e5a9c640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e013b8f0 con 0x7fc5e0147040 2024-01-15T11:34:22.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.834+0000 7fc5e5a9c640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e015ff90 con 0x7fc5e0146c60 2024-01-15T11:34:22.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.834+0000 7fc5df7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e006bb10 0x7fc5e015fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:22.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.834+0000 7fc5df7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e006bb10 0x7fc5e015fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38514/0 (socket says 172.21.15.27:38514) 2024-01-15T11:34:22.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.834+0000 7fc5df7fe640 1 -- 172.21.15.27:0/3284834016 learned_addr learned my addr 172.21.15.27:0/3284834016 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:22.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.834+0000 7fc5dffff640 1 --2- 172.21.15.27:0/3284834016 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5e0147040 0x7fc5e013c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:22.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.834+0000 7fc5deffd640 1 --2- 172.21.15.27:0/3284834016 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc5e0146c60 0x7fc5e013baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:22.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.834+0000 7fc5df7fe640 1 -- 172.21.15.27:0/3284834016 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc5e0146c60 msgr2=0x7fc5e013baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:22.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.834+0000 7fc5df7fe640 1 --2- 172.21.15.27:0/3284834016 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc5e0146c60 0x7fc5e013baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.834+0000 7fc5df7fe640 1 -- 172.21.15.27:0/3284834016 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5e0147040 msgr2=0x7fc5e013c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:22.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.834+0000 7fc5df7fe640 1 --2- 172.21.15.27:0/3284834016 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5e0147040 0x7fc5e013c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:22.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.834+0000 7fc5df7fe640 1 -- 172.21.15.27:0/3284834016 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d40094d0 con 0x7fc5e006bb10 2024-01-15T11:34:22.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.834+0000 7fc5deffd640 1 --2- 172.21.15.27:0/3284834016 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc5e0146c60 0x7fc5e013baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:34:22.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.834+0000 7fc5df7fe640 1 --2- 172.21.15.27:0/3284834016 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e006bb10 0x7fc5e015fa50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc5d000b550 tx=0x7fc5d000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:22.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.834+0000 7fc5c7fff640 1 -- 172.21.15.27:0/3284834016 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d0010870 con 0x7fc5e006bb10 2024-01-15T11:34:22.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.834+0000 7fc5c7fff640 1 -- 172.21.15.27:0/3284834016 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d00109f0 con 0x7fc5e006bb10 2024-01-15T11:34:22.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.834+0000 7fc5c7fff640 1 -- 172.21.15.27:0/3284834016 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d0010da0 con 0x7fc5e006bb10 2024-01-15T11:34:22.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.834+0000 7fc5e5a9c640 1 -- 172.21.15.27:0/3284834016 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e01f9fa0 con 0x7fc5e006bb10 2024-01-15T11:34:22.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.834+0000 7fc5e5a9c640 1 -- 172.21.15.27:0/3284834016 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e01fa330 con 0x7fc5e006bb10 2024-01-15T11:34:22.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.834+0000 7fc5e5a9c640 1 -- 172.21.15.27:0/3284834016 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e004e850 con 0x7fc5e006bb10 2024-01-15T11:34:22.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.834+0000 7fc5c7fff640 1 -- 172.21.15.27:0/3284834016 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fc5d000f3c0 con 0x7fc5e006bb10 2024-01-15T11:34:22.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.838+0000 7fc5c7fff640 1 --2- 172.21.15.27:0/3284834016 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc5cc0668f0 0x7fc5cc068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:22.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.838+0000 7fc5c7fff640 1 -- 172.21.15.27:0/3284834016 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5d0084430 con 0x7fc5e006bb10 2024-01-15T11:34:22.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.838+0000 7fc5deffd640 1 --2- 172.21.15.27:0/3284834016 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc5cc0668f0 0x7fc5cc068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:22.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.838+0000 7fc5deffd640 1 --2- 172.21.15.27:0/3284834016 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc5cc0668f0 0x7fc5cc068db0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc5d40ae000 tx=0x7fc5d40a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:22.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:22.842+0000 7fc5c7fff640 1 -- 172.21.15.27:0/3284834016 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc5d0051660 con 0x7fc5e006bb10 2024-01-15T11:34:23.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.034+0000 7fc5e5a9c640 1 -- 172.21.15.27:0/3284834016 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5e0167a80 con 0x7fc5e006bb10 2024-01-15T11:34:23.037 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.034+0000 7fc5c7fff640 1 -- 172.21.15.27:0/3284834016 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4907 (secure 0 0 0) 0x7fc5d0054c80 con 0x7fc5e006bb10 2024-01-15T11:34:23.038 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:34:23.038 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/586691059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":586691059},{"type":"v1","addr":"172.21.15.93:6835","nonce":586691059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4811,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/213641846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":213641846},{"type":"v1","addr":"172.21.15.93:6837","nonce":213641846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5067,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6834/1958435006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":1958435006},{"type":"v1","addr":"172.21.15.27:6834","nonce":1958435006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-15T11:34:12.570285+0000","modified":"2024-01-15T11:34:15.593039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.27:6835/1732204565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6833","nonce":1732204565},{"type":"v1","addr":"172.21.15.27:6835","nonce":1732204565}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-15T11:34:23.038 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 17 2024-01-15T11:34:23.039 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.034+0000 7fc5e5a9c640 1 -- 172.21.15.27:0/3284834016 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc5cc0668f0 msgr2=0x7fc5cc068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:23.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.034+0000 7fc5e5a9c640 1 --2- 172.21.15.27:0/3284834016 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc5cc0668f0 0x7fc5cc068db0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc5d40ae000 tx=0x7fc5d40a7000 comp rx=0 tx=0).stop 2024-01-15T11:34:23.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.034+0000 7fc5e5a9c640 1 -- 172.21.15.27:0/3284834016 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e006bb10 msgr2=0x7fc5e015fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:23.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.034+0000 7fc5e5a9c640 1 --2- 172.21.15.27:0/3284834016 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e006bb10 0x7fc5e015fa50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc5d000b550 tx=0x7fc5d000ba10 comp rx=0 tx=0).stop 2024-01-15T11:34:23.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.034+0000 7fc5e5a9c640 1 -- 172.21.15.27:0/3284834016 shutdown_connections 2024-01-15T11:34:23.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.034+0000 7fc5e5a9c640 1 --2- 172.21.15.27:0/3284834016 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc5cc0668f0 0x7fc5cc068db0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.034+0000 7fc5e5a9c640 1 --2- 172.21.15.27:0/3284834016 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5e0147040 0x7fc5e013c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.034+0000 7fc5e5a9c640 1 --2- 172.21.15.27:0/3284834016 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc5e0146c60 0x7fc5e013baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.034+0000 7fc5e5a9c640 1 --2- 172.21.15.27:0/3284834016 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5e006bb10 0x7fc5e015fa50 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.034+0000 7fc5e5a9c640 1 -- 172.21.15.27:0/3284834016 >> 172.21.15.27:0/3284834016 conn(0x7fc5e00b2ea0 msgr2=0x7fc5e0145c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:23.040 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.034+0000 7fc5e5a9c640 1 -- 172.21.15.27:0/3284834016 shutdown_connections 2024-01-15T11:34:23.041 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.034+0000 7fc5e5a9c640 1 -- 172.21.15.27:0/3284834016 wait complete. 2024-01-15T11:34:23.462 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-15T11:34:12.570285+0000', 'modified': '2024-01-15T11:34:15.593039+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5070}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5070': {'gid': 5070, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.27:6835/1732204565', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.27:6833', 'nonce': 1732204565}, {'type': 'v1', 'addr': '172.21.15.27:6835', 'nonce': 1732204565}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-15T11:34:23.462 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-15T11:34:23.462 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-15T11:34:23.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.602+0000 7fbbdae5a640 1 Processor -- start 2024-01-15T11:34:23.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.602+0000 7fbbdae5a640 1 -- start start 2024-01-15T11:34:23.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.606+0000 7fbbdae5a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbbd40b5830 0x7fbbd415e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:23.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.606+0000 7fbbdae5a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbbd40ad8e0 0x7fbbd406d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:23.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.606+0000 7fbbdae5a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd40af630 con 0x7fbbd40acd70 2024-01-15T11:34:23.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.606+0000 7fbbdae5a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd40acb10 con 0x7fbbd40b5830 2024-01-15T11:34:23.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.606+0000 7fbbdae5a640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd40ae5b0 con 0x7fbbd40ad8e0 2024-01-15T11:34:23.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.606+0000 7fbbd8bf6640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbbd40b5830 0x7fbbd415e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:23.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.606+0000 7fbbd8bf6640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fbbd40b5830 0x7fbbd415e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38522/0 (socket says 172.21.15.27:38522) 2024-01-15T11:34:23.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.606+0000 7fbbd8bf6640 1 -- 172.21.15.27:0/3554484234 learned_addr learned my addr 172.21.15.27:0/3554484234 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:23.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.606+0000 7fbbd8bf6640 1 -- 172.21.15.27:0/3554484234 >> v2:172.21.15.93:3300/0 conn(0x7fbbd40ad8e0 msgr2=0x7fbbd406d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:23.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.606+0000 7fbbd8bf6640 1 --2- 172.21.15.27:0/3554484234 >> v2:172.21.15.93:3300/0 conn(0x7fbbd40ad8e0 0x7fbbd406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.606+0000 7fbbd8bf6640 1 -- 172.21.15.27:0/3554484234 >> v1:172.21.15.93:6789/0 conn(0x7fbbd40acd70 legacy=0x7fbbd40ad1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:23.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.606+0000 7fbbd8bf6640 1 -- 172.21.15.27:0/3554484234 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd40ae870 con 0x7fbbd40b5830 2024-01-15T11:34:23.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.610+0000 7fbbd8bf6640 1 --2- 172.21.15.27:0/3554484234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbd40b5830 0x7fbbd415e690 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbbd406bfa0 tx=0x7fbbc801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57cb4ce4691e8834 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:23.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.610+0000 7fbbd37fe640 1 -- 172.21.15.27:0/3554484234 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc80aa620 con 0x7fbbd40b5830 2024-01-15T11:34:23.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.610+0000 7fbbd37fe640 1 -- 172.21.15.27:0/3554484234 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc80aa780 con 0x7fbbd40b5830 2024-01-15T11:34:23.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.610+0000 7fbbd37fe640 1 -- 172.21.15.27:0/3554484234 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc80aab10 con 0x7fbbd40b5830 2024-01-15T11:34:23.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.610+0000 7fbbdae5a640 1 -- 172.21.15.27:0/3554484234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbd40b5830 msgr2=0x7fbbd415e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:23.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.610+0000 7fbbdae5a640 1 --2- 172.21.15.27:0/3554484234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbd40b5830 0x7fbbd415e690 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbbd406bfa0 tx=0x7fbbc801c4c0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.610+0000 7fbbdae5a640 1 -- 172.21.15.27:0/3554484234 shutdown_connections 2024-01-15T11:34:23.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.610+0000 7fbbdae5a640 1 --2- 172.21.15.27:0/3554484234 >> v2:172.21.15.93:3300/0 conn(0x7fbbd40ad8e0 0x7fbbd406d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.610+0000 7fbbdae5a640 1 --2- 172.21.15.27:0/3554484234 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbd40b5830 0x7fbbd415e690 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.610+0000 7fbbdae5a640 1 -- 172.21.15.27:0/3554484234 >> 172.21.15.27:0/3554484234 conn(0x7fbbd4071d80 msgr2=0x7fbbd406a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:23.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.610+0000 7fbbdae5a640 1 -- 172.21.15.27:0/3554484234 shutdown_connections 2024-01-15T11:34:23.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.610+0000 7fbbdae5a640 1 -- 172.21.15.27:0/3554484234 wait complete. 2024-01-15T11:34:23.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.610+0000 7fbbdae5a640 1 Processor -- start 2024-01-15T11:34:23.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.610+0000 7fbbdae5a640 1 -- start start 2024-01-15T11:34:23.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.614+0000 7fbbdae5a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbd40acd70 0x7fbbd4147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:23.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.614+0000 7fbbdae5a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbd40ad8e0 0x7fbbd4153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:23.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.614+0000 7fbbdae5a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbbd40b5830 0x7fbbd415d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:23.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.614+0000 7fbbdae5a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd41582d0 con 0x7fbbd40acd70 2024-01-15T11:34:23.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.614+0000 7fbbdae5a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd4157430 con 0x7fbbd40ad8e0 2024-01-15T11:34:23.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.614+0000 7fbbdae5a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd41520c0 con 0x7fbbd40b5830 2024-01-15T11:34:23.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.614+0000 7fbbd8bf6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbd40acd70 0x7fbbd4147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:23.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.614+0000 7fbbd8bf6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbd40acd70 0x7fbbd4147240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38534/0 (socket says 172.21.15.27:38534) 2024-01-15T11:34:23.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.614+0000 7fbbd8bf6640 1 -- 172.21.15.27:0/3826347480 learned_addr learned my addr 172.21.15.27:0/3826347480 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:23.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.614+0000 7fbbd8bf6640 1 -- 172.21.15.27:0/3826347480 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbbd40b5830 msgr2=0x7fbbd415d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:23.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.614+0000 7fbbd8bf6640 1 --2- 172.21.15.27:0/3826347480 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbbd40b5830 0x7fbbd415d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.614+0000 7fbbd8bf6640 1 -- 172.21.15.27:0/3826347480 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbd40ad8e0 msgr2=0x7fbbd4153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:23.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.614+0000 7fbbd8bf6640 1 --2- 172.21.15.27:0/3826347480 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbd40ad8e0 0x7fbbd4153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.614+0000 7fbbd8bf6640 1 -- 172.21.15.27:0/3826347480 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc80094d0 con 0x7fbbd40acd70 2024-01-15T11:34:23.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.614+0000 7fbbd8bf6640 1 --2- 172.21.15.27:0/3826347480 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbd40acd70 0x7fbbd4147240 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbbc801a0f0 tx=0x7fbbc801ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:23.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.614+0000 7fbbd17fa640 1 -- 172.21.15.27:0/3826347480 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc80bd3f0 con 0x7fbbd40acd70 2024-01-15T11:34:23.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.614+0000 7fbbd17fa640 1 -- 172.21.15.27:0/3826347480 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc80bd550 con 0x7fbbd40acd70 2024-01-15T11:34:23.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.614+0000 7fbbd17fa640 1 -- 172.21.15.27:0/3826347480 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc80bd900 con 0x7fbbd40acd70 2024-01-15T11:34:23.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.614+0000 7fbbdae5a640 1 -- 172.21.15.27:0/3826347480 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd4153b40 con 0x7fbbd40acd70 2024-01-15T11:34:23.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.614+0000 7fbbdae5a640 1 -- 172.21.15.27:0/3826347480 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd4156670 con 0x7fbbd40acd70 2024-01-15T11:34:23.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.614+0000 7fbbd17fa640 1 -- 172.21.15.27:0/3826347480 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fbbc80b33f0 con 0x7fbbd40acd70 2024-01-15T11:34:23.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbd17fa640 1 --2- 172.21.15.27:0/3826347480 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbbb80668f0 0x7fbbb8068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:23.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbd17fa640 1 -- 172.21.15.27:0/3826347480 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbc811e5b0 con 0x7fbbd40acd70 2024-01-15T11:34:23.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbd3fff640 1 --2- 172.21.15.27:0/3826347480 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbbb80668f0 0x7fbbb8068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:23.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbde1d1000 1 Processor -- start 2024-01-15T11:34:23.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbde1d1000 1 -- start start 2024-01-15T11:34:23.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbd3fff640 1 --2- 172.21.15.27:0/3826347480 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbbb80668f0 0x7fbbb8068db0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40cf950 tx=0x7fbbc0006bb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:23.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbde1d1000 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55fb8ccdcc90 0x55fb8ccdd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:23.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbde1d1000 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdd5b0 0x55fb8cc92de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:23.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbde1d1000 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55fb8cc93320 0x55fb8cc93700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:23.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbde1d1000 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb8cafd130 con 0x55fb8ccdd5b0 2024-01-15T11:34:23.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbde1d1000 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb8caea9a0 con 0x55fb8cc93320 2024-01-15T11:34:23.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbde1d1000 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb8cae7ed0 con 0x55fb8ccdcc90 2024-01-15T11:34:23.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbd3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdd5b0 0x55fb8cc92de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:23.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbd3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdd5b0 0x55fb8cc92de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38542/0 (socket says 172.21.15.27:38542) 2024-01-15T11:34:23.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbd3fff640 1 -- 172.21.15.27:0/2347590238 learned_addr learned my addr 172.21.15.27:0/2347590238 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:23.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbd8bf6640 1 --2- 172.21.15.27:0/2347590238 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55fb8ccdcc90 0x55fb8ccdd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:23.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbd93f7640 1 --2- 172.21.15.27:0/2347590238 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55fb8cc93320 0x55fb8cc93700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:23.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbd3fff640 1 -- 172.21.15.27:0/2347590238 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55fb8ccdcc90 msgr2=0x55fb8ccdd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:23.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbd3fff640 1 --2- 172.21.15.27:0/2347590238 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55fb8ccdcc90 0x55fb8ccdd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbd3fff640 1 -- 172.21.15.27:0/2347590238 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55fb8cc93320 msgr2=0x55fb8cc93700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:23.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbd3fff640 1 --2- 172.21.15.27:0/2347590238 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55fb8cc93320 0x55fb8cc93700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbd3fff640 1 -- 172.21.15.27:0/2347590238 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb8c7db890 con 0x55fb8ccdd5b0 2024-01-15T11:34:23.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbd3fff640 1 --2- 172.21.15.27:0/2347590238 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdd5b0 0x55fb8cc92de0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0013830 tx=0x7fbbc000e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=189bd160592f424a server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:23.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbbe7fc640 1 -- 172.21.15.27:0/2347590238 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0012a90 con 0x55fb8ccdd5b0 2024-01-15T11:34:23.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbbe7fc640 1 -- 172.21.15.27:0/2347590238 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc0019040 con 0x55fb8ccdd5b0 2024-01-15T11:34:23.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.618+0000 7fbbbe7fc640 1 -- 172.21.15.27:0/2347590238 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0012e30 con 0x55fb8ccdd5b0 2024-01-15T11:34:23.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbde1d1000 1 -- 172.21.15.27:0/2347590238 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdd5b0 msgr2=0x55fb8cc92de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:23.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbde1d1000 1 --2- 172.21.15.27:0/2347590238 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdd5b0 0x55fb8cc92de0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0013830 tx=0x7fbbc000e000 comp rx=0 tx=0).stop 2024-01-15T11:34:23.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbde1d1000 1 -- 172.21.15.27:0/2347590238 shutdown_connections 2024-01-15T11:34:23.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbde1d1000 1 --2- 172.21.15.27:0/2347590238 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55fb8cc93320 0x55fb8cc93700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbde1d1000 1 --2- 172.21.15.27:0/2347590238 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdd5b0 0x55fb8cc92de0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbde1d1000 1 --2- 172.21.15.27:0/2347590238 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55fb8ccdcc90 0x55fb8ccdd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbde1d1000 1 -- 172.21.15.27:0/2347590238 >> 172.21.15.27:0/2347590238 conn(0x55fb8cc8f2d0 msgr2=0x55fb8cc916c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:23.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbde1d1000 1 -- 172.21.15.27:0/2347590238 shutdown_connections 2024-01-15T11:34:23.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbde1d1000 1 -- 172.21.15.27:0/2347590238 wait complete. 2024-01-15T11:34:23.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbde1d1000 1 -- start start 2024-01-15T11:34:23.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbde1d1000 1 Processor -- start 2024-01-15T11:34:23.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbde1d1000 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55fb8cc93320 0x55fb8cc97d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:23.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbde1d1000 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdcc90 0x55fb8cc98280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:23.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbde1d1000 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55fb8ccdd5b0 0x55fb8ccab910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:23.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbde1d1000 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb8cae37c0 con 0x55fb8ccdcc90 2024-01-15T11:34:23.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbde1d1000 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb8ca9bbf0 con 0x55fb8ccdd5b0 2024-01-15T11:34:23.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbde1d1000 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb8caa1a90 con 0x55fb8cc93320 2024-01-15T11:34:23.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbde1d1000 10 client.0 _ll_register_callbacks cb 0x55fb8cc7e3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-15T11:34:23.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbd3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdcc90 0x55fb8cc98280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:23.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbd3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdcc90 0x55fb8cc98280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38554/0 (socket says 172.21.15.27:38554) 2024-01-15T11:34:23.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbd3fff640 1 -- 172.21.15.27:0/1405944870 learned_addr learned my addr 172.21.15.27:0/1405944870 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:23.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbd8bf6640 1 --2- 172.21.15.27:0/1405944870 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55fb8cc93320 0x55fb8cc97d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:23.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbd93f7640 1 --2- 172.21.15.27:0/1405944870 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55fb8ccdd5b0 0x55fb8ccab910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:23.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbd3fff640 1 -- 172.21.15.27:0/1405944870 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55fb8cc93320 msgr2=0x55fb8cc97d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:23.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbd3fff640 1 --2- 172.21.15.27:0/1405944870 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55fb8cc93320 0x55fb8cc97d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbd3fff640 1 -- 172.21.15.27:0/1405944870 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55fb8ccdd5b0 msgr2=0x55fb8ccab910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:23.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbd3fff640 1 --2- 172.21.15.27:0/1405944870 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55fb8ccdd5b0 0x55fb8ccab910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbd3fff640 1 -- 172.21.15.27:0/1405944870 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc0013510 con 0x55fb8ccdcc90 2024-01-15T11:34:23.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbd93f7640 1 --2- 172.21.15.27:0/1405944870 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55fb8ccdd5b0 0x55fb8ccab910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:34:23.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbd3fff640 1 --2- 172.21.15.27:0/1405944870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdcc90 0x55fb8cc98280 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x55fb8cb99e70 tx=0x7fbbc0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33b194f1508d5aa2 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:23.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-01-15T11:34:23.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbb37fe640 1 -- 172.21.15.27:0/1405944870 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0004020 con 0x55fb8ccdcc90 2024-01-15T11:34:23.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbb37fe640 1 -- 172.21.15.27:0/1405944870 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbc0004180 con 0x55fb8ccdcc90 2024-01-15T11:34:23.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbde1d1000 1 -- 172.21.15.27:0/1405944870 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fb8caa5470 con 0x55fb8ccdcc90 2024-01-15T11:34:23.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbb37fe640 1 -- 172.21.15.27:0/1405944870 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbc0004340 con 0x55fb8ccdcc90 2024-01-15T11:34:23.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbde1d1000 10 client.5271 fetch_fsmap learned FSMap version 17 2024-01-15T11:34:23.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.622+0000 7fbbde1d1000 1 -- 172.21.15.27:0/1405944870 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55fb8caa4190 con 0x55fb8ccdcc90 2024-01-15T11:34:23.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbb37fe640 1 -- 172.21.15.27:0/1405944870 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fb8caa5470 con 0x55fb8ccdcc90 2024-01-15T11:34:23.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbb37fe640 1 -- 172.21.15.27:0/1405944870 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbbc001c070 con 0x55fb8ccdcc90 2024-01-15T11:34:23.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbde1d1000 10 client.5271 fetch_fsmap finished waiting for FSMap version 17 2024-01-15T11:34:23.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbde1d1000 10 client.5271 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-15T11:34:23.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbde1d1000 20 client.5271 populate_metadata read hostname 'smithi027' 2024-01-15T11:34:23.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbde1d1000 1 --2- 172.21.15.27:0/1405944870 >> [v2:172.21.15.27:6833/1732204565,v1:172.21.15.27:6835/1732204565] conn(0x55fb8ccac320 0x55fb8cceef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:23.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbde1d1000 4 client.5271 mds_command: new command op to 5070 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-15T11:34:23.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbde1d1000 1 -- 172.21.15.27:0/1405944870 --> [v2:172.21.15.27:6833/1732204565,v1:172.21.15.27:6835/1732204565] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fb8caa8b50 con 0x55fb8ccac320 2024-01-15T11:34:23.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbd8bf6640 1 --2- 172.21.15.27:0/1405944870 >> [v2:172.21.15.27:6833/1732204565,v1:172.21.15.27:6835/1732204565] conn(0x55fb8ccac320 0x55fb8cceef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:23.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbd8bf6640 1 --2- 172.21.15.27:0/1405944870 >> [v2:172.21.15.27:6833/1732204565,v1:172.21.15.27:6835/1732204565] conn(0x55fb8ccac320 0x55fb8cceef50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d7d8530c170f311 server_cookie=be8ff60ac088143 in_seq=0 out_seq=0 2024-01-15T11:34:23.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbb37fe640 10 client.5271 ms_handle_connect on v2:172.21.15.27:6833/1732204565 2024-01-15T11:34:23.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbb37fe640 1 -- 172.21.15.27:0/1405944870 <== mds.0 v2:172.21.15.27:6833/1732204565 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fb8caa8b50 con 0x55fb8ccac320 2024-01-15T11:34:23.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbb37fe640 10 client.5271 handle_command_reply: tid=0 2024-01-15T11:34:23.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbde1d1000 1 client.5271 shutdown 2024-01-15T11:34:23.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbde1d1000 1 -- 172.21.15.27:0/1405944870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdcc90 msgr2=0x55fb8cc98280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:23.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbde1d1000 1 --2- 172.21.15.27:0/1405944870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdcc90 0x55fb8cc98280 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x55fb8cb99e70 tx=0x7fbbc0004730 comp rx=0 tx=0).stop 2024-01-15T11:34:23.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbde1d1000 1 -- 172.21.15.27:0/1405944870 shutdown_connections 2024-01-15T11:34:23.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbde1d1000 1 --2- 172.21.15.27:0/1405944870 >> [v2:172.21.15.27:6833/1732204565,v1:172.21.15.27:6835/1732204565] conn(0x55fb8ccac320 0x55fb8cceef50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbde1d1000 1 --2- 172.21.15.27:0/1405944870 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55fb8ccdd5b0 0x55fb8ccab910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbde1d1000 1 --2- 172.21.15.27:0/1405944870 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdcc90 0x55fb8cc98280 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbde1d1000 1 --2- 172.21.15.27:0/1405944870 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55fb8cc93320 0x55fb8cc97d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbb37fe640 0 client.5271 ms_handle_reset on v2:172.21.15.27:6833/1732204565 2024-01-15T11:34:23.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbde1d1000 1 -- 172.21.15.27:0/1405944870 >> 172.21.15.27:0/1405944870 conn(0x55fb8cc8f2d0 msgr2=0x55fb8cc916c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:23.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbde1d1000 1 -- 172.21.15.27:0/1405944870 shutdown_connections 2024-01-15T11:34:23.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbde1d1000 1 -- 172.21.15.27:0/1405944870 wait complete. 2024-01-15T11:34:23.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.626+0000 7fbbde1d1000 20 client.5271 trim_cache size 0 max 16384 2024-01-15T11:34:23.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.642+0000 7fbbde1d1000 1 Processor -- start 2024-01-15T11:34:23.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.642+0000 7fbbde1d1000 1 -- start start 2024-01-15T11:34:23.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.642+0000 7fbbde1d1000 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55fb8cc8f2d0 0x55fb8ccdab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:23.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.642+0000 7fbbde1d1000 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55fb8cc93320 0x55fb8ccdb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:23.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.642+0000 7fbbde1d1000 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdcc90 0x55fb8ccbf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:23.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.642+0000 7fbbde1d1000 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb8c79c940 con 0x55fb8ccdcc90 2024-01-15T11:34:23.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.642+0000 7fbbde1d1000 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb8cb25140 con 0x55fb8cc93320 2024-01-15T11:34:23.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.642+0000 7fbbde1d1000 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb8ccab8c0 con 0x55fb8cc8f2d0 2024-01-15T11:34:23.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.642+0000 7fbbd93f7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdcc90 0x55fb8ccbf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:23.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.642+0000 7fbbd93f7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdcc90 0x55fb8ccbf7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38558/0 (socket says 172.21.15.27:38558) 2024-01-15T11:34:23.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.642+0000 7fbbd93f7640 1 -- 172.21.15.27:0/4047942407 learned_addr learned my addr 172.21.15.27:0/4047942407 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:23.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.642+0000 7fbbd8bf6640 1 --2- 172.21.15.27:0/4047942407 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55fb8cc8f2d0 0x55fb8ccdab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:23.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.642+0000 7fbbd3fff640 1 --2- 172.21.15.27:0/4047942407 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55fb8cc93320 0x55fb8ccdb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:23.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.642+0000 7fbbd93f7640 1 -- 172.21.15.27:0/4047942407 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55fb8cc8f2d0 msgr2=0x55fb8ccdab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:23.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.642+0000 7fbbd93f7640 1 --2- 172.21.15.27:0/4047942407 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55fb8cc8f2d0 0x55fb8ccdab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.642+0000 7fbbd93f7640 1 -- 172.21.15.27:0/4047942407 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55fb8cc93320 msgr2=0x55fb8ccdb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:23.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.642+0000 7fbbd93f7640 1 --2- 172.21.15.27:0/4047942407 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55fb8cc93320 0x55fb8ccdb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.642+0000 7fbbd93f7640 1 -- 172.21.15.27:0/4047942407 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb8ca8a490 con 0x55fb8ccdcc90 2024-01-15T11:34:23.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.642+0000 7fbbd3fff640 1 --2- 172.21.15.27:0/4047942407 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55fb8cc93320 0x55fb8ccdb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:34:23.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.642+0000 7fbbd93f7640 1 --2- 172.21.15.27:0/4047942407 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdcc90 0x55fb8ccbf7a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc009f40 tx=0x7fbbcc00a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4c5cfd75ab59c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:23.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbbeffd640 1 -- 172.21.15.27:0/4047942407 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc011040 con 0x55fb8ccdcc90 2024-01-15T11:34:23.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbbeffd640 1 -- 172.21.15.27:0/4047942407 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbcc014750 con 0x55fb8ccdcc90 2024-01-15T11:34:23.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbbeffd640 1 -- 172.21.15.27:0/4047942407 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc014b00 con 0x55fb8ccdcc90 2024-01-15T11:34:23.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbde1d1000 1 -- 172.21.15.27:0/4047942407 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdcc90 msgr2=0x55fb8ccbf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:23.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbde1d1000 1 --2- 172.21.15.27:0/4047942407 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdcc90 0x55fb8ccbf7a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc009f40 tx=0x7fbbcc00a890 comp rx=0 tx=0).stop 2024-01-15T11:34:23.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbde1d1000 1 -- 172.21.15.27:0/4047942407 shutdown_connections 2024-01-15T11:34:23.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbde1d1000 1 --2- 172.21.15.27:0/4047942407 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdcc90 0x55fb8ccbf7a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbde1d1000 1 --2- 172.21.15.27:0/4047942407 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55fb8cc93320 0x55fb8ccdb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbde1d1000 1 --2- 172.21.15.27:0/4047942407 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55fb8cc8f2d0 0x55fb8ccdab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbde1d1000 1 -- 172.21.15.27:0/4047942407 >> 172.21.15.27:0/4047942407 conn(0x55fb8cc97f10 msgr2=0x55fb8cc916c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:23.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbde1d1000 1 -- 172.21.15.27:0/4047942407 shutdown_connections 2024-01-15T11:34:23.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbde1d1000 1 -- 172.21.15.27:0/4047942407 wait complete. 2024-01-15T11:34:23.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbde1d1000 1 -- start start 2024-01-15T11:34:23.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbde1d1000 1 Processor -- start 2024-01-15T11:34:23.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbde1d1000 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55fb8cc8f2d0 0x55fb8ccbfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:23.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbde1d1000 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55fb8cc93320 0x55fb8cceef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:23.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbde1d1000 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdcc90 0x55fb8ccef490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:23.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbde1d1000 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb8cae0bc0 con 0x55fb8ccdcc90 2024-01-15T11:34:23.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbde1d1000 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb8ca98760 con 0x55fb8cc93320 2024-01-15T11:34:23.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbde1d1000 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb8caad2e0 con 0x55fb8cc8f2d0 2024-01-15T11:34:23.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbde1d1000 10 client.0 _ll_register_callbacks cb 0x55fb8cb31c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-15T11:34:23.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbd8bf6640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55fb8cc8f2d0 0x55fb8ccbfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:23.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbd3fff640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55fb8cc93320 0x55fb8cceef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:23.657 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbd8bf6640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55fb8cc8f2d0 0x55fb8ccbfbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.27:38106/0 (socket says 172.21.15.27:38106) 2024-01-15T11:34:23.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbd8bf6640 1 -- 172.21.15.27:0/2121176718 learned_addr learned my addr 172.21.15.27:0/2121176718 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:23.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbd93f7640 1 --2- 172.21.15.27:0/2121176718 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdcc90 0x55fb8ccef490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:23.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbd8bf6640 1 -- 172.21.15.27:0/2121176718 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55fb8cc93320 msgr2=0x55fb8cceef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:23.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbd8bf6640 1 --2- 172.21.15.27:0/2121176718 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55fb8cc93320 0x55fb8cceef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbd8bf6640 1 -- 172.21.15.27:0/2121176718 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdcc90 msgr2=0x55fb8ccef490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:23.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbd8bf6640 1 --2- 172.21.15.27:0/2121176718 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdcc90 0x55fb8ccef490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.646+0000 7fbbd8bf6640 1 -- 172.21.15.27:0/2121176718 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbcc009b70 con 0x55fb8cc8f2d0 2024-01-15T11:34:23.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbd8bf6640 1 --2- 172.21.15.27:0/2121176718 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55fb8cc8f2d0 0x55fb8ccbfbd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbbc801ca30 tx=0x7fbbc80f79b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2652cf1ef3ed6692 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:23.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.93:3301/0 2024-01-15T11:34:23.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbb37fe640 1 -- 172.21.15.27:0/2121176718 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc811cea0 con 0x55fb8cc8f2d0 2024-01-15T11:34:23.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbb37fe640 1 -- 172.21.15.27:0/2121176718 <== mon.2 v2:172.21.15.93:3301/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbc80f75a0 con 0x55fb8cc8f2d0 2024-01-15T11:34:23.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbde1d1000 1 -- 172.21.15.27:0/2121176718 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fb8cae2110 con 0x55fb8cc8f2d0 2024-01-15T11:34:23.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbb37fe640 1 -- 172.21.15.27:0/2121176718 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbc80f3150 con 0x55fb8cc8f2d0 2024-01-15T11:34:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbde1d1000 10 client.4934 fetch_fsmap learned FSMap version 17 2024-01-15T11:34:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbde1d1000 1 -- 172.21.15.27:0/2121176718 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55fb8c7dbcc0 con 0x55fb8cc8f2d0 2024-01-15T11:34:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbb37fe640 1 -- 172.21.15.27:0/2121176718 <== mon.2 v2:172.21.15.93:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc80ff080 con 0x55fb8cc8f2d0 2024-01-15T11:34:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbb37fe640 1 -- 172.21.15.27:0/2121176718 <== mon.2 v2:172.21.15.93:3301/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbbc80f32b0 con 0x55fb8cc8f2d0 2024-01-15T11:34:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbde1d1000 10 client.4934 fetch_fsmap finished waiting for FSMap version 17 2024-01-15T11:34:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbde1d1000 10 client.4934 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-15T11:34:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbde1d1000 20 client.4934 populate_metadata read hostname 'smithi027' 2024-01-15T11:34:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbde1d1000 1 --2- 172.21.15.27:0/2121176718 >> [v2:172.21.15.27:6833/1732204565,v1:172.21.15.27:6835/1732204565] conn(0x55fb8ccdd5b0 0x55fb8cd45e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbde1d1000 4 client.4934 mds_command: new command op to 5070 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-15T11:34:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbde1d1000 1 -- 172.21.15.27:0/2121176718 --> [v2:172.21.15.27:6833/1732204565,v1:172.21.15.27:6835/1732204565] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fb8cb119a0 con 0x55fb8ccdd5b0 2024-01-15T11:34:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbd3fff640 1 --2- 172.21.15.27:0/2121176718 >> [v2:172.21.15.27:6833/1732204565,v1:172.21.15.27:6835/1732204565] conn(0x55fb8ccdd5b0 0x55fb8cd45e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbb37fe640 10 client.4934 ms_handle_connect on v2:172.21.15.27:6833/1732204565 2024-01-15T11:34:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbd3fff640 1 --2- 172.21.15.27:0/2121176718 >> [v2:172.21.15.27:6833/1732204565,v1:172.21.15.27:6835/1732204565] conn(0x55fb8ccdd5b0 0x55fb8cd45e40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7e8eca8ba715ba1 server_cookie=5b6c7bf170c9ccaf in_seq=0 out_seq=0 2024-01-15T11:34:23.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbb37fe640 1 -- 172.21.15.27:0/2121176718 <== mds.0 v2:172.21.15.27:6833/1732204565 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55fb8cb119a0 con 0x55fb8ccdd5b0 2024-01-15T11:34:23.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbb37fe640 10 client.4934 handle_command_reply: tid=0 2024-01-15T11:34:23.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbde1d1000 1 client.4934 shutdown 2024-01-15T11:34:23.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbde1d1000 1 -- 172.21.15.27:0/2121176718 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55fb8cc8f2d0 msgr2=0x55fb8ccbfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:23.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbde1d1000 1 --2- 172.21.15.27:0/2121176718 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55fb8cc8f2d0 0x55fb8ccbfbd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbbc801ca30 tx=0x7fbbc80f79b0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbde1d1000 1 -- 172.21.15.27:0/2121176718 shutdown_connections 2024-01-15T11:34:23.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbde1d1000 1 --2- 172.21.15.27:0/2121176718 >> [v2:172.21.15.27:6833/1732204565,v1:172.21.15.27:6835/1732204565] conn(0x55fb8ccdd5b0 0x55fb8cd45e40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbde1d1000 1 --2- 172.21.15.27:0/2121176718 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55fb8ccdcc90 0x55fb8ccef490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbde1d1000 1 --2- 172.21.15.27:0/2121176718 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55fb8cc93320 0x55fb8cceef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbb37fe640 0 client.4934 ms_handle_reset on v2:172.21.15.27:6833/1732204565 2024-01-15T11:34:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbde1d1000 1 --2- 172.21.15.27:0/2121176718 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55fb8cc8f2d0 0x55fb8ccbfbd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbde1d1000 1 -- 172.21.15.27:0/2121176718 >> 172.21.15.27:0/2121176718 conn(0x55fb8cc97f10 msgr2=0x55fb8cc91f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbde1d1000 1 -- 172.21.15.27:0/2121176718 shutdown_connections 2024-01-15T11:34:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbde1d1000 1 -- 172.21.15.27:0/2121176718 wait complete. 2024-01-15T11:34:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbde1d1000 20 client.4934 trim_cache size 0 max 16384 2024-01-15T11:34:23.661 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-01-15T11:34:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "adeed595-43d7-47b7-9d6d-c1a89f44a694", 2024-01-15T11:34:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 0, 2024-01-15T11:34:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 5070, 2024-01-15T11:34:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2024-01-15T11:34:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2024-01-15T11:34:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2024-01-15T11:34:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 10.455696788999999, 2024-01-15T11:34:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 17, 2024-01-15T11:34:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 35, 2024-01-15T11:34:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 35, 2024-01-15T11:34:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 18.345131789 2024-01-15T11:34:23.662 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-01-15T11:34:23.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbdae5a640 1 -- 172.21.15.27:0/3826347480 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbbb80668f0 msgr2=0x7fbbb8068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:23.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbdae5a640 1 --2- 172.21.15.27:0/3826347480 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbbb80668f0 0x7fbbb8068db0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40cf950 tx=0x7fbbc0006bb0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbdae5a640 1 -- 172.21.15.27:0/3826347480 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbd40acd70 msgr2=0x7fbbd4147240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:23.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbdae5a640 1 --2- 172.21.15.27:0/3826347480 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbd40acd70 0x7fbbd4147240 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbbc801a0f0 tx=0x7fbbc801ad00 comp rx=0 tx=0).stop 2024-01-15T11:34:23.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbdae5a640 1 -- 172.21.15.27:0/3826347480 shutdown_connections 2024-01-15T11:34:23.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbdae5a640 1 --2- 172.21.15.27:0/3826347480 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbbd40b5830 0x7fbbd415d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbdae5a640 1 --2- 172.21.15.27:0/3826347480 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fbbb80668f0 0x7fbbb8068db0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbdae5a640 1 --2- 172.21.15.27:0/3826347480 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbd40ad8e0 0x7fbbd4153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbdae5a640 1 --2- 172.21.15.27:0/3826347480 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbbd40acd70 0x7fbbd4147240 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbdae5a640 1 -- 172.21.15.27:0/3826347480 >> 172.21.15.27:0/3826347480 conn(0x7fbbd4071d80 msgr2=0x7fbbd40734f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:23.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.650+0000 7fbbdae5a640 1 -- 172.21.15.27:0/3826347480 shutdown_connections 2024-01-15T11:34:23.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.654+0000 7fbbdae5a640 1 -- 172.21.15.27:0/3826347480 wait complete. 2024-01-15T11:34:23.675 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-15T11:34:23.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.814+0000 7f0b66c09640 1 Processor -- start 2024-01-15T11:34:23.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.818+0000 7f0b66c09640 1 -- start start 2024-01-15T11:34:23.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.818+0000 7f0b66c09640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0b600d0130 0x7f0b600d3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:23.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.818+0000 7f0b66c09640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b600d15f0 con 0x7f0b600d3760 2024-01-15T11:34:23.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.818+0000 7f0b66c09640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b600ce000 con 0x7f0b6015d880 2024-01-15T11:34:23.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.818+0000 7f0b66c09640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b600d4110 con 0x7f0b600d0130 2024-01-15T11:34:23.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.818+0000 7f0b66408640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0b600d0130 0x7f0b600d3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:23.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.818+0000 7f0b65406640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f0b600d3760 0x7f0b600cfa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:60080/0 (socket says 172.21.15.27:60080) 2024-01-15T11:34:23.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.818+0000 7f0b65406640 1 -- 172.21.15.27:0/288144078 learned_addr learned my addr 172.21.15.27:0/288144078 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:23.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.818+0000 7f0b66408640 1 -- 172.21.15.27:0/288144078 >> v1:172.21.15.93:6789/0 conn(0x7f0b6015d880 legacy=0x7f0b600b6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:23.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.818+0000 7f0b66408640 1 -- 172.21.15.27:0/288144078 >> v1:172.21.15.27:6789/0 conn(0x7f0b600d3760 legacy=0x7f0b600cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:23.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.818+0000 7f0b66408640 1 -- 172.21.15.27:0/288144078 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b600d0630 con 0x7f0b600d0130 2024-01-15T11:34:23.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.822+0000 7f0b66408640 1 --2- 172.21.15.27:0/288144078 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b600d0130 0x7f0b600d3bd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009d90 tx=0x7f0b5801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4e8fb5ce40093f server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:23.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.822+0000 7f0b64c05640 1 -- 172.21.15.27:0/288144078 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b580a5a10 con 0x7f0b600d0130 2024-01-15T11:34:23.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.822+0000 7f0b64c05640 1 -- 172.21.15.27:0/288144078 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b580a5b70 con 0x7f0b600d0130 2024-01-15T11:34:23.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.822+0000 7f0b64c05640 1 -- 172.21.15.27:0/288144078 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b580ad440 con 0x7f0b600d0130 2024-01-15T11:34:23.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.822+0000 7f0b66c09640 1 -- 172.21.15.27:0/288144078 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b600d0130 msgr2=0x7f0b600d3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:23.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.822+0000 7f0b66c09640 1 --2- 172.21.15.27:0/288144078 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b600d0130 0x7f0b600d3bd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009d90 tx=0x7f0b5801c950 comp rx=0 tx=0).stop 2024-01-15T11:34:23.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.822+0000 7f0b66c09640 1 -- 172.21.15.27:0/288144078 shutdown_connections 2024-01-15T11:34:23.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.822+0000 7f0b66c09640 1 --2- 172.21.15.27:0/288144078 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b600d0130 0x7f0b600d3bd0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.822+0000 7f0b66c09640 1 -- 172.21.15.27:0/288144078 >> 172.21.15.27:0/288144078 conn(0x7f0b6006b9f0 msgr2=0x7f0b6006be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:23.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.822+0000 7f0b66c09640 1 -- 172.21.15.27:0/288144078 shutdown_connections 2024-01-15T11:34:23.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.822+0000 7f0b66c09640 1 -- 172.21.15.27:0/288144078 wait complete. 2024-01-15T11:34:23.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.822+0000 7f0b66c09640 1 Processor -- start 2024-01-15T11:34:23.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.822+0000 7f0b66c09640 1 -- start start 2024-01-15T11:34:23.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b66c09640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0b600d0130 0x7f0b600b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:23.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b66c09640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0b600d3760 0x7f0b600b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:23.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b66c09640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b6015d880 0x7f0b60154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:23.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b66c09640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b60155f80 con 0x7f0b6015d880 2024-01-15T11:34:23.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b66c09640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b60155650 con 0x7f0b600d3760 2024-01-15T11:34:23.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b66c09640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b60155930 con 0x7f0b600d0130 2024-01-15T11:34:23.831 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b66408640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b6015d880 0x7f0b60154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:23.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b66408640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b6015d880 0x7f0b60154360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38586/0 (socket says 172.21.15.27:38586) 2024-01-15T11:34:23.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b66408640 1 -- 172.21.15.27:0/2611626131 learned_addr learned my addr 172.21.15.27:0/2611626131 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:23.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b65c07640 1 --2- 172.21.15.27:0/2611626131 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0b600d0130 0x7f0b600b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:23.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b65406640 1 --2- 172.21.15.27:0/2611626131 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0b600d3760 0x7f0b600b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:23.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b66408640 1 -- 172.21.15.27:0/2611626131 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0b600d0130 msgr2=0x7f0b600b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:23.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b66408640 1 --2- 172.21.15.27:0/2611626131 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0b600d0130 0x7f0b600b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b66408640 1 -- 172.21.15.27:0/2611626131 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0b600d3760 msgr2=0x7f0b600b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:23.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b66408640 1 --2- 172.21.15.27:0/2611626131 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0b600d3760 0x7f0b600b52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:23.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b66408640 1 -- 172.21.15.27:0/2611626131 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b58009a70 con 0x7f0b6015d880 2024-01-15T11:34:23.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b65c07640 1 --2- 172.21.15.27:0/2611626131 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0b600d0130 0x7f0b600b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:34:23.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b65406640 1 --2- 172.21.15.27:0/2611626131 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0b600d3760 0x7f0b600b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:34:23.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b66408640 1 --2- 172.21.15.27:0/2611626131 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b6015d880 0x7f0b60154360 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0b5801a580 tx=0x7f0b580196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:23.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b567fc640 1 -- 172.21.15.27:0/2611626131 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b580ade40 con 0x7f0b6015d880 2024-01-15T11:34:23.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b567fc640 1 -- 172.21.15.27:0/2611626131 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b580b9450 con 0x7f0b6015d880 2024-01-15T11:34:23.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b567fc640 1 -- 172.21.15.27:0/2611626131 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b580b97e0 con 0x7f0b6015d880 2024-01-15T11:34:23.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b66c09640 1 -- 172.21.15.27:0/2611626131 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b60155c10 con 0x7f0b6015d880 2024-01-15T11:34:23.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b66c09640 1 -- 172.21.15.27:0/2611626131 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b60151440 con 0x7f0b6015d880 2024-01-15T11:34:23.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b66c09640 1 -- 172.21.15.27:0/2611626131 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b60074a00 con 0x7f0b6015d880 2024-01-15T11:34:23.834 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.826+0000 7f0b567fc640 1 -- 172.21.15.27:0/2611626131 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f0b580b9940 con 0x7f0b6015d880 2024-01-15T11:34:23.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.830+0000 7f0b567fc640 1 --2- 172.21.15.27:0/2611626131 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f0b440668f0 0x7f0b44068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:23.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.830+0000 7f0b567fc640 1 -- 172.21.15.27:0/2611626131 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b5811fc60 con 0x7f0b6015d880 2024-01-15T11:34:23.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.830+0000 7f0b65c07640 1 --2- 172.21.15.27:0/2611626131 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f0b440668f0 0x7f0b44068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:23.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.830+0000 7f0b65c07640 1 --2- 172.21.15.27:0/2611626131 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f0b440668f0 0x7f0b44068db0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c000f70 tx=0x7f0b5c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:23.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:23.834+0000 7f0b567fc640 1 -- 172.21.15.27:0/2611626131 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0b580ecf50 con 0x7f0b6015d880 2024-01-15T11:34:24.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.026+0000 7f0b66c09640 1 -- 172.21.15.27:0/2611626131 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0b6015de10 con 0x7f0b6015d880 2024-01-15T11:34:24.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.026+0000 7f0b567fc640 1 -- 172.21.15.27:0/2611626131 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0b580f0570 con 0x7f0b6015d880 2024-01-15T11:34:24.029 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-15T11:34:24.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.026+0000 7f0b66c09640 1 -- 172.21.15.27:0/2611626131 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f0b440668f0 msgr2=0x7f0b44068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:24.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.026+0000 7f0b66c09640 1 --2- 172.21.15.27:0/2611626131 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f0b440668f0 0x7f0b44068db0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c000f70 tx=0x7f0b5c009040 comp rx=0 tx=0).stop 2024-01-15T11:34:24.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.026+0000 7f0b66c09640 1 -- 172.21.15.27:0/2611626131 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b6015d880 msgr2=0x7f0b60154360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:24.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.026+0000 7f0b66c09640 1 --2- 172.21.15.27:0/2611626131 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b6015d880 0x7f0b60154360 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0b5801a580 tx=0x7f0b580196f0 comp rx=0 tx=0).stop 2024-01-15T11:34:24.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.026+0000 7f0b66c09640 1 -- 172.21.15.27:0/2611626131 shutdown_connections 2024-01-15T11:34:24.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.026+0000 7f0b66c09640 1 --2- 172.21.15.27:0/2611626131 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b6015d880 0x7f0b60154360 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:24.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.026+0000 7f0b66c09640 1 --2- 172.21.15.27:0/2611626131 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f0b440668f0 0x7f0b44068db0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:24.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.026+0000 7f0b66c09640 1 --2- 172.21.15.27:0/2611626131 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0b600d3760 0x7f0b600b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:24.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.026+0000 7f0b66c09640 1 --2- 172.21.15.27:0/2611626131 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0b600d0130 0x7f0b600b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:24.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.026+0000 7f0b66c09640 1 -- 172.21.15.27:0/2611626131 >> 172.21.15.27:0/2611626131 conn(0x7f0b6006b9f0 msgr2=0x7f0b6006bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:24.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.026+0000 7f0b66c09640 1 -- 172.21.15.27:0/2611626131 shutdown_connections 2024-01-15T11:34:24.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.026+0000 7f0b66c09640 1 -- 172.21.15.27:0/2611626131 wait complete. 2024-01-15T11:34:24.050 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-15T11:34:24.050 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-15T11:34:24.050 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi027.front.sepia.ceph.com 2024-01-15T11:34:24.050 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-15T11:34:24.050 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-15T11:34:24.050 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-15T11:34:24.050 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-15T11:34:24.050 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-15T11:34:24.050 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-15T11:34:24.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:34:24.051 DEBUG:teuthology.orchestra.run.smithi027:> ip addr 2024-01-15T11:34:24.062 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-15T11:34:24.062 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-15T11:34:24.062 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2024-01-15T11:34:24.062 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:34:24.062 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2024-01-15T11:34:24.062 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:34:24.062 INFO:teuthology.orchestra.run.smithi027.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T11:34:24.063 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c8 brd ff:ff:ff:ff:ff:ff 2024-01-15T11:34:24.063 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp7s0f0 2024-01-15T11:34:24.063 INFO:teuthology.orchestra.run.smithi027.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T11:34:24.063 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c9 brd ff:ff:ff:ff:ff:ff 2024-01-15T11:34:24.063 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp7s0f1 2024-01-15T11:34:24.063 INFO:teuthology.orchestra.run.smithi027.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-15T11:34:24.063 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5a brd ff:ff:ff:ff:ff:ff 2024-01-15T11:34:24.063 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp1s0f0 2024-01-15T11:34:24.063 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.21.15.27/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-01-15T11:34:24.063 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft 42417sec preferred_lft 42417sec 2024-01-15T11:34:24.064 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2024-01-15T11:34:24.064 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:34:24.064 INFO:teuthology.orchestra.run.smithi027.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T11:34:24.064 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5b brd ff:ff:ff:ff:ff:ff 2024-01-15T11:34:24.064 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp1s0f1 2024-01-15T11:34:24.064 INFO:teuthology.orchestra.run.smithi027.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-15T11:34:24.064 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 02:42:6f:76:e1:a1 brd ff:ff:ff:ff:ff:ff 2024-01-15T11:34:24.064 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-15T11:34:24.064 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:34:24.064 INFO:teuthology.orchestra.run.smithi027.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-15T11:34:24.065 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-15T11:34:24.065 INFO:teuthology.orchestra.run.smithi027.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-15T11:34:24.065 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:34:24.065 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-15T11:34:24.065 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:34:24.065 INFO:teuthology.orchestra.run.smithi027.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-15T11:34:24.065 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-15T11:34:24.065 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-15T11:34:24.065 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:34:24.065 INFO:teuthology.orchestra.run.smithi027.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-15T11:34:24.065 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-15T11:34:24.065 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-01-15T11:34:24.066 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:34:24.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:34:24.066 DEBUG:teuthology.orchestra.run.smithi027:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-15T11:34:24.124 INFO:teuthology.orchestra.run.smithi027.stdout:1 2024-01-15T11:34:24.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:34:24.126 DEBUG:teuthology.orchestra.run.smithi027:> route 2024-01-15T11:34:24.178 INFO:teuthology.orchestra.run.smithi027.stdout:Kernel IP routing table 2024-01-15T11:34:24.178 INFO:teuthology.orchestra.run.smithi027.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-15T11:34:24.178 INFO:teuthology.orchestra.run.smithi027.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-01-15T11:34:24.178 INFO:teuthology.orchestra.run.smithi027.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-15T11:34:24.178 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-01-15T11:34:24.178 INFO:teuthology.orchestra.run.smithi027.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-15T11:34:24.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:34:24.179 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2024-01-15T11:34:24.179 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2024-01-15T11:34:24.179 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-15T11:34:24.179 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-15T11:34:24.179 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-15T11:34:24.179 DEBUG:teuthology.orchestra.run.smithi027:> ') 2024-01-15T11:34:24.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:34:24.273 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2024-01-15T11:34:24.283 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-15T11:34:24.283 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-15T11:34:24.283 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-15T11:34:24.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:34:24.284 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set brx.0 up 2024-01-15T11:34:24.345 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-15T11:34:24.345 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-15T11:34:24.400 INFO:teuthology.orchestra.run.smithi027.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-15T11:34:24.401 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-15T11:34:24.401 DEBUG:teuthology.orchestra.run.smithi027:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-15T11:34:24.452 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-01-15T11:34:24.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:34:24.452 DEBUG:teuthology.orchestra.run.smithi027:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T11:34:24.547 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T11:34:24.547 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-15T11:34:24.561 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T11:34:24.561 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-15T11:34:24.561 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: resolved to: "172.21.15.27:3300,172.21.15.93:3300,172.21.15.93:3301" 2024-01-15T11:34:24.561 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: trying mount with new device syntax: 0@adeed595-43d7-47b7-9d6d-c1a89f44a694.cephfs=/ 2024-01-15T11:34:24.561 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.27:3300/172.21.15.93:3300/172.21.15.93:3301" will pass to kernel 2024-01-15T11:34:24.566 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-15T11:34:24.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:34:24.566 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-15T11:34:24.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:34:24.588 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T11:34:24.653 INFO:teuthology.orchestra.run.smithi027.stdout:client5289 2024-01-15T11:34:24.653 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:34:24.653 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T11:34:24.705 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-15T11:34:24.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.886+0000 7fa3d8cc9640 1 Processor -- start 2024-01-15T11:34:24.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.886+0000 7fa3d8cc9640 1 -- start start 2024-01-15T11:34:24.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.890+0000 7fa3d8cc9640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa3d415d3e0 0x7fa3d40716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:24.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.890+0000 7fa3d8cc9640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa3d406c630 0x7fa3d406ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:24.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.890+0000 7fa3d8cc9640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d4070920 con 0x7fa3d4071f30 2024-01-15T11:34:24.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.890+0000 7fa3d8cc9640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d4071be0 con 0x7fa3d415d3e0 2024-01-15T11:34:24.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.890+0000 7fa3d8cc9640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d415d7c0 con 0x7fa3d406c630 2024-01-15T11:34:24.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.890+0000 7fa3d2d9d640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fa3d4071f30 0x7fa3d40b1f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:60090/0 (socket says 172.21.15.27:60090) 2024-01-15T11:34:24.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.890+0000 7fa3d2d9d640 1 -- 172.21.15.27:0/2843939121 learned_addr learned my addr 172.21.15.27:0/2843939121 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:24.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.890+0000 7fa3cbfff640 1 --2- 172.21.15.27:0/2843939121 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa3d406c630 0x7fa3d406ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:24.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.890+0000 7fa3d259c640 1 --2- 172.21.15.27:0/2843939121 >> v2:172.21.15.93:3300/0 conn(0x7fa3d415d3e0 0x7fa3d40716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:24.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.890+0000 7fa3d1d9b640 1 -- 172.21.15.27:0/2843939121 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567683074 0 0) 0x7fa3d4070920 con 0x7fa3d4071f30 2024-01-15T11:34:24.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.890+0000 7fa3d1d9b640 1 -- 172.21.15.27:0/2843939121 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3c0003530 con 0x7fa3d4071f30 2024-01-15T11:34:24.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.890+0000 7fa3cbfff640 1 -- 172.21.15.27:0/2843939121 >> v2:172.21.15.93:3300/0 conn(0x7fa3d415d3e0 msgr2=0x7fa3d40716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:24.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.890+0000 7fa3cbfff640 1 --2- 172.21.15.27:0/2843939121 >> v2:172.21.15.93:3300/0 conn(0x7fa3d415d3e0 0x7fa3d40716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:24.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.890+0000 7fa3cbfff640 1 -- 172.21.15.27:0/2843939121 >> v1:172.21.15.27:6789/0 conn(0x7fa3d4071f30 legacy=0x7fa3d40b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:24.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.890+0000 7fa3cbfff640 1 -- 172.21.15.27:0/2843939121 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d4070bc0 con 0x7fa3d406c630 2024-01-15T11:34:24.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.894+0000 7fa3cbfff640 1 --2- 172.21.15.27:0/2843939121 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa3d406c630 0x7fa3d406ca90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0097f0 tx=0x7fa3bc01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e54c8869f1f169fb server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:24.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.894+0000 7fa3d1d9b640 1 -- 172.21.15.27:0/2843939121 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc0ab650 con 0x7fa3d406c630 2024-01-15T11:34:24.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.894+0000 7fa3d1d9b640 1 -- 172.21.15.27:0/2843939121 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3bc0ab7b0 con 0x7fa3d406c630 2024-01-15T11:34:24.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.894+0000 7fa3d1d9b640 1 -- 172.21.15.27:0/2843939121 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc0abb40 con 0x7fa3d406c630 2024-01-15T11:34:24.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.894+0000 7fa3d8cc9640 1 -- 172.21.15.27:0/2843939121 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa3d406c630 msgr2=0x7fa3d406ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:24.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.894+0000 7fa3d8cc9640 1 --2- 172.21.15.27:0/2843939121 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa3d406c630 0x7fa3d406ca90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0097f0 tx=0x7fa3bc01c450 comp rx=0 tx=0).stop 2024-01-15T11:34:24.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.894+0000 7fa3d8cc9640 1 -- 172.21.15.27:0/2843939121 shutdown_connections 2024-01-15T11:34:24.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.894+0000 7fa3d8cc9640 1 --2- 172.21.15.27:0/2843939121 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa3d406c630 0x7fa3d406ca90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:24.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.894+0000 7fa3d8cc9640 1 --2- 172.21.15.27:0/2843939121 >> v2:172.21.15.93:3300/0 conn(0x7fa3d415d3e0 0x7fa3d40716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:24.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.894+0000 7fa3d8cc9640 1 -- 172.21.15.27:0/2843939121 >> 172.21.15.27:0/2843939121 conn(0x7fa3d40b0c40 msgr2=0x7fa3d40b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:24.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.894+0000 7fa3d8cc9640 1 -- 172.21.15.27:0/2843939121 shutdown_connections 2024-01-15T11:34:24.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.894+0000 7fa3d8cc9640 1 -- 172.21.15.27:0/2843939121 wait complete. 2024-01-15T11:34:24.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.894+0000 7fa3d8cc9640 1 Processor -- start 2024-01-15T11:34:24.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.894+0000 7fa3d8cc9640 1 -- start start 2024-01-15T11:34:24.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.894+0000 7fa3d8cc9640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa3d406c630 0x7fa3d4155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:24.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.894+0000 7fa3d8cc9640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa3d4071f30 0x7fa3d414f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:24.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.894+0000 7fa3d8cc9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3d415d3e0 0x7fa3d415b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:24.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.894+0000 7fa3d8cc9640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d415c7e0 con 0x7fa3d415d3e0 2024-01-15T11:34:24.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.894+0000 7fa3d8cc9640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d414f840 con 0x7fa3d406c630 2024-01-15T11:34:24.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.894+0000 7fa3d8cc9640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d415bb60 con 0x7fa3d4071f30 2024-01-15T11:34:24.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.898+0000 7fa3d2d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3d415d3e0 0x7fa3d415b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:24.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.898+0000 7fa3d2d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3d415d3e0 0x7fa3d415b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38598/0 (socket says 172.21.15.27:38598) 2024-01-15T11:34:24.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.898+0000 7fa3d2d9d640 1 -- 172.21.15.27:0/580274501 learned_addr learned my addr 172.21.15.27:0/580274501 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:24.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.898+0000 7fa3d259c640 1 --2- 172.21.15.27:0/580274501 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa3d406c630 0x7fa3d4155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:24.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.898+0000 7fa3cbfff640 1 --2- 172.21.15.27:0/580274501 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa3d4071f30 0x7fa3d414f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:24.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.898+0000 7fa3d2d9d640 1 -- 172.21.15.27:0/580274501 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa3d4071f30 msgr2=0x7fa3d414f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:24.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.898+0000 7fa3d2d9d640 1 --2- 172.21.15.27:0/580274501 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa3d4071f30 0x7fa3d414f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:24.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.898+0000 7fa3d2d9d640 1 -- 172.21.15.27:0/580274501 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa3d406c630 msgr2=0x7fa3d4155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:24.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.898+0000 7fa3d2d9d640 1 --2- 172.21.15.27:0/580274501 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa3d406c630 0x7fa3d4155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:24.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.898+0000 7fa3d2d9d640 1 -- 172.21.15.27:0/580274501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc009420 con 0x7fa3d415d3e0 2024-01-15T11:34:24.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.898+0000 7fa3d2d9d640 1 --2- 172.21.15.27:0/580274501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3d415d3e0 0x7fa3d415b280 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00cb40 tx=0x7fa3cc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:24.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.898+0000 7fa3caffd640 1 -- 172.21.15.27:0/580274501 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc00aca0 con 0x7fa3d415d3e0 2024-01-15T11:34:24.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.898+0000 7fa3caffd640 1 -- 172.21.15.27:0/580274501 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3cc00ae00 con 0x7fa3d415d3e0 2024-01-15T11:34:24.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.898+0000 7fa3d8cc9640 1 -- 172.21.15.27:0/580274501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d40728d0 con 0x7fa3d415d3e0 2024-01-15T11:34:24.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.898+0000 7fa3caffd640 1 -- 172.21.15.27:0/580274501 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc012620 con 0x7fa3d415d3e0 2024-01-15T11:34:24.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.898+0000 7fa3d8cc9640 1 -- 172.21.15.27:0/580274501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d415c120 con 0x7fa3d415d3e0 2024-01-15T11:34:24.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.898+0000 7fa3d8cc9640 1 -- 172.21.15.27:0/580274501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d415c920 con 0x7fa3d415d3e0 2024-01-15T11:34:24.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.898+0000 7fa3caffd640 1 -- 172.21.15.27:0/580274501 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fa3cc007070 con 0x7fa3d415d3e0 2024-01-15T11:34:24.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.902+0000 7fa3caffd640 1 --2- 172.21.15.27:0/580274501 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa3b40668f0 0x7fa3b4068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:24.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.902+0000 7fa3caffd640 1 -- 172.21.15.27:0/580274501 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3cc084400 con 0x7fa3d415d3e0 2024-01-15T11:34:24.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.902+0000 7fa3d259c640 1 --2- 172.21.15.27:0/580274501 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa3b40668f0 0x7fa3b4068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:24.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.902+0000 7fa3d259c640 1 --2- 172.21.15.27:0/580274501 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa3b40668f0 0x7fa3b4068db0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40af2f0 tx=0x7fa3c4009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:24.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:24.906+0000 7fa3caffd640 1 -- 172.21.15.27:0/580274501 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa3d415c920 con 0x7fa3d415d3e0 2024-01-15T11:34:25.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.094+0000 7fa3d8cc9640 1 -- 172.21.15.27:0/580274501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa3d415c920 con 0x7fa3d415d3e0 2024-01-15T11:34:25.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.098+0000 7fa3caffd640 1 -- 172.21.15.27:0/580274501 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa3cc017060 con 0x7fa3d415d3e0 2024-01-15T11:34:25.100 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-15T11:34:25.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.098+0000 7fa3d8cc9640 1 -- 172.21.15.27:0/580274501 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa3b40668f0 msgr2=0x7fa3b4068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:25.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.098+0000 7fa3d8cc9640 1 --2- 172.21.15.27:0/580274501 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa3b40668f0 0x7fa3b4068db0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40af2f0 tx=0x7fa3c4009190 comp rx=0 tx=0).stop 2024-01-15T11:34:25.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.098+0000 7fa3d8cc9640 1 -- 172.21.15.27:0/580274501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3d415d3e0 msgr2=0x7fa3d415b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:25.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.098+0000 7fa3d8cc9640 1 --2- 172.21.15.27:0/580274501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3d415d3e0 0x7fa3d415b280 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00cb40 tx=0x7fa3cc00a060 comp rx=0 tx=0).stop 2024-01-15T11:34:25.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.098+0000 7fa3d8cc9640 1 -- 172.21.15.27:0/580274501 shutdown_connections 2024-01-15T11:34:25.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.098+0000 7fa3d8cc9640 1 --2- 172.21.15.27:0/580274501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3d415d3e0 0x7fa3d415b280 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:25.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.098+0000 7fa3d8cc9640 1 --2- 172.21.15.27:0/580274501 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa3d4071f30 0x7fa3d414f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:25.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.098+0000 7fa3d8cc9640 1 --2- 172.21.15.27:0/580274501 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa3b40668f0 0x7fa3b4068db0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:25.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.098+0000 7fa3d8cc9640 1 --2- 172.21.15.27:0/580274501 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa3d406c630 0x7fa3d4155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:25.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.098+0000 7fa3d8cc9640 1 -- 172.21.15.27:0/580274501 >> 172.21.15.27:0/580274501 conn(0x7fa3d40b0c40 msgr2=0x7fa3d4161600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:25.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.098+0000 7fa3d8cc9640 1 -- 172.21.15.27:0/580274501 shutdown_connections 2024-01-15T11:34:25.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.098+0000 7fa3d8cc9640 1 -- 172.21.15.27:0/580274501 wait complete. 2024-01-15T11:34:25.121 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-15T11:34:25.122 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-15T11:34:25.122 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi093.front.sepia.ceph.com 2024-01-15T11:34:25.122 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-15T11:34:25.122 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-15T11:34:25.122 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-15T11:34:25.122 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-15T11:34:25.122 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-15T11:34:25.122 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-15T11:34:25.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:34:25.123 DEBUG:teuthology.orchestra.run.smithi093:> ip addr 2024-01-15T11:34:25.134 INFO:teuthology.orchestra.run.smithi093.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-15T11:34:25.134 INFO:teuthology.orchestra.run.smithi093.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-15T11:34:25.134 INFO:teuthology.orchestra.run.smithi093.stdout: inet 127.0.0.1/8 scope host lo 2024-01-15T11:34:25.134 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:34:25.135 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 ::1/128 scope host 2024-01-15T11:34:25.135 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:34:25.135 INFO:teuthology.orchestra.run.smithi093.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T11:34:25.135 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1c brd ff:ff:ff:ff:ff:ff 2024-01-15T11:34:25.135 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f0 2024-01-15T11:34:25.135 INFO:teuthology.orchestra.run.smithi093.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T11:34:25.135 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1d brd ff:ff:ff:ff:ff:ff 2024-01-15T11:34:25.135 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f1 2024-01-15T11:34:25.135 INFO:teuthology.orchestra.run.smithi093.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-01-15T11:34:25.135 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:34 brd ff:ff:ff:ff:ff:ff 2024-01-15T11:34:25.135 INFO:teuthology.orchestra.run.smithi093.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-15T11:34:25.136 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:35 brd ff:ff:ff:ff:ff:ff 2024-01-15T11:34:25.136 INFO:teuthology.orchestra.run.smithi093.stdout: inet 172.21.15.93/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-01-15T11:34:25.136 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft 42395sec preferred_lft 42395sec 2024-01-15T11:34:25.136 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::ec4:7aff:fe8f:d635/64 scope link 2024-01-15T11:34:25.136 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:34:25.136 INFO:teuthology.orchestra.run.smithi093.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-01-15T11:34:25.136 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 02:42:04:9e:20:9c brd ff:ff:ff:ff:ff:ff 2024-01-15T11:34:25.136 INFO:teuthology.orchestra.run.smithi093.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-01-15T11:34:25.136 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:34:25.136 INFO:teuthology.orchestra.run.smithi093.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-15T11:34:25.136 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-01-15T11:34:25.137 INFO:teuthology.orchestra.run.smithi093.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-15T11:34:25.137 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:34:25.137 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-01-15T11:34:25.137 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:34:25.137 INFO:teuthology.orchestra.run.smithi093.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-15T11:34:25.137 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-15T11:34:25.137 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-01-15T11:34:25.137 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:34:25.137 INFO:teuthology.orchestra.run.smithi093.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-15T11:34:25.137 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-01-15T11:34:25.137 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-01-15T11:34:25.138 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2024-01-15T11:34:25.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:34:25.138 DEBUG:teuthology.orchestra.run.smithi093:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-15T11:34:25.203 INFO:teuthology.orchestra.run.smithi093.stdout:1 2024-01-15T11:34:25.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:34:25.205 DEBUG:teuthology.orchestra.run.smithi093:> route 2024-01-15T11:34:25.258 INFO:teuthology.orchestra.run.smithi093.stdout:Kernel IP routing table 2024-01-15T11:34:25.258 INFO:teuthology.orchestra.run.smithi093.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-15T11:34:25.258 INFO:teuthology.orchestra.run.smithi093.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-01-15T11:34:25.258 INFO:teuthology.orchestra.run.smithi093.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-15T11:34:25.258 INFO:teuthology.orchestra.run.smithi093.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-01-15T11:34:25.258 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-15T11:34:25.258 INFO:teuthology.orchestra.run.smithi093.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T11:34:25.259 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T11:34:25.259 INFO:teuthology.orchestra.run.smithi093.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-01-15T11:34:25.259 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-15T11:34:25.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:34:25.259 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2024-01-15T11:34:25.259 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2024-01-15T11:34:25.259 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-15T11:34:25.259 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-15T11:34:25.260 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-15T11:34:25.260 DEBUG:teuthology.orchestra.run.smithi093:> ') 2024-01-15T11:34:25.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:34:25.358 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list 2024-01-15T11:34:25.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-15T11:34:25.368 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-01-15T11:34:25.368 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-15T11:34:25.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:34:25.369 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set brx.0 up 2024-01-15T11:34:25.431 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-15T11:34:25.431 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-15T11:34:25.483 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-15T11:34:25.483 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-15T11:34:25.483 DEBUG:teuthology.orchestra.run.smithi093:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-15T11:34:25.534 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-01-15T11:34:25.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:34:25.534 DEBUG:teuthology.orchestra.run.smithi093:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T11:34:25.628 INFO:teuthology.orchestra.run.smithi093.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T11:34:25.628 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-15T11:34:25.642 INFO:teuthology.orchestra.run.smithi093.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-15T11:34:25.642 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-15T11:34:25.643 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: resolved to: "172.21.15.27:3300,172.21.15.93:3300,172.21.15.93:3301" 2024-01-15T11:34:25.643 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: trying mount with new device syntax: 1@adeed595-43d7-47b7-9d6d-c1a89f44a694.cephfs=/ 2024-01-15T11:34:25.643 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.27:3300/172.21.15.93:3300/172.21.15.93:3301" will pass to kernel 2024-01-15T11:34:25.646 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-15T11:34:25.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:34:25.647 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-15T11:34:25.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:34:25.668 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-15T11:34:25.726 INFO:teuthology.orchestra.run.smithi093.stdout:client5298 2024-01-15T11:34:25.726 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2024-01-15T11:34:25.727 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T11:34:25.779 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-01-15T11:34:25.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.934+0000 7ff2728ea640 1 Processor -- start 2024-01-15T11:34:25.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.934+0000 7ff2728ea640 1 -- start start 2024-01-15T11:34:25.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.938+0000 7ff2728ea640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff26c159f00 0x7ff26c0ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:25.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.938+0000 7ff2728ea640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff26c072950 con 0x7ff26c070890 2024-01-15T11:34:25.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.938+0000 7ff2728ea640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff26c06e2b0 con 0x7ff26c0ae680 2024-01-15T11:34:25.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.938+0000 7ff2728ea640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff26c06c6f0 con 0x7ff26c159f00 2024-01-15T11:34:25.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.938+0000 7ff270e87640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7ff26c070890 0x7ff26c070d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42904/0 (socket says 172.21.15.27:42904) 2024-01-15T11:34:25.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.938+0000 7ff270e87640 1 -- 172.21.15.27:0/3886791805 learned_addr learned my addr 172.21.15.27:0/3886791805 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:25.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.938+0000 7ff26bfff640 1 --2- 172.21.15.27:0/3886791805 >> v2:172.21.15.93:3300/0 conn(0x7ff26c159f00 0x7ff26c0ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:25.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.938+0000 7ff26affd640 1 -- 172.21.15.27:0/3886791805 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1358361090 0 0) 0x7ff26c072950 con 0x7ff26c070890 2024-01-15T11:34:25.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.938+0000 7ff26affd640 1 -- 172.21.15.27:0/3886791805 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff254003450 con 0x7ff26c070890 2024-01-15T11:34:25.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.938+0000 7ff26affd640 1 -- 172.21.15.27:0/3886791805 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3305250288 0 0) 0x7ff254003450 con 0x7ff26c070890 2024-01-15T11:34:25.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.938+0000 7ff26bfff640 1 -- 172.21.15.27:0/3886791805 >> v1:172.21.15.93:6789/0 conn(0x7ff26c0ae680 legacy=0x7ff26c0cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:25.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.938+0000 7ff26bfff640 1 -- 172.21.15.27:0/3886791805 >> v1:172.21.15.27:6789/0 conn(0x7ff26c070890 legacy=0x7ff26c070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:25.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.938+0000 7ff26bfff640 1 -- 172.21.15.27:0/3886791805 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26c06e550 con 0x7ff26c159f00 2024-01-15T11:34:25.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.942+0000 7ff26bfff640 1 --2- 172.21.15.27:0/3886791805 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff26c159f00 0x7ff26c0ccea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0097c0 tx=0x7ff25c01c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10c5e2111be25ec5 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:25.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.942+0000 7ff26affd640 1 -- 172.21.15.27:0/3886791805 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff264001a00 con 0x7ff26c159f00 2024-01-15T11:34:25.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.942+0000 7ff26affd640 1 -- 172.21.15.27:0/3886791805 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25c0a7050 con 0x7ff26c159f00 2024-01-15T11:34:25.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.942+0000 7ff26affd640 1 -- 172.21.15.27:0/3886791805 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0ab620 con 0x7ff26c159f00 2024-01-15T11:34:25.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.942+0000 7ff2728ea640 1 -- 172.21.15.27:0/3886791805 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff26c159f00 msgr2=0x7ff26c0ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:25.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.942+0000 7ff2728ea640 1 --2- 172.21.15.27:0/3886791805 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff26c159f00 0x7ff26c0ccea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0097c0 tx=0x7ff25c01c370 comp rx=0 tx=0).stop 2024-01-15T11:34:25.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.942+0000 7ff2728ea640 1 -- 172.21.15.27:0/3886791805 shutdown_connections 2024-01-15T11:34:25.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.942+0000 7ff2728ea640 1 --2- 172.21.15.27:0/3886791805 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff26c159f00 0x7ff26c0ccea0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:25.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.942+0000 7ff2728ea640 1 -- 172.21.15.27:0/3886791805 >> 172.21.15.27:0/3886791805 conn(0x7ff26c0b0cb0 msgr2=0x7ff26c0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:25.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.942+0000 7ff2728ea640 1 -- 172.21.15.27:0/3886791805 shutdown_connections 2024-01-15T11:34:25.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.942+0000 7ff2728ea640 1 -- 172.21.15.27:0/3886791805 wait complete. 2024-01-15T11:34:25.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.942+0000 7ff2728ea640 1 Processor -- start 2024-01-15T11:34:25.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.942+0000 7ff2728ea640 1 -- start start 2024-01-15T11:34:25.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.946+0000 7ff2728ea640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff26c070890 0x7ff26c09c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:25.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.946+0000 7ff2728ea640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff26c0ae680 0x7ff26c15c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:25.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.946+0000 7ff2728ea640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff26c15cd10 0x7ff26c0b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:25.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.946+0000 7ff2728ea640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c09c880 con 0x7ff26c15cd10 2024-01-15T11:34:25.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.946+0000 7ff2728ea640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c099bb0 con 0x7ff26c070890 2024-01-15T11:34:25.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.946+0000 7ff2728ea640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c099e70 con 0x7ff26c0ae680 2024-01-15T11:34:25.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.946+0000 7ff270e87640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff26c15cd10 0x7ff26c0b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:25.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.946+0000 7ff270e87640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff26c15cd10 0x7ff26c0b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53462/0 (socket says 172.21.15.27:53462) 2024-01-15T11:34:25.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.946+0000 7ff270e87640 1 -- 172.21.15.27:0/165779686 learned_addr learned my addr 172.21.15.27:0/165779686 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:25.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.946+0000 7ff26b7fe640 1 --2- 172.21.15.27:0/165779686 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff26c0ae680 0x7ff26c15c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:25.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.946+0000 7ff26bfff640 1 --2- 172.21.15.27:0/165779686 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff26c070890 0x7ff26c09c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:25.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.946+0000 7ff270e87640 1 -- 172.21.15.27:0/165779686 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff26c0ae680 msgr2=0x7ff26c15c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:25.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.946+0000 7ff270e87640 1 --2- 172.21.15.27:0/165779686 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff26c0ae680 0x7ff26c15c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:25.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.946+0000 7ff270e87640 1 -- 172.21.15.27:0/165779686 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff26c070890 msgr2=0x7ff26c09c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:25.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.946+0000 7ff270e87640 1 --2- 172.21.15.27:0/165779686 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff26c070890 0x7ff26c09c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:25.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.946+0000 7ff270e87640 1 -- 172.21.15.27:0/165779686 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25c009420 con 0x7ff26c15cd10 2024-01-15T11:34:25.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.946+0000 7ff270e87640 1 --2- 172.21.15.27:0/165779686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff26c15cd10 0x7ff26c0b2140 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff264001f80 tx=0x7ff26400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:25.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.946+0000 7ff268ff9640 1 -- 172.21.15.27:0/165779686 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff264012400 con 0x7ff26c15cd10 2024-01-15T11:34:25.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.946+0000 7ff268ff9640 1 -- 172.21.15.27:0/165779686 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff264012560 con 0x7ff26c15cd10 2024-01-15T11:34:25.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.946+0000 7ff268ff9640 1 -- 172.21.15.27:0/165779686 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff264012910 con 0x7ff26c15cd10 2024-01-15T11:34:25.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.946+0000 7ff2728ea640 1 -- 172.21.15.27:0/165779686 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26c09a150 con 0x7ff26c15cd10 2024-01-15T11:34:25.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.946+0000 7ff2728ea640 1 -- 172.21.15.27:0/165779686 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26c148e50 con 0x7ff26c15cd10 2024-01-15T11:34:25.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.946+0000 7ff2728ea640 1 -- 172.21.15.27:0/165779686 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff26c0671f0 con 0x7ff26c15cd10 2024-01-15T11:34:25.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.946+0000 7ff268ff9640 1 -- 172.21.15.27:0/165779686 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7ff264012a70 con 0x7ff26c15cd10 2024-01-15T11:34:25.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.950+0000 7ff268ff9640 1 --2- 172.21.15.27:0/165779686 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff2580668f0 0x7ff258068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:25.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.950+0000 7ff268ff9640 1 -- 172.21.15.27:0/165779686 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff264084ca0 con 0x7ff26c15cd10 2024-01-15T11:34:25.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.950+0000 7ff26bfff640 1 --2- 172.21.15.27:0/165779686 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff2580668f0 0x7ff258068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:25.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.950+0000 7ff26bfff640 1 --2- 172.21.15.27:0/165779686 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff2580668f0 0x7ff258068db0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0ad000 tx=0x7ff25c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:25.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:25.954+0000 7ff268ff9640 1 -- 172.21.15.27:0/165779686 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff264051e40 con 0x7ff26c15cd10 2024-01-15T11:34:26.149 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.146+0000 7ff2728ea640 1 -- 172.21.15.27:0/165779686 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff26c06b460 con 0x7ff26c15cd10 2024-01-15T11:34:26.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.802+0000 7ff268ff9640 1 -- 172.21.15.27:0/165779686 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 136+0+0 (secure 0 0 0) 0x7ff264055460 con 0x7ff26c15cd10 2024-01-15T11:34:26.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.802+0000 7ff2728ea640 1 -- 172.21.15.27:0/165779686 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff2580668f0 msgr2=0x7ff258068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:26.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.802+0000 7ff2728ea640 1 --2- 172.21.15.27:0/165779686 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff2580668f0 0x7ff258068db0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0ad000 tx=0x7ff25c008040 comp rx=0 tx=0).stop 2024-01-15T11:34:26.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.802+0000 7ff2728ea640 1 -- 172.21.15.27:0/165779686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff26c15cd10 msgr2=0x7ff26c0b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:26.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.802+0000 7ff2728ea640 1 --2- 172.21.15.27:0/165779686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff26c15cd10 0x7ff26c0b2140 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff264001f80 tx=0x7ff26400a430 comp rx=0 tx=0).stop 2024-01-15T11:34:26.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.806+0000 7ff2728ea640 1 -- 172.21.15.27:0/165779686 shutdown_connections 2024-01-15T11:34:26.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.806+0000 7ff2728ea640 1 --2- 172.21.15.27:0/165779686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff26c15cd10 0x7ff26c0b2140 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:26.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.806+0000 7ff2728ea640 1 --2- 172.21.15.27:0/165779686 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff26c0ae680 0x7ff26c15c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:26.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.806+0000 7ff2728ea640 1 --2- 172.21.15.27:0/165779686 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7ff2580668f0 0x7ff258068db0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:26.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.806+0000 7ff2728ea640 1 --2- 172.21.15.27:0/165779686 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff26c070890 0x7ff26c09c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:26.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.806+0000 7ff2728ea640 1 -- 172.21.15.27:0/165779686 >> 172.21.15.27:0/165779686 conn(0x7ff26c0b0cb0 msgr2=0x7ff26c0b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:26.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.806+0000 7ff2728ea640 1 -- 172.21.15.27:0/165779686 shutdown_connections 2024-01-15T11:34:26.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.806+0000 7ff2728ea640 1 -- 172.21.15.27:0/165779686 wait complete. 2024-01-15T11:34:26.830 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-01-15T11:34:26.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.974+0000 7fae5532a640 1 Processor -- start 2024-01-15T11:34:26.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.974+0000 7fae5532a640 1 -- start start 2024-01-15T11:34:26.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.974+0000 7fae5532a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fae500d04c0 0x7fae50168550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:26.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.974+0000 7fae5532a640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae500d11a0 con 0x7fae5015d7c0 2024-01-15T11:34:26.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.974+0000 7fae5532a640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae500d1480 con 0x7fae50161f20 2024-01-15T11:34:26.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.974+0000 7fae5532a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae500d0f90 con 0x7fae500d04c0 2024-01-15T11:34:26.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.974+0000 7fae4f7fe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fae500d04c0 0x7fae50168550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:26.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.974+0000 7fae4effd640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fae5015d7c0 0x7fae500d3d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42912/0 (socket says 172.21.15.27:42912) 2024-01-15T11:34:26.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.974+0000 7fae4effd640 1 -- 172.21.15.27:0/974581701 learned_addr learned my addr 172.21.15.27:0/974581701 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:26.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.974+0000 7fae4f7fe640 1 -- 172.21.15.27:0/974581701 >> v1:172.21.15.93:6789/0 conn(0x7fae50161f20 legacy=0x7fae500cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:26.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.974+0000 7fae4f7fe640 1 -- 172.21.15.27:0/974581701 >> v1:172.21.15.27:6789/0 conn(0x7fae5015d7c0 legacy=0x7fae500d3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:26.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.974+0000 7fae4f7fe640 1 -- 172.21.15.27:0/974581701 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae500d1760 con 0x7fae500d04c0 2024-01-15T11:34:26.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.978+0000 7fae4f7fe640 1 --2- 172.21.15.27:0/974581701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae500d04c0 0x7fae50168550 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fae48009dc0 tx=0x7fae4801c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a404cbebdddb1db server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:26.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.978+0000 7fae4e7fc640 1 -- 172.21.15.27:0/974581701 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae480a58f0 con 0x7fae500d04c0 2024-01-15T11:34:26.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.978+0000 7fae4e7fc640 1 -- 172.21.15.27:0/974581701 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae480a5a50 con 0x7fae500d04c0 2024-01-15T11:34:26.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.978+0000 7fae4e7fc640 1 -- 172.21.15.27:0/974581701 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae480a5de0 con 0x7fae500d04c0 2024-01-15T11:34:26.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.978+0000 7fae5532a640 1 -- 172.21.15.27:0/974581701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae500d04c0 msgr2=0x7fae50168550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:26.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.978+0000 7fae5532a640 1 --2- 172.21.15.27:0/974581701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae500d04c0 0x7fae50168550 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fae48009dc0 tx=0x7fae4801c830 comp rx=0 tx=0).stop 2024-01-15T11:34:26.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.978+0000 7fae5532a640 1 -- 172.21.15.27:0/974581701 shutdown_connections 2024-01-15T11:34:26.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.978+0000 7fae5532a640 1 --2- 172.21.15.27:0/974581701 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae500d04c0 0x7fae50168550 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:26.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.978+0000 7fae5532a640 1 -- 172.21.15.27:0/974581701 >> 172.21.15.27:0/974581701 conn(0x7fae5008afc0 msgr2=0x7fae500d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:26.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.978+0000 7fae5532a640 1 -- 172.21.15.27:0/974581701 shutdown_connections 2024-01-15T11:34:26.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.978+0000 7fae5532a640 1 -- 172.21.15.27:0/974581701 wait complete. 2024-01-15T11:34:26.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae5532a640 1 Processor -- start 2024-01-15T11:34:26.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae5532a640 1 -- start start 2024-01-15T11:34:26.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae5532a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae500d04c0 0x7fae500caea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:26.987 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae5532a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae5015d7c0 0x7fae5015c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:26.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae5532a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fae5015c830 0x7fae5009d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:26.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae5532a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae500cb3e0 con 0x7fae500d04c0 2024-01-15T11:34:26.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae5532a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5015c680 con 0x7fae5015d7c0 2024-01-15T11:34:26.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae5532a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae500cc220 con 0x7fae5015c830 2024-01-15T11:34:26.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae4effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae500d04c0 0x7fae500caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:26.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae4effd640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae500d04c0 0x7fae500caea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53482/0 (socket says 172.21.15.27:53482) 2024-01-15T11:34:26.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae4effd640 1 -- 172.21.15.27:0/2982942067 learned_addr learned my addr 172.21.15.27:0/2982942067 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:26.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae47fff640 1 --2- 172.21.15.27:0/2982942067 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae5015d7c0 0x7fae5015c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:26.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae4f7fe640 1 --2- 172.21.15.27:0/2982942067 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fae5015c830 0x7fae5009d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:26.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae4effd640 1 -- 172.21.15.27:0/2982942067 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fae5015c830 msgr2=0x7fae5009d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:26.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae4effd640 1 --2- 172.21.15.27:0/2982942067 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fae5015c830 0x7fae5009d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:26.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae4effd640 1 -- 172.21.15.27:0/2982942067 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae5015d7c0 msgr2=0x7fae5015c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:26.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae4effd640 1 --2- 172.21.15.27:0/2982942067 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae5015d7c0 0x7fae5015c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:26.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae4effd640 1 -- 172.21.15.27:0/2982942067 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae48009a70 con 0x7fae500d04c0 2024-01-15T11:34:26.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae4f7fe640 1 --2- 172.21.15.27:0/2982942067 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fae5015c830 0x7fae5009d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:34:26.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae4effd640 1 --2- 172.21.15.27:0/2982942067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae500d04c0 0x7fae500caea0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fae4000c500 tx=0x7fae4000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:26.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae477fe640 1 -- 172.21.15.27:0/2982942067 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae40005cf0 con 0x7fae500d04c0 2024-01-15T11:34:26.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae477fe640 1 -- 172.21.15.27:0/2982942067 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae40005e50 con 0x7fae500d04c0 2024-01-15T11:34:26.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae477fe640 1 -- 172.21.15.27:0/2982942067 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae400072f0 con 0x7fae500d04c0 2024-01-15T11:34:26.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae5532a640 1 -- 172.21.15.27:0/2982942067 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae500b7e40 con 0x7fae500d04c0 2024-01-15T11:34:26.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae5532a640 1 -- 172.21.15.27:0/2982942067 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae500cb8f0 con 0x7fae500d04c0 2024-01-15T11:34:26.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.982+0000 7fae5532a640 1 -- 172.21.15.27:0/2982942067 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae5004e850 con 0x7fae500d04c0 2024-01-15T11:34:26.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.986+0000 7fae477fe640 1 -- 172.21.15.27:0/2982942067 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7fae40007450 con 0x7fae500d04c0 2024-01-15T11:34:26.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.986+0000 7fae477fe640 1 --2- 172.21.15.27:0/2982942067 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fae30066920 0x7fae30068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:26.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.986+0000 7fae477fe640 1 -- 172.21.15.27:0/2982942067 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae400838c0 con 0x7fae500d04c0 2024-01-15T11:34:26.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.986+0000 7fae47fff640 1 --2- 172.21.15.27:0/2982942067 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fae30066920 0x7fae30068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:26.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.986+0000 7fae47fff640 1 --2- 172.21.15.27:0/2982942067 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fae30066920 0x7fae30068de0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fae501f9a10 tx=0x7fae38009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:26.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:26.990+0000 7fae477fe640 1 -- 172.21.15.27:0/2982942067 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fae40050ba0 con 0x7fae500d04c0 2024-01-15T11:34:27.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.166+0000 7fae5532a640 1 -- 172.21.15.27:0/2982942067 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fae5016b6c0 con 0x7fae30066920 2024-01-15T11:34:27.173 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.170+0000 7fae477fe640 1 -- 172.21.15.27:0/2982942067 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fae380095b0 con 0x7fae30066920 2024-01-15T11:34:27.173 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2024-01-15T11:34:27.174 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:34:27.174 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cephfs" 2024-01-15T11:34:27.174 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:34:27.174 INFO:teuthology.orchestra.run.smithi027.stdout:] 2024-01-15T11:34:27.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.170+0000 7fae5532a640 1 -- 172.21.15.27:0/2982942067 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fae30066920 msgr2=0x7fae30068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:27.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.170+0000 7fae5532a640 1 --2- 172.21.15.27:0/2982942067 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fae30066920 0x7fae30068de0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fae501f9a10 tx=0x7fae38009060 comp rx=0 tx=0).stop 2024-01-15T11:34:27.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.170+0000 7fae5532a640 1 -- 172.21.15.27:0/2982942067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae500d04c0 msgr2=0x7fae500caea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:27.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.170+0000 7fae5532a640 1 --2- 172.21.15.27:0/2982942067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae500d04c0 0x7fae500caea0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fae4000c500 tx=0x7fae4000c9c0 comp rx=0 tx=0).stop 2024-01-15T11:34:27.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.170+0000 7fae5532a640 1 -- 172.21.15.27:0/2982942067 shutdown_connections 2024-01-15T11:34:27.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.170+0000 7fae5532a640 1 --2- 172.21.15.27:0/2982942067 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fae5015c830 0x7fae5009d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:27.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.170+0000 7fae5532a640 1 --2- 172.21.15.27:0/2982942067 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fae30066920 0x7fae30068de0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:27.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.170+0000 7fae5532a640 1 --2- 172.21.15.27:0/2982942067 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae5015d7c0 0x7fae5015c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:27.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.170+0000 7fae5532a640 1 --2- 172.21.15.27:0/2982942067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae500d04c0 0x7fae500caea0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:27.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.170+0000 7fae5532a640 1 -- 172.21.15.27:0/2982942067 >> 172.21.15.27:0/2982942067 conn(0x7fae5008afc0 msgr2=0x7fae500b1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:27.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.170+0000 7fae5532a640 1 -- 172.21.15.27:0/2982942067 shutdown_connections 2024-01-15T11:34:27.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.170+0000 7fae5532a640 1 -- 172.21.15.27:0/2982942067 wait complete. 2024-01-15T11:34:27.195 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-15T11:34:27.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.338+0000 7f0ce7a79640 1 Processor -- start 2024-01-15T11:34:27.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.338+0000 7f0ce7a79640 1 -- start start 2024-01-15T11:34:27.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.338+0000 7f0ce7a79640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0ce00b3c60 0x7f0ce00b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:27.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.338+0000 7f0ce7a79640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0ce00b4040 0x7f0ce00ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:27.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.338+0000 7f0ce7a79640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce00b2590 con 0x7f0ce0162190 2024-01-15T11:34:27.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.338+0000 7f0ce7a79640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce00b2870 con 0x7f0ce00b4040 2024-01-15T11:34:27.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.338+0000 7f0ce7a79640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce00b2b50 con 0x7f0ce00b3c60 2024-01-15T11:34:27.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.338+0000 7f0ce5014640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0ce00b4040 0x7f0ce00ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:27.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.338+0000 7f0ce5014640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f0ce00b4040 0x7f0ce00ce5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53488/0 (socket says 172.21.15.27:53488) 2024-01-15T11:34:27.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.338+0000 7f0ce5014640 1 -- 172.21.15.27:0/3292179925 learned_addr learned my addr 172.21.15.27:0/3292179925 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:27.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.338+0000 7f0ce5815640 1 --2- 172.21.15.27:0/3292179925 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0ce00b3c60 0x7f0ce00b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:27.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.338+0000 7f0ce5014640 1 -- 172.21.15.27:0/3292179925 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0ce00b3c60 msgr2=0x7f0ce00b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:27.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.338+0000 7f0ce5014640 1 --2- 172.21.15.27:0/3292179925 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0ce00b3c60 0x7f0ce00b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:27.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.338+0000 7f0ce5014640 1 -- 172.21.15.27:0/3292179925 >> v1:172.21.15.93:6789/0 conn(0x7f0ce0162190 legacy=0x7f0ce0165d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:27.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.338+0000 7f0ce5014640 1 -- 172.21.15.27:0/3292179925 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce00b2e30 con 0x7f0ce00b4040 2024-01-15T11:34:27.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.342+0000 7f0ce5014640 1 --2- 172.21.15.27:0/3292179925 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ce00b4040 0x7f0ce00ce5e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009870 tx=0x7f0cd001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573384b891d2f91 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:27.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.342+0000 7f0ce4813640 1 -- 172.21.15.27:0/3292179925 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00a6040 con 0x7f0ce00b4040 2024-01-15T11:34:27.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.342+0000 7f0ce4813640 1 -- 172.21.15.27:0/3292179925 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd00aa600 con 0x7f0ce00b4040 2024-01-15T11:34:27.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.342+0000 7f0ce4813640 1 -- 172.21.15.27:0/3292179925 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00aa990 con 0x7f0ce00b4040 2024-01-15T11:34:27.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.342+0000 7f0ce7a79640 1 -- 172.21.15.27:0/3292179925 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ce00b4040 msgr2=0x7f0ce00ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:27.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.342+0000 7f0ce7a79640 1 --2- 172.21.15.27:0/3292179925 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ce00b4040 0x7f0ce00ce5e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009870 tx=0x7f0cd001c510 comp rx=0 tx=0).stop 2024-01-15T11:34:27.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.342+0000 7f0ce7a79640 1 -- 172.21.15.27:0/3292179925 shutdown_connections 2024-01-15T11:34:27.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.342+0000 7f0ce7a79640 1 --2- 172.21.15.27:0/3292179925 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ce00b4040 0x7f0ce00ce5e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:27.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.342+0000 7f0ce7a79640 1 --2- 172.21.15.27:0/3292179925 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0ce00b3c60 0x7f0ce00b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:27.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.342+0000 7f0ce7a79640 1 -- 172.21.15.27:0/3292179925 >> 172.21.15.27:0/3292179925 conn(0x7f0ce00b0cb0 msgr2=0x7f0ce00b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:27.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.342+0000 7f0ce7a79640 1 -- 172.21.15.27:0/3292179925 shutdown_connections 2024-01-15T11:34:27.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.342+0000 7f0ce7a79640 1 -- 172.21.15.27:0/3292179925 wait complete. 2024-01-15T11:34:27.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.346+0000 7f0ce7a79640 1 Processor -- start 2024-01-15T11:34:27.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.346+0000 7f0ce7a79640 1 -- start start 2024-01-15T11:34:27.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.346+0000 7f0ce7a79640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ce00b3c60 0x7f0ce0164820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:27.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.346+0000 7f0ce7a79640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ce0162190 0x7f0ce009aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:27.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.346+0000 7f0ce7a79640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0ce015afb0 0x7f0ce01571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:27.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.346+0000 7f0ce7a79640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce009c2f0 con 0x7f0ce0162190 2024-01-15T11:34:27.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.346+0000 7f0ce7a79640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce009b250 con 0x7f0ce00b3c60 2024-01-15T11:34:27.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.346+0000 7f0ce7a79640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce009b530 con 0x7f0ce015afb0 2024-01-15T11:34:27.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.346+0000 7f0ce5014640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ce0162190 0x7f0ce009aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:27.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.346+0000 7f0ce5014640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ce0162190 0x7f0ce009aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53496/0 (socket says 172.21.15.27:53496) 2024-01-15T11:34:27.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.346+0000 7f0ce5014640 1 -- 172.21.15.27:0/901971901 learned_addr learned my addr 172.21.15.27:0/901971901 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:27.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.346+0000 7f0ce5815640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ce00b3c60 0x7f0ce0164820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:27.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.346+0000 7f0ce6016640 1 --2- 172.21.15.27:0/901971901 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0ce015afb0 0x7f0ce01571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:27.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.346+0000 7f0ce5014640 1 -- 172.21.15.27:0/901971901 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0ce015afb0 msgr2=0x7f0ce01571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:27.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.346+0000 7f0ce5014640 1 --2- 172.21.15.27:0/901971901 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0ce015afb0 0x7f0ce01571c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:27.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.346+0000 7f0ce5014640 1 -- 172.21.15.27:0/901971901 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ce00b3c60 msgr2=0x7f0ce0164820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:27.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.346+0000 7f0ce5014640 1 --2- 172.21.15.27:0/901971901 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ce00b3c60 0x7f0ce0164820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:27.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.346+0000 7f0ce5014640 1 -- 172.21.15.27:0/901971901 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd00094d0 con 0x7f0ce0162190 2024-01-15T11:34:27.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.346+0000 7f0ce5014640 1 --2- 172.21.15.27:0/901971901 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ce0162190 0x7f0ce009aa00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0cd001abc0 tx=0x7f0cd001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:27.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.346+0000 7f0cd67fc640 1 -- 172.21.15.27:0/901971901 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00b3800 con 0x7f0ce0162190 2024-01-15T11:34:27.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.346+0000 7f0cd67fc640 1 -- 172.21.15.27:0/901971901 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd00b3960 con 0x7f0ce0162190 2024-01-15T11:34:27.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.346+0000 7f0cd67fc640 1 -- 172.21.15.27:0/901971901 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00b3cd0 con 0x7f0ce0162190 2024-01-15T11:34:27.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.346+0000 7f0ce7a79640 1 -- 172.21.15.27:0/901971901 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce009b810 con 0x7f0ce0162190 2024-01-15T11:34:27.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.346+0000 7f0ce7a79640 1 -- 172.21.15.27:0/901971901 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce009bdd0 con 0x7f0ce0162190 2024-01-15T11:34:27.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.350+0000 7f0ce7a79640 1 -- 172.21.15.27:0/901971901 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce00671f0 con 0x7f0ce0162190 2024-01-15T11:34:27.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.350+0000 7f0cd67fc640 1 -- 172.21.15.27:0/901971901 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f0cd00bc3e0 con 0x7f0ce0162190 2024-01-15T11:34:27.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.350+0000 7f0cd67fc640 1 --2- 172.21.15.27:0/901971901 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f0cc40668f0 0x7f0cc4068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:27.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.350+0000 7f0cd67fc640 1 -- 172.21.15.27:0/901971901 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0cd011e820 con 0x7f0ce0162190 2024-01-15T11:34:27.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.350+0000 7f0ce5815640 1 --2- 172.21.15.27:0/901971901 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f0cc40668f0 0x7f0cc4068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:27.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.354+0000 7f0ce5815640 1 --2- 172.21.15.27:0/901971901 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f0cc40668f0 0x7f0cc4068db0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc007a60 tx=0x7f0cdc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:27.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.354+0000 7f0cd67fc640 1 -- 172.21.15.27:0/901971901 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0cd00ebaf0 con 0x7f0ce0162190 2024-01-15T11:34:27.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.514+0000 7f0ce7a79640 1 -- 172.21.15.27:0/901971901 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0ce006b460 con 0x7f0ce0162190 2024-01-15T11:34:27.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.514+0000 7f0cd67fc640 1 -- 172.21.15.27:0/901971901 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0cd00c20c0 con 0x7f0ce0162190 2024-01-15T11:34:27.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.514+0000 7f0ce7a79640 1 -- 172.21.15.27:0/901971901 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f0cc40668f0 msgr2=0x7f0cc4068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:27.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.514+0000 7f0ce7a79640 1 --2- 172.21.15.27:0/901971901 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f0cc40668f0 0x7f0cc4068db0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc007a60 tx=0x7f0cdc008040 comp rx=0 tx=0).stop 2024-01-15T11:34:27.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.514+0000 7f0ce7a79640 1 -- 172.21.15.27:0/901971901 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ce0162190 msgr2=0x7f0ce009aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:27.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.514+0000 7f0ce7a79640 1 --2- 172.21.15.27:0/901971901 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ce0162190 0x7f0ce009aa00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0cd001abc0 tx=0x7f0cd001ad50 comp rx=0 tx=0).stop 2024-01-15T11:34:27.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.514+0000 7f0ce7a79640 1 -- 172.21.15.27:0/901971901 shutdown_connections 2024-01-15T11:34:27.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.514+0000 7f0ce7a79640 1 --2- 172.21.15.27:0/901971901 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0ce015afb0 0x7f0ce01571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:27.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.514+0000 7f0ce7a79640 1 --2- 172.21.15.27:0/901971901 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0ce0162190 0x7f0ce009aa00 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:27.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.514+0000 7f0ce7a79640 1 --2- 172.21.15.27:0/901971901 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f0cc40668f0 0x7f0cc4068db0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:27.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.514+0000 7f0ce7a79640 1 --2- 172.21.15.27:0/901971901 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ce00b3c60 0x7f0ce0164820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:27.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.514+0000 7f0ce7a79640 1 -- 172.21.15.27:0/901971901 >> 172.21.15.27:0/901971901 conn(0x7f0ce00b0cb0 msgr2=0x7f0ce00b02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:27.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.518+0000 7f0ce7a79640 1 -- 172.21.15.27:0/901971901 shutdown_connections 2024-01-15T11:34:27.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.518+0000 7f0ce7a79640 1 -- 172.21.15.27:0/901971901 wait complete. 2024-01-15T11:34:27.540 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-01-15T11:34:27.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.682+0000 7f69f68ea640 1 Processor -- start 2024-01-15T11:34:27.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.682+0000 7f69f68ea640 1 -- start start 2024-01-15T11:34:27.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.686+0000 7f69f68ea640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f69f0159f00 0x7f69f00ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:27.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.686+0000 7f69f68ea640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f0072950 con 0x7f69f00ae680 2024-01-15T11:34:27.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.686+0000 7f69f68ea640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f006e2b0 con 0x7f69f0070890 2024-01-15T11:34:27.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.686+0000 7f69f68ea640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f006c6f0 con 0x7f69f0159f00 2024-01-15T11:34:27.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.686+0000 7f69effff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f69f0159f00 0x7f69f00ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:27.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.686+0000 7f69ef7fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f69f00ae680 0x7f69f00cd3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42924/0 (socket says 172.21.15.27:42924) 2024-01-15T11:34:27.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.686+0000 7f69ef7fe640 1 -- 172.21.15.27:0/4214083204 learned_addr learned my addr 172.21.15.27:0/4214083204 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:27.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.686+0000 7f69effff640 1 -- 172.21.15.27:0/4214083204 >> v1:172.21.15.93:6789/0 conn(0x7f69f0070890 legacy=0x7f69f0070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:27.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.686+0000 7f69effff640 1 -- 172.21.15.27:0/4214083204 >> v1:172.21.15.27:6789/0 conn(0x7f69f00ae680 legacy=0x7f69f00cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:27.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.686+0000 7f69effff640 1 -- 172.21.15.27:0/4214083204 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f006e550 con 0x7f69f0159f00 2024-01-15T11:34:27.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.686+0000 7f69effff640 1 --2- 172.21.15.27:0/4214083204 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69f0159f00 0x7f69f00ccea0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f69e00097c0 tx=0x7f69e001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104a5f85c4618119 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:27.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.686+0000 7f69eeffd640 1 -- 172.21.15.27:0/4214083204 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e00ac630 con 0x7f69f0159f00 2024-01-15T11:34:27.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.690+0000 7f69eeffd640 1 -- 172.21.15.27:0/4214083204 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e00ac790 con 0x7f69f0159f00 2024-01-15T11:34:27.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.690+0000 7f69eeffd640 1 -- 172.21.15.27:0/4214083204 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e00acb20 con 0x7f69f0159f00 2024-01-15T11:34:27.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.690+0000 7f69f68ea640 1 -- 172.21.15.27:0/4214083204 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69f0159f00 msgr2=0x7f69f00ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:27.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.690+0000 7f69f68ea640 1 --2- 172.21.15.27:0/4214083204 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69f0159f00 0x7f69f00ccea0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f69e00097c0 tx=0x7f69e001c450 comp rx=0 tx=0).stop 2024-01-15T11:34:27.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.690+0000 7f69f68ea640 1 -- 172.21.15.27:0/4214083204 shutdown_connections 2024-01-15T11:34:27.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.690+0000 7f69f68ea640 1 --2- 172.21.15.27:0/4214083204 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69f0159f00 0x7f69f00ccea0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:27.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.690+0000 7f69f68ea640 1 -- 172.21.15.27:0/4214083204 >> 172.21.15.27:0/4214083204 conn(0x7f69f00b0cb0 msgr2=0x7f69f00b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:27.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.690+0000 7f69f68ea640 1 -- 172.21.15.27:0/4214083204 shutdown_connections 2024-01-15T11:34:27.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.690+0000 7f69f68ea640 1 -- 172.21.15.27:0/4214083204 wait complete. 2024-01-15T11:34:27.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.690+0000 7f69f68ea640 1 Processor -- start 2024-01-15T11:34:27.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.690+0000 7f69f68ea640 1 -- start start 2024-01-15T11:34:27.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.690+0000 7f69f68ea640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69f0070890 0x7f69f013f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:27.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.690+0000 7f69f68ea640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69f00ae680 0x7f69f0155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:27.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.690+0000 7f69f68ea640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f69f01562f0 0x7f69f009ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:27.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.690+0000 7f69f68ea640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f0156ae0 con 0x7f69f0070890 2024-01-15T11:34:27.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.690+0000 7f69f68ea640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f0156800 con 0x7f69f00ae680 2024-01-15T11:34:27.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.690+0000 7f69f68ea640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f0151160 con 0x7f69f01562f0 2024-01-15T11:34:27.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.690+0000 7f69effff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69f0070890 0x7f69f013f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:27.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.690+0000 7f69effff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69f0070890 0x7f69f013f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53514/0 (socket says 172.21.15.27:53514) 2024-01-15T11:34:27.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.690+0000 7f69effff640 1 -- 172.21.15.27:0/4208344521 learned_addr learned my addr 172.21.15.27:0/4208344521 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:27.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.690+0000 7f69ef7fe640 1 --2- 172.21.15.27:0/4208344521 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69f00ae680 0x7f69f0155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:27.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.690+0000 7f69f4e87640 1 --2- 172.21.15.27:0/4208344521 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f69f01562f0 0x7f69f009ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:27.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.694+0000 7f69effff640 1 -- 172.21.15.27:0/4208344521 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f69f01562f0 msgr2=0x7f69f009ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:27.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.694+0000 7f69effff640 1 --2- 172.21.15.27:0/4208344521 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f69f01562f0 0x7f69f009ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:27.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.694+0000 7f69effff640 1 -- 172.21.15.27:0/4208344521 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69f00ae680 msgr2=0x7f69f0155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:27.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.694+0000 7f69effff640 1 --2- 172.21.15.27:0/4208344521 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69f00ae680 0x7f69f0155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:27.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.694+0000 7f69effff640 1 -- 172.21.15.27:0/4208344521 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e0009420 con 0x7f69f0070890 2024-01-15T11:34:27.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.694+0000 7f69f4e87640 1 --2- 172.21.15.27:0/4208344521 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f69f01562f0 0x7f69f009ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:34:27.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.694+0000 7f69effff640 1 --2- 172.21.15.27:0/4208344521 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69f0070890 0x7f69f013f940 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f69e0019060 tx=0x7f69e00191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:27.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.694+0000 7f69ecff9640 1 -- 172.21.15.27:0/4208344521 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e00b5610 con 0x7f69f0070890 2024-01-15T11:34:27.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.694+0000 7f69ecff9640 1 -- 172.21.15.27:0/4208344521 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e00b5770 con 0x7f69f0070890 2024-01-15T11:34:27.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.694+0000 7f69ecff9640 1 -- 172.21.15.27:0/4208344521 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e00b5b00 con 0x7f69f0070890 2024-01-15T11:34:27.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.694+0000 7f69f68ea640 1 -- 172.21.15.27:0/4208344521 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f0151440 con 0x7f69f0070890 2024-01-15T11:34:27.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.694+0000 7f69f68ea640 1 -- 172.21.15.27:0/4208344521 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f013fe80 con 0x7f69f0070890 2024-01-15T11:34:27.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.694+0000 7f69f68ea640 1 -- 172.21.15.27:0/4208344521 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f00671f0 con 0x7f69f0070890 2024-01-15T11:34:27.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.694+0000 7f69ecff9640 1 -- 172.21.15.27:0/4208344521 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f69e00b3040 con 0x7f69f0070890 2024-01-15T11:34:27.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.694+0000 7f69ecff9640 1 --2- 172.21.15.27:0/4208344521 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f69dc066920 0x7f69dc068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:27.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.694+0000 7f69ecff9640 1 -- 172.21.15.27:0/4208344521 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69e011e3d0 con 0x7f69f0070890 2024-01-15T11:34:27.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.694+0000 7f69ef7fe640 1 --2- 172.21.15.27:0/4208344521 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f69dc066920 0x7f69dc068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:27.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.698+0000 7f69ef7fe640 1 --2- 172.21.15.27:0/4208344521 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f69dc066920 0x7f69dc068de0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f69f01f7660 tx=0x7f69e4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:27.704 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.698+0000 7f69ecff9640 1 -- 172.21.15.27:0/4208344521 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f69e00eb580 con 0x7f69f0070890 2024-01-15T11:34:27.884 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:27.882+0000 7f69f68ea640 1 -- 172.21.15.27:0/4208344521 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7f69f0071430 con 0x7f69dc066920 2024-01-15T11:34:27.891 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:34:27.889+0000 7fbe8e6c6640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:34:27.891 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:34:27.889+0000 7fbe8e6c6640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:34:27.891 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:34:27.889+0000 7fbe8e6c6640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:34:27.891 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:34:27.889+0000 7fbe8e6c6640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:34:27.891 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:34:27.889+0000 7fbe8e6c6640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:34:28.065 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.062+0000 7f69ecff9640 1 -- 172.21.15.27:0/4208344521 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f69e4001510 con 0x7f69dc066920 2024-01-15T11:34:28.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.062+0000 7f69f68ea640 1 -- 172.21.15.27:0/4208344521 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f69dc066920 msgr2=0x7f69dc068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:28.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.062+0000 7f69f68ea640 1 --2- 172.21.15.27:0/4208344521 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f69dc066920 0x7f69dc068de0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f69f01f7660 tx=0x7f69e4009040 comp rx=0 tx=0).stop 2024-01-15T11:34:28.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.062+0000 7f69f68ea640 1 -- 172.21.15.27:0/4208344521 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69f0070890 msgr2=0x7f69f013f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:28.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.062+0000 7f69f68ea640 1 --2- 172.21.15.27:0/4208344521 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69f0070890 0x7f69f013f940 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f69e0019060 tx=0x7f69e00191f0 comp rx=0 tx=0).stop 2024-01-15T11:34:28.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.062+0000 7f69f68ea640 1 -- 172.21.15.27:0/4208344521 shutdown_connections 2024-01-15T11:34:28.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.062+0000 7f69f68ea640 1 --2- 172.21.15.27:0/4208344521 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f69f01562f0 0x7f69f009ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:28.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.062+0000 7f69f68ea640 1 --2- 172.21.15.27:0/4208344521 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f69dc066920 0x7f69dc068de0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:28.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.062+0000 7f69f68ea640 1 --2- 172.21.15.27:0/4208344521 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69f00ae680 0x7f69f0155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:28.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.062+0000 7f69f68ea640 1 --2- 172.21.15.27:0/4208344521 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69f0070890 0x7f69f013f940 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:28.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.062+0000 7f69f68ea640 1 -- 172.21.15.27:0/4208344521 >> 172.21.15.27:0/4208344521 conn(0x7f69f00b0cb0 msgr2=0x7f69f00b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:28.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.062+0000 7f69f68ea640 1 -- 172.21.15.27:0/4208344521 shutdown_connections 2024-01-15T11:34:28.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.062+0000 7f69f68ea640 1 -- 172.21.15.27:0/4208344521 wait complete. 2024-01-15T11:34:28.087 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-01-15T11:34:28.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.230+0000 7f03e5479640 1 Processor -- start 2024-01-15T11:34:28.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.230+0000 7f03e5479640 1 -- start start 2024-01-15T11:34:28.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.230+0000 7f03e5479640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f03e00cdfb0 0x7f03e00abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:28.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.230+0000 7f03e5479640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f03e015a710 0x7f03e00ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:28.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.230+0000 7f03e5479640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f03e00cbd50 0x7f03e00cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:28.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.230+0000 7f03e5479640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e00cca80 con 0x7f03e015a710 2024-01-15T11:34:28.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.230+0000 7f03e5479640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e00ce8d0 con 0x7f03e00cdfb0 2024-01-15T11:34:28.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.230+0000 7f03e5479640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e00b2710 con 0x7f03e00cbd50 2024-01-15T11:34:28.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.234+0000 7f03d7fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f03e015a710 0x7f03e00ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:28.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.234+0000 7f03d7fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f03e015a710 0x7f03e00ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53516/0 (socket says 172.21.15.27:53516) 2024-01-15T11:34:28.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.234+0000 7f03d7fff640 1 -- 172.21.15.27:0/3447064054 learned_addr learned my addr 172.21.15.27:0/3447064054 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:28.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.234+0000 7f03deffd640 1 --2- 172.21.15.27:0/3447064054 >> v2:172.21.15.93:3300/0 conn(0x7f03e00cdfb0 0x7f03e00abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:28.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.234+0000 7f03df7fe640 1 --2- 172.21.15.27:0/3447064054 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f03e00cbd50 0x7f03e00cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:28.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.234+0000 7f03d7fff640 1 -- 172.21.15.27:0/3447064054 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f03e00cbd50 msgr2=0x7f03e00cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:28.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.234+0000 7f03d7fff640 1 --2- 172.21.15.27:0/3447064054 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f03e00cbd50 0x7f03e00cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:28.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.234+0000 7f03d7fff640 1 -- 172.21.15.27:0/3447064054 >> v2:172.21.15.93:3300/0 conn(0x7f03e00cdfb0 msgr2=0x7f03e00abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:28.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.234+0000 7f03d7fff640 1 --2- 172.21.15.27:0/3447064054 >> v2:172.21.15.93:3300/0 conn(0x7f03e00cdfb0 0x7f03e00abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:28.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.234+0000 7f03d7fff640 1 -- 172.21.15.27:0/3447064054 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e00b29f0 con 0x7f03e015a710 2024-01-15T11:34:28.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.234+0000 7f03d7fff640 1 --2- 172.21.15.27:0/3447064054 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03e015a710 0x7f03e00ce390 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f03e006c270 tx=0x7f03c801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c00c342dc261585 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:28.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.234+0000 7f03de7fc640 1 -- 172.21.15.27:0/3447064054 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c80aa5f0 con 0x7f03e015a710 2024-01-15T11:34:28.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.234+0000 7f03de7fc640 1 -- 172.21.15.27:0/3447064054 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c80aa750 con 0x7f03e015a710 2024-01-15T11:34:28.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.234+0000 7f03de7fc640 1 -- 172.21.15.27:0/3447064054 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c80aaae0 con 0x7f03e015a710 2024-01-15T11:34:28.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03e5479640 1 -- 172.21.15.27:0/3447064054 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03e015a710 msgr2=0x7f03e00ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:28.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03e5479640 1 --2- 172.21.15.27:0/3447064054 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03e015a710 0x7f03e00ce390 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f03e006c270 tx=0x7f03c801c4d0 comp rx=0 tx=0).stop 2024-01-15T11:34:28.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03e5479640 1 -- 172.21.15.27:0/3447064054 shutdown_connections 2024-01-15T11:34:28.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03e5479640 1 --2- 172.21.15.27:0/3447064054 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f03e00cbd50 0x7f03e00cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:28.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03e5479640 1 --2- 172.21.15.27:0/3447064054 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03e015a710 0x7f03e00ce390 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:28.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03e5479640 1 --2- 172.21.15.27:0/3447064054 >> v2:172.21.15.93:3300/0 conn(0x7f03e00cdfb0 0x7f03e00abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:28.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03e5479640 1 -- 172.21.15.27:0/3447064054 >> 172.21.15.27:0/3447064054 conn(0x7f03e00b0cb0 msgr2=0x7f03e00b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:28.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03e5479640 1 -- 172.21.15.27:0/3447064054 shutdown_connections 2024-01-15T11:34:28.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03e5479640 1 -- 172.21.15.27:0/3447064054 wait complete. 2024-01-15T11:34:28.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03e5479640 1 Processor -- start 2024-01-15T11:34:28.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03e5479640 1 -- start start 2024-01-15T11:34:28.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03e5479640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03e00cbd50 0x7f03e0153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:28.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03e5479640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f03e00cdfb0 0x7f03e0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:28.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03e5479640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03e015a710 0x7f03e015dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:28.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03e5479640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e01588d0 con 0x7f03e015a710 2024-01-15T11:34:28.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03e5479640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e0154ae0 con 0x7f03e00cbd50 2024-01-15T11:34:28.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03e5479640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e0072480 con 0x7f03e00cdfb0 2024-01-15T11:34:28.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03df7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03e015a710 0x7f03e015dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:28.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03df7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03e015a710 0x7f03e015dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53530/0 (socket says 172.21.15.27:53530) 2024-01-15T11:34:28.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03df7fe640 1 -- 172.21.15.27:0/3668109754 learned_addr learned my addr 172.21.15.27:0/3668109754 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:28.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03d7fff640 1 --2- 172.21.15.27:0/3668109754 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f03e00cdfb0 0x7f03e0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:28.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03deffd640 1 --2- 172.21.15.27:0/3668109754 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03e00cbd50 0x7f03e0153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:28.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03df7fe640 1 -- 172.21.15.27:0/3668109754 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f03e00cdfb0 msgr2=0x7f03e0154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:28.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03df7fe640 1 --2- 172.21.15.27:0/3668109754 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f03e00cdfb0 0x7f03e0154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:28.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03df7fe640 1 -- 172.21.15.27:0/3668109754 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03e00cbd50 msgr2=0x7f03e0153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:28.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03df7fe640 1 --2- 172.21.15.27:0/3668109754 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03e00cbd50 0x7f03e0153c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:28.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.238+0000 7f03df7fe640 1 -- 172.21.15.27:0/3668109754 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c80094d0 con 0x7f03e015a710 2024-01-15T11:34:28.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.242+0000 7f03df7fe640 1 --2- 172.21.15.27:0/3668109754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03e015a710 0x7f03e015dff0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f03d8009dd0 tx=0x7f03d800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:28.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.242+0000 7f03d77fe640 1 -- 172.21.15.27:0/3668109754 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8014480 con 0x7f03e015a710 2024-01-15T11:34:28.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.242+0000 7f03d77fe640 1 -- 172.21.15.27:0/3668109754 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d800f040 con 0x7f03e015a710 2024-01-15T11:34:28.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.242+0000 7f03d77fe640 1 -- 172.21.15.27:0/3668109754 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8014840 con 0x7f03e015a710 2024-01-15T11:34:28.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.242+0000 7f03e5479640 1 -- 172.21.15.27:0/3668109754 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e0154140 con 0x7f03e015a710 2024-01-15T11:34:28.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.242+0000 7f03e5479640 1 -- 172.21.15.27:0/3668109754 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e0071580 con 0x7f03e015a710 2024-01-15T11:34:28.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.242+0000 7f03e5479640 1 -- 172.21.15.27:0/3668109754 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e00671f0 con 0x7f03e015a710 2024-01-15T11:34:28.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.242+0000 7f03d77fe640 1 -- 172.21.15.27:0/3668109754 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 86160+0+0 (secure 0 0 0) 0x7f03d80149a0 con 0x7f03e015a710 2024-01-15T11:34:28.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.242+0000 7f03d77fe640 1 --2- 172.21.15.27:0/3668109754 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f03c00668f0 0x7f03c0068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:28.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.242+0000 7f03d77fe640 1 -- 172.21.15.27:0/3668109754 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03d8084ed0 con 0x7f03e015a710 2024-01-15T11:34:28.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.242+0000 7f03deffd640 1 --2- 172.21.15.27:0/3668109754 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f03c00668f0 0x7f03c0068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:28.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.246+0000 7f03deffd640 1 --2- 172.21.15.27:0/3668109754 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f03c00668f0 0x7f03c0068db0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f03d0009ae0 tx=0x7f03d0009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:28.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.246+0000 7f03d77fe640 1 -- 172.21.15.27:0/3668109754 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f03d8052120 con 0x7f03e015a710 2024-01-15T11:34:28.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.430+0000 7f03e5479640 1 -- 172.21.15.27:0/3668109754 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) v1 -- 0x7f03e0154c20 con 0x7f03c00668f0 2024-01-15T11:34:28.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.434+0000 7f03d77fe640 1 -- 172.21.15.27:0/3668109754 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7f03e0154c20 con 0x7f03c00668f0 2024-01-15T11:34:28.439 INFO:teuthology.orchestra.run.smithi027.stdout:/volumes/_nogroup/sv1/9c025116-e3bd-4173-8757-8674a72f7a6b 2024-01-15T11:34:28.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.438+0000 7f03e5479640 1 -- 172.21.15.27:0/3668109754 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f03c00668f0 msgr2=0x7f03c0068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:28.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.438+0000 7f03e5479640 1 --2- 172.21.15.27:0/3668109754 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f03c00668f0 0x7f03c0068db0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f03d0009ae0 tx=0x7f03d0009190 comp rx=0 tx=0).stop 2024-01-15T11:34:28.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.438+0000 7f03e5479640 1 -- 172.21.15.27:0/3668109754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03e015a710 msgr2=0x7f03e015dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:28.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.438+0000 7f03e5479640 1 --2- 172.21.15.27:0/3668109754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03e015a710 0x7f03e015dff0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f03d8009dd0 tx=0x7f03d800c490 comp rx=0 tx=0).stop 2024-01-15T11:34:28.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.438+0000 7f03e5479640 1 -- 172.21.15.27:0/3668109754 shutdown_connections 2024-01-15T11:34:28.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.438+0000 7f03e5479640 1 --2- 172.21.15.27:0/3668109754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03e015a710 0x7f03e015dff0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:28.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.438+0000 7f03e5479640 1 --2- 172.21.15.27:0/3668109754 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f03e00cdfb0 0x7f03e0154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:28.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.438+0000 7f03e5479640 1 --2- 172.21.15.27:0/3668109754 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f03c00668f0 0x7f03c0068db0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:28.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.438+0000 7f03e5479640 1 --2- 172.21.15.27:0/3668109754 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03e00cbd50 0x7f03e0153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:28.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.438+0000 7f03e5479640 1 -- 172.21.15.27:0/3668109754 >> 172.21.15.27:0/3668109754 conn(0x7f03e00b0cb0 msgr2=0x7f03e00b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:28.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.438+0000 7f03e5479640 1 -- 172.21.15.27:0/3668109754 shutdown_connections 2024-01-15T11:34:28.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:28.438+0000 7f03e5479640 1 -- 172.21.15.27:0/3668109754 wait complete. 2024-01-15T11:34:28.461 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 3 files each 1024MB size under directory volumes/_nogroup/sv1/9c025116-e3bd-4173-8757-8674a72f7a6b 2024-01-15T11:34:28.461 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:34:28.461 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T11:34:28.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:34:28.472 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/9c025116-e3bd-4173-8757-8674a72f7a6b/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-01-15T11:34:36.483 INFO:teuthology.orchestra.run.smithi027.stderr:1024+0 records in 2024-01-15T11:34:36.484 INFO:teuthology.orchestra.run.smithi027.stderr:1024+0 records out 2024-01-15T11:34:36.484 INFO:teuthology.orchestra.run.smithi027.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.94885 s, 135 MB/s 2024-01-15T11:34:36.485 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:34:36.485 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T11:34:36.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:34:36.496 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/9c025116-e3bd-4173-8757-8674a72f7a6b/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-01-15T11:34:43.030 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:34:43.035 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:34:44.744 INFO:teuthology.orchestra.run.smithi027.stderr:1024+0 records in 2024-01-15T11:34:44.744 INFO:teuthology.orchestra.run.smithi027.stderr:1024+0 records out 2024-01-15T11:34:44.745 INFO:teuthology.orchestra.run.smithi027.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.19441 s, 131 MB/s 2024-01-15T11:34:44.746 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:34:44.746 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T11:34:44.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:34:44.755 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/9c025116-e3bd-4173-8757-8674a72f7a6b/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-01-15T11:34:52.970 INFO:teuthology.orchestra.run.smithi027.stderr:1024+0 records in 2024-01-15T11:34:52.972 INFO:teuthology.orchestra.run.smithi027.stderr:1024+0 records out 2024-01-15T11:34:52.972 INFO:teuthology.orchestra.run.smithi027.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.16332 s, 132 MB/s 2024-01-15T11:34:52.974 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/clone_delay_every_regfile 2 2024-01-15T11:34:53.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.114+0000 7f67cdde7640 1 Processor -- start 2024-01-15T11:34:53.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.118+0000 7f67cdde7640 1 -- start start 2024-01-15T11:34:53.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.118+0000 7f67cdde7640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f67c806e3f0 0x7f67c815f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:53.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.118+0000 7f67cdde7640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67c80ce5d0 0x7f67c815bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:53.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.118+0000 7f67cdde7640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c8159630 con 0x7f67c80cb9b0 2024-01-15T11:34:53.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.118+0000 7f67cdde7640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c806e860 con 0x7f67c806e3f0 2024-01-15T11:34:53.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.118+0000 7f67cdde7640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c815bba0 con 0x7f67c80ce5d0 2024-01-15T11:34:53.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.118+0000 7f67c6ffd640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f67c806e3f0 0x7f67c815f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:53.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.118+0000 7f67c6ffd640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f67c806e3f0 0x7f67c815f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45300/0 (socket says 172.21.15.27:45300) 2024-01-15T11:34:53.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.118+0000 7f67c77fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f67c80cb9b0 0x7f67c80cbd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44860/0 (socket says 172.21.15.27:44860) 2024-01-15T11:34:53.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.118+0000 7f67c6ffd640 1 -- 172.21.15.27:0/2582156746 learned_addr learned my addr 172.21.15.27:0/2582156746 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:53.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.118+0000 7f67c7fff640 1 --2- 172.21.15.27:0/2582156746 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67c80ce5d0 0x7f67c815bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:53.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.118+0000 7f67c6ffd640 1 -- 172.21.15.27:0/2582156746 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67c80ce5d0 msgr2=0x7f67c815bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:53.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.118+0000 7f67c6ffd640 1 --2- 172.21.15.27:0/2582156746 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67c80ce5d0 0x7f67c815bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:53.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.118+0000 7f67c6ffd640 1 -- 172.21.15.27:0/2582156746 >> v1:172.21.15.27:6789/0 conn(0x7f67c80cb9b0 legacy=0x7f67c80cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:53.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.118+0000 7f67c6ffd640 1 -- 172.21.15.27:0/2582156746 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c815f6d0 con 0x7f67c806e3f0 2024-01-15T11:34:53.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.118+0000 7f67c7fff640 1 --2- 172.21.15.27:0/2582156746 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67c80ce5d0 0x7f67c815bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:34:53.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.118+0000 7f67c67fc640 1 -- 172.21.15.27:0/2582156746 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305057594 0 0) 0x7f67c8159630 con 0x7f67c80cb9b0 2024-01-15T11:34:53.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.122+0000 7f67c6ffd640 1 --2- 172.21.15.27:0/2582156746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67c806e3f0 0x7f67c815f190 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f67bc009870 tx=0x7f67bc01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3899bc1f0b585f server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:53.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.122+0000 7f67c67fc640 1 -- 172.21.15.27:0/2582156746 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc0ab610 con 0x7f67c806e3f0 2024-01-15T11:34:53.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.122+0000 7f67c67fc640 1 -- 172.21.15.27:0/2582156746 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67bc0ab770 con 0x7f67c806e3f0 2024-01-15T11:34:53.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.122+0000 7f67c67fc640 1 -- 172.21.15.27:0/2582156746 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc0abb00 con 0x7f67c806e3f0 2024-01-15T11:34:53.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.122+0000 7f67cdde7640 1 -- 172.21.15.27:0/2582156746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67c806e3f0 msgr2=0x7f67c815f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:53.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.122+0000 7f67cdde7640 1 --2- 172.21.15.27:0/2582156746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67c806e3f0 0x7f67c815f190 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f67bc009870 tx=0x7f67bc01c540 comp rx=0 tx=0).stop 2024-01-15T11:34:53.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.122+0000 7f67cdde7640 1 -- 172.21.15.27:0/2582156746 shutdown_connections 2024-01-15T11:34:53.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.122+0000 7f67cdde7640 1 --2- 172.21.15.27:0/2582156746 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67c80ce5d0 0x7f67c815bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:53.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.122+0000 7f67cdde7640 1 --2- 172.21.15.27:0/2582156746 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67c806e3f0 0x7f67c815f190 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:53.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.122+0000 7f67cdde7640 1 -- 172.21.15.27:0/2582156746 >> 172.21.15.27:0/2582156746 conn(0x7f67c80b0cb0 msgr2=0x7f67c80b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:53.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.122+0000 7f67cdde7640 1 -- 172.21.15.27:0/2582156746 shutdown_connections 2024-01-15T11:34:53.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.122+0000 7f67cdde7640 1 -- 172.21.15.27:0/2582156746 wait complete. 2024-01-15T11:34:53.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.122+0000 7f67cdde7640 1 Processor -- start 2024-01-15T11:34:53.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.122+0000 7f67cdde7640 1 -- start start 2024-01-15T11:34:53.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.126+0000 7f67cdde7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67c806e3f0 0x7f67c81472c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:53.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.126+0000 7f67cdde7640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67c80cb9b0 0x7f67c80af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:53.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.126+0000 7f67cdde7640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67c80ce5d0 0x7f67c8145230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:53.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.126+0000 7f67cdde7640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c8147bc0 con 0x7f67c806e3f0 2024-01-15T11:34:53.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.126+0000 7f67cdde7640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c8147ea0 con 0x7f67c80cb9b0 2024-01-15T11:34:53.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.126+0000 7f67cdde7640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c8148180 con 0x7f67c80ce5d0 2024-01-15T11:34:53.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.126+0000 7f67c77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67c806e3f0 0x7f67c81472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:53.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.126+0000 7f67c77fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67c806e3f0 0x7f67c81472c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45302/0 (socket says 172.21.15.27:45302) 2024-01-15T11:34:53.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.126+0000 7f67c77fe640 1 -- 172.21.15.27:0/1568030983 learned_addr learned my addr 172.21.15.27:0/1568030983 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:53.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.126+0000 7f67c7fff640 1 --2- 172.21.15.27:0/1568030983 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67c80ce5d0 0x7f67c8145230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:53.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.126+0000 7f67c6ffd640 1 --2- 172.21.15.27:0/1568030983 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67c80cb9b0 0x7f67c80af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:53.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.126+0000 7f67c77fe640 1 -- 172.21.15.27:0/1568030983 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67c80ce5d0 msgr2=0x7f67c8145230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:53.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.126+0000 7f67c77fe640 1 --2- 172.21.15.27:0/1568030983 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67c80ce5d0 0x7f67c8145230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:53.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.126+0000 7f67c77fe640 1 -- 172.21.15.27:0/1568030983 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67c80cb9b0 msgr2=0x7f67c80af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:53.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.126+0000 7f67c77fe640 1 --2- 172.21.15.27:0/1568030983 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67c80cb9b0 0x7f67c80af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:53.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.126+0000 7f67c77fe640 1 -- 172.21.15.27:0/1568030983 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67bc0094d0 con 0x7f67c806e3f0 2024-01-15T11:34:53.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.126+0000 7f67c7fff640 1 --2- 172.21.15.27:0/1568030983 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67c80ce5d0 0x7f67c8145230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:34:53.131 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.126+0000 7f67c77fe640 1 --2- 172.21.15.27:0/1568030983 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67c806e3f0 0x7f67c81472c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f67b80011f0 tx=0x7f67b800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:53.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.126+0000 7f67affff640 1 -- 172.21.15.27:0/1568030983 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b80074e0 con 0x7f67c806e3f0 2024-01-15T11:34:53.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.126+0000 7f67affff640 1 -- 172.21.15.27:0/1568030983 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b8007640 con 0x7f67c806e3f0 2024-01-15T11:34:53.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.126+0000 7f67affff640 1 -- 172.21.15.27:0/1568030983 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b8004a10 con 0x7f67c806e3f0 2024-01-15T11:34:53.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.126+0000 7f67cdde7640 1 -- 172.21.15.27:0/1568030983 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c809bf90 con 0x7f67c806e3f0 2024-01-15T11:34:53.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.126+0000 7f67cdde7640 1 -- 172.21.15.27:0/1568030983 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c8147800 con 0x7f67c806e3f0 2024-01-15T11:34:53.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.126+0000 7f67cdde7640 1 -- 172.21.15.27:0/1568030983 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67c80671f0 con 0x7f67c806e3f0 2024-01-15T11:34:53.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.130+0000 7f67affff640 1 -- 172.21.15.27:0/1568030983 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 6) v1 ==== 86211+0+0 (secure 0 0 0) 0x7f67b8004b70 con 0x7f67c806e3f0 2024-01-15T11:34:53.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.130+0000 7f67affff640 1 --2- 172.21.15.27:0/1568030983 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f67b4066980 0x7f67b4068e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:53.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.130+0000 7f67affff640 1 -- 172.21.15.27:0/1568030983 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67b8083730 con 0x7f67c806e3f0 2024-01-15T11:34:53.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.130+0000 7f67c6ffd640 1 --2- 172.21.15.27:0/1568030983 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f67b4066980 0x7f67b4068e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:53.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.130+0000 7f67c6ffd640 1 --2- 172.21.15.27:0/1568030983 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f67b4066980 0x7f67b4068e40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f67bc0af000 tx=0x7f67bc0b6040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:53.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.134+0000 7f67affff640 1 -- 172.21.15.27:0/1568030983 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f67b80509b0 con 0x7f67c806e3f0 2024-01-15T11:34:53.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.298+0000 7f67cdde7640 1 -- 172.21.15.27:0/1568030983 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/clone_delay_every_regfile}] v 0) v1 -- 0x7f67c809bdf0 con 0x7f67c806e3f0 2024-01-15T11:34:53.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.302+0000 7f67affff640 1 -- 172.21.15.27:0/1568030983 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/clone_delay_every_regfile}]=0 v11)=0 v11) v1 ==== 135+0+0 (secure 0 0 0) 0x7f67c809bdf0 con 0x7f67c806e3f0 2024-01-15T11:34:53.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.302+0000 7f67cdde7640 1 -- 172.21.15.27:0/1568030983 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f67b4066980 msgr2=0x7f67b4068e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:53.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.302+0000 7f67cdde7640 1 --2- 172.21.15.27:0/1568030983 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f67b4066980 0x7f67b4068e40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f67bc0af000 tx=0x7f67bc0b6040 comp rx=0 tx=0).stop 2024-01-15T11:34:53.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.302+0000 7f67cdde7640 1 -- 172.21.15.27:0/1568030983 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67c806e3f0 msgr2=0x7f67c81472c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:53.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.302+0000 7f67cdde7640 1 --2- 172.21.15.27:0/1568030983 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67c806e3f0 0x7f67c81472c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f67b80011f0 tx=0x7f67b800c9b0 comp rx=0 tx=0).stop 2024-01-15T11:34:53.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.302+0000 7f67cdde7640 1 -- 172.21.15.27:0/1568030983 shutdown_connections 2024-01-15T11:34:53.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.302+0000 7f67cdde7640 1 --2- 172.21.15.27:0/1568030983 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67c80ce5d0 0x7f67c8145230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:53.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.302+0000 7f67cdde7640 1 --2- 172.21.15.27:0/1568030983 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f67b4066980 0x7f67b4068e40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:53.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.302+0000 7f67cdde7640 1 --2- 172.21.15.27:0/1568030983 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67c80cb9b0 0x7f67c80af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:53.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.302+0000 7f67cdde7640 1 --2- 172.21.15.27:0/1568030983 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f67c806e3f0 0x7f67c81472c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:53.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.302+0000 7f67cdde7640 1 -- 172.21.15.27:0/1568030983 >> 172.21.15.27:0/1568030983 conn(0x7f67c80b0cb0 msgr2=0x7f67c8071690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:53.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.302+0000 7f67cdde7640 1 -- 172.21.15.27:0/1568030983 shutdown_connections 2024-01-15T11:34:53.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.302+0000 7f67cdde7640 1 -- 172.21.15.27:0/1568030983 wait complete. 2024-01-15T11:34:53.327 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-01-15T11:34:53.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.470+0000 7f7447980640 1 Processor -- start 2024-01-15T11:34:53.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.470+0000 7f7447980640 1 -- start start 2024-01-15T11:34:53.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.474+0000 7f7447980640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f744015a710 0x7f74400abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:53.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.474+0000 7f7447980640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74400b2710 con 0x7f74400cbd50 2024-01-15T11:34:53.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.474+0000 7f7447980640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74400b29f0 con 0x7f74400cdfb0 2024-01-15T11:34:53.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.474+0000 7f7447980640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74400cca80 con 0x7f744015a710 2024-01-15T11:34:53.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.474+0000 7f7445f1d640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f74400cbd50 0x7f74400cc1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44874/0 (socket says 172.21.15.27:44874) 2024-01-15T11:34:53.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.474+0000 7f7445f1d640 1 -- 172.21.15.27:0/3831688626 learned_addr learned my addr 172.21.15.27:0/3831688626 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:53.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.474+0000 7f7444f1b640 1 --2- 172.21.15.27:0/3831688626 >> v2:172.21.15.93:3300/0 conn(0x7f744015a710 0x7f74400abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:53.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.474+0000 7f7437fff640 1 -- 172.21.15.27:0/3831688626 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703744291 0 0) 0x7f74400b2710 con 0x7f74400cbd50 2024-01-15T11:34:53.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.474+0000 7f7437fff640 1 -- 172.21.15.27:0/3831688626 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f742c005740 con 0x7f74400cbd50 2024-01-15T11:34:53.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.474+0000 7f7437fff640 1 -- 172.21.15.27:0/3831688626 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489387805 0 0) 0x7f74400b29f0 con 0x7f74400cdfb0 2024-01-15T11:34:53.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.474+0000 7f7437fff640 1 -- 172.21.15.27:0/3831688626 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74400b2710 con 0x7f74400cdfb0 2024-01-15T11:34:53.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.474+0000 7f7444f1b640 1 -- 172.21.15.27:0/3831688626 >> v1:172.21.15.93:6789/0 conn(0x7f74400cdfb0 legacy=0x7f74400ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:53.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.474+0000 7f7444f1b640 1 -- 172.21.15.27:0/3831688626 >> v1:172.21.15.27:6789/0 conn(0x7f74400cbd50 legacy=0x7f74400cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:53.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.474+0000 7f7437fff640 1 -- 172.21.15.27:0/3831688626 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1651779286 0 0) 0x7f742c005740 con 0x7f74400cbd50 2024-01-15T11:34:53.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.474+0000 7f7444f1b640 1 -- 172.21.15.27:0/3831688626 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74400b2cd0 con 0x7f744015a710 2024-01-15T11:34:53.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.478+0000 7f7444f1b640 1 --2- 172.21.15.27:0/3831688626 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f744015a710 0x7f74400abf90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f74300097c0 tx=0x7f743001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3169f7dc0277ef94 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:53.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.478+0000 7f7437fff640 1 -- 172.21.15.27:0/3831688626 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438001a00 con 0x7f744015a710 2024-01-15T11:34:53.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.478+0000 7f7437fff640 1 -- 172.21.15.27:0/3831688626 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74300ac440 con 0x7f744015a710 2024-01-15T11:34:53.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.478+0000 7f7437fff640 1 -- 172.21.15.27:0/3831688626 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74300ac7d0 con 0x7f744015a710 2024-01-15T11:34:53.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.478+0000 7f7447980640 1 -- 172.21.15.27:0/3831688626 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f744015a710 msgr2=0x7f74400abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:53.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.478+0000 7f7447980640 1 --2- 172.21.15.27:0/3831688626 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f744015a710 0x7f74400abf90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f74300097c0 tx=0x7f743001c370 comp rx=0 tx=0).stop 2024-01-15T11:34:53.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.478+0000 7f7447980640 1 -- 172.21.15.27:0/3831688626 shutdown_connections 2024-01-15T11:34:53.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.478+0000 7f7447980640 1 --2- 172.21.15.27:0/3831688626 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f744015a710 0x7f74400abf90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:53.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.478+0000 7f7447980640 1 -- 172.21.15.27:0/3831688626 >> 172.21.15.27:0/3831688626 conn(0x7f74400b0cb0 msgr2=0x7f74400b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:53.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.478+0000 7f7447980640 1 -- 172.21.15.27:0/3831688626 shutdown_connections 2024-01-15T11:34:53.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.478+0000 7f7447980640 1 -- 172.21.15.27:0/3831688626 wait complete. 2024-01-15T11:34:53.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.478+0000 7f7447980640 1 Processor -- start 2024-01-15T11:34:53.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.478+0000 7f7447980640 1 -- start start 2024-01-15T11:34:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.482+0000 7f7447980640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74400cbd50 0x7f7440070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.482+0000 7f7447980640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74400cdfb0 0x7f74401558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.482+0000 7f7447980640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f744015a710 0x7f74401f91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.482+0000 7f7447980640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7440070bd0 con 0x7f744015a710 2024-01-15T11:34:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.482+0000 7f7447980640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7440155df0 con 0x7f74400cdfb0 2024-01-15T11:34:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.482+0000 7f7447980640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7440070e00 con 0x7f74400cbd50 2024-01-15T11:34:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.482+0000 7f7445f1d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f744015a710 0x7f74401f91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.482+0000 7f7445f1d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f744015a710 0x7f74401f91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45312/0 (socket says 172.21.15.27:45312) 2024-01-15T11:34:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.482+0000 7f7445f1d640 1 -- 172.21.15.27:0/1524904553 learned_addr learned my addr 172.21.15.27:0/1524904553 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.482+0000 7f744571c640 1 --2- 172.21.15.27:0/1524904553 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74400cbd50 0x7f7440070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.482+0000 7f7444f1b640 1 --2- 172.21.15.27:0/1524904553 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74400cdfb0 0x7f74401558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.482+0000 7f7445f1d640 1 -- 172.21.15.27:0/1524904553 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74400cbd50 msgr2=0x7f7440070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.482+0000 7f7445f1d640 1 --2- 172.21.15.27:0/1524904553 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74400cbd50 0x7f7440070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.482+0000 7f7445f1d640 1 -- 172.21.15.27:0/1524904553 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74400cdfb0 msgr2=0x7f74401558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.482+0000 7f7445f1d640 1 --2- 172.21.15.27:0/1524904553 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74400cdfb0 0x7f74401558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.482+0000 7f7445f1d640 1 -- 172.21.15.27:0/1524904553 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7430009420 con 0x7f744015a710 2024-01-15T11:34:53.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.482+0000 7f7445f1d640 1 --2- 172.21.15.27:0/1524904553 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f744015a710 0x7f74401f91d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7438001fb0 tx=0x7f743800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:53.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.482+0000 7f7435ffb640 1 -- 172.21.15.27:0/1524904553 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438012400 con 0x7f744015a710 2024-01-15T11:34:53.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.482+0000 7f7435ffb640 1 -- 172.21.15.27:0/1524904553 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7438012560 con 0x7f744015a710 2024-01-15T11:34:53.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.482+0000 7f7435ffb640 1 -- 172.21.15.27:0/1524904553 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438012910 con 0x7f744015a710 2024-01-15T11:34:53.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.482+0000 7f7447980640 1 -- 172.21.15.27:0/1524904553 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74400710e0 con 0x7f744015a710 2024-01-15T11:34:53.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.482+0000 7f7447980640 1 -- 172.21.15.27:0/1524904553 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74400716a0 con 0x7f744015a710 2024-01-15T11:34:53.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.482+0000 7f7447980640 1 -- 172.21.15.27:0/1524904553 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74400671f0 con 0x7f744015a710 2024-01-15T11:34:53.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.486+0000 7f7435ffb640 1 -- 172.21.15.27:0/1524904553 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 6) v1 ==== 86211+0+0 (secure 0 0 0) 0x7f7438012a70 con 0x7f744015a710 2024-01-15T11:34:53.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.486+0000 7f7435ffb640 1 --2- 172.21.15.27:0/1524904553 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7424066980 0x7f7424068e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:53.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.486+0000 7f7435ffb640 1 -- 172.21.15.27:0/1524904553 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7438084c80 con 0x7f744015a710 2024-01-15T11:34:53.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.486+0000 7f744571c640 1 --2- 172.21.15.27:0/1524904553 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7424066980 0x7f7424068e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:53.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.486+0000 7f744571c640 1 --2- 172.21.15.27:0/1524904553 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7424066980 0x7f7424068e40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f743c0011f0 tx=0x7f743c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:53.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.490+0000 7f7435ffb640 1 -- 172.21.15.27:0/1524904553 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7438051e80 con 0x7f744015a710 2024-01-15T11:34:53.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.674+0000 7f7447980640 1 -- 172.21.15.27:0/1524904553 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) v1 -- 0x7f744006b460 con 0x7f7424066980 2024-01-15T11:34:53.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.690+0000 7f7435ffb640 1 -- 172.21.15.27:0/1524904553 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f744006b460 con 0x7f7424066980 2024-01-15T11:34:53.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.690+0000 7f7447980640 1 -- 172.21.15.27:0/1524904553 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7424066980 msgr2=0x7f7424068e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:53.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.690+0000 7f7447980640 1 --2- 172.21.15.27:0/1524904553 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7424066980 0x7f7424068e40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f743c0011f0 tx=0x7f743c009040 comp rx=0 tx=0).stop 2024-01-15T11:34:53.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.690+0000 7f7447980640 1 -- 172.21.15.27:0/1524904553 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f744015a710 msgr2=0x7f74401f91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:53.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.690+0000 7f7447980640 1 --2- 172.21.15.27:0/1524904553 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f744015a710 0x7f74401f91d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7438001fb0 tx=0x7f743800a430 comp rx=0 tx=0).stop 2024-01-15T11:34:53.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.690+0000 7f7447980640 1 -- 172.21.15.27:0/1524904553 shutdown_connections 2024-01-15T11:34:53.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.690+0000 7f7447980640 1 --2- 172.21.15.27:0/1524904553 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f744015a710 0x7f74401f91d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:53.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.690+0000 7f7447980640 1 --2- 172.21.15.27:0/1524904553 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7424066980 0x7f7424068e40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:53.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.690+0000 7f7447980640 1 --2- 172.21.15.27:0/1524904553 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74400cdfb0 0x7f74401558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:53.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.690+0000 7f7447980640 1 --2- 172.21.15.27:0/1524904553 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74400cbd50 0x7f7440070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:53.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.690+0000 7f7447980640 1 -- 172.21.15.27:0/1524904553 >> 172.21.15.27:0/1524904553 conn(0x7f74400b0cb0 msgr2=0x7f74400acda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:53.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.690+0000 7f7447980640 1 -- 172.21.15.27:0/1524904553 shutdown_connections 2024-01-15T11:34:53.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.690+0000 7f7447980640 1 -- 172.21.15.27:0/1524904553 wait complete. 2024-01-15T11:34:53.715 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-01-15T11:34:53.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.858+0000 7f75611f5640 1 Processor -- start 2024-01-15T11:34:53.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.858+0000 7f75611f5640 1 -- start start 2024-01-15T11:34:53.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.858+0000 7f75611f5640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f755c154940 0x7f755c06da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:53.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.858+0000 7f75611f5640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f755c0cd870 con 0x7f755c15e6a0 2024-01-15T11:34:53.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.858+0000 7f75611f5640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f755c15ecc0 con 0x7f755c06df50 2024-01-15T11:34:53.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.858+0000 7f75611f5640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755c154d20 con 0x7f755c154940 2024-01-15T11:34:53.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.858+0000 7f755b59e640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f755c15e6a0 0x7f755c0ad080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:44880/0 (socket says 172.21.15.27:44880) 2024-01-15T11:34:53.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.858+0000 7f755b59e640 1 -- 172.21.15.27:0/461746929 learned_addr learned my addr 172.21.15.27:0/461746929 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:34:53.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.858+0000 7f755ad9d640 1 --2- 172.21.15.27:0/461746929 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f755c154940 0x7f755c06da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:53.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.858+0000 7f755a59c640 1 -- 172.21.15.27:0/461746929 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672236309 0 0) 0x7f755c0cd870 con 0x7f755c15e6a0 2024-01-15T11:34:53.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.858+0000 7f755a59c640 1 -- 172.21.15.27:0/461746929 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7548003530 con 0x7f755c15e6a0 2024-01-15T11:34:53.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.858+0000 7f755a59c640 1 -- 172.21.15.27:0/461746929 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443406431 0 0) 0x7f755c15ecc0 con 0x7f755c06df50 2024-01-15T11:34:53.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.858+0000 7f755a59c640 1 -- 172.21.15.27:0/461746929 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f755c0cd870 con 0x7f755c06df50 2024-01-15T11:34:53.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.858+0000 7f755ad9d640 1 -- 172.21.15.27:0/461746929 >> v1:172.21.15.93:6789/0 conn(0x7f755c06df50 legacy=0x7f755c15df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:53.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.858+0000 7f755ad9d640 1 -- 172.21.15.27:0/461746929 >> v1:172.21.15.27:6789/0 conn(0x7f755c15e6a0 legacy=0x7f755c0ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:53.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.858+0000 7f755ad9d640 1 -- 172.21.15.27:0/461746929 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755c0ccf40 con 0x7f755c154940 2024-01-15T11:34:53.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.862+0000 7f755ad9d640 1 --2- 172.21.15.27:0/461746929 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f755c154940 0x7f755c06da10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f754c0097f0 tx=0x7f754c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d397b1214980c1b7 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:53.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.862+0000 7f755a59c640 1 -- 172.21.15.27:0/461746929 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c0ac600 con 0x7f755c154940 2024-01-15T11:34:53.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.862+0000 7f755a59c640 1 -- 172.21.15.27:0/461746929 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c0a8050 con 0x7f755c154940 2024-01-15T11:34:53.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.862+0000 7f755a59c640 1 -- 172.21.15.27:0/461746929 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c0ac980 con 0x7f755c154940 2024-01-15T11:34:53.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.862+0000 7f75611f5640 1 -- 172.21.15.27:0/461746929 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f755c154940 msgr2=0x7f755c06da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:53.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.862+0000 7f75611f5640 1 --2- 172.21.15.27:0/461746929 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f755c154940 0x7f755c06da10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f754c0097f0 tx=0x7f754c01c490 comp rx=0 tx=0).stop 2024-01-15T11:34:53.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.862+0000 7f75611f5640 1 -- 172.21.15.27:0/461746929 shutdown_connections 2024-01-15T11:34:53.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.862+0000 7f75611f5640 1 --2- 172.21.15.27:0/461746929 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f755c154940 0x7f755c06da10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:53.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.862+0000 7f75611f5640 1 -- 172.21.15.27:0/461746929 >> 172.21.15.27:0/461746929 conn(0x7f755c0b0cb0 msgr2=0x7f755c0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:53.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.862+0000 7f75611f5640 1 -- 172.21.15.27:0/461746929 shutdown_connections 2024-01-15T11:34:53.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.862+0000 7f75611f5640 1 -- 172.21.15.27:0/461746929 wait complete. 2024-01-15T11:34:53.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.866+0000 7f75611f5640 1 Processor -- start 2024-01-15T11:34:53.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.866+0000 7f75611f5640 1 -- start start 2024-01-15T11:34:53.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.866+0000 7f75611f5640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f755c06df50 0x7f755c157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:53.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.866+0000 7f75611f5640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f755c154940 0x7f755c152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:53.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.866+0000 7f75611f5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f755c15e6a0 0x7f755c1493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:53.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.866+0000 7f75611f5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c157690 con 0x7f755c15e6a0 2024-01-15T11:34:53.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.866+0000 7f75611f5640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c14eaf0 con 0x7f755c06df50 2024-01-15T11:34:53.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.866+0000 7f75611f5640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755c09cf50 con 0x7f755c154940 2024-01-15T11:34:53.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.866+0000 7f755b59e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f755c15e6a0 0x7f755c1493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:53.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.866+0000 7f755b59e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f755c15e6a0 0x7f755c1493a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45328/0 (socket says 172.21.15.27:45328) 2024-01-15T11:34:53.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.866+0000 7f755b59e640 1 -- 172.21.15.27:0/1177683241 learned_addr learned my addr 172.21.15.27:0/1177683241 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:53.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.866+0000 7f755ad9d640 1 --2- 172.21.15.27:0/1177683241 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f755c06df50 0x7f755c157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:53.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.866+0000 7f7553fff640 1 --2- 172.21.15.27:0/1177683241 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f755c154940 0x7f755c152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:53.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.866+0000 7f755b59e640 1 -- 172.21.15.27:0/1177683241 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f755c154940 msgr2=0x7f755c152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:53.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.866+0000 7f755b59e640 1 --2- 172.21.15.27:0/1177683241 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f755c154940 0x7f755c152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:53.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.866+0000 7f755b59e640 1 -- 172.21.15.27:0/1177683241 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f755c06df50 msgr2=0x7f755c157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:53.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.866+0000 7f755b59e640 1 --2- 172.21.15.27:0/1177683241 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f755c06df50 0x7f755c157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:53.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.866+0000 7f755b59e640 1 -- 172.21.15.27:0/1177683241 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c009420 con 0x7f755c15e6a0 2024-01-15T11:34:53.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.866+0000 7f755b59e640 1 --2- 172.21.15.27:0/1177683241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f755c15e6a0 0x7f755c1493a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f755400caf0 tx=0x7f755400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:53.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.866+0000 7f75537fe640 1 -- 172.21.15.27:0/1177683241 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755400ac40 con 0x7f755c15e6a0 2024-01-15T11:34:53.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.866+0000 7f75537fe640 1 -- 172.21.15.27:0/1177683241 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755400ada0 con 0x7f755c15e6a0 2024-01-15T11:34:53.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.866+0000 7f75611f5640 1 -- 172.21.15.27:0/1177683241 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755c14e530 con 0x7f755c15e6a0 2024-01-15T11:34:53.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.866+0000 7f75537fe640 1 -- 172.21.15.27:0/1177683241 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7554012620 con 0x7f755c15e6a0 2024-01-15T11:34:53.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.866+0000 7f75611f5640 1 -- 172.21.15.27:0/1177683241 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755c09c990 con 0x7f755c15e6a0 2024-01-15T11:34:53.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.870+0000 7f75611f5640 1 -- 172.21.15.27:0/1177683241 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f755c0671f0 con 0x7f755c15e6a0 2024-01-15T11:34:53.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.870+0000 7f75537fe640 1 -- 172.21.15.27:0/1177683241 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 6) v1 ==== 86211+0+0 (secure 0 0 0) 0x7f7554007070 con 0x7f755c15e6a0 2024-01-15T11:34:53.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.870+0000 7f75537fe640 1 --2- 172.21.15.27:0/1177683241 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f753c066980 0x7f753c068e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:53.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.870+0000 7f75537fe640 1 -- 172.21.15.27:0/1177683241 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7554084310 con 0x7f755c15e6a0 2024-01-15T11:34:53.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.870+0000 7f755ad9d640 1 --2- 172.21.15.27:0/1177683241 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f753c066980 0x7f753c068e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:53.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.874+0000 7f755ad9d640 1 --2- 172.21.15.27:0/1177683241 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f753c066980 0x7f753c068e40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f754c0ae000 tx=0x7f754c0a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:53.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:53.874+0000 7f75537fe640 1 -- 172.21.15.27:0/1177683241 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7554051610 con 0x7f755c15e6a0 2024-01-15T11:34:54.062 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:54.058+0000 7f75611f5640 1 -- 172.21.15.27:0/1177683241 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) v1 -- 0x7f755c06e330 con 0x7f753c066980 2024-01-15T11:34:54.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:54.062+0000 7f75537fe640 1 -- 172.21.15.27:0/1177683241 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7f755c06e330 con 0x7f753c066980 2024-01-15T11:34:54.068 INFO:teuthology.orchestra.run.smithi027.stdout:/volumes/_nogroup/sv1/9c025116-e3bd-4173-8757-8674a72f7a6b 2024-01-15T11:34:54.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:54.066+0000 7f75611f5640 1 -- 172.21.15.27:0/1177683241 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f753c066980 msgr2=0x7f753c068e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:54.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:54.066+0000 7f75611f5640 1 --2- 172.21.15.27:0/1177683241 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f753c066980 0x7f753c068e40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f754c0ae000 tx=0x7f754c0a7000 comp rx=0 tx=0).stop 2024-01-15T11:34:54.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:54.066+0000 7f75611f5640 1 -- 172.21.15.27:0/1177683241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f755c15e6a0 msgr2=0x7f755c1493a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:54.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:54.066+0000 7f75611f5640 1 --2- 172.21.15.27:0/1177683241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f755c15e6a0 0x7f755c1493a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f755400caf0 tx=0x7f755400a060 comp rx=0 tx=0).stop 2024-01-15T11:34:54.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:54.066+0000 7f75611f5640 1 -- 172.21.15.27:0/1177683241 shutdown_connections 2024-01-15T11:34:54.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:54.066+0000 7f75611f5640 1 --2- 172.21.15.27:0/1177683241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f755c15e6a0 0x7f755c1493a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:54.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:54.066+0000 7f75611f5640 1 --2- 172.21.15.27:0/1177683241 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f755c154940 0x7f755c152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:54.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:54.066+0000 7f75611f5640 1 --2- 172.21.15.27:0/1177683241 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f753c066980 0x7f753c068e40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:54.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:54.066+0000 7f75611f5640 1 --2- 172.21.15.27:0/1177683241 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f755c06df50 0x7f755c157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:54.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:54.066+0000 7f75611f5640 1 -- 172.21.15.27:0/1177683241 >> 172.21.15.27:0/1177683241 conn(0x7f755c0b0cb0 msgr2=0x7f755c153ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:54.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:54.066+0000 7f75611f5640 1 -- 172.21.15.27:0/1177683241 shutdown_connections 2024-01-15T11:34:54.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:54.066+0000 7f75611f5640 1 -- 172.21.15.27:0/1177683241 wait complete. 2024-01-15T11:34:54.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:34:54.089 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/9c025116-e3bd-4173-8757-8674a72f7a6b) 2024-01-15T11:34:54.101 INFO:teuthology.orchestra.run.smithi027.stdout:# file: volumes/_nogroup/sv1/9c025116-e3bd-4173-8757-8674a72f7a6b 2024-01-15T11:34:54.101 INFO:teuthology.orchestra.run.smithi027.stdout:ceph.dir.rbytes="3055190016" 2024-01-15T11:34:54.101 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:34:54.101 INFO:tasks.cephfs.test_volumes:r_size = 3055190016 2024-01-15T11:34:56.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:34:56.102 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/9c025116-e3bd-4173-8757-8674a72f7a6b) 2024-01-15T11:34:56.113 INFO:teuthology.orchestra.run.smithi027.stdout:# file: volumes/_nogroup/sv1/9c025116-e3bd-4173-8757-8674a72f7a6b 2024-01-15T11:34:56.113 INFO:teuthology.orchestra.run.smithi027.stdout:ceph.dir.rbytes="3221225472" 2024-01-15T11:34:56.114 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:34:56.114 INFO:tasks.cephfs.test_volumes:r_size = 3221225472 2024-01-15T11:34:56.115 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 ss1clone1 2024-01-15T11:34:56.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.310+0000 7fb3ba8e3640 1 Processor -- start 2024-01-15T11:34:56.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.310+0000 7fb3ba8e3640 1 -- start start 2024-01-15T11:34:56.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.314+0000 7fb3ba8e3640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb3b4159f00 0x7fb3b40ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:56.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.314+0000 7fb3ba8e3640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb3b4070890 0x7fb3b4070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:56.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.314+0000 7fb3ba8e3640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b4072950 con 0x7fb3b40ae680 2024-01-15T11:34:56.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.314+0000 7fb3ba8e3640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3b406e2b0 con 0x7fb3b4159f00 2024-01-15T11:34:56.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.314+0000 7fb3ba8e3640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3b406c6f0 con 0x7fb3b4070890 2024-01-15T11:34:56.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.314+0000 7fb3b3fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb3b4159f00 0x7fb3b40ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:56.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.314+0000 7fb3b3fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fb3b4159f00 0x7fb3b40ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36602/0 (socket says 172.21.15.27:36602) 2024-01-15T11:34:56.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.314+0000 7fb3b3fff640 1 -- 172.21.15.27:0/1038711605 learned_addr learned my addr 172.21.15.27:0/1038711605 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:56.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.314+0000 7fb3b37fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fb3b40ae680 0x7fb3b40cd3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:48122/0 (socket says 172.21.15.27:48122) 2024-01-15T11:34:56.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.314+0000 7fb3b8e80640 1 --2- 172.21.15.27:0/1038711605 >> v2:172.21.15.93:3300/0 conn(0x7fb3b4070890 0x7fb3b4070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:56.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.314+0000 7fb3b3fff640 1 -- 172.21.15.27:0/1038711605 >> v2:172.21.15.93:3300/0 conn(0x7fb3b4070890 msgr2=0x7fb3b4070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:56.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.314+0000 7fb3b3fff640 1 --2- 172.21.15.27:0/1038711605 >> v2:172.21.15.93:3300/0 conn(0x7fb3b4070890 0x7fb3b4070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:56.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.314+0000 7fb3b3fff640 1 -- 172.21.15.27:0/1038711605 >> v1:172.21.15.27:6789/0 conn(0x7fb3b40ae680 legacy=0x7fb3b40cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:56.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.314+0000 7fb3b3fff640 1 -- 172.21.15.27:0/1038711605 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b406e550 con 0x7fb3b4159f00 2024-01-15T11:34:56.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.318+0000 7fb3b3fff640 1 --2- 172.21.15.27:0/1038711605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3b4159f00 0x7fb3b40ccea0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4070360 tx=0x7fb3a401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92c7daa2b2d0bdc server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:56.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.318+0000 7fb3b2ffd640 1 -- 172.21.15.27:0/1038711605 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a40ab600 con 0x7fb3b4159f00 2024-01-15T11:34:56.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.318+0000 7fb3b2ffd640 1 -- 172.21.15.27:0/1038711605 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a40a7050 con 0x7fb3b4159f00 2024-01-15T11:34:56.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.318+0000 7fb3b2ffd640 1 -- 172.21.15.27:0/1038711605 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a40ab980 con 0x7fb3b4159f00 2024-01-15T11:34:56.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.318+0000 7fb3ba8e3640 1 -- 172.21.15.27:0/1038711605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3b4159f00 msgr2=0x7fb3b40ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:56.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.318+0000 7fb3ba8e3640 1 --2- 172.21.15.27:0/1038711605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3b4159f00 0x7fb3b40ccea0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4070360 tx=0x7fb3a401c4d0 comp rx=0 tx=0).stop 2024-01-15T11:34:56.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.318+0000 7fb3ba8e3640 1 -- 172.21.15.27:0/1038711605 shutdown_connections 2024-01-15T11:34:56.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.318+0000 7fb3ba8e3640 1 --2- 172.21.15.27:0/1038711605 >> v2:172.21.15.93:3300/0 conn(0x7fb3b4070890 0x7fb3b4070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:56.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.318+0000 7fb3ba8e3640 1 --2- 172.21.15.27:0/1038711605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3b4159f00 0x7fb3b40ccea0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:56.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.318+0000 7fb3ba8e3640 1 -- 172.21.15.27:0/1038711605 >> 172.21.15.27:0/1038711605 conn(0x7fb3b40b0cb0 msgr2=0x7fb3b40b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:56.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.318+0000 7fb3ba8e3640 1 -- 172.21.15.27:0/1038711605 shutdown_connections 2024-01-15T11:34:56.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.318+0000 7fb3ba8e3640 1 -- 172.21.15.27:0/1038711605 wait complete. 2024-01-15T11:34:56.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.318+0000 7fb3ba8e3640 1 Processor -- start 2024-01-15T11:34:56.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.318+0000 7fb3ba8e3640 1 -- start start 2024-01-15T11:34:56.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.322+0000 7fb3ba8e3640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3b4070890 0x7fb3b40c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:56.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.322+0000 7fb3ba8e3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3b40ae680 0x7fb3b4168700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:56.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.322+0000 7fb3ba8e3640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3b4155cc0 0x7fb3b41587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:56.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.322+0000 7fb3ba8e3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b40c9520 con 0x7fb3b40ae680 2024-01-15T11:34:56.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.322+0000 7fb3ba8e3640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b40c88a0 con 0x7fb3b4155cc0 2024-01-15T11:34:56.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.322+0000 7fb3ba8e3640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b40c8b80 con 0x7fb3b4070890 2024-01-15T11:34:56.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.322+0000 7fb3b37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3b40ae680 0x7fb3b4168700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:56.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.322+0000 7fb3b37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3b40ae680 0x7fb3b4168700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36618/0 (socket says 172.21.15.27:36618) 2024-01-15T11:34:56.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.322+0000 7fb3b37fe640 1 -- 172.21.15.27:0/1496643902 learned_addr learned my addr 172.21.15.27:0/1496643902 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:56.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.322+0000 7fb3b8e80640 1 --2- 172.21.15.27:0/1496643902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3b4155cc0 0x7fb3b41587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:56.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.322+0000 7fb3b3fff640 1 --2- 172.21.15.27:0/1496643902 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3b4070890 0x7fb3b40c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:56.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.322+0000 7fb3b37fe640 1 -- 172.21.15.27:0/1496643902 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3b4070890 msgr2=0x7fb3b40c9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:56.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.322+0000 7fb3b37fe640 1 --2- 172.21.15.27:0/1496643902 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3b4070890 0x7fb3b40c9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:56.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.322+0000 7fb3b37fe640 1 -- 172.21.15.27:0/1496643902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3b4155cc0 msgr2=0x7fb3b41587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:56.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.322+0000 7fb3b37fe640 1 --2- 172.21.15.27:0/1496643902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3b4155cc0 0x7fb3b41587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:56.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.322+0000 7fb3b37fe640 1 -- 172.21.15.27:0/1496643902 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a40094d0 con 0x7fb3b40ae680 2024-01-15T11:34:56.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.322+0000 7fb3b3fff640 1 --2- 172.21.15.27:0/1496643902 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3b4070890 0x7fb3b40c9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:34:56.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.322+0000 7fb3b37fe640 1 --2- 172.21.15.27:0/1496643902 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3b40ae680 0x7fb3b4168700 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb3a800c490 tx=0x7fb3a800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:56.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.322+0000 7fb3b0ff9640 1 -- 172.21.15.27:0/1496643902 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8007480 con 0x7fb3b40ae680 2024-01-15T11:34:56.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.322+0000 7fb3b0ff9640 1 -- 172.21.15.27:0/1496643902 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a80075e0 con 0x7fb3b40ae680 2024-01-15T11:34:56.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.322+0000 7fb3b0ff9640 1 -- 172.21.15.27:0/1496643902 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8004a10 con 0x7fb3b40ae680 2024-01-15T11:34:56.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.322+0000 7fb3ba8e3640 1 -- 172.21.15.27:0/1496643902 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b40c8e60 con 0x7fb3b40ae680 2024-01-15T11:34:56.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.322+0000 7fb3ba8e3640 1 -- 172.21.15.27:0/1496643902 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b4168c40 con 0x7fb3b40ae680 2024-01-15T11:34:56.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.322+0000 7fb3ba8e3640 1 -- 172.21.15.27:0/1496643902 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3b40671f0 con 0x7fb3b40ae680 2024-01-15T11:34:56.328 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.322+0000 7fb3b0ff9640 1 -- 172.21.15.27:0/1496643902 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 6) v1 ==== 86211+0+0 (secure 0 0 0) 0x7fb3a8004b70 con 0x7fb3b40ae680 2024-01-15T11:34:56.328 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.326+0000 7fb3b0ff9640 1 --2- 172.21.15.27:0/1496643902 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb3a0066980 0x7fb3a0068e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:56.328 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.326+0000 7fb3b0ff9640 1 -- 172.21.15.27:0/1496643902 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3a8083680 con 0x7fb3b40ae680 2024-01-15T11:34:56.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.326+0000 7fb3b3fff640 1 --2- 172.21.15.27:0/1496643902 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb3a0066980 0x7fb3a0068e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:56.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.326+0000 7fb3b3fff640 1 --2- 172.21.15.27:0/1496643902 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb3a0066980 0x7fb3a0068e40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40d0040 tx=0x7fb3a4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:56.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.330+0000 7fb3b0ff9640 1 -- 172.21.15.27:0/1496643902 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb3a8050880 con 0x7fb3b40ae680 2024-01-15T11:34:56.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.518+0000 7fb3ba8e3640 1 -- 172.21.15.27:0/1496643902 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3b4071260 con 0x7fb3a0066980 2024-01-15T11:34:56.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.602+0000 7fb3b0ff9640 1 -- 172.21.15.27:0/1496643902 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb3a40bb0f0 con 0x7fb3a0066980 2024-01-15T11:34:56.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.602+0000 7fb3ba8e3640 1 -- 172.21.15.27:0/1496643902 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb3a0066980 msgr2=0x7fb3a0068e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:56.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.602+0000 7fb3ba8e3640 1 --2- 172.21.15.27:0/1496643902 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb3a0066980 0x7fb3a0068e40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40d0040 tx=0x7fb3a4009040 comp rx=0 tx=0).stop 2024-01-15T11:34:56.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.602+0000 7fb3ba8e3640 1 -- 172.21.15.27:0/1496643902 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3b40ae680 msgr2=0x7fb3b4168700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:56.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.602+0000 7fb3ba8e3640 1 --2- 172.21.15.27:0/1496643902 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3b40ae680 0x7fb3b4168700 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb3a800c490 tx=0x7fb3a800c950 comp rx=0 tx=0).stop 2024-01-15T11:34:56.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.602+0000 7fb3ba8e3640 1 -- 172.21.15.27:0/1496643902 shutdown_connections 2024-01-15T11:34:56.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.602+0000 7fb3ba8e3640 1 --2- 172.21.15.27:0/1496643902 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fb3a0066980 0x7fb3a0068e40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:56.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.602+0000 7fb3ba8e3640 1 --2- 172.21.15.27:0/1496643902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3b4155cc0 0x7fb3b41587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:56.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.602+0000 7fb3ba8e3640 1 --2- 172.21.15.27:0/1496643902 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb3b40ae680 0x7fb3b4168700 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:56.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.602+0000 7fb3ba8e3640 1 --2- 172.21.15.27:0/1496643902 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3b4070890 0x7fb3b40c9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:56.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.602+0000 7fb3ba8e3640 1 -- 172.21.15.27:0/1496643902 >> 172.21.15.27:0/1496643902 conn(0x7fb3b40b0cb0 msgr2=0x7fb3b40b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:56.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.606+0000 7fb3ba8e3640 1 -- 172.21.15.27:0/1496643902 shutdown_connections 2024-01-15T11:34:56.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.606+0000 7fb3ba8e3640 1 -- 172.21.15.27:0/1496643902 wait complete. 2024-01-15T11:34:56.611 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:34:56.608+0000 7fbe946d2640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:34:56.611 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:34:56.608+0000 7fbe946d2640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:34:56.611 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:34:56.608+0000 7fbe946d2640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:34:56.611 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:34:56.608+0000 7fbe946d2640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:34:56.611 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:34:56.608+0000 7fbe946d2640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:34:56.628 INFO:tasks.cephfs.test_volumes:expected clone state = ('in-progress',) 2024-01-15T11:34:56.628 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-01-15T11:34:56.630 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:34:56.628+0000 7fbe936d0640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:34:56.630 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:34:56.628+0000 7fbe936d0640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:34:56.630 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:34:56.628+0000 7fbe936d0640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:34:56.630 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:34:56.628+0000 7fbe936d0640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:34:56.630 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:34:56.628+0000 7fbe936d0640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:34:56.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.774+0000 7f5dff2bb640 1 Processor -- start 2024-01-15T11:34:56.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.774+0000 7f5dff2bb640 1 -- start start 2024-01-15T11:34:56.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.774+0000 7f5dff2bb640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5df815a710 0x7f5df80abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:56.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.774+0000 7f5dff2bb640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5df80cbd50 0x7f5df80cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:56.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.774+0000 7f5dff2bb640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df80b2710 con 0x7f5df80cdfb0 2024-01-15T11:34:56.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.774+0000 7f5dff2bb640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df80cca80 con 0x7f5df80cbd50 2024-01-15T11:34:56.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.774+0000 7f5dff2bb640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df80b29f0 con 0x7f5df815a710 2024-01-15T11:34:56.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.774+0000 7f5dfd858640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5df80cbd50 0x7f5df80cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:56.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.774+0000 7f5dfd858640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f5df80cbd50 0x7f5df80cc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36630/0 (socket says 172.21.15.27:36630) 2024-01-15T11:34:56.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.774+0000 7f5dfd858640 1 -- 172.21.15.27:0/2618498383 learned_addr learned my addr 172.21.15.27:0/2618498383 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:56.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.774+0000 7f5dfc856640 1 --2- 172.21.15.27:0/2618498383 >> v2:172.21.15.93:3300/0 conn(0x7f5df815a710 0x7f5df80abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:56.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.778+0000 7f5dfd858640 1 -- 172.21.15.27:0/2618498383 >> v2:172.21.15.93:3300/0 conn(0x7f5df815a710 msgr2=0x7f5df80abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:34:56.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.778+0000 7f5dfd858640 1 --2- 172.21.15.27:0/2618498383 >> v2:172.21.15.93:3300/0 conn(0x7f5df815a710 0x7f5df80abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:56.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.778+0000 7f5dfd858640 1 -- 172.21.15.27:0/2618498383 >> v1:172.21.15.93:6789/0 conn(0x7f5df80cdfb0 legacy=0x7f5df80ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:56.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.778+0000 7f5dfd858640 1 -- 172.21.15.27:0/2618498383 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df80b2cd0 con 0x7f5df80cbd50 2024-01-15T11:34:56.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.778+0000 7f5dfd858640 1 --2- 172.21.15.27:0/2618498383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5df80cbd50 0x7f5df80cc1e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5df80d0040 tx=0x7f5df001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20208b0df090bea7 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:56.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.778+0000 7f5deffff640 1 -- 172.21.15.27:0/2618498383 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df00a5880 con 0x7f5df80cbd50 2024-01-15T11:34:56.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.778+0000 7f5deffff640 1 -- 172.21.15.27:0/2618498383 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df00a59e0 con 0x7f5df80cbd50 2024-01-15T11:34:56.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.778+0000 7f5deffff640 1 -- 172.21.15.27:0/2618498383 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df00a5d70 con 0x7f5df80cbd50 2024-01-15T11:34:56.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.778+0000 7f5dff2bb640 1 -- 172.21.15.27:0/2618498383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5df80cbd50 msgr2=0x7f5df80cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:56.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.778+0000 7f5dff2bb640 1 --2- 172.21.15.27:0/2618498383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5df80cbd50 0x7f5df80cc1e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5df80d0040 tx=0x7f5df001c9a0 comp rx=0 tx=0).stop 2024-01-15T11:34:56.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.778+0000 7f5dff2bb640 1 -- 172.21.15.27:0/2618498383 shutdown_connections 2024-01-15T11:34:56.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.778+0000 7f5dff2bb640 1 --2- 172.21.15.27:0/2618498383 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5df80cbd50 0x7f5df80cc1e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:56.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.778+0000 7f5dff2bb640 1 --2- 172.21.15.27:0/2618498383 >> v2:172.21.15.93:3300/0 conn(0x7f5df815a710 0x7f5df80abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:56.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.778+0000 7f5dff2bb640 1 -- 172.21.15.27:0/2618498383 >> 172.21.15.27:0/2618498383 conn(0x7f5df80b0cb0 msgr2=0x7f5df80b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:34:56.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.782+0000 7f5dff2bb640 1 -- 172.21.15.27:0/2618498383 shutdown_connections 2024-01-15T11:34:56.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.782+0000 7f5dff2bb640 1 -- 172.21.15.27:0/2618498383 wait complete. 2024-01-15T11:34:56.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.782+0000 7f5dff2bb640 1 Processor -- start 2024-01-15T11:34:56.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.782+0000 7f5dff2bb640 1 -- start start 2024-01-15T11:34:56.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.782+0000 7f5dff2bb640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5df80cbd50 0x7f5df81671c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:56.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.782+0000 7f5dff2bb640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5df80cdfb0 0x7f5df81649e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:56.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.782+0000 7f5dff2bb640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5df815a710 0x7f5df814fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:56.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.782+0000 7f5dff2bb640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df8153d20 con 0x7f5df80cbd50 2024-01-15T11:34:56.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.782+0000 7f5dff2bb640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df8164f20 con 0x7f5df80cdfb0 2024-01-15T11:34:56.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.782+0000 7f5dff2bb640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df8167850 con 0x7f5df815a710 2024-01-15T11:34:56.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.782+0000 7f5dfd057640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5df80cbd50 0x7f5df81671c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:56.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.782+0000 7f5dfd057640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5df80cbd50 0x7f5df81671c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36632/0 (socket says 172.21.15.27:36632) 2024-01-15T11:34:56.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.782+0000 7f5dfd057640 1 -- 172.21.15.27:0/90688180 learned_addr learned my addr 172.21.15.27:0/90688180 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:34:56.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.782+0000 7f5dfc856640 1 --2- 172.21.15.27:0/90688180 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5df80cdfb0 0x7f5df81649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:56.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.782+0000 7f5dfd858640 1 --2- 172.21.15.27:0/90688180 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5df815a710 0x7f5df814fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:56.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.782+0000 7f5dfd057640 1 -- 172.21.15.27:0/90688180 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5df815a710 msgr2=0x7f5df814fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:56.788 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.782+0000 7f5dfd057640 1 --2- 172.21.15.27:0/90688180 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5df815a710 0x7f5df814fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:56.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.782+0000 7f5dfd057640 1 -- 172.21.15.27:0/90688180 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5df80cdfb0 msgr2=0x7f5df81649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:34:56.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.782+0000 7f5dfd057640 1 --2- 172.21.15.27:0/90688180 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5df80cdfb0 0x7f5df81649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:34:56.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.782+0000 7f5dfd057640 1 -- 172.21.15.27:0/90688180 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df0009b30 con 0x7f5df80cbd50 2024-01-15T11:34:56.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.782+0000 7f5dfd057640 1 --2- 172.21.15.27:0/90688180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5df80cbd50 0x7f5df81671c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5df400c530 tx=0x7f5df400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:56.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.782+0000 7f5dedffb640 1 -- 172.21.15.27:0/90688180 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4005220 con 0x7f5df80cbd50 2024-01-15T11:34:56.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.782+0000 7f5dedffb640 1 -- 172.21.15.27:0/90688180 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df4005380 con 0x7f5df80cbd50 2024-01-15T11:34:56.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.782+0000 7f5dedffb640 1 -- 172.21.15.27:0/90688180 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4007270 con 0x7f5df80cbd50 2024-01-15T11:34:56.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.782+0000 7f5dff2bb640 1 -- 172.21.15.27:0/90688180 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df8167b30 con 0x7f5df80cbd50 2024-01-15T11:34:56.789 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.786+0000 7f5dff2bb640 1 -- 172.21.15.27:0/90688180 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df81680f0 con 0x7f5df80cbd50 2024-01-15T11:34:56.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.786+0000 7f5dff2bb640 1 -- 172.21.15.27:0/90688180 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df80cb660 con 0x7f5df80cbd50 2024-01-15T11:34:56.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.786+0000 7f5dedffb640 1 -- 172.21.15.27:0/90688180 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 6) v1 ==== 86211+0+0 (secure 0 0 0) 0x7f5df40073d0 con 0x7f5df80cbd50 2024-01-15T11:34:56.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.786+0000 7f5dedffb640 1 --2- 172.21.15.27:0/90688180 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5ddc0669b0 0x7f5ddc068e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:34:56.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.786+0000 7f5dedffb640 1 -- 172.21.15.27:0/90688180 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5df4083d30 con 0x7f5df80cbd50 2024-01-15T11:34:56.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.786+0000 7f5dfc856640 1 --2- 172.21.15.27:0/90688180 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5ddc0669b0 0x7f5ddc068e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:34:56.791 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.786+0000 7f5dfc856640 1 --2- 172.21.15.27:0/90688180 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5ddc0669b0 0x7f5ddc068e70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5df8167150 tx=0x7f5de8009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:34:56.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.790+0000 7f5dedffb640 1 -- 172.21.15.27:0/90688180 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5df4050f30 con 0x7f5df80cbd50 2024-01-15T11:34:56.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:56.986+0000 7f5dff2bb640 1 -- 172.21.15.27:0/90688180 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) v1 -- 0x7f5df81679c0 con 0x7f5ddc0669b0 2024-01-15T11:34:58.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:34:58.922+0000 7f5dedffb640 1 -- 172.21.15.27:0/90688180 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7f5df4051300 con 0x7f5df80cbd50 2024-01-15T11:35:00.327 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.322+0000 7f5dedffb640 1 -- 172.21.15.27:0/90688180 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f5df81679c0 con 0x7f5ddc0669b0 2024-01-15T11:35:00.327 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-01-15T11:35:00.327 INFO:teuthology.orchestra.run.smithi027.stdout: "status": { 2024-01-15T11:35:00.327 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "in-progress", 2024-01-15T11:35:00.327 INFO:teuthology.orchestra.run.smithi027.stdout: "source": { 2024-01-15T11:35:00.327 INFO:teuthology.orchestra.run.smithi027.stdout: "volume": "cephfs", 2024-01-15T11:35:00.327 INFO:teuthology.orchestra.run.smithi027.stdout: "subvolume": "sv1", 2024-01-15T11:35:00.327 INFO:teuthology.orchestra.run.smithi027.stdout: "snapshot": "ss1" 2024-01-15T11:35:00.327 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:00.327 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:00.328 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-01-15T11:35:00.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.326+0000 7f5dff2bb640 1 -- 172.21.15.27:0/90688180 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5ddc0669b0 msgr2=0x7f5ddc068e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:00.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.326+0000 7f5dff2bb640 1 --2- 172.21.15.27:0/90688180 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5ddc0669b0 0x7f5ddc068e70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5df8167150 tx=0x7f5de8009190 comp rx=0 tx=0).stop 2024-01-15T11:35:00.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.326+0000 7f5dff2bb640 1 -- 172.21.15.27:0/90688180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5df80cbd50 msgr2=0x7f5df81671c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:00.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.326+0000 7f5dff2bb640 1 --2- 172.21.15.27:0/90688180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5df80cbd50 0x7f5df81671c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5df400c530 tx=0x7f5df400c9f0 comp rx=0 tx=0).stop 2024-01-15T11:35:00.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.326+0000 7f5dff2bb640 1 -- 172.21.15.27:0/90688180 shutdown_connections 2024-01-15T11:35:00.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.326+0000 7f5dff2bb640 1 --2- 172.21.15.27:0/90688180 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5df815a710 0x7f5df814fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:00.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.326+0000 7f5dff2bb640 1 --2- 172.21.15.27:0/90688180 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f5ddc0669b0 0x7f5ddc068e70 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:00.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.326+0000 7f5dff2bb640 1 --2- 172.21.15.27:0/90688180 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5df80cdfb0 0x7f5df81649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:00.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.326+0000 7f5dff2bb640 1 --2- 172.21.15.27:0/90688180 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5df80cbd50 0x7f5df81671c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:00.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.326+0000 7f5dff2bb640 1 -- 172.21.15.27:0/90688180 >> 172.21.15.27:0/90688180 conn(0x7f5df80b0cb0 msgr2=0x7f5df80cd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:00.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.326+0000 7f5dff2bb640 1 -- 172.21.15.27:0/90688180 shutdown_connections 2024-01-15T11:35:00.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.326+0000 7f5dff2bb640 1 -- 172.21.15.27:0/90688180 wait complete. 2024-01-15T11:35:00.353 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-01-15T11:35:00.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.498+0000 7fa0c5afe640 1 Processor -- start 2024-01-15T11:35:00.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.498+0000 7fa0c5afe640 1 -- start start 2024-01-15T11:35:00.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.498+0000 7fa0c5afe640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa0c0143ae0 0x7fa0c00b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:00.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.498+0000 7fa0c5afe640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa0c00ae3d0 0x7fa0c006e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:00.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.498+0000 7fa0c5afe640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c00ae7f0 con 0x7fa0c006dfd0 2024-01-15T11:35:00.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.498+0000 7fa0c5afe640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c006e980 con 0x7fa0c00ae3d0 2024-01-15T11:35:00.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.498+0000 7fa0c5afe640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c00b2480 con 0x7fa0c0143ae0 2024-01-15T11:35:00.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.498+0000 7fa0bffff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa0c00ae3d0 0x7fa0c006e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:00.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.498+0000 7fa0beffd640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fa0c006dfd0 0x7fa0c00adcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:48134/0 (socket says 172.21.15.27:48134) 2024-01-15T11:35:00.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.498+0000 7fa0beffd640 1 -- 172.21.15.27:0/2678509204 learned_addr learned my addr 172.21.15.27:0/2678509204 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:35:00.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.498+0000 7fa0bf7fe640 1 --2- 172.21.15.27:0/2678509204 >> v2:172.21.15.93:3300/0 conn(0x7fa0c0143ae0 0x7fa0c00b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:00.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.498+0000 7fa0bffff640 1 -- 172.21.15.27:0/2678509204 >> v2:172.21.15.93:3300/0 conn(0x7fa0c0143ae0 msgr2=0x7fa0c00b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:00.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.498+0000 7fa0bffff640 1 --2- 172.21.15.27:0/2678509204 >> v2:172.21.15.93:3300/0 conn(0x7fa0c0143ae0 0x7fa0c00b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:00.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.498+0000 7fa0bffff640 1 -- 172.21.15.27:0/2678509204 >> v1:172.21.15.27:6789/0 conn(0x7fa0c006dfd0 legacy=0x7fa0c00adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:00.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.498+0000 7fa0bffff640 1 -- 172.21.15.27:0/2678509204 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c0070670 con 0x7fa0c00ae3d0 2024-01-15T11:35:00.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.498+0000 7fa0be7fc640 1 -- 172.21.15.27:0/2678509204 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4036182503 0 0) 0x7fa0c00ae7f0 con 0x7fa0c006dfd0 2024-01-15T11:35:00.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.502+0000 7fa0bffff640 1 --2- 172.21.15.27:0/2678509204 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0c00ae3d0 0x7fa0c006e440 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0070080 tx=0x7fa0b801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d3ed7a3fc84973d server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:00.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.502+0000 7fa0be7fc640 1 -- 172.21.15.27:0/2678509204 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b80a59a0 con 0x7fa0c00ae3d0 2024-01-15T11:35:00.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.502+0000 7fa0be7fc640 1 -- 172.21.15.27:0/2678509204 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b80a5b00 con 0x7fa0c00ae3d0 2024-01-15T11:35:00.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.502+0000 7fa0be7fc640 1 -- 172.21.15.27:0/2678509204 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b80a5e90 con 0x7fa0c00ae3d0 2024-01-15T11:35:00.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.502+0000 7fa0c5afe640 1 -- 172.21.15.27:0/2678509204 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0c00ae3d0 msgr2=0x7fa0c006e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:00.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.502+0000 7fa0c5afe640 1 --2- 172.21.15.27:0/2678509204 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0c00ae3d0 0x7fa0c006e440 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0070080 tx=0x7fa0b801c8e0 comp rx=0 tx=0).stop 2024-01-15T11:35:00.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.502+0000 7fa0c5afe640 1 -- 172.21.15.27:0/2678509204 shutdown_connections 2024-01-15T11:35:00.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.502+0000 7fa0c5afe640 1 --2- 172.21.15.27:0/2678509204 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0c00ae3d0 0x7fa0c006e440 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:00.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.502+0000 7fa0c5afe640 1 --2- 172.21.15.27:0/2678509204 >> v2:172.21.15.93:3300/0 conn(0x7fa0c0143ae0 0x7fa0c00b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:00.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.502+0000 7fa0c5afe640 1 -- 172.21.15.27:0/2678509204 >> 172.21.15.27:0/2678509204 conn(0x7fa0c00b0c40 msgr2=0x7fa0c00b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:00.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.502+0000 7fa0c5afe640 1 -- 172.21.15.27:0/2678509204 shutdown_connections 2024-01-15T11:35:00.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.502+0000 7fa0c5afe640 1 -- 172.21.15.27:0/2678509204 wait complete. 2024-01-15T11:35:00.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.506+0000 7fa0c5afe640 1 Processor -- start 2024-01-15T11:35:00.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.506+0000 7fa0c5afe640 1 -- start start 2024-01-15T11:35:00.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.506+0000 7fa0c5afe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0c006dfd0 0x7fa0c013a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:00.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.506+0000 7fa0c5afe640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa0c00ae3d0 0x7fa0c0099a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:00.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.506+0000 7fa0c5afe640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0c0143ae0 0x7fa0c0099f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:00.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.506+0000 7fa0c5afe640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c0163220 con 0x7fa0c006dfd0 2024-01-15T11:35:00.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.506+0000 7fa0c5afe640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c015c0d0 con 0x7fa0c0143ae0 2024-01-15T11:35:00.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.506+0000 7fa0c5afe640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c0162b60 con 0x7fa0c00ae3d0 2024-01-15T11:35:00.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.506+0000 7fa0bf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0c006dfd0 0x7fa0c013a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:00.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.506+0000 7fa0bf7fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0c006dfd0 0x7fa0c013a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36642/0 (socket says 172.21.15.27:36642) 2024-01-15T11:35:00.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.506+0000 7fa0bf7fe640 1 -- 172.21.15.27:0/1148321282 learned_addr learned my addr 172.21.15.27:0/1148321282 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:00.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.506+0000 7fa0bffff640 1 --2- 172.21.15.27:0/1148321282 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0c0143ae0 0x7fa0c0099f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:00.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.506+0000 7fa0beffd640 1 --2- 172.21.15.27:0/1148321282 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa0c00ae3d0 0x7fa0c0099a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:00.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.506+0000 7fa0bf7fe640 1 -- 172.21.15.27:0/1148321282 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa0c00ae3d0 msgr2=0x7fa0c0099a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:00.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.506+0000 7fa0bf7fe640 1 --2- 172.21.15.27:0/1148321282 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa0c00ae3d0 0x7fa0c0099a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:00.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.506+0000 7fa0bf7fe640 1 -- 172.21.15.27:0/1148321282 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0c0143ae0 msgr2=0x7fa0c0099f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:00.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.506+0000 7fa0bf7fe640 1 --2- 172.21.15.27:0/1148321282 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0c0143ae0 0x7fa0c0099f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:00.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.506+0000 7fa0bf7fe640 1 -- 172.21.15.27:0/1148321282 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b8009a70 con 0x7fa0c006dfd0 2024-01-15T11:35:00.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.506+0000 7fa0bf7fe640 1 --2- 172.21.15.27:0/1148321282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0c006dfd0 0x7fa0c013a690 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa0b000e870 tx=0x7fa0b000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:00.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.506+0000 7fa0a7fff640 1 -- 172.21.15.27:0/1148321282 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0009510 con 0x7fa0c006dfd0 2024-01-15T11:35:00.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.506+0000 7fa0a7fff640 1 -- 172.21.15.27:0/1148321282 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b000eec0 con 0x7fa0c006dfd0 2024-01-15T11:35:00.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.506+0000 7fa0a7fff640 1 -- 172.21.15.27:0/1148321282 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b000cb40 con 0x7fa0c006dfd0 2024-01-15T11:35:00.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.506+0000 7fa0c5afe640 1 -- 172.21.15.27:0/1148321282 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c0162e40 con 0x7fa0c006dfd0 2024-01-15T11:35:00.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.506+0000 7fa0c5afe640 1 -- 172.21.15.27:0/1148321282 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c015b4e0 con 0x7fa0c006dfd0 2024-01-15T11:35:00.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.506+0000 7fa0c5afe640 1 -- 172.21.15.27:0/1148321282 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c0163490 con 0x7fa0c006dfd0 2024-01-15T11:35:00.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.510+0000 7fa0a7fff640 1 -- 172.21.15.27:0/1148321282 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7fa0b000ccc0 con 0x7fa0c006dfd0 2024-01-15T11:35:00.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.510+0000 7fa0a7fff640 1 --2- 172.21.15.27:0/1148321282 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa0ac066aa0 0x7fa0ac068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:00.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.510+0000 7fa0a7fff640 1 -- 172.21.15.27:0/1148321282 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0b0084790 con 0x7fa0c006dfd0 2024-01-15T11:35:00.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.510+0000 7fa0beffd640 1 --2- 172.21.15.27:0/1148321282 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa0ac066aa0 0x7fa0ac068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:00.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.510+0000 7fa0beffd640 1 --2- 172.21.15.27:0/1148321282 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa0ac066aa0 0x7fa0ac068f60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa0c01f9b10 tx=0x7fa0b4007b60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:00.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.514+0000 7fa0a7fff640 1 -- 172.21.15.27:0/1148321282 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa0b00517f0 con 0x7fa0c006dfd0 2024-01-15T11:35:00.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.726+0000 7fa0c5afe640 1 -- 172.21.15.27:0/1148321282 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fa0c01629c0 con 0x7fa0c006dfd0 2024-01-15T11:35:00.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.726+0000 7fa0a7fff640 1 -- 172.21.15.27:0/1148321282 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+3263 (secure 0 0 0) 0x7fa0b0017cd0 con 0x7fa0c006dfd0 2024-01-15T11:35:00.729 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:35:00.729 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-01-15T11:35:00.729 INFO:teuthology.orchestra.run.smithi027.stdout: "fsid": "adeed595-43d7-47b7-9d6d-c1a89f44a694", 2024-01-15T11:35:00.730 INFO:teuthology.orchestra.run.smithi027.stdout: "health": { 2024-01-15T11:35:00.730 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "HEALTH_OK", 2024-01-15T11:35:00.730 INFO:teuthology.orchestra.run.smithi027.stdout: "checks": {}, 2024-01-15T11:35:00.730 INFO:teuthology.orchestra.run.smithi027.stdout: "mutes": [] 2024-01-15T11:35:00.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:35:00.730 INFO:teuthology.orchestra.run.smithi027.stdout: "election_epoch": 4, 2024-01-15T11:35:00.730 INFO:teuthology.orchestra.run.smithi027.stdout: "quorum": [ 2024-01-15T11:35:00.730 INFO:teuthology.orchestra.run.smithi027.stdout: 0, 2024-01-15T11:35:00.730 INFO:teuthology.orchestra.run.smithi027.stdout: 1, 2024-01-15T11:35:00.730 INFO:teuthology.orchestra.run.smithi027.stdout: 2 2024-01-15T11:35:00.730 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-01-15T11:35:00.731 INFO:teuthology.orchestra.run.smithi027.stdout: "quorum_names": [ 2024-01-15T11:35:00.731 INFO:teuthology.orchestra.run.smithi027.stdout: "a", 2024-01-15T11:35:00.731 INFO:teuthology.orchestra.run.smithi027.stdout: "b", 2024-01-15T11:35:00.731 INFO:teuthology.orchestra.run.smithi027.stdout: "c" 2024-01-15T11:35:00.731 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-01-15T11:35:00.731 INFO:teuthology.orchestra.run.smithi027.stdout: "quorum_age": 125, 2024-01-15T11:35:00.731 INFO:teuthology.orchestra.run.smithi027.stdout: "monmap": { 2024-01-15T11:35:00.731 INFO:teuthology.orchestra.run.smithi027.stdout: "epoch": 1, 2024-01-15T11:35:00.731 INFO:teuthology.orchestra.run.smithi027.stdout: "min_mon_release_name": "reef", 2024-01-15T11:35:00.731 INFO:teuthology.orchestra.run.smithi027.stdout: "num_mons": 3 2024-01-15T11:35:00.731 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:35:00.732 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap": { 2024-01-15T11:35:00.732 INFO:teuthology.orchestra.run.smithi027.stdout: "epoch": 35, 2024-01-15T11:35:00.732 INFO:teuthology.orchestra.run.smithi027.stdout: "num_osds": 8, 2024-01-15T11:35:00.732 INFO:teuthology.orchestra.run.smithi027.stdout: "num_up_osds": 8, 2024-01-15T11:35:00.732 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_up_since": 1705318386, 2024-01-15T11:35:00.732 INFO:teuthology.orchestra.run.smithi027.stdout: "num_in_osds": 8, 2024-01-15T11:35:00.732 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_in_since": 1705318377, 2024-01-15T11:35:00.732 INFO:teuthology.orchestra.run.smithi027.stdout: "num_remapped_pgs": 0 2024-01-15T11:35:00.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:35:00.732 INFO:teuthology.orchestra.run.smithi027.stdout: "pgmap": { 2024-01-15T11:35:00.733 INFO:teuthology.orchestra.run.smithi027.stdout: "pgs_by_state": [ 2024-01-15T11:35:00.733 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:35:00.733 INFO:teuthology.orchestra.run.smithi027.stdout: "state_name": "active+clean", 2024-01-15T11:35:00.733 INFO:teuthology.orchestra.run.smithi027.stdout: "count": 97 2024-01-15T11:35:00.733 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:00.733 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-01-15T11:35:00.733 INFO:teuthology.orchestra.run.smithi027.stdout: "num_pgs": 97, 2024-01-15T11:35:00.733 INFO:teuthology.orchestra.run.smithi027.stdout: "num_pools": 3, 2024-01-15T11:35:00.733 INFO:teuthology.orchestra.run.smithi027.stdout: "num_objects": 795, 2024-01-15T11:35:00.733 INFO:teuthology.orchestra.run.smithi027.stdout: "data_bytes": 3222077733, 2024-01-15T11:35:00.734 INFO:teuthology.orchestra.run.smithi027.stdout: "bytes_used": 6694096896, 2024-01-15T11:35:00.734 INFO:teuthology.orchestra.run.smithi027.stdout: "bytes_avail": 766400016384, 2024-01-15T11:35:00.734 INFO:teuthology.orchestra.run.smithi027.stdout: "bytes_total": 773094113280, 2024-01-15T11:35:00.734 INFO:teuthology.orchestra.run.smithi027.stdout: "write_bytes_sec": 171593893, 2024-01-15T11:35:00.734 INFO:teuthology.orchestra.run.smithi027.stdout: "read_op_per_sec": 0, 2024-01-15T11:35:00.734 INFO:teuthology.orchestra.run.smithi027.stdout: "write_op_per_sec": 44 2024-01-15T11:35:00.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:35:00.734 INFO:teuthology.orchestra.run.smithi027.stdout: "fsmap": { 2024-01-15T11:35:00.734 INFO:teuthology.orchestra.run.smithi027.stdout: "epoch": 18, 2024-01-15T11:35:00.734 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 2, 2024-01-15T11:35:00.734 INFO:teuthology.orchestra.run.smithi027.stdout: "up": 1, 2024-01-15T11:35:00.735 INFO:teuthology.orchestra.run.smithi027.stdout: "in": 1, 2024-01-15T11:35:00.735 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 1, 2024-01-15T11:35:00.735 INFO:teuthology.orchestra.run.smithi027.stdout: "by_rank": [ 2024-01-15T11:35:00.735 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:35:00.735 INFO:teuthology.orchestra.run.smithi027.stdout: "filesystem_id": 2, 2024-01-15T11:35:00.735 INFO:teuthology.orchestra.run.smithi027.stdout: "rank": 0, 2024-01-15T11:35:00.735 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "c", 2024-01-15T11:35:00.735 INFO:teuthology.orchestra.run.smithi027.stdout: "status": "up:active", 2024-01-15T11:35:00.735 INFO:teuthology.orchestra.run.smithi027.stdout: "gid": 5070 2024-01-15T11:35:00.735 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:00.735 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-01-15T11:35:00.736 INFO:teuthology.orchestra.run.smithi027.stdout: "up:standby": 3 2024-01-15T11:35:00.736 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:35:00.736 INFO:teuthology.orchestra.run.smithi027.stdout: "mgrmap": { 2024-01-15T11:35:00.736 INFO:teuthology.orchestra.run.smithi027.stdout: "available": true, 2024-01-15T11:35:00.736 INFO:teuthology.orchestra.run.smithi027.stdout: "num_standbys": 1, 2024-01-15T11:35:00.736 INFO:teuthology.orchestra.run.smithi027.stdout: "modules": [ 2024-01-15T11:35:00.736 INFO:teuthology.orchestra.run.smithi027.stdout: "iostat", 2024-01-15T11:35:00.736 INFO:teuthology.orchestra.run.smithi027.stdout: "nfs", 2024-01-15T11:35:00.736 INFO:teuthology.orchestra.run.smithi027.stdout: "restful" 2024-01-15T11:35:00.736 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-01-15T11:35:00.736 INFO:teuthology.orchestra.run.smithi027.stdout: "services": {} 2024-01-15T11:35:00.737 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:35:00.737 INFO:teuthology.orchestra.run.smithi027.stdout: "servicemap": { 2024-01-15T11:35:00.737 INFO:teuthology.orchestra.run.smithi027.stdout: "epoch": 4, 2024-01-15T11:35:00.737 INFO:teuthology.orchestra.run.smithi027.stdout: "modified": "2024-01-15T11:34:08.076938+0000", 2024-01-15T11:35:00.737 INFO:teuthology.orchestra.run.smithi027.stdout: "services": { 2024-01-15T11:35:00.737 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-01-15T11:35:00.737 INFO:teuthology.orchestra.run.smithi027.stdout: "daemons": { 2024-01-15T11:35:00.737 INFO:teuthology.orchestra.run.smithi027.stdout: "summary": "", 2024-01-15T11:35:00.737 INFO:teuthology.orchestra.run.smithi027.stdout: "a": { 2024-01-15T11:35:00.737 INFO:teuthology.orchestra.run.smithi027.stdout: "start_epoch": 0, 2024-01-15T11:35:00.737 INFO:teuthology.orchestra.run.smithi027.stdout: "start_stamp": "0.000000", 2024-01-15T11:35:00.738 INFO:teuthology.orchestra.run.smithi027.stdout: "gid": 0, 2024-01-15T11:35:00.738 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "(unrecognized address family 0)/0", 2024-01-15T11:35:00.738 INFO:teuthology.orchestra.run.smithi027.stdout: "metadata": {}, 2024-01-15T11:35:00.738 INFO:teuthology.orchestra.run.smithi027.stdout: "task_status": {} 2024-01-15T11:35:00.738 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:35:00.738 INFO:teuthology.orchestra.run.smithi027.stdout: "b": { 2024-01-15T11:35:00.738 INFO:teuthology.orchestra.run.smithi027.stdout: "start_epoch": 0, 2024-01-15T11:35:00.738 INFO:teuthology.orchestra.run.smithi027.stdout: "start_stamp": "0.000000", 2024-01-15T11:35:00.738 INFO:teuthology.orchestra.run.smithi027.stdout: "gid": 0, 2024-01-15T11:35:00.738 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "(unrecognized address family 0)/0", 2024-01-15T11:35:00.738 INFO:teuthology.orchestra.run.smithi027.stdout: "metadata": {}, 2024-01-15T11:35:00.739 INFO:teuthology.orchestra.run.smithi027.stdout: "task_status": {} 2024-01-15T11:35:00.739 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:35:00.739 INFO:teuthology.orchestra.run.smithi027.stdout: "c": { 2024-01-15T11:35:00.739 INFO:teuthology.orchestra.run.smithi027.stdout: "start_epoch": 0, 2024-01-15T11:35:00.739 INFO:teuthology.orchestra.run.smithi027.stdout: "start_stamp": "0.000000", 2024-01-15T11:35:00.739 INFO:teuthology.orchestra.run.smithi027.stdout: "gid": 0, 2024-01-15T11:35:00.739 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "(unrecognized address family 0)/0", 2024-01-15T11:35:00.739 INFO:teuthology.orchestra.run.smithi027.stdout: "metadata": {}, 2024-01-15T11:35:00.739 INFO:teuthology.orchestra.run.smithi027.stdout: "task_status": {} 2024-01-15T11:35:00.739 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:35:00.739 INFO:teuthology.orchestra.run.smithi027.stdout: "d": { 2024-01-15T11:35:00.740 INFO:teuthology.orchestra.run.smithi027.stdout: "start_epoch": 0, 2024-01-15T11:35:00.740 INFO:teuthology.orchestra.run.smithi027.stdout: "start_stamp": "0.000000", 2024-01-15T11:35:00.740 INFO:teuthology.orchestra.run.smithi027.stdout: "gid": 0, 2024-01-15T11:35:00.740 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "(unrecognized address family 0)/0", 2024-01-15T11:35:00.740 INFO:teuthology.orchestra.run.smithi027.stdout: "metadata": {}, 2024-01-15T11:35:00.740 INFO:teuthology.orchestra.run.smithi027.stdout: "task_status": {} 2024-01-15T11:35:00.740 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:00.740 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:00.740 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:00.740 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:00.740 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:35:00.741 INFO:teuthology.orchestra.run.smithi027.stdout: "progress_events": {} 2024-01-15T11:35:00.741 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-01-15T11:35:00.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.726+0000 7fa0c5afe640 1 -- 172.21.15.27:0/1148321282 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa0ac066aa0 msgr2=0x7fa0ac068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:00.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.726+0000 7fa0c5afe640 1 --2- 172.21.15.27:0/1148321282 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa0ac066aa0 0x7fa0ac068f60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa0c01f9b10 tx=0x7fa0b4007b60 comp rx=0 tx=0).stop 2024-01-15T11:35:00.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.726+0000 7fa0c5afe640 1 -- 172.21.15.27:0/1148321282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0c006dfd0 msgr2=0x7fa0c013a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:00.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.726+0000 7fa0c5afe640 1 --2- 172.21.15.27:0/1148321282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0c006dfd0 0x7fa0c013a690 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa0b000e870 tx=0x7fa0b000ec70 comp rx=0 tx=0).stop 2024-01-15T11:35:00.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.726+0000 7fa0c5afe640 1 -- 172.21.15.27:0/1148321282 shutdown_connections 2024-01-15T11:35:00.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.726+0000 7fa0c5afe640 1 --2- 172.21.15.27:0/1148321282 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa0ac066aa0 0x7fa0ac068f60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:00.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.726+0000 7fa0c5afe640 1 --2- 172.21.15.27:0/1148321282 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0c0143ae0 0x7fa0c0099f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:00.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.726+0000 7fa0c5afe640 1 --2- 172.21.15.27:0/1148321282 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa0c00ae3d0 0x7fa0c0099a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:00.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.726+0000 7fa0c5afe640 1 --2- 172.21.15.27:0/1148321282 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0c006dfd0 0x7fa0c013a690 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:00.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.726+0000 7fa0c5afe640 1 -- 172.21.15.27:0/1148321282 >> 172.21.15.27:0/1148321282 conn(0x7fa0c00b0c40 msgr2=0x7fa0c00b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:00.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.726+0000 7fa0c5afe640 1 -- 172.21.15.27:0/1148321282 shutdown_connections 2024-01-15T11:35:00.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.726+0000 7fa0c5afe640 1 -- 172.21.15.27:0/1148321282 wait complete. 2024-01-15T11:35:00.750 INFO:tasks.cephfs.test_volumes:expected clone state = ('complete',) 2024-01-15T11:35:00.751 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-01-15T11:35:00.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.894+0000 7f398792a640 1 Processor -- start 2024-01-15T11:35:00.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.894+0000 7f398792a640 1 -- start start 2024-01-15T11:35:00.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.894+0000 7f398792a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f39800b3c60 0x7f39800b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:00.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.894+0000 7f398792a640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f39800b4040 0x7f39800ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:00.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.894+0000 7f398792a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3980162190 0x7f39801625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:00.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.894+0000 7f398792a640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39800b2590 con 0x7f39800b4040 2024-01-15T11:35:00.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.894+0000 7f398792a640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39800b2870 con 0x7f39800b3c60 2024-01-15T11:35:00.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.894+0000 7f398792a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39800b2b50 con 0x7f3980162190 2024-01-15T11:35:00.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.894+0000 7f3984ec5640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f39800b4040 0x7f39800ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:00.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.894+0000 7f39856c6640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f39800b3c60 0x7f39800b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:00.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.894+0000 7f3985ec7640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3980162190 0x7f39801625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:00.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.894+0000 7f3984ec5640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f39800b4040 0x7f39800ce5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36648/0 (socket says 172.21.15.27:36648) 2024-01-15T11:35:00.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.894+0000 7f3984ec5640 1 -- 172.21.15.27:0/4003981992 learned_addr learned my addr 172.21.15.27:0/4003981992 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:00.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.894+0000 7f3984ec5640 1 -- 172.21.15.27:0/4003981992 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3980162190 msgr2=0x7f39801625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:00.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.894+0000 7f3984ec5640 1 --2- 172.21.15.27:0/4003981992 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3980162190 0x7f39801625e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:00.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.894+0000 7f3984ec5640 1 -- 172.21.15.27:0/4003981992 >> v2:172.21.15.93:3300/0 conn(0x7f39800b3c60 msgr2=0x7f39800b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:00.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.894+0000 7f3984ec5640 1 --2- 172.21.15.27:0/4003981992 >> v2:172.21.15.93:3300/0 conn(0x7f39800b3c60 0x7f39800b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:00.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.894+0000 7f3984ec5640 1 -- 172.21.15.27:0/4003981992 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39800b2e30 con 0x7f39800b4040 2024-01-15T11:35:00.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.898+0000 7f3984ec5640 1 --2- 172.21.15.27:0/4003981992 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39800b4040 0x7f39800ce5e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f39800d0010 tx=0x7f397001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4182da58658f6f3b server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:00.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.898+0000 7f3977fff640 1 -- 172.21.15.27:0/4003981992 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39700ab620 con 0x7f39800b4040 2024-01-15T11:35:00.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.898+0000 7f3977fff640 1 -- 172.21.15.27:0/4003981992 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39700ab780 con 0x7f39800b4040 2024-01-15T11:35:00.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.898+0000 7f3977fff640 1 -- 172.21.15.27:0/4003981992 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39700abb10 con 0x7f39800b4040 2024-01-15T11:35:00.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.898+0000 7f398792a640 1 -- 172.21.15.27:0/4003981992 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39800b4040 msgr2=0x7f39800ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:00.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.898+0000 7f398792a640 1 --2- 172.21.15.27:0/4003981992 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39800b4040 0x7f39800ce5e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f39800d0010 tx=0x7f397001c4d0 comp rx=0 tx=0).stop 2024-01-15T11:35:00.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.898+0000 7f398792a640 1 -- 172.21.15.27:0/4003981992 shutdown_connections 2024-01-15T11:35:00.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.898+0000 7f398792a640 1 --2- 172.21.15.27:0/4003981992 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3980162190 0x7f39801625e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:00.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.898+0000 7f398792a640 1 --2- 172.21.15.27:0/4003981992 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39800b4040 0x7f39800ce5e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:00.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.898+0000 7f398792a640 1 --2- 172.21.15.27:0/4003981992 >> v2:172.21.15.93:3300/0 conn(0x7f39800b3c60 0x7f39800b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:00.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.898+0000 7f398792a640 1 -- 172.21.15.27:0/4003981992 >> 172.21.15.27:0/4003981992 conn(0x7f39800b0cb0 msgr2=0x7f39800b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:00.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.898+0000 7f398792a640 1 -- 172.21.15.27:0/4003981992 shutdown_connections 2024-01-15T11:35:00.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.898+0000 7f398792a640 1 -- 172.21.15.27:0/4003981992 wait complete. 2024-01-15T11:35:00.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f398792a640 1 Processor -- start 2024-01-15T11:35:00.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f398792a640 1 -- start start 2024-01-15T11:35:00.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f398792a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39800b3c60 0x7f398015da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:00.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f398792a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3980162190 0x7f3980099f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:00.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f398792a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f398009a450 0x7f39801625a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:00.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f398792a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398015b540 con 0x7f39800b3c60 2024-01-15T11:35:00.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f398792a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398009adc0 con 0x7f3980162190 2024-01-15T11:35:00.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f398792a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398009b0a0 con 0x7f398009a450 2024-01-15T11:35:00.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f39856c6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39800b3c60 0x7f398015da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:00.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f39856c6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39800b3c60 0x7f398015da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36660/0 (socket says 172.21.15.27:36660) 2024-01-15T11:35:00.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f39856c6640 1 -- 172.21.15.27:0/3949294800 learned_addr learned my addr 172.21.15.27:0/3949294800 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:00.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f3985ec7640 1 --2- 172.21.15.27:0/3949294800 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f398009a450 0x7f39801625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:00.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f3984ec5640 1 --2- 172.21.15.27:0/3949294800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3980162190 0x7f3980099f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:00.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f39856c6640 1 -- 172.21.15.27:0/3949294800 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f398009a450 msgr2=0x7f39801625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:00.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f39856c6640 1 --2- 172.21.15.27:0/3949294800 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f398009a450 0x7f39801625a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:00.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f39856c6640 1 -- 172.21.15.27:0/3949294800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3980162190 msgr2=0x7f3980099f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:00.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f39856c6640 1 --2- 172.21.15.27:0/3949294800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3980162190 0x7f3980099f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:00.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f39856c6640 1 -- 172.21.15.27:0/3949294800 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39700094d0 con 0x7f39800b3c60 2024-01-15T11:35:00.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f3984ec5640 1 --2- 172.21.15.27:0/3949294800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3980162190 0x7f3980099f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:35:00.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f39856c6640 1 --2- 172.21.15.27:0/3949294800 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39800b3c60 0x7f398015da40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f397c00e8b0 tx=0x7f397c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:00.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f3975ffb640 1 -- 172.21.15.27:0/3949294800 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c00c940 con 0x7f39800b3c60 2024-01-15T11:35:00.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f3975ffb640 1 -- 172.21.15.27:0/3949294800 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c00caa0 con 0x7f39800b3c60 2024-01-15T11:35:00.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f3975ffb640 1 -- 172.21.15.27:0/3949294800 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c00ce30 con 0x7f39800b3c60 2024-01-15T11:35:00.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f398792a640 1 -- 172.21.15.27:0/3949294800 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39801603f0 con 0x7f39800b3c60 2024-01-15T11:35:00.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f398792a640 1 -- 172.21.15.27:0/3949294800 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398009b380 con 0x7f39800b3c60 2024-01-15T11:35:00.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.902+0000 7f398792a640 1 -- 172.21.15.27:0/3949294800 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39800671f0 con 0x7f39800b3c60 2024-01-15T11:35:00.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.906+0000 7f3975ffb640 1 -- 172.21.15.27:0/3949294800 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7f397c013470 con 0x7f39800b3c60 2024-01-15T11:35:00.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.906+0000 7f3975ffb640 1 --2- 172.21.15.27:0/3949294800 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3964066aa0 0x7f3964068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:00.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.906+0000 7f3975ffb640 1 -- 172.21.15.27:0/3949294800 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f397c084830 con 0x7f39800b3c60 2024-01-15T11:35:00.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.906+0000 7f3984ec5640 1 --2- 172.21.15.27:0/3949294800 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3964066aa0 0x7f3964068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:00.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.906+0000 7f3984ec5640 1 --2- 172.21.15.27:0/3949294800 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3964066aa0 0x7f3964068f60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f39700af000 tx=0x7f39700b6040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:00.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:00.910+0000 7f3975ffb640 1 -- 172.21.15.27:0/3949294800 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f397c051940 con 0x7f39800b3c60 2024-01-15T11:35:01.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:01.102+0000 7f398792a640 1 -- 172.21.15.27:0/3949294800 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) v1 -- 0x7f398006b460 con 0x7f3964066aa0 2024-01-15T11:35:01.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:01.110+0000 7f3975ffb640 1 -- 172.21.15.27:0/3949294800 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+344 (secure 0 0 0) 0x7f398006b460 con 0x7f3964066aa0 2024-01-15T11:35:01.114 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-01-15T11:35:01.114 INFO:teuthology.orchestra.run.smithi027.stdout: "status": { 2024-01-15T11:35:01.114 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "in-progress", 2024-01-15T11:35:01.114 INFO:teuthology.orchestra.run.smithi027.stdout: "source": { 2024-01-15T11:35:01.114 INFO:teuthology.orchestra.run.smithi027.stdout: "volume": "cephfs", 2024-01-15T11:35:01.114 INFO:teuthology.orchestra.run.smithi027.stdout: "subvolume": "sv1", 2024-01-15T11:35:01.114 INFO:teuthology.orchestra.run.smithi027.stdout: "snapshot": "ss1" 2024-01-15T11:35:01.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:35:01.115 INFO:teuthology.orchestra.run.smithi027.stdout: "progress_report": { 2024-01-15T11:35:01.115 INFO:teuthology.orchestra.run.smithi027.stdout: "percentage completed": 0.0, 2024-01-15T11:35:01.115 INFO:teuthology.orchestra.run.smithi027.stdout: "amount copied": "0 B/3 GB", 2024-01-15T11:35:01.115 INFO:teuthology.orchestra.run.smithi027.stdout: "regfiles copied": "0/3", 2024-01-15T11:35:01.115 INFO:teuthology.orchestra.run.smithi027.stdout: "subdirs copied": "0/1", 2024-01-15T11:35:01.115 INFO:teuthology.orchestra.run.smithi027.stdout: "symlinks copied": "0/0" 2024-01-15T11:35:01.115 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:01.115 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:01.115 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-01-15T11:35:01.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:01.110+0000 7f398792a640 1 -- 172.21.15.27:0/3949294800 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3964066aa0 msgr2=0x7f3964068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:01.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:01.110+0000 7f398792a640 1 --2- 172.21.15.27:0/3949294800 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3964066aa0 0x7f3964068f60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f39700af000 tx=0x7f39700b6040 comp rx=0 tx=0).stop 2024-01-15T11:35:01.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:01.110+0000 7f398792a640 1 -- 172.21.15.27:0/3949294800 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39800b3c60 msgr2=0x7f398015da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:01.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:01.110+0000 7f398792a640 1 --2- 172.21.15.27:0/3949294800 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39800b3c60 0x7f398015da40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f397c00e8b0 tx=0x7f397c00ed70 comp rx=0 tx=0).stop 2024-01-15T11:35:01.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:01.110+0000 7f398792a640 1 -- 172.21.15.27:0/3949294800 shutdown_connections 2024-01-15T11:35:01.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:01.110+0000 7f398792a640 1 --2- 172.21.15.27:0/3949294800 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f398009a450 0x7f39801625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:01.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:01.110+0000 7f398792a640 1 --2- 172.21.15.27:0/3949294800 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3964066aa0 0x7f3964068f60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:01.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:01.110+0000 7f398792a640 1 --2- 172.21.15.27:0/3949294800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3980162190 0x7f3980099f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:01.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:01.110+0000 7f398792a640 1 --2- 172.21.15.27:0/3949294800 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f39800b3c60 0x7f398015da40 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:01.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:01.110+0000 7f398792a640 1 -- 172.21.15.27:0/3949294800 >> 172.21.15.27:0/3949294800 conn(0x7f39800b0cb0 msgr2=0x7f39800ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:01.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:01.110+0000 7f398792a640 1 -- 172.21.15.27:0/3949294800 shutdown_connections 2024-01-15T11:35:01.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:01.110+0000 7f398792a640 1 -- 172.21.15.27:0/3949294800 wait complete. 2024-01-15T11:35:01.136 INFO:tasks.cephfs.test_volumes:current clone state = in-progress 2024-01-15T11:35:02.139 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-01-15T11:35:02.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.290+0000 7f7e82de4640 1 Processor -- start 2024-01-15T11:35:02.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.290+0000 7f7e82de4640 1 -- start start 2024-01-15T11:35:02.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.294+0000 7f7e82de4640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7e7c15d2a0 0x7f7e7c0d26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:02.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.294+0000 7f7e82de4640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e7c0b6250 con 0x7f7e7c0d2c20 2024-01-15T11:35:02.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.294+0000 7f7e82de4640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e7c161cf0 con 0x7f7e7c0b5350 2024-01-15T11:35:02.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.294+0000 7f7e82de4640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e7c0ce8c0 con 0x7f7e7c15d2a0 2024-01-15T11:35:02.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.294+0000 7f7e815e1640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f7e7c0d2c20 0x7f7e7c0b4c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:48148/0 (socket says 172.21.15.27:48148) 2024-01-15T11:35:02.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.294+0000 7f7e815e1640 1 -- 172.21.15.27:0/2933710325 learned_addr learned my addr 172.21.15.27:0/2933710325 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:35:02.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.294+0000 7f7e81de2640 1 --2- 172.21.15.27:0/2933710325 >> v2:172.21.15.93:3300/0 conn(0x7f7e7c15d2a0 0x7f7e7c0d26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:02.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.294+0000 7f7e80de0640 1 -- 172.21.15.27:0/2933710325 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360269069 0 0) 0x7f7e7c0b6250 con 0x7f7e7c0d2c20 2024-01-15T11:35:02.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.294+0000 7f7e80de0640 1 -- 172.21.15.27:0/2933710325 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e68003530 con 0x7f7e7c0d2c20 2024-01-15T11:35:02.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.294+0000 7f7e81de2640 1 -- 172.21.15.27:0/2933710325 >> v1:172.21.15.93:6789/0 conn(0x7f7e7c0b5350 legacy=0x7f7e7c0d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:02.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.294+0000 7f7e81de2640 1 -- 172.21.15.27:0/2933710325 >> v1:172.21.15.27:6789/0 conn(0x7f7e7c0d2c20 legacy=0x7f7e7c0b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:02.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.294+0000 7f7e80de0640 1 -- 172.21.15.27:0/2933710325 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1554779405 0 0) 0x7f7e68003530 con 0x7f7e7c0d2c20 2024-01-15T11:35:02.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.294+0000 7f7e81de2640 1 -- 172.21.15.27:0/2933710325 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7c161170 con 0x7f7e7c15d2a0 2024-01-15T11:35:02.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.298+0000 7f7e81de2640 1 --2- 172.21.15.27:0/2933710325 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e7c15d2a0 0x7f7e7c0d26e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7e780097c0 tx=0x7f7e7801c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52a0c381a6852349 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:02.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.298+0000 7f7e80de0640 1 -- 172.21.15.27:0/2933710325 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c0016a0 con 0x7f7e7c15d2a0 2024-01-15T11:35:02.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.298+0000 7f7e80de0640 1 -- 172.21.15.27:0/2933710325 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e780a7050 con 0x7f7e7c15d2a0 2024-01-15T11:35:02.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.298+0000 7f7e80de0640 1 -- 172.21.15.27:0/2933710325 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e780ab600 con 0x7f7e7c15d2a0 2024-01-15T11:35:02.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.298+0000 7f7e82de4640 1 -- 172.21.15.27:0/2933710325 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e7c15d2a0 msgr2=0x7f7e7c0d26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:02.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.298+0000 7f7e82de4640 1 --2- 172.21.15.27:0/2933710325 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e7c15d2a0 0x7f7e7c0d26e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7e780097c0 tx=0x7f7e7801c370 comp rx=0 tx=0).stop 2024-01-15T11:35:02.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.298+0000 7f7e82de4640 1 -- 172.21.15.27:0/2933710325 shutdown_connections 2024-01-15T11:35:02.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.298+0000 7f7e82de4640 1 --2- 172.21.15.27:0/2933710325 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e7c15d2a0 0x7f7e7c0d26e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:02.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.298+0000 7f7e82de4640 1 -- 172.21.15.27:0/2933710325 >> 172.21.15.27:0/2933710325 conn(0x7f7e7c0668a0 msgr2=0x7f7e7c0cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:02.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.298+0000 7f7e82de4640 1 -- 172.21.15.27:0/2933710325 shutdown_connections 2024-01-15T11:35:02.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.298+0000 7f7e82de4640 1 -- 172.21.15.27:0/2933710325 wait complete. 2024-01-15T11:35:02.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.298+0000 7f7e82de4640 1 Processor -- start 2024-01-15T11:35:02.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.298+0000 7f7e82de4640 1 -- start start 2024-01-15T11:35:02.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.302+0000 7f7e82de4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e7c0b5350 0x7f7e7c1529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:02.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.302+0000 7f7e82de4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e7c0d2c20 0x7f7e7c15aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:02.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.302+0000 7f7e82de4640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7e7c15d2a0 0x7f7e7c0c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:02.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.302+0000 7f7e82de4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c15ba40 con 0x7f7e7c0d2c20 2024-01-15T11:35:02.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.302+0000 7f7e82de4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c15b480 con 0x7f7e7c0b5350 2024-01-15T11:35:02.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.302+0000 7f7e82de4640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c15b760 con 0x7f7e7c15d2a0 2024-01-15T11:35:02.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.302+0000 7f7e815e1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e7c0d2c20 0x7f7e7c15aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:02.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.302+0000 7f7e815e1640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e7c0d2c20 0x7f7e7c15aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36666/0 (socket says 172.21.15.27:36666) 2024-01-15T11:35:02.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.302+0000 7f7e815e1640 1 -- 172.21.15.27:0/3945593186 learned_addr learned my addr 172.21.15.27:0/3945593186 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:02.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.302+0000 7f7e81de2640 1 --2- 172.21.15.27:0/3945593186 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e7c0b5350 0x7f7e7c1529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:02.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.302+0000 7f7e825e3640 1 --2- 172.21.15.27:0/3945593186 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7e7c15d2a0 0x7f7e7c0c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:02.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.302+0000 7f7e815e1640 1 -- 172.21.15.27:0/3945593186 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7e7c15d2a0 msgr2=0x7f7e7c0c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:02.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.302+0000 7f7e815e1640 1 --2- 172.21.15.27:0/3945593186 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7e7c15d2a0 0x7f7e7c0c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:02.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.302+0000 7f7e815e1640 1 -- 172.21.15.27:0/3945593186 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e7c0b5350 msgr2=0x7f7e7c1529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:02.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.302+0000 7f7e815e1640 1 --2- 172.21.15.27:0/3945593186 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e7c0b5350 0x7f7e7c1529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:02.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.302+0000 7f7e815e1640 1 -- 172.21.15.27:0/3945593186 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e78009420 con 0x7f7e7c0d2c20 2024-01-15T11:35:02.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.302+0000 7f7e825e3640 1 --2- 172.21.15.27:0/3945593186 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7e7c15d2a0 0x7f7e7c0c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:35:02.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.302+0000 7f7e815e1640 1 --2- 172.21.15.27:0/3945593186 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e7c0d2c20 0x7f7e7c15aaa0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00c750 tx=0x7f7e6c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:02.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.302+0000 7f7e727fc640 1 -- 172.21.15.27:0/3945593186 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c005ae0 con 0x7f7e7c0d2c20 2024-01-15T11:35:02.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.302+0000 7f7e727fc640 1 -- 172.21.15.27:0/3945593186 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c005c40 con 0x7f7e7c0d2c20 2024-01-15T11:35:02.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.302+0000 7f7e727fc640 1 -- 172.21.15.27:0/3945593186 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c0072b0 con 0x7f7e7c0d2c20 2024-01-15T11:35:02.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.302+0000 7f7e82de4640 1 -- 172.21.15.27:0/3945593186 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e7c0c83e0 con 0x7f7e7c0d2c20 2024-01-15T11:35:02.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.302+0000 7f7e82de4640 1 -- 172.21.15.27:0/3945593186 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e7c152f10 con 0x7f7e7c0d2c20 2024-01-15T11:35:02.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.302+0000 7f7e82de4640 1 -- 172.21.15.27:0/3945593186 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e7c074990 con 0x7f7e7c0d2c20 2024-01-15T11:35:02.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.306+0000 7f7e727fc640 1 -- 172.21.15.27:0/3945593186 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7f7e6c007410 con 0x7f7e7c0d2c20 2024-01-15T11:35:02.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.306+0000 7f7e727fc640 1 --2- 172.21.15.27:0/3945593186 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7e60066aa0 0x7f7e60068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:02.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.306+0000 7f7e727fc640 1 -- 172.21.15.27:0/3945593186 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7e6c083d40 con 0x7f7e7c0d2c20 2024-01-15T11:35:02.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.306+0000 7f7e81de2640 1 --2- 172.21.15.27:0/3945593186 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7e60066aa0 0x7f7e60068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:02.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.306+0000 7f7e81de2640 1 --2- 172.21.15.27:0/3945593186 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7e60066aa0 0x7f7e60068f60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7e780ad000 tx=0x7f7e780a6000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:02.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.310+0000 7f7e727fc640 1 -- 172.21.15.27:0/3945593186 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7e6c050de0 con 0x7f7e7c0d2c20 2024-01-15T11:35:02.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.554+0000 7f7e82de4640 1 -- 172.21.15.27:0/3945593186 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e7c160e20 con 0x7f7e60066aa0 2024-01-15T11:35:02.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.562+0000 7f7e727fc640 1 -- 172.21.15.27:0/3945593186 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+344 (secure 0 0 0) 0x7f7e780ab6a0 con 0x7f7e60066aa0 2024-01-15T11:35:02.567 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-01-15T11:35:02.567 INFO:teuthology.orchestra.run.smithi027.stdout: "status": { 2024-01-15T11:35:02.567 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "in-progress", 2024-01-15T11:35:02.567 INFO:teuthology.orchestra.run.smithi027.stdout: "source": { 2024-01-15T11:35:02.567 INFO:teuthology.orchestra.run.smithi027.stdout: "volume": "cephfs", 2024-01-15T11:35:02.567 INFO:teuthology.orchestra.run.smithi027.stdout: "subvolume": "sv1", 2024-01-15T11:35:02.567 INFO:teuthology.orchestra.run.smithi027.stdout: "snapshot": "ss1" 2024-01-15T11:35:02.567 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:35:02.567 INFO:teuthology.orchestra.run.smithi027.stdout: "progress_report": { 2024-01-15T11:35:02.568 INFO:teuthology.orchestra.run.smithi027.stdout: "percentage completed": 0.0, 2024-01-15T11:35:02.568 INFO:teuthology.orchestra.run.smithi027.stdout: "amount copied": "0 B/3 GB", 2024-01-15T11:35:02.568 INFO:teuthology.orchestra.run.smithi027.stdout: "regfiles copied": "0/3", 2024-01-15T11:35:02.568 INFO:teuthology.orchestra.run.smithi027.stdout: "subdirs copied": "0/1", 2024-01-15T11:35:02.568 INFO:teuthology.orchestra.run.smithi027.stdout: "symlinks copied": "0/0" 2024-01-15T11:35:02.568 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:02.568 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:02.568 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-01-15T11:35:02.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.566+0000 7f7e82de4640 1 -- 172.21.15.27:0/3945593186 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7e60066aa0 msgr2=0x7f7e60068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:02.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.566+0000 7f7e82de4640 1 --2- 172.21.15.27:0/3945593186 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7e60066aa0 0x7f7e60068f60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7e780ad000 tx=0x7f7e780a6000 comp rx=0 tx=0).stop 2024-01-15T11:35:02.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.566+0000 7f7e82de4640 1 -- 172.21.15.27:0/3945593186 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e7c0d2c20 msgr2=0x7f7e7c15aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:02.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.566+0000 7f7e82de4640 1 --2- 172.21.15.27:0/3945593186 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e7c0d2c20 0x7f7e7c15aaa0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00c750 tx=0x7f7e6c00cc10 comp rx=0 tx=0).stop 2024-01-15T11:35:02.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.566+0000 7f7e82de4640 1 -- 172.21.15.27:0/3945593186 shutdown_connections 2024-01-15T11:35:02.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.566+0000 7f7e82de4640 1 --2- 172.21.15.27:0/3945593186 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7e7c15d2a0 0x7f7e7c0c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:02.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.566+0000 7f7e82de4640 1 --2- 172.21.15.27:0/3945593186 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7e7c0d2c20 0x7f7e7c15aaa0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:02.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.566+0000 7f7e82de4640 1 --2- 172.21.15.27:0/3945593186 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7e60066aa0 0x7f7e60068f60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:02.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.566+0000 7f7e82de4640 1 --2- 172.21.15.27:0/3945593186 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7e7c0b5350 0x7f7e7c1529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:02.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.566+0000 7f7e82de4640 1 -- 172.21.15.27:0/3945593186 >> 172.21.15.27:0/3945593186 conn(0x7f7e7c0668a0 msgr2=0x7f7e7c0cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:02.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.566+0000 7f7e82de4640 1 -- 172.21.15.27:0/3945593186 shutdown_connections 2024-01-15T11:35:02.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:02.566+0000 7f7e82de4640 1 -- 172.21.15.27:0/3945593186 wait complete. 2024-01-15T11:35:02.591 INFO:tasks.cephfs.test_volumes:current clone state = in-progress 2024-01-15T11:35:03.591 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-01-15T11:35:03.799 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.794+0000 7fac4b765640 1 Processor -- start 2024-01-15T11:35:03.800 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.794+0000 7fac4b765640 1 -- start start 2024-01-15T11:35:03.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.798+0000 7fac4b765640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fac4415d7c0 0x7fac440d3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:03.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.798+0000 7fac4b765640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fac44161f20 0x7fac440cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:03.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.798+0000 7fac4b765640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fac440d02f0 0x7fac4415dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:03.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.798+0000 7fac4b765640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac440d0f90 con 0x7fac44161f20 2024-01-15T11:35:03.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.798+0000 7fac4b765640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac440d0740 con 0x7fac440d02f0 2024-01-15T11:35:03.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.798+0000 7fac4b765640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac440d11a0 con 0x7fac4415d7c0 2024-01-15T11:35:03.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.798+0000 7fac48d00640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fac44161f20 0x7fac440cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:03.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.798+0000 7fac48d00640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fac44161f20 0x7fac440cfdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36680/0 (socket says 172.21.15.27:36680) 2024-01-15T11:35:03.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.798+0000 7fac48d00640 1 -- 172.21.15.27:0/4275428931 learned_addr learned my addr 172.21.15.27:0/4275428931 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:03.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.798+0000 7fac49d02640 1 --2- 172.21.15.27:0/4275428931 >> v2:172.21.15.93:3300/0 conn(0x7fac440d02f0 0x7fac4415dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:03.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.798+0000 7fac48d00640 1 -- 172.21.15.27:0/4275428931 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fac4415d7c0 msgr2=0x7fac440d3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:03.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.798+0000 7fac49501640 1 --2- 172.21.15.27:0/4275428931 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fac4415d7c0 0x7fac440d3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:03.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.798+0000 7fac48d00640 1 --2- 172.21.15.27:0/4275428931 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fac4415d7c0 0x7fac440d3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:03.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.798+0000 7fac48d00640 1 -- 172.21.15.27:0/4275428931 >> v2:172.21.15.93:3300/0 conn(0x7fac440d02f0 msgr2=0x7fac4415dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:03.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.798+0000 7fac48d00640 1 --2- 172.21.15.27:0/4275428931 >> v2:172.21.15.93:3300/0 conn(0x7fac440d02f0 0x7fac4415dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:03.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.798+0000 7fac48d00640 1 -- 172.21.15.27:0/4275428931 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac440d1480 con 0x7fac44161f20 2024-01-15T11:35:03.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.798+0000 7fac49501640 1 --2- 172.21.15.27:0/4275428931 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fac4415d7c0 0x7fac440d3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:35:03.809 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.806+0000 7fac48d00640 1 --2- 172.21.15.27:0/4275428931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac44161f20 0x7fac440cfdb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fac4415ed40 tx=0x7fac3401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c243571c1d0dd9d9 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:03.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.806+0000 7fac3bfff640 1 -- 172.21.15.27:0/4275428931 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac340aa5f0 con 0x7fac44161f20 2024-01-15T11:35:03.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.806+0000 7fac3bfff640 1 -- 172.21.15.27:0/4275428931 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac340aa750 con 0x7fac44161f20 2024-01-15T11:35:03.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.806+0000 7fac3bfff640 1 -- 172.21.15.27:0/4275428931 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac340aaae0 con 0x7fac44161f20 2024-01-15T11:35:03.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.806+0000 7fac4b765640 1 -- 172.21.15.27:0/4275428931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac44161f20 msgr2=0x7fac440cfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:03.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.806+0000 7fac4b765640 1 --2- 172.21.15.27:0/4275428931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac44161f20 0x7fac440cfdb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fac4415ed40 tx=0x7fac3401c4d0 comp rx=0 tx=0).stop 2024-01-15T11:35:03.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.806+0000 7fac4b765640 1 -- 172.21.15.27:0/4275428931 shutdown_connections 2024-01-15T11:35:03.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.806+0000 7fac4b765640 1 --2- 172.21.15.27:0/4275428931 >> v2:172.21.15.93:3300/0 conn(0x7fac440d02f0 0x7fac4415dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:03.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.806+0000 7fac4b765640 1 --2- 172.21.15.27:0/4275428931 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac44161f20 0x7fac440cfdb0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:03.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.806+0000 7fac4b765640 1 --2- 172.21.15.27:0/4275428931 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fac4415d7c0 0x7fac440d3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:03.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.806+0000 7fac4b765640 1 -- 172.21.15.27:0/4275428931 >> 172.21.15.27:0/4275428931 conn(0x7fac4408afc0 msgr2=0x7fac440d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:03.812 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.810+0000 7fac4b765640 1 -- 172.21.15.27:0/4275428931 shutdown_connections 2024-01-15T11:35:03.813 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.810+0000 7fac4b765640 1 -- 172.21.15.27:0/4275428931 wait complete. 2024-01-15T11:35:03.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.814+0000 7fac4b765640 1 Processor -- start 2024-01-15T11:35:03.817 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.814+0000 7fac4b765640 1 -- start start 2024-01-15T11:35:03.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.814+0000 7fac4b765640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac440d02f0 0x7fac440c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:03.819 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.814+0000 7fac4b765640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fac4415d7c0 0x7fac4415c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:03.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.814+0000 7fac4b765640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac440b0f80 0x7fac440b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:03.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.814+0000 7fac4b765640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4415bac0 con 0x7fac440b0f80 2024-01-15T11:35:03.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.814+0000 7fac4b765640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac440b1970 con 0x7fac440d02f0 2024-01-15T11:35:03.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.814+0000 7fac4b765640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac440c9570 con 0x7fac4415d7c0 2024-01-15T11:35:03.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.814+0000 7fac49d02640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac440b0f80 0x7fac440b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:03.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.814+0000 7fac49d02640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac440b0f80 0x7fac440b1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36692/0 (socket says 172.21.15.27:36692) 2024-01-15T11:35:03.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.814+0000 7fac49d02640 1 -- 172.21.15.27:0/1805038027 learned_addr learned my addr 172.21.15.27:0/1805038027 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:03.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.814+0000 7fac48d00640 1 --2- 172.21.15.27:0/1805038027 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fac4415d7c0 0x7fac4415c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:03.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.814+0000 7fac49501640 1 --2- 172.21.15.27:0/1805038027 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac440d02f0 0x7fac440c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:03.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.814+0000 7fac49d02640 1 -- 172.21.15.27:0/1805038027 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fac4415d7c0 msgr2=0x7fac4415c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:03.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.814+0000 7fac49d02640 1 --2- 172.21.15.27:0/1805038027 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fac4415d7c0 0x7fac4415c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:03.820 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.814+0000 7fac49d02640 1 -- 172.21.15.27:0/1805038027 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac440d02f0 msgr2=0x7fac440c9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:03.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.814+0000 7fac49d02640 1 --2- 172.21.15.27:0/1805038027 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac440d02f0 0x7fac440c9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:03.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.814+0000 7fac49d02640 1 -- 172.21.15.27:0/1805038027 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac34009480 con 0x7fac440b0f80 2024-01-15T11:35:03.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.814+0000 7fac49501640 1 --2- 172.21.15.27:0/1805038027 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac440d02f0 0x7fac440c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:35:03.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.814+0000 7fac48d00640 1 --2- 172.21.15.27:0/1805038027 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fac4415d7c0 0x7fac4415c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:35:03.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.814+0000 7fac49d02640 1 --2- 172.21.15.27:0/1805038027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac440b0f80 0x7fac440b1430 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fac3c007e60 tx=0x7fac3c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:03.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.818+0000 7fac39ffb640 1 -- 172.21.15.27:0/1805038027 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3c014620 con 0x7fac440b0f80 2024-01-15T11:35:03.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.818+0000 7fac39ffb640 1 -- 172.21.15.27:0/1805038027 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3c0147a0 con 0x7fac440b0f80 2024-01-15T11:35:03.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.818+0000 7fac39ffb640 1 -- 172.21.15.27:0/1805038027 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3c014b50 con 0x7fac440b0f80 2024-01-15T11:35:03.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.818+0000 7fac4b765640 1 -- 172.21.15.27:0/1805038027 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4415ae40 con 0x7fac440b0f80 2024-01-15T11:35:03.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.818+0000 7fac4b765640 1 -- 172.21.15.27:0/1805038027 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4415b400 con 0x7fac440b0f80 2024-01-15T11:35:03.823 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.818+0000 7fac4b765640 1 -- 172.21.15.27:0/1805038027 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac4415bc00 con 0x7fac440b0f80 2024-01-15T11:35:03.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.822+0000 7fac39ffb640 1 -- 172.21.15.27:0/1805038027 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7fac3c014cb0 con 0x7fac440b0f80 2024-01-15T11:35:03.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.822+0000 7fac39ffb640 1 --2- 172.21.15.27:0/1805038027 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fac28066af0 0x7fac28068fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:03.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.822+0000 7fac39ffb640 1 -- 172.21.15.27:0/1805038027 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fac3c085070 con 0x7fac440b0f80 2024-01-15T11:35:03.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.826+0000 7fac49501640 1 --2- 172.21.15.27:0/1805038027 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fac28066af0 0x7fac28068fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:03.830 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.826+0000 7fac49501640 1 --2- 172.21.15.27:0/1805038027 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fac28066af0 0x7fac28068fb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fac40008930 tx=0x7fac40008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:03.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:03.830+0000 7fac39ffb640 1 -- 172.21.15.27:0/1805038027 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fac4415bc00 con 0x7fac440b0f80 2024-01-15T11:35:04.154 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:04.150+0000 7fac4b765640 1 -- 172.21.15.27:0/1805038027 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) v1 -- 0x7fac440d4290 con 0x7fac28066af0 2024-01-15T11:35:04.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:04.162+0000 7fac39ffb640 1 -- 172.21.15.27:0/1805038027 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+344 (secure 0 0 0) 0x7fac4000c040 con 0x7fac28066af0 2024-01-15T11:35:04.167 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-01-15T11:35:04.167 INFO:teuthology.orchestra.run.smithi027.stdout: "status": { 2024-01-15T11:35:04.167 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "in-progress", 2024-01-15T11:35:04.167 INFO:teuthology.orchestra.run.smithi027.stdout: "source": { 2024-01-15T11:35:04.167 INFO:teuthology.orchestra.run.smithi027.stdout: "volume": "cephfs", 2024-01-15T11:35:04.167 INFO:teuthology.orchestra.run.smithi027.stdout: "subvolume": "sv1", 2024-01-15T11:35:04.167 INFO:teuthology.orchestra.run.smithi027.stdout: "snapshot": "ss1" 2024-01-15T11:35:04.167 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:35:04.167 INFO:teuthology.orchestra.run.smithi027.stdout: "progress_report": { 2024-01-15T11:35:04.167 INFO:teuthology.orchestra.run.smithi027.stdout: "percentage completed": 0.0, 2024-01-15T11:35:04.168 INFO:teuthology.orchestra.run.smithi027.stdout: "amount copied": "0 B/3 GB", 2024-01-15T11:35:04.168 INFO:teuthology.orchestra.run.smithi027.stdout: "regfiles copied": "0/3", 2024-01-15T11:35:04.168 INFO:teuthology.orchestra.run.smithi027.stdout: "subdirs copied": "0/1", 2024-01-15T11:35:04.168 INFO:teuthology.orchestra.run.smithi027.stdout: "symlinks copied": "0/0" 2024-01-15T11:35:04.168 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:04.168 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:04.168 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-01-15T11:35:04.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:04.170+0000 7fac4b765640 1 -- 172.21.15.27:0/1805038027 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fac28066af0 msgr2=0x7fac28068fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:04.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:04.170+0000 7fac4b765640 1 --2- 172.21.15.27:0/1805038027 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fac28066af0 0x7fac28068fb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fac40008930 tx=0x7fac40008040 comp rx=0 tx=0).stop 2024-01-15T11:35:04.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:04.170+0000 7fac4b765640 1 -- 172.21.15.27:0/1805038027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac440b0f80 msgr2=0x7fac440b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:04.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:04.170+0000 7fac4b765640 1 --2- 172.21.15.27:0/1805038027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac440b0f80 0x7fac440b1430 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fac3c007e60 tx=0x7fac3c00e4b0 comp rx=0 tx=0).stop 2024-01-15T11:35:04.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:04.170+0000 7fac4b765640 1 -- 172.21.15.27:0/1805038027 shutdown_connections 2024-01-15T11:35:04.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:04.170+0000 7fac4b765640 1 --2- 172.21.15.27:0/1805038027 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac440b0f80 0x7fac440b1430 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:04.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:04.170+0000 7fac4b765640 1 --2- 172.21.15.27:0/1805038027 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fac4415d7c0 0x7fac4415c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:04.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:04.170+0000 7fac4b765640 1 --2- 172.21.15.27:0/1805038027 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fac28066af0 0x7fac28068fb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:04.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:04.170+0000 7fac4b765640 1 --2- 172.21.15.27:0/1805038027 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fac440d02f0 0x7fac440c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:04.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:04.170+0000 7fac4b765640 1 -- 172.21.15.27:0/1805038027 >> 172.21.15.27:0/1805038027 conn(0x7fac4408afc0 msgr2=0x7fac440cf5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:04.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:04.170+0000 7fac4b765640 1 -- 172.21.15.27:0/1805038027 shutdown_connections 2024-01-15T11:35:04.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:04.170+0000 7fac4b765640 1 -- 172.21.15.27:0/1805038027 wait complete. 2024-01-15T11:35:04.200 INFO:tasks.cephfs.test_volumes:current clone state = in-progress 2024-01-15T11:35:05.201 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-01-15T11:35:05.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.346+0000 7f6caa99d640 1 Processor -- start 2024-01-15T11:35:05.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.346+0000 7f6caa99d640 1 -- start start 2024-01-15T11:35:05.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.346+0000 7f6caa99d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f6ca40cc460 0x7f6ca40abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:05.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.346+0000 7f6caa99d640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca40b2710 con 0x7f6ca415a710 2024-01-15T11:35:05.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.346+0000 7f6caa99d640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca40b29f0 con 0x7f6ca40cdfb0 2024-01-15T11:35:05.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.346+0000 7f6caa99d640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca40cca80 con 0x7f6ca40cc460 2024-01-15T11:35:05.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.346+0000 7f6ca37fe640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f6ca415a710 0x7f6ca40cbd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34126/0 (socket says 172.21.15.27:34126) 2024-01-15T11:35:05.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.350+0000 7f6ca37fe640 1 -- 172.21.15.27:0/2696510933 learned_addr learned my addr 172.21.15.27:0/2696510933 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:35:05.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.350+0000 7f6ca8f3a640 1 --2- 172.21.15.27:0/2696510933 >> v2:172.21.15.27:3300/0 conn(0x7f6ca40cc460 0x7f6ca40abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:05.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.350+0000 7f6ca2ffd640 1 -- 172.21.15.27:0/2696510933 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447047325 0 0) 0x7f6ca40b2710 con 0x7f6ca415a710 2024-01-15T11:35:05.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.350+0000 7f6ca2ffd640 1 -- 172.21.15.27:0/2696510933 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c8c005740 con 0x7f6ca415a710 2024-01-15T11:35:05.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.350+0000 7f6ca8f3a640 1 -- 172.21.15.27:0/2696510933 >> v1:172.21.15.93:6789/0 conn(0x7f6ca40cdfb0 legacy=0x7f6ca40ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:05.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.350+0000 7f6ca8f3a640 1 -- 172.21.15.27:0/2696510933 >> v1:172.21.15.27:6789/0 conn(0x7f6ca415a710 legacy=0x7f6ca40cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:05.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.350+0000 7f6ca8f3a640 1 -- 172.21.15.27:0/2696510933 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca40b2cd0 con 0x7f6ca40cc460 2024-01-15T11:35:05.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.350+0000 7f6ca8f3a640 1 --2- 172.21.15.27:0/2696510933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ca40cc460 0x7f6ca40abf90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009d90 tx=0x7f6c9c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de13b6f9485804e8 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:05.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.350+0000 7f6ca2ffd640 1 -- 172.21.15.27:0/2696510933 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c0a5a00 con 0x7f6ca40cc460 2024-01-15T11:35:05.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.350+0000 7f6ca2ffd640 1 -- 172.21.15.27:0/2696510933 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9c0a5b60 con 0x7f6ca40cc460 2024-01-15T11:35:05.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.350+0000 7f6ca2ffd640 1 -- 172.21.15.27:0/2696510933 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c0ad440 con 0x7f6ca40cc460 2024-01-15T11:35:05.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6caa99d640 1 -- 172.21.15.27:0/2696510933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ca40cc460 msgr2=0x7f6ca40abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:05.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6caa99d640 1 --2- 172.21.15.27:0/2696510933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ca40cc460 0x7f6ca40abf90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009d90 tx=0x7f6c9c01c920 comp rx=0 tx=0).stop 2024-01-15T11:35:05.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6caa99d640 1 -- 172.21.15.27:0/2696510933 shutdown_connections 2024-01-15T11:35:05.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6caa99d640 1 --2- 172.21.15.27:0/2696510933 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ca40cc460 0x7f6ca40abf90 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:05.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6caa99d640 1 -- 172.21.15.27:0/2696510933 >> 172.21.15.27:0/2696510933 conn(0x7f6ca40b0cb0 msgr2=0x7f6ca40b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:05.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6caa99d640 1 -- 172.21.15.27:0/2696510933 shutdown_connections 2024-01-15T11:35:05.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6caa99d640 1 -- 172.21.15.27:0/2696510933 wait complete. 2024-01-15T11:35:05.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6caa99d640 1 Processor -- start 2024-01-15T11:35:05.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6caa99d640 1 -- start start 2024-01-15T11:35:05.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6caa99d640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6ca40cc460 0x7f6ca4146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:05.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6caa99d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ca40cdfb0 0x7f6ca4164850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:05.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6caa99d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ca415a710 0x7f6ca415ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:05.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6caa99d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca4157980 con 0x7f6ca40cdfb0 2024-01-15T11:35:05.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6caa99d640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca4156a20 con 0x7f6ca415a710 2024-01-15T11:35:05.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6caa99d640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca4156d00 con 0x7f6ca40cc460 2024-01-15T11:35:05.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6ca37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ca40cdfb0 0x7f6ca4164850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:05.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6ca37fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ca40cdfb0 0x7f6ca4164850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47584/0 (socket says 172.21.15.27:47584) 2024-01-15T11:35:05.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6ca37fe640 1 -- 172.21.15.27:0/1666106798 learned_addr learned my addr 172.21.15.27:0/1666106798 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:05.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6ca8f3a640 1 --2- 172.21.15.27:0/1666106798 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ca415a710 0x7f6ca415ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:05.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6ca3fff640 1 --2- 172.21.15.27:0/1666106798 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6ca40cc460 0x7f6ca4146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:05.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6ca37fe640 1 -- 172.21.15.27:0/1666106798 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6ca40cc460 msgr2=0x7f6ca4146350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:05.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6ca37fe640 1 --2- 172.21.15.27:0/1666106798 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6ca40cc460 0x7f6ca4146350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:05.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6ca37fe640 1 -- 172.21.15.27:0/1666106798 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ca415a710 msgr2=0x7f6ca415ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:05.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6ca37fe640 1 --2- 172.21.15.27:0/1666106798 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ca415a710 0x7f6ca415ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:05.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6ca37fe640 1 -- 172.21.15.27:0/1666106798 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9c009a70 con 0x7f6ca40cdfb0 2024-01-15T11:35:05.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6ca3fff640 1 --2- 172.21.15.27:0/1666106798 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6ca40cc460 0x7f6ca4146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:35:05.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.354+0000 7f6ca37fe640 1 --2- 172.21.15.27:0/1666106798 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ca40cdfb0 0x7f6ca4164850 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800c400 tx=0x7f6c9800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:05.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.358+0000 7f6ca0ff9640 1 -- 172.21.15.27:0/1666106798 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98005cf0 con 0x7f6ca40cdfb0 2024-01-15T11:35:05.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.358+0000 7f6ca0ff9640 1 -- 172.21.15.27:0/1666106798 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c98005e50 con 0x7f6ca40cdfb0 2024-01-15T11:35:05.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.358+0000 7f6caa99d640 1 -- 172.21.15.27:0/1666106798 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca4156fe0 con 0x7f6ca40cdfb0 2024-01-15T11:35:05.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.358+0000 7f6ca0ff9640 1 -- 172.21.15.27:0/1666106798 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c980072d0 con 0x7f6ca40cdfb0 2024-01-15T11:35:05.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.358+0000 7f6caa99d640 1 -- 172.21.15.27:0/1666106798 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca41575a0 con 0x7f6ca40cdfb0 2024-01-15T11:35:05.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.358+0000 7f6caa99d640 1 -- 172.21.15.27:0/1666106798 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca40671f0 con 0x7f6ca40cdfb0 2024-01-15T11:35:05.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.358+0000 7f6ca0ff9640 1 -- 172.21.15.27:0/1666106798 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7f6c98007430 con 0x7f6ca40cdfb0 2024-01-15T11:35:05.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.358+0000 7f6ca0ff9640 1 --2- 172.21.15.27:0/1666106798 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6c90066aa0 0x7f6c90068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:05.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.358+0000 7f6ca0ff9640 1 -- 172.21.15.27:0/1666106798 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6c98083e70 con 0x7f6ca40cdfb0 2024-01-15T11:35:05.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.358+0000 7f6ca3fff640 1 --2- 172.21.15.27:0/1666106798 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6c90066aa0 0x7f6c90068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:05.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.362+0000 7f6ca3fff640 1 --2- 172.21.15.27:0/1666106798 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6c90066aa0 0x7f6c90068f60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6c94000f70 tx=0x7f6c94009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:05.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.362+0000 7f6ca0ff9640 1 -- 172.21.15.27:0/1666106798 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c98050df0 con 0x7f6ca40cdfb0 2024-01-15T11:35:05.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.554+0000 7f6caa99d640 1 -- 172.21.15.27:0/1666106798 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ca4157ac0 con 0x7f6c90066aa0 2024-01-15T11:35:05.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.558+0000 7f6ca0ff9640 1 -- 172.21.15.27:0/1666106798 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+359 (secure 0 0 0) 0x7f6ca4157ac0 con 0x7f6c90066aa0 2024-01-15T11:35:05.563 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-01-15T11:35:05.564 INFO:teuthology.orchestra.run.smithi027.stdout: "status": { 2024-01-15T11:35:05.564 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "in-progress", 2024-01-15T11:35:05.564 INFO:teuthology.orchestra.run.smithi027.stdout: "source": { 2024-01-15T11:35:05.564 INFO:teuthology.orchestra.run.smithi027.stdout: "volume": "cephfs", 2024-01-15T11:35:05.564 INFO:teuthology.orchestra.run.smithi027.stdout: "subvolume": "sv1", 2024-01-15T11:35:05.564 INFO:teuthology.orchestra.run.smithi027.stdout: "snapshot": "ss1" 2024-01-15T11:35:05.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:35:05.564 INFO:teuthology.orchestra.run.smithi027.stdout: "progress_report": { 2024-01-15T11:35:05.565 INFO:teuthology.orchestra.run.smithi027.stdout: "percentage completed": 33.33333333333333, 2024-01-15T11:35:05.565 INFO:teuthology.orchestra.run.smithi027.stdout: "amount copied": "1 GB/3 GB", 2024-01-15T11:35:05.565 INFO:teuthology.orchestra.run.smithi027.stdout: "regfiles copied": "1/3", 2024-01-15T11:35:05.565 INFO:teuthology.orchestra.run.smithi027.stdout: "subdirs copied": "0/1", 2024-01-15T11:35:05.565 INFO:teuthology.orchestra.run.smithi027.stdout: "symlinks copied": "0/0" 2024-01-15T11:35:05.565 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:05.565 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:05.565 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-01-15T11:35:05.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.562+0000 7f6caa99d640 1 -- 172.21.15.27:0/1666106798 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6c90066aa0 msgr2=0x7f6c90068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:05.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.562+0000 7f6caa99d640 1 --2- 172.21.15.27:0/1666106798 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6c90066aa0 0x7f6c90068f60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6c94000f70 tx=0x7f6c94009040 comp rx=0 tx=0).stop 2024-01-15T11:35:05.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.562+0000 7f6caa99d640 1 -- 172.21.15.27:0/1666106798 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ca40cdfb0 msgr2=0x7f6ca4164850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:05.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.562+0000 7f6caa99d640 1 --2- 172.21.15.27:0/1666106798 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ca40cdfb0 0x7f6ca4164850 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800c400 tx=0x7f6c9800c8c0 comp rx=0 tx=0).stop 2024-01-15T11:35:05.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.562+0000 7f6caa99d640 1 -- 172.21.15.27:0/1666106798 shutdown_connections 2024-01-15T11:35:05.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.562+0000 7f6caa99d640 1 --2- 172.21.15.27:0/1666106798 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f6c90066aa0 0x7f6c90068f60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:05.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.562+0000 7f6caa99d640 1 --2- 172.21.15.27:0/1666106798 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ca415a710 0x7f6ca415ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:05.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.562+0000 7f6caa99d640 1 --2- 172.21.15.27:0/1666106798 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6ca40cdfb0 0x7f6ca4164850 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:05.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.562+0000 7f6caa99d640 1 --2- 172.21.15.27:0/1666106798 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6ca40cc460 0x7f6ca4146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:05.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.562+0000 7f6caa99d640 1 -- 172.21.15.27:0/1666106798 >> 172.21.15.27:0/1666106798 conn(0x7f6ca40b0cb0 msgr2=0x7f6ca415e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:05.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.562+0000 7f6caa99d640 1 -- 172.21.15.27:0/1666106798 shutdown_connections 2024-01-15T11:35:05.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:05.562+0000 7f6caa99d640 1 -- 172.21.15.27:0/1666106798 wait complete. 2024-01-15T11:35:05.585 INFO:tasks.cephfs.test_volumes:current clone state = in-progress 2024-01-15T11:35:06.587 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-01-15T11:35:06.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.746+0000 7f5808ed6640 1 Processor -- start 2024-01-15T11:35:06.748 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.746+0000 7f5808ed6640 1 -- start start 2024-01-15T11:35:06.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.746+0000 7f5808ed6640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5804154940 0x7f580406da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:06.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.746+0000 7f5808ed6640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f580415e6a0 0x7f58040ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:06.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.746+0000 7f5808ed6640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58040cd870 con 0x7f580406df50 2024-01-15T11:35:06.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.746+0000 7f5808ed6640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5804154d20 con 0x7f580415e6a0 2024-01-15T11:35:06.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.746+0000 7f5808ed6640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580415ecc0 con 0x7f5804154940 2024-01-15T11:35:06.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.746+0000 7f5802d9d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f580415e6a0 0x7f58040ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:06.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.746+0000 7f5802d9d640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f580415e6a0 0x7f58040ad080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47598/0 (socket says 172.21.15.27:47598) 2024-01-15T11:35:06.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.746+0000 7f5802d9d640 1 -- 172.21.15.27:0/1553920824 learned_addr learned my addr 172.21.15.27:0/1553920824 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:06.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.746+0000 7f580259c640 1 --2- 172.21.15.27:0/1553920824 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5804154940 0x7f580406da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:06.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.746+0000 7f5802d9d640 1 -- 172.21.15.27:0/1553920824 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5804154940 msgr2=0x7f580406da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:06.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.746+0000 7f5802d9d640 1 --2- 172.21.15.27:0/1553920824 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5804154940 0x7f580406da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:06.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.746+0000 7f5802d9d640 1 -- 172.21.15.27:0/1553920824 >> v1:172.21.15.93:6789/0 conn(0x7f580406df50 legacy=0x7f580415df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:06.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.746+0000 7f5802d9d640 1 -- 172.21.15.27:0/1553920824 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58040ccf40 con 0x7f580415e6a0 2024-01-15T11:35:06.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.750+0000 7f5802d9d640 1 --2- 172.21.15.27:0/1553920824 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f580415e6a0 0x7f58040ad080 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009e50 tx=0x7f57fc01c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9806f70f8272c077 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:06.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.750+0000 7f580159a640 1 -- 172.21.15.27:0/1553920824 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc0a56c0 con 0x7f580415e6a0 2024-01-15T11:35:06.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.750+0000 7f580159a640 1 -- 172.21.15.27:0/1553920824 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57fc0a5820 con 0x7f580415e6a0 2024-01-15T11:35:06.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.750+0000 7f580159a640 1 -- 172.21.15.27:0/1553920824 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc0a5bb0 con 0x7f580415e6a0 2024-01-15T11:35:06.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.750+0000 7f5808ed6640 1 -- 172.21.15.27:0/1553920824 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f580415e6a0 msgr2=0x7f58040ad080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:06.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.750+0000 7f5808ed6640 1 --2- 172.21.15.27:0/1553920824 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f580415e6a0 0x7f58040ad080 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009e50 tx=0x7f57fc01c800 comp rx=0 tx=0).stop 2024-01-15T11:35:06.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.750+0000 7f5808ed6640 1 -- 172.21.15.27:0/1553920824 shutdown_connections 2024-01-15T11:35:06.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.750+0000 7f5808ed6640 1 --2- 172.21.15.27:0/1553920824 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f580415e6a0 0x7f58040ad080 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:06.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.750+0000 7f5808ed6640 1 --2- 172.21.15.27:0/1553920824 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5804154940 0x7f580406da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:06.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.750+0000 7f5808ed6640 1 -- 172.21.15.27:0/1553920824 >> 172.21.15.27:0/1553920824 conn(0x7f58040b0cb0 msgr2=0x7f58040b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:06.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.750+0000 7f5808ed6640 1 -- 172.21.15.27:0/1553920824 shutdown_connections 2024-01-15T11:35:06.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.750+0000 7f5808ed6640 1 -- 172.21.15.27:0/1553920824 wait complete. 2024-01-15T11:35:06.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.754+0000 7f5808ed6640 1 Processor -- start 2024-01-15T11:35:06.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.754+0000 7f5808ed6640 1 -- start start 2024-01-15T11:35:06.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.754+0000 7f5808ed6640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f580406df50 0x7f5804153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:06.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.754+0000 7f5808ed6640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5804154940 0x7f58041358d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:06.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.754+0000 7f5808ed6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f580415e6a0 0x7f5804150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:06.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.754+0000 7f5808ed6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5804070e80 con 0x7f580415e6a0 2024-01-15T11:35:06.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.754+0000 7f5808ed6640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5804153a50 con 0x7f5804154940 2024-01-15T11:35:06.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.754+0000 7f5808ed6640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5804153770 con 0x7f580406df50 2024-01-15T11:35:06.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.754+0000 7f5802d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f580415e6a0 0x7f5804150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:06.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.754+0000 7f5802d9d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f580415e6a0 0x7f5804150c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47608/0 (socket says 172.21.15.27:47608) 2024-01-15T11:35:06.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.754+0000 7f5802d9d640 1 -- 172.21.15.27:0/800755594 learned_addr learned my addr 172.21.15.27:0/800755594 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:06.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.754+0000 7f580259c640 1 --2- 172.21.15.27:0/800755594 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f580406df50 0x7f5804153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:06.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.754+0000 7f5801d9b640 1 --2- 172.21.15.27:0/800755594 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5804154940 0x7f58041358d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:06.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.754+0000 7f5802d9d640 1 -- 172.21.15.27:0/800755594 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f580406df50 msgr2=0x7f5804153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:06.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.754+0000 7f5802d9d640 1 --2- 172.21.15.27:0/800755594 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f580406df50 0x7f5804153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:06.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.754+0000 7f5802d9d640 1 -- 172.21.15.27:0/800755594 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5804154940 msgr2=0x7f58041358d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:06.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.754+0000 7f5802d9d640 1 --2- 172.21.15.27:0/800755594 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5804154940 0x7f58041358d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:06.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.754+0000 7f5802d9d640 1 -- 172.21.15.27:0/800755594 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57fc009b30 con 0x7f580415e6a0 2024-01-15T11:35:06.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.754+0000 7f5802d9d640 1 --2- 172.21.15.27:0/800755594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f580415e6a0 0x7f5804150c10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f57fc0af040 tx=0x7f57fc0195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:06.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.754+0000 7f57f2ffd640 1 -- 172.21.15.27:0/800755594 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc0b8670 con 0x7f580415e6a0 2024-01-15T11:35:06.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.754+0000 7f57f2ffd640 1 -- 172.21.15.27:0/800755594 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57fc0b87d0 con 0x7f580415e6a0 2024-01-15T11:35:06.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.754+0000 7f57f2ffd640 1 -- 172.21.15.27:0/800755594 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc0b8b80 con 0x7f580415e6a0 2024-01-15T11:35:06.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.754+0000 7f5808ed6640 1 -- 172.21.15.27:0/800755594 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58040707c0 con 0x7f580415e6a0 2024-01-15T11:35:06.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.754+0000 7f5808ed6640 1 -- 172.21.15.27:0/800755594 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5804151150 con 0x7f580415e6a0 2024-01-15T11:35:06.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.758+0000 7f5808ed6640 1 -- 172.21.15.27:0/800755594 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58040671f0 con 0x7f580415e6a0 2024-01-15T11:35:06.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.758+0000 7f57f2ffd640 1 -- 172.21.15.27:0/800755594 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7f57fc0b8ce0 con 0x7f580415e6a0 2024-01-15T11:35:06.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.758+0000 7f57f2ffd640 1 --2- 172.21.15.27:0/800755594 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f57e4066aa0 0x7f57e4068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:06.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.758+0000 7f57f2ffd640 1 -- 172.21.15.27:0/800755594 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f57fc11fbe0 con 0x7f580415e6a0 2024-01-15T11:35:06.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.758+0000 7f580259c640 1 --2- 172.21.15.27:0/800755594 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f57e4066aa0 0x7f57e4068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:06.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.758+0000 7f580259c640 1 --2- 172.21.15.27:0/800755594 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f57e4066aa0 0x7f57e4068f60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f58041f9ae0 tx=0x7f57f4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:06.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:06.762+0000 7f57f2ffd640 1 -- 172.21.15.27:0/800755594 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f57fc0ecbc0 con 0x7f580415e6a0 2024-01-15T11:35:07.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:07.006+0000 7f5808ed6640 1 -- 172.21.15.27:0/800755594 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) v1 -- 0x7f580406e330 con 0x7f57e4066aa0 2024-01-15T11:35:07.043 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:07.038+0000 7f57f2ffd640 1 -- 172.21.15.27:0/800755594 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+359 (secure 0 0 0) 0x7f580406e330 con 0x7f57e4066aa0 2024-01-15T11:35:07.044 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-01-15T11:35:07.044 INFO:teuthology.orchestra.run.smithi027.stdout: "status": { 2024-01-15T11:35:07.044 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "in-progress", 2024-01-15T11:35:07.044 INFO:teuthology.orchestra.run.smithi027.stdout: "source": { 2024-01-15T11:35:07.044 INFO:teuthology.orchestra.run.smithi027.stdout: "volume": "cephfs", 2024-01-15T11:35:07.044 INFO:teuthology.orchestra.run.smithi027.stdout: "subvolume": "sv1", 2024-01-15T11:35:07.044 INFO:teuthology.orchestra.run.smithi027.stdout: "snapshot": "ss1" 2024-01-15T11:35:07.044 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:35:07.045 INFO:teuthology.orchestra.run.smithi027.stdout: "progress_report": { 2024-01-15T11:35:07.045 INFO:teuthology.orchestra.run.smithi027.stdout: "percentage completed": 33.33333333333333, 2024-01-15T11:35:07.045 INFO:teuthology.orchestra.run.smithi027.stdout: "amount copied": "1 GB/3 GB", 2024-01-15T11:35:07.045 INFO:teuthology.orchestra.run.smithi027.stdout: "regfiles copied": "1/3", 2024-01-15T11:35:07.045 INFO:teuthology.orchestra.run.smithi027.stdout: "subdirs copied": "0/1", 2024-01-15T11:35:07.045 INFO:teuthology.orchestra.run.smithi027.stdout: "symlinks copied": "0/0" 2024-01-15T11:35:07.045 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:07.045 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:07.045 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-01-15T11:35:07.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:07.042+0000 7f5808ed6640 1 -- 172.21.15.27:0/800755594 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f57e4066aa0 msgr2=0x7f57e4068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:07.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:07.042+0000 7f5808ed6640 1 --2- 172.21.15.27:0/800755594 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f57e4066aa0 0x7f57e4068f60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f58041f9ae0 tx=0x7f57f4008040 comp rx=0 tx=0).stop 2024-01-15T11:35:07.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:07.042+0000 7f5808ed6640 1 -- 172.21.15.27:0/800755594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f580415e6a0 msgr2=0x7f5804150c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:07.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:07.042+0000 7f5808ed6640 1 --2- 172.21.15.27:0/800755594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f580415e6a0 0x7f5804150c10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f57fc0af040 tx=0x7f57fc0195a0 comp rx=0 tx=0).stop 2024-01-15T11:35:07.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:07.046+0000 7f5808ed6640 1 -- 172.21.15.27:0/800755594 shutdown_connections 2024-01-15T11:35:07.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:07.046+0000 7f5808ed6640 1 --2- 172.21.15.27:0/800755594 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f580415e6a0 0x7f5804150c10 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:07.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:07.046+0000 7f5808ed6640 1 --2- 172.21.15.27:0/800755594 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f57e4066aa0 0x7f57e4068f60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:07.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:07.046+0000 7f5808ed6640 1 --2- 172.21.15.27:0/800755594 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5804154940 0x7f58041358d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:07.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:07.046+0000 7f5808ed6640 1 --2- 172.21.15.27:0/800755594 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f580406df50 0x7f5804153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:07.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:07.046+0000 7f5808ed6640 1 -- 172.21.15.27:0/800755594 >> 172.21.15.27:0/800755594 conn(0x7f58040b0cb0 msgr2=0x7f58040af100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:07.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:07.046+0000 7f5808ed6640 1 -- 172.21.15.27:0/800755594 shutdown_connections 2024-01-15T11:35:07.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:07.046+0000 7f5808ed6640 1 -- 172.21.15.27:0/800755594 wait complete. 2024-01-15T11:35:07.077 INFO:tasks.cephfs.test_volumes:current clone state = in-progress 2024-01-15T11:35:08.078 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-01-15T11:35:08.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.290+0000 7fe28879d640 1 Processor -- start 2024-01-15T11:35:08.294 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.290+0000 7fe28879d640 1 -- start start 2024-01-15T11:35:08.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.290+0000 7fe28879d640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe2800af300 0x7fe2800af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:08.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.290+0000 7fe28879d640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2800ad700 con 0x7fe28015a790 2024-01-15T11:35:08.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.290+0000 7fe28879d640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2800b28c0 con 0x7fe28015a3b0 2024-01-15T11:35:08.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.290+0000 7fe28879d640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2800b2ba0 con 0x7fe2800af300 2024-01-15T11:35:08.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.290+0000 7fe286d3a640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fe28015a790 0x7fe2800b3160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34130/0 (socket says 172.21.15.27:34130) 2024-01-15T11:35:08.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.290+0000 7fe286d3a640 1 -- 172.21.15.27:0/1664341005 learned_addr learned my addr 172.21.15.27:0/1664341005 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:35:08.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.294+0000 7fe285537640 1 -- 172.21.15.27:0/1664341005 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3713239862 0 0) 0x7fe2800ad700 con 0x7fe28015a790 2024-01-15T11:35:08.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.294+0000 7fe285537640 1 -- 172.21.15.27:0/1664341005 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe26c003530 con 0x7fe28015a790 2024-01-15T11:35:08.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.294+0000 7fe285537640 1 -- 172.21.15.27:0/1664341005 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2258657636 0 0) 0x7fe26c003530 con 0x7fe28015a790 2024-01-15T11:35:08.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.294+0000 7fe285537640 1 -- 172.21.15.27:0/1664341005 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe2800af300 msgr2=0x7fe2800af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:08.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.294+0000 7fe285537640 1 --2- 172.21.15.27:0/1664341005 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe2800af300 0x7fe2800af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:08.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.294+0000 7fe285537640 1 -- 172.21.15.27:0/1664341005 >> v1:172.21.15.93:6789/0 conn(0x7fe28015a3b0 legacy=0x7fe28006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:08.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.294+0000 7fe285537640 1 -- 172.21.15.27:0/1664341005 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2800ad9a0 con 0x7fe28015a790 2024-01-15T11:35:08.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.294+0000 7fe285537640 1 -- 172.21.15.27:0/1664341005 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1394381265 0 0) 0x7fe278001a00 con 0x7fe28015a790 2024-01-15T11:35:08.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.294+0000 7fe285537640 1 -- 172.21.15.27:0/1664341005 >> v1:172.21.15.27:6789/0 conn(0x7fe28015a790 legacy=0x7fe2800b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:08.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.294+0000 7fe285537640 1 --2- 172.21.15.27:0/1664341005 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe26c0039b0 0x7fe26c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:08.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.294+0000 7fe285537640 1 --2- 172.21.15.27:0/1664341005 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe26c0047d0 0x7fe26c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:08.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.294+0000 7fe285537640 1 --2- 172.21.15.27:0/1664341005 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe26c0052b0 0x7fe26c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:08.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.294+0000 7fe285537640 1 -- 172.21.15.27:0/1664341005 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2800b2ba0 con 0x7fe26c0039b0 2024-01-15T11:35:08.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.294+0000 7fe285537640 1 -- 172.21.15.27:0/1664341005 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c00c160 con 0x7fe26c0052b0 2024-01-15T11:35:08.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.294+0000 7fe285537640 1 -- 172.21.15.27:0/1664341005 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c00e530 con 0x7fe26c0047d0 2024-01-15T11:35:08.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.294+0000 7fe286539640 1 --2- 172.21.15.27:0/1664341005 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe26c0039b0 0x7fe26c003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:08.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.294+0000 7fe286539640 1 -- 172.21.15.27:0/1664341005 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe26c0047d0 msgr2=0x7fe26c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:08.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.294+0000 7fe286539640 1 --2- 172.21.15.27:0/1664341005 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe26c0047d0 0x7fe26c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:08.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.294+0000 7fe286539640 1 -- 172.21.15.27:0/1664341005 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe26c0052b0 msgr2=0x7fe26c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:08.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.294+0000 7fe286539640 1 --2- 172.21.15.27:0/1664341005 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe26c0052b0 0x7fe26c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:08.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.294+0000 7fe286539640 1 -- 172.21.15.27:0/1664341005 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2800ad9a0 con 0x7fe26c0039b0 2024-01-15T11:35:08.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.298+0000 7fe286539640 1 --2- 172.21.15.27:0/1664341005 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe26c0039b0 0x7fe26c003db0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe27c007fd0 tx=0x7fe27c01c290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac78152c4d8e60d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:08.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.298+0000 7fe285537640 1 -- 172.21.15.27:0/1664341005 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c005270 con 0x7fe26c0039b0 2024-01-15T11:35:08.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.298+0000 7fe285537640 1 -- 172.21.15.27:0/1664341005 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c0a7070 con 0x7fe26c0039b0 2024-01-15T11:35:08.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.298+0000 7fe285537640 1 -- 172.21.15.27:0/1664341005 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c003620 con 0x7fe26c0039b0 2024-01-15T11:35:08.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.298+0000 7fe28879d640 1 -- 172.21.15.27:0/1664341005 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe26c0039b0 msgr2=0x7fe26c003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:08.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.298+0000 7fe28879d640 1 --2- 172.21.15.27:0/1664341005 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe26c0039b0 0x7fe26c003db0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe27c007fd0 tx=0x7fe27c01c290 comp rx=0 tx=0).stop 2024-01-15T11:35:08.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.298+0000 7fe286d3a640 1 -- 172.21.15.27:0/1664341005 reap_dead start 2024-01-15T11:35:08.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.298+0000 7fe28879d640 1 -- 172.21.15.27:0/1664341005 shutdown_connections 2024-01-15T11:35:08.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.298+0000 7fe28879d640 1 -- 172.21.15.27:0/1664341005 >> 172.21.15.27:0/1664341005 conn(0x7fe280071c90 msgr2=0x7fe2800b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:08.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.298+0000 7fe28879d640 1 -- 172.21.15.27:0/1664341005 shutdown_connections 2024-01-15T11:35:08.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.298+0000 7fe28879d640 1 -- 172.21.15.27:0/1664341005 wait complete. 2024-01-15T11:35:08.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.302+0000 7fe28879d640 1 Processor -- start 2024-01-15T11:35:08.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.302+0000 7fe28879d640 1 -- start start 2024-01-15T11:35:08.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.302+0000 7fe28879d640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe26c0039b0 0x7fe2800b0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:08.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.302+0000 7fe28879d640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2801587d0 0x7fe2801439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:08.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.302+0000 7fe28879d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe28006a5b0 0x7fe28006aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:08.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.302+0000 7fe28879d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe280159a20 con 0x7fe28006a5b0 2024-01-15T11:35:08.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.302+0000 7fe28879d640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28006af70 con 0x7fe2801587d0 2024-01-15T11:35:08.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.302+0000 7fe28879d640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe280158da0 con 0x7fe26c0039b0 2024-01-15T11:35:08.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.302+0000 7fe286d3a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe28006a5b0 0x7fe28006aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:08.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.302+0000 7fe286d3a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe28006a5b0 0x7fe28006aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47624/0 (socket says 172.21.15.27:47624) 2024-01-15T11:35:08.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.302+0000 7fe286d3a640 1 -- 172.21.15.27:0/3896007276 learned_addr learned my addr 172.21.15.27:0/3896007276 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:08.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.302+0000 7fe286539640 1 --2- 172.21.15.27:0/3896007276 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe26c0039b0 0x7fe2800b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:08.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.302+0000 7fe285d38640 1 --2- 172.21.15.27:0/3896007276 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2801587d0 0x7fe2801439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:08.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.302+0000 7fe286d3a640 1 -- 172.21.15.27:0/3896007276 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe26c0039b0 msgr2=0x7fe2800b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:08.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.302+0000 7fe286d3a640 1 --2- 172.21.15.27:0/3896007276 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe26c0039b0 0x7fe2800b0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:08.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.302+0000 7fe286d3a640 1 -- 172.21.15.27:0/3896007276 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2801587d0 msgr2=0x7fe2801439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:08.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.302+0000 7fe286d3a640 1 --2- 172.21.15.27:0/3896007276 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2801587d0 0x7fe2801439b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:08.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.302+0000 7fe286d3a640 1 -- 172.21.15.27:0/3896007276 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe280159080 con 0x7fe28006a5b0 2024-01-15T11:35:08.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.306+0000 7fe285d38640 1 --2- 172.21.15.27:0/3896007276 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2801587d0 0x7fe2801439b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:35:08.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.306+0000 7fe286d3a640 1 --2- 172.21.15.27:0/3896007276 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe28006a5b0 0x7fe28006aa30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe2800b5830 tx=0x7fe27800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:08.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.306+0000 7fe276ffd640 1 -- 172.21.15.27:0/3896007276 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27800a6d0 con 0x7fe28006a5b0 2024-01-15T11:35:08.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.306+0000 7fe276ffd640 1 -- 172.21.15.27:0/3896007276 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27800a830 con 0x7fe28006a5b0 2024-01-15T11:35:08.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.306+0000 7fe276ffd640 1 -- 172.21.15.27:0/3896007276 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27800abe0 con 0x7fe28006a5b0 2024-01-15T11:35:08.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.306+0000 7fe28879d640 1 -- 172.21.15.27:0/3896007276 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe280159360 con 0x7fe28006a5b0 2024-01-15T11:35:08.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.306+0000 7fe28879d640 1 -- 172.21.15.27:0/3896007276 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2800b0c70 con 0x7fe28006a5b0 2024-01-15T11:35:08.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.306+0000 7fe28879d640 1 -- 172.21.15.27:0/3896007276 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe280159b60 con 0x7fe28006a5b0 2024-01-15T11:35:08.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.310+0000 7fe276ffd640 1 -- 172.21.15.27:0/3896007276 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7fe27800ad40 con 0x7fe28006a5b0 2024-01-15T11:35:08.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.314+0000 7fe276ffd640 1 --2- 172.21.15.27:0/3896007276 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fe264066b70 0x7fe264069030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:08.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.314+0000 7fe276ffd640 1 -- 172.21.15.27:0/3896007276 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe278084410 con 0x7fe28006a5b0 2024-01-15T11:35:08.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.318+0000 7fe276ffd640 1 -- 172.21.15.27:0/3896007276 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe278084740 con 0x7fe28006a5b0 2024-01-15T11:35:08.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.318+0000 7fe286539640 1 --2- 172.21.15.27:0/3896007276 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fe264066b70 0x7fe264069030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:08.325 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.322+0000 7fe286539640 1 --2- 172.21.15.27:0/3896007276 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fe264066b70 0x7fe264069030 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0aa000 tx=0x7fe27c001030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:08.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.666+0000 7fe28879d640 1 -- 172.21.15.27:0/3896007276 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2800aec90 con 0x7fe264066b70 2024-01-15T11:35:08.674 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.670+0000 7fe276ffd640 1 -- 172.21.15.27:0/3896007276 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+359 (secure 0 0 0) 0x7fe27c0b3040 con 0x7fe264066b70 2024-01-15T11:35:08.675 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-01-15T11:35:08.675 INFO:teuthology.orchestra.run.smithi027.stdout: "status": { 2024-01-15T11:35:08.675 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "in-progress", 2024-01-15T11:35:08.675 INFO:teuthology.orchestra.run.smithi027.stdout: "source": { 2024-01-15T11:35:08.675 INFO:teuthology.orchestra.run.smithi027.stdout: "volume": "cephfs", 2024-01-15T11:35:08.675 INFO:teuthology.orchestra.run.smithi027.stdout: "subvolume": "sv1", 2024-01-15T11:35:08.675 INFO:teuthology.orchestra.run.smithi027.stdout: "snapshot": "ss1" 2024-01-15T11:35:08.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:35:08.675 INFO:teuthology.orchestra.run.smithi027.stdout: "progress_report": { 2024-01-15T11:35:08.675 INFO:teuthology.orchestra.run.smithi027.stdout: "percentage completed": 66.66666666666666, 2024-01-15T11:35:08.676 INFO:teuthology.orchestra.run.smithi027.stdout: "amount copied": "2 GB/3 GB", 2024-01-15T11:35:08.676 INFO:teuthology.orchestra.run.smithi027.stdout: "regfiles copied": "2/3", 2024-01-15T11:35:08.676 INFO:teuthology.orchestra.run.smithi027.stdout: "subdirs copied": "0/1", 2024-01-15T11:35:08.676 INFO:teuthology.orchestra.run.smithi027.stdout: "symlinks copied": "0/0" 2024-01-15T11:35:08.676 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:08.676 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:08.676 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-01-15T11:35:08.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.674+0000 7fe28879d640 1 -- 172.21.15.27:0/3896007276 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fe264066b70 msgr2=0x7fe264069030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:08.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.674+0000 7fe28879d640 1 --2- 172.21.15.27:0/3896007276 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fe264066b70 0x7fe264069030 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0aa000 tx=0x7fe27c001030 comp rx=0 tx=0).stop 2024-01-15T11:35:08.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.674+0000 7fe28879d640 1 -- 172.21.15.27:0/3896007276 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe28006a5b0 msgr2=0x7fe28006aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:08.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.674+0000 7fe28879d640 1 --2- 172.21.15.27:0/3896007276 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe28006a5b0 0x7fe28006aa30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe2800b5830 tx=0x7fe27800cf00 comp rx=0 tx=0).stop 2024-01-15T11:35:08.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.674+0000 7fe28879d640 1 -- 172.21.15.27:0/3896007276 shutdown_connections 2024-01-15T11:35:08.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.674+0000 7fe28879d640 1 --2- 172.21.15.27:0/3896007276 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe28006a5b0 0x7fe28006aa30 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:08.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.674+0000 7fe28879d640 1 --2- 172.21.15.27:0/3896007276 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fe264066b70 0x7fe264069030 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:08.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.674+0000 7fe28879d640 1 --2- 172.21.15.27:0/3896007276 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2801587d0 0x7fe2801439b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:08.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.674+0000 7fe28879d640 1 --2- 172.21.15.27:0/3896007276 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe26c0039b0 0x7fe2800b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:08.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.674+0000 7fe28879d640 1 -- 172.21.15.27:0/3896007276 >> 172.21.15.27:0/3896007276 conn(0x7fe280071c90 msgr2=0x7fe280153a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:08.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.674+0000 7fe28879d640 1 -- 172.21.15.27:0/3896007276 shutdown_connections 2024-01-15T11:35:08.679 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:08.674+0000 7fe28879d640 1 -- 172.21.15.27:0/3896007276 wait complete. 2024-01-15T11:35:08.696 INFO:tasks.cephfs.test_volumes:current clone state = in-progress 2024-01-15T11:35:09.697 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-01-15T11:35:09.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.850+0000 7fa0ba9e4640 1 Processor -- start 2024-01-15T11:35:09.855 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.850+0000 7fa0ba9e4640 1 -- start start 2024-01-15T11:35:09.857 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.854+0000 7fa0ba9e4640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa0b406c250 0x7fa0b406c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:09.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.854+0000 7fa0ba9e4640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa0b40b3340 0x7fa0b40b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:09.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.854+0000 7fa0ba9e4640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b406cbf0 con 0x7fa0b4143e50 2024-01-15T11:35:09.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.854+0000 7fa0ba9e4640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b40cecf0 con 0x7fa0b406c250 2024-01-15T11:35:09.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.854+0000 7fa0ba9e4640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b415ef10 con 0x7fa0b40b3340 2024-01-15T11:35:09.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.854+0000 7fa0b91e1640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa0b406c250 0x7fa0b406c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:09.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.854+0000 7fa0b91e1640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fa0b406c250 0x7fa0b406c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47640/0 (socket says 172.21.15.27:47640) 2024-01-15T11:35:09.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.854+0000 7fa0b91e1640 1 -- 172.21.15.27:0/189896736 learned_addr learned my addr 172.21.15.27:0/189896736 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:09.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.854+0000 7fa0ba1e3640 1 --2- 172.21.15.27:0/189896736 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa0b40b3340 0x7fa0b40b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:09.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.854+0000 7fa0b91e1640 1 -- 172.21.15.27:0/189896736 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa0b40b3340 msgr2=0x7fa0b40b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:09.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.854+0000 7fa0b91e1640 1 --2- 172.21.15.27:0/189896736 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa0b40b3340 0x7fa0b40b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:09.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.854+0000 7fa0b91e1640 1 -- 172.21.15.27:0/189896736 >> v1:172.21.15.93:6789/0 conn(0x7fa0b4143e50 legacy=0x7fa0b41444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:09.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.854+0000 7fa0b91e1640 1 -- 172.21.15.27:0/189896736 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b415f1f0 con 0x7fa0b406c250 2024-01-15T11:35:09.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.854+0000 7fa0ba1e3640 1 --2- 172.21.15.27:0/189896736 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa0b40b3340 0x7fa0b40b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:35:09.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.858+0000 7fa0b91e1640 1 --2- 172.21.15.27:0/189896736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0b406c250 0x7fa0b406c6b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4009870 tx=0x7fa0a401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4e99cb456e0647 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:09.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.858+0000 7fa0b89e0640 1 -- 172.21.15.27:0/189896736 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a40ab600 con 0x7fa0b406c250 2024-01-15T11:35:09.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.858+0000 7fa0b89e0640 1 -- 172.21.15.27:0/189896736 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a40ab760 con 0x7fa0b406c250 2024-01-15T11:35:09.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.858+0000 7fa0b89e0640 1 -- 172.21.15.27:0/189896736 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a40abaf0 con 0x7fa0b406c250 2024-01-15T11:35:09.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.858+0000 7fa0ba9e4640 1 -- 172.21.15.27:0/189896736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0b406c250 msgr2=0x7fa0b406c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:09.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.858+0000 7fa0ba9e4640 1 --2- 172.21.15.27:0/189896736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0b406c250 0x7fa0b406c6b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4009870 tx=0x7fa0a401c440 comp rx=0 tx=0).stop 2024-01-15T11:35:09.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.858+0000 7fa0ba9e4640 1 -- 172.21.15.27:0/189896736 shutdown_connections 2024-01-15T11:35:09.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.858+0000 7fa0ba9e4640 1 --2- 172.21.15.27:0/189896736 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa0b40b3340 0x7fa0b40b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:09.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.858+0000 7fa0ba9e4640 1 --2- 172.21.15.27:0/189896736 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0b406c250 0x7fa0b406c6b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:09.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.858+0000 7fa0ba9e4640 1 -- 172.21.15.27:0/189896736 >> 172.21.15.27:0/189896736 conn(0x7fa0b406df30 msgr2=0x7fa0b406a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:09.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.858+0000 7fa0ba9e4640 1 -- 172.21.15.27:0/189896736 shutdown_connections 2024-01-15T11:35:09.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.858+0000 7fa0ba9e4640 1 -- 172.21.15.27:0/189896736 wait complete. 2024-01-15T11:35:09.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.858+0000 7fa0ba9e4640 1 Processor -- start 2024-01-15T11:35:09.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.858+0000 7fa0ba9e4640 1 -- start start 2024-01-15T11:35:09.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0ba9e4640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0b406c250 0x7fa0b413f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:09.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0ba9e4640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa0b40b3340 0x7fa0b4155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:09.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0ba9e4640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0b4143e50 0x7fa0b40b2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:09.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0ba9e4640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b413e8b0 con 0x7fa0b4143e50 2024-01-15T11:35:09.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0ba9e4640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b41419c0 con 0x7fa0b406c250 2024-01-15T11:35:09.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0ba9e4640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b4141ca0 con 0x7fa0b40b3340 2024-01-15T11:35:09.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0ba1e3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0b4143e50 0x7fa0b40b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:09.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0ba1e3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0b4143e50 0x7fa0b40b2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47644/0 (socket says 172.21.15.27:47644) 2024-01-15T11:35:09.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0ba1e3640 1 -- 172.21.15.27:0/2265563755 learned_addr learned my addr 172.21.15.27:0/2265563755 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:09.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0b99e2640 1 --2- 172.21.15.27:0/2265563755 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0b406c250 0x7fa0b413f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:09.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0b91e1640 1 --2- 172.21.15.27:0/2265563755 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa0b40b3340 0x7fa0b4155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:09.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0ba1e3640 1 -- 172.21.15.27:0/2265563755 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa0b40b3340 msgr2=0x7fa0b4155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:09.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0ba1e3640 1 --2- 172.21.15.27:0/2265563755 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa0b40b3340 0x7fa0b4155810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:09.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0ba1e3640 1 -- 172.21.15.27:0/2265563755 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0b406c250 msgr2=0x7fa0b413f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:09.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0ba1e3640 1 --2- 172.21.15.27:0/2265563755 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0b406c250 0x7fa0b413f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:09.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0ba1e3640 1 -- 172.21.15.27:0/2265563755 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a40094d0 con 0x7fa0b4143e50 2024-01-15T11:35:09.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0b91e1640 1 --2- 172.21.15.27:0/2265563755 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa0b40b3340 0x7fa0b4155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:35:09.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0b99e2640 1 --2- 172.21.15.27:0/2265563755 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0b406c250 0x7fa0b413f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:35:09.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0ba1e3640 1 --2- 172.21.15.27:0/2265563755 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0b4143e50 0x7fa0b40b2240 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00cef0 tx=0x7fa0ac00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:09.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0aa7fc640 1 -- 172.21.15.27:0/2265563755 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac00d840 con 0x7fa0b4143e50 2024-01-15T11:35:09.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0aa7fc640 1 -- 172.21.15.27:0/2265563755 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ac00d9c0 con 0x7fa0b4143e50 2024-01-15T11:35:09.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0aa7fc640 1 -- 172.21.15.27:0/2265563755 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac00dd70 con 0x7fa0b4143e50 2024-01-15T11:35:09.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0ba9e4640 1 -- 172.21.15.27:0/2265563755 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b413eb30 con 0x7fa0b4143e50 2024-01-15T11:35:09.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0ba9e4640 1 -- 172.21.15.27:0/2265563755 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b4155d50 con 0x7fa0b4143e50 2024-01-15T11:35:09.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0ba9e4640 1 -- 172.21.15.27:0/2265563755 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b4074990 con 0x7fa0b4143e50 2024-01-15T11:35:09.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.862+0000 7fa0aa7fc640 1 -- 172.21.15.27:0/2265563755 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7fa0ac01e3b0 con 0x7fa0b4143e50 2024-01-15T11:35:09.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.866+0000 7fa0aa7fc640 1 --2- 172.21.15.27:0/2265563755 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa098066aa0 0x7fa098068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:09.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.866+0000 7fa0aa7fc640 1 -- 172.21.15.27:0/2265563755 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa0ac085290 con 0x7fa0b4143e50 2024-01-15T11:35:09.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.866+0000 7fa0b99e2640 1 --2- 172.21.15.27:0/2265563755 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa098066aa0 0x7fa098068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:09.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.866+0000 7fa0b99e2640 1 --2- 172.21.15.27:0/2265563755 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa098066aa0 0x7fa098068f60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0003ec0 tx=0x7fa0b0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:09.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:09.870+0000 7fa0aa7fc640 1 -- 172.21.15.27:0/2265563755 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa0ac052280 con 0x7fa0b4143e50 2024-01-15T11:35:10.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:10.058+0000 7fa0ba9e4640 1 -- 172.21.15.27:0/2265563755 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0b4144230 con 0x7fa098066aa0 2024-01-15T11:35:10.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:10.066+0000 7fa0aa7fc640 1 -- 172.21.15.27:0/2265563755 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+359 (secure 0 0 0) 0x7fa0b0003ab0 con 0x7fa098066aa0 2024-01-15T11:35:10.072 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-01-15T11:35:10.072 INFO:teuthology.orchestra.run.smithi027.stdout: "status": { 2024-01-15T11:35:10.072 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "in-progress", 2024-01-15T11:35:10.072 INFO:teuthology.orchestra.run.smithi027.stdout: "source": { 2024-01-15T11:35:10.073 INFO:teuthology.orchestra.run.smithi027.stdout: "volume": "cephfs", 2024-01-15T11:35:10.073 INFO:teuthology.orchestra.run.smithi027.stdout: "subvolume": "sv1", 2024-01-15T11:35:10.073 INFO:teuthology.orchestra.run.smithi027.stdout: "snapshot": "ss1" 2024-01-15T11:35:10.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:35:10.073 INFO:teuthology.orchestra.run.smithi027.stdout: "progress_report": { 2024-01-15T11:35:10.073 INFO:teuthology.orchestra.run.smithi027.stdout: "percentage completed": 66.66666666666666, 2024-01-15T11:35:10.073 INFO:teuthology.orchestra.run.smithi027.stdout: "amount copied": "2 GB/3 GB", 2024-01-15T11:35:10.073 INFO:teuthology.orchestra.run.smithi027.stdout: "regfiles copied": "2/3", 2024-01-15T11:35:10.073 INFO:teuthology.orchestra.run.smithi027.stdout: "subdirs copied": "0/1", 2024-01-15T11:35:10.073 INFO:teuthology.orchestra.run.smithi027.stdout: "symlinks copied": "0/0" 2024-01-15T11:35:10.074 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:10.074 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:10.074 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-01-15T11:35:10.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:10.070+0000 7fa0ba9e4640 1 -- 172.21.15.27:0/2265563755 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa098066aa0 msgr2=0x7fa098068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:10.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:10.070+0000 7fa0ba9e4640 1 --2- 172.21.15.27:0/2265563755 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa098066aa0 0x7fa098068f60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0003ec0 tx=0x7fa0b0009040 comp rx=0 tx=0).stop 2024-01-15T11:35:10.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:10.070+0000 7fa0ba9e4640 1 -- 172.21.15.27:0/2265563755 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0b4143e50 msgr2=0x7fa0b40b2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:10.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:10.070+0000 7fa0ba9e4640 1 --2- 172.21.15.27:0/2265563755 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0b4143e50 0x7fa0b40b2240 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00cef0 tx=0x7fa0ac00a710 comp rx=0 tx=0).stop 2024-01-15T11:35:10.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:10.070+0000 7fa0ba9e4640 1 -- 172.21.15.27:0/2265563755 shutdown_connections 2024-01-15T11:35:10.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:10.070+0000 7fa0ba9e4640 1 --2- 172.21.15.27:0/2265563755 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa0b4143e50 0x7fa0b40b2240 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:10.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:10.070+0000 7fa0ba9e4640 1 --2- 172.21.15.27:0/2265563755 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa0b40b3340 0x7fa0b4155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:10.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:10.070+0000 7fa0ba9e4640 1 --2- 172.21.15.27:0/2265563755 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa098066aa0 0x7fa098068f60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:10.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:10.070+0000 7fa0ba9e4640 1 --2- 172.21.15.27:0/2265563755 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0b406c250 0x7fa0b413f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:10.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:10.070+0000 7fa0ba9e4640 1 -- 172.21.15.27:0/2265563755 >> 172.21.15.27:0/2265563755 conn(0x7fa0b406df30 msgr2=0x7fa0b4156490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:10.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:10.070+0000 7fa0ba9e4640 1 -- 172.21.15.27:0/2265563755 shutdown_connections 2024-01-15T11:35:10.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:10.070+0000 7fa0ba9e4640 1 -- 172.21.15.27:0/2265563755 wait complete. 2024-01-15T11:35:10.094 INFO:tasks.cephfs.test_volumes:current clone state = in-progress 2024-01-15T11:35:11.096 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-01-15T11:35:11.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.330+0000 7fc10b032640 1 Processor -- start 2024-01-15T11:35:11.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.334+0000 7fc10b032640 1 -- start start 2024-01-15T11:35:11.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.334+0000 7fc10b032640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc1040ae680 0x7fc10415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:11.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.334+0000 7fc10b032640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc10415dda0 0x7fc10415e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:11.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.334+0000 7fc10b032640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc104072950 con 0x7fc104159f00 2024-01-15T11:35:11.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.334+0000 7fc10b032640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1040cc130 con 0x7fc1040ae680 2024-01-15T11:35:11.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.334+0000 7fc10b032640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc10415e770 con 0x7fc10415dda0 2024-01-15T11:35:11.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.334+0000 7fc103fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc1040ae680 0x7fc10415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:11.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.334+0000 7fc103fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fc1040ae680 0x7fc10415d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47658/0 (socket says 172.21.15.27:47658) 2024-01-15T11:35:11.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.334+0000 7fc103fff640 1 -- 172.21.15.27:0/1688608599 learned_addr learned my addr 172.21.15.27:0/1688608599 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:11.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.334+0000 7fc103fff640 1 -- 172.21.15.27:0/1688608599 >> v2:172.21.15.93:3300/0 conn(0x7fc10415dda0 msgr2=0x7fc10415e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:11.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.334+0000 7fc103fff640 1 --2- 172.21.15.27:0/1688608599 >> v2:172.21.15.93:3300/0 conn(0x7fc10415dda0 0x7fc10415e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:11.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.334+0000 7fc103fff640 1 -- 172.21.15.27:0/1688608599 >> v1:172.21.15.93:6789/0 conn(0x7fc104159f00 legacy=0x7fc1040cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:11.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.334+0000 7fc103fff640 1 -- 172.21.15.27:0/1688608599 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10406e2b0 con 0x7fc1040ae680 2024-01-15T11:35:11.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.338+0000 7fc103fff640 1 --2- 172.21.15.27:0/1688608599 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1040ae680 0x7fc10415d860 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc104070360 tx=0x7fc0f001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64cc7d95c78877f server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:11.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.338+0000 7fc1037fe640 1 -- 172.21.15.27:0/1688608599 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f00ac410 con 0x7fc1040ae680 2024-01-15T11:35:11.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.338+0000 7fc1037fe640 1 -- 172.21.15.27:0/1688608599 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f00ac570 con 0x7fc1040ae680 2024-01-15T11:35:11.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.338+0000 7fc1037fe640 1 -- 172.21.15.27:0/1688608599 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f00ac900 con 0x7fc1040ae680 2024-01-15T11:35:11.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.338+0000 7fc10b032640 1 -- 172.21.15.27:0/1688608599 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1040ae680 msgr2=0x7fc10415d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:11.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.338+0000 7fc10b032640 1 --2- 172.21.15.27:0/1688608599 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1040ae680 0x7fc10415d860 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc104070360 tx=0x7fc0f001c4c0 comp rx=0 tx=0).stop 2024-01-15T11:35:11.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.342+0000 7fc10b032640 1 -- 172.21.15.27:0/1688608599 shutdown_connections 2024-01-15T11:35:11.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.342+0000 7fc10b032640 1 --2- 172.21.15.27:0/1688608599 >> v2:172.21.15.93:3300/0 conn(0x7fc10415dda0 0x7fc10415e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:11.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.342+0000 7fc10b032640 1 --2- 172.21.15.27:0/1688608599 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1040ae680 0x7fc10415d860 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:11.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.342+0000 7fc10b032640 1 -- 172.21.15.27:0/1688608599 >> 172.21.15.27:0/1688608599 conn(0x7fc1040b0cb0 msgr2=0x7fc1040b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:11.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.342+0000 7fc10b032640 1 -- 172.21.15.27:0/1688608599 shutdown_connections 2024-01-15T11:35:11.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.342+0000 7fc10b032640 1 -- 172.21.15.27:0/1688608599 wait complete. 2024-01-15T11:35:11.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.346+0000 7fc10b032640 1 Processor -- start 2024-01-15T11:35:11.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.346+0000 7fc10b032640 1 -- start start 2024-01-15T11:35:11.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.346+0000 7fc10b032640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1040ae680 0x7fc1041591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:11.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.346+0000 7fc10b032640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc104159f00 0x7fc104151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:11.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.346+0000 7fc10b032640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc10415dda0 0x7fc1040b3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:11.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.346+0000 7fc10b032640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1041581b0 con 0x7fc1040ae680 2024-01-15T11:35:11.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.346+0000 7fc10b032640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc104158400 con 0x7fc104159f00 2024-01-15T11:35:11.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.346+0000 7fc10b032640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1041586e0 con 0x7fc10415dda0 2024-01-15T11:35:11.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.346+0000 7fc108dce640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1040ae680 0x7fc1041591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:11.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.346+0000 7fc108dce640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1040ae680 0x7fc1041591c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47664/0 (socket says 172.21.15.27:47664) 2024-01-15T11:35:11.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.346+0000 7fc108dce640 1 -- 172.21.15.27:0/1997641161 learned_addr learned my addr 172.21.15.27:0/1997641161 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:11.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.350+0000 7fc103fff640 1 --2- 172.21.15.27:0/1997641161 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc104159f00 0x7fc104151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:11.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.350+0000 7fc108dce640 1 -- 172.21.15.27:0/1997641161 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc10415dda0 msgr2=0x7fc1040b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:11.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.350+0000 7fc1095cf640 1 --2- 172.21.15.27:0/1997641161 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc10415dda0 0x7fc1040b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:11.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.350+0000 7fc108dce640 1 --2- 172.21.15.27:0/1997641161 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc10415dda0 0x7fc1040b3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:11.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.350+0000 7fc108dce640 1 -- 172.21.15.27:0/1997641161 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc104159f00 msgr2=0x7fc104151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:11.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.350+0000 7fc108dce640 1 --2- 172.21.15.27:0/1997641161 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc104159f00 0x7fc104151990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:11.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.350+0000 7fc108dce640 1 -- 172.21.15.27:0/1997641161 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f00094d0 con 0x7fc1040ae680 2024-01-15T11:35:11.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.350+0000 7fc1095cf640 1 --2- 172.21.15.27:0/1997641161 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc10415dda0 0x7fc1040b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:35:11.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.350+0000 7fc103fff640 1 --2- 172.21.15.27:0/1997641161 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc104159f00 0x7fc104151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:35:11.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.350+0000 7fc108dce640 1 --2- 172.21.15.27:0/1997641161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1040ae680 0x7fc1041591c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800c490 tx=0x7fc0f8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:11.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.350+0000 7fc1017fa640 1 -- 172.21.15.27:0/1997641161 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8003600 con 0x7fc1040ae680 2024-01-15T11:35:11.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.350+0000 7fc1017fa640 1 -- 172.21.15.27:0/1997641161 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f8003780 con 0x7fc1040ae680 2024-01-15T11:35:11.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.350+0000 7fc10b032640 1 -- 172.21.15.27:0/1997641161 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1041589c0 con 0x7fc1040ae680 2024-01-15T11:35:11.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.350+0000 7fc1017fa640 1 -- 172.21.15.27:0/1997641161 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8003b70 con 0x7fc1040ae680 2024-01-15T11:35:11.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.350+0000 7fc10b032640 1 -- 172.21.15.27:0/1997641161 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc104151ed0 con 0x7fc1040ae680 2024-01-15T11:35:11.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.350+0000 7fc10b032640 1 -- 172.21.15.27:0/1997641161 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1040671f0 con 0x7fc1040ae680 2024-01-15T11:35:11.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.350+0000 7fc1017fa640 1 -- 172.21.15.27:0/1997641161 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7fc0f8003cd0 con 0x7fc1040ae680 2024-01-15T11:35:11.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.354+0000 7fc1017fa640 1 --2- 172.21.15.27:0/1997641161 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc0e8066aa0 0x7fc0e8068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:11.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.354+0000 7fc1017fa640 1 -- 172.21.15.27:0/1997641161 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc0f8083eb0 con 0x7fc1040ae680 2024-01-15T11:35:11.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.354+0000 7fc103fff640 1 --2- 172.21.15.27:0/1997641161 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc0e8066aa0 0x7fc0e8068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:11.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.358+0000 7fc1017fa640 1 -- 172.21.15.27:0/1997641161 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc0f8050d50 con 0x7fc1040ae680 2024-01-15T11:35:11.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.358+0000 7fc103fff640 1 --2- 172.21.15.27:0/1997641161 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc0e8066aa0 0x7fc0e8068f60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc0f00ae000 tx=0x7fc0f0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:11.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.658+0000 7fc10b032640 1 -- 172.21.15.27:0/1997641161 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc10406cc70 con 0x7fc0e8066aa0 2024-01-15T11:35:11.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.674+0000 7fc1017fa640 1 -- 172.21.15.27:0/1997641161 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+359 (secure 0 0 0) 0x7fc0f00bb0c0 con 0x7fc0e8066aa0 2024-01-15T11:35:11.677 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-01-15T11:35:11.677 INFO:teuthology.orchestra.run.smithi027.stdout: "status": { 2024-01-15T11:35:11.677 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "in-progress", 2024-01-15T11:35:11.677 INFO:teuthology.orchestra.run.smithi027.stdout: "source": { 2024-01-15T11:35:11.678 INFO:teuthology.orchestra.run.smithi027.stdout: "volume": "cephfs", 2024-01-15T11:35:11.678 INFO:teuthology.orchestra.run.smithi027.stdout: "subvolume": "sv1", 2024-01-15T11:35:11.678 INFO:teuthology.orchestra.run.smithi027.stdout: "snapshot": "ss1" 2024-01-15T11:35:11.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:35:11.678 INFO:teuthology.orchestra.run.smithi027.stdout: "progress_report": { 2024-01-15T11:35:11.678 INFO:teuthology.orchestra.run.smithi027.stdout: "percentage completed": 66.66666666666666, 2024-01-15T11:35:11.678 INFO:teuthology.orchestra.run.smithi027.stdout: "amount copied": "2 GB/3 GB", 2024-01-15T11:35:11.678 INFO:teuthology.orchestra.run.smithi027.stdout: "regfiles copied": "2/3", 2024-01-15T11:35:11.678 INFO:teuthology.orchestra.run.smithi027.stdout: "subdirs copied": "0/1", 2024-01-15T11:35:11.678 INFO:teuthology.orchestra.run.smithi027.stdout: "symlinks copied": "0/0" 2024-01-15T11:35:11.678 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:11.679 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:11.679 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-01-15T11:35:11.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.678+0000 7fc10b032640 1 -- 172.21.15.27:0/1997641161 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc0e8066aa0 msgr2=0x7fc0e8068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:11.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.678+0000 7fc10b032640 1 --2- 172.21.15.27:0/1997641161 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc0e8066aa0 0x7fc0e8068f60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc0f00ae000 tx=0x7fc0f0008040 comp rx=0 tx=0).stop 2024-01-15T11:35:11.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.678+0000 7fc10b032640 1 -- 172.21.15.27:0/1997641161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1040ae680 msgr2=0x7fc1041591c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:11.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.678+0000 7fc10b032640 1 --2- 172.21.15.27:0/1997641161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1040ae680 0x7fc1041591c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800c490 tx=0x7fc0f8001e80 comp rx=0 tx=0).stop 2024-01-15T11:35:11.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.678+0000 7fc10b032640 1 -- 172.21.15.27:0/1997641161 shutdown_connections 2024-01-15T11:35:11.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.678+0000 7fc10b032640 1 --2- 172.21.15.27:0/1997641161 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc10415dda0 0x7fc1040b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:11.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.678+0000 7fc10b032640 1 --2- 172.21.15.27:0/1997641161 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fc0e8066aa0 0x7fc0e8068f60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:11.681 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.678+0000 7fc10b032640 1 --2- 172.21.15.27:0/1997641161 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc104159f00 0x7fc104151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:11.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.678+0000 7fc10b032640 1 --2- 172.21.15.27:0/1997641161 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc1040ae680 0x7fc1041591c0 secure :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800c490 tx=0x7fc0f8001e80 comp rx=0 tx=0).stop 2024-01-15T11:35:11.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.678+0000 7fc10b032640 1 -- 172.21.15.27:0/1997641161 >> 172.21.15.27:0/1997641161 conn(0x7fc1040b0cb0 msgr2=0x7fc1040b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:11.682 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.678+0000 7fc10b032640 1 -- 172.21.15.27:0/1997641161 shutdown_connections 2024-01-15T11:35:11.683 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:11.678+0000 7fc10b032640 1 -- 172.21.15.27:0/1997641161 wait complete. 2024-01-15T11:35:11.710 INFO:tasks.cephfs.test_volumes:current clone state = in-progress 2024-01-15T11:35:12.711 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-01-15T11:35:12.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.854+0000 7f76547df640 1 Processor -- start 2024-01-15T11:35:12.858 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.854+0000 7f76547df640 1 -- start start 2024-01-15T11:35:12.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.854+0000 7f76547df640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f764c0cc460 0x7f764c0abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:12.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.854+0000 7f76547df640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f764c0b2710 con 0x7f764c15a710 2024-01-15T11:35:12.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.854+0000 7f76547df640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f764c0b29f0 con 0x7f764c0cdfb0 2024-01-15T11:35:12.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.854+0000 7f76547df640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f764c0cca80 con 0x7f764c0cc460 2024-01-15T11:35:12.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.854+0000 7f7651d7a640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f764c15a710 0x7f764c0cbd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34132/0 (socket says 172.21.15.27:34132) 2024-01-15T11:35:12.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.854+0000 7f7651d7a640 1 -- 172.21.15.27:0/2286158236 learned_addr learned my addr 172.21.15.27:0/2286158236 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:35:12.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.854+0000 7f7652d7c640 1 --2- 172.21.15.27:0/2286158236 >> v2:172.21.15.27:3300/0 conn(0x7f764c0cc460 0x7f764c0abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:12.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.858+0000 7f7651579640 1 -- 172.21.15.27:0/2286158236 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060464770 0 0) 0x7f764c0b2710 con 0x7f764c15a710 2024-01-15T11:35:12.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.858+0000 7f7651579640 1 -- 172.21.15.27:0/2286158236 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7638005740 con 0x7f764c15a710 2024-01-15T11:35:12.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.858+0000 7f7652d7c640 1 -- 172.21.15.27:0/2286158236 >> v1:172.21.15.93:6789/0 conn(0x7f764c0cdfb0 legacy=0x7f764c0ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:12.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.858+0000 7f7652d7c640 1 -- 172.21.15.27:0/2286158236 >> v1:172.21.15.27:6789/0 conn(0x7f764c15a710 legacy=0x7f764c0cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:12.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.858+0000 7f7652d7c640 1 -- 172.21.15.27:0/2286158236 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c0b2cd0 con 0x7f764c0cc460 2024-01-15T11:35:12.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.858+0000 7f7652d7c640 1 --2- 172.21.15.27:0/2286158236 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f764c0cc460 0x7f764c0abf90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7644009d90 tx=0x7f764401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457e20b921356e5b server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:12.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.858+0000 7f7651579640 1 -- 172.21.15.27:0/2286158236 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76440a5a00 con 0x7f764c0cc460 2024-01-15T11:35:12.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.858+0000 7f7651579640 1 -- 172.21.15.27:0/2286158236 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76440a5b60 con 0x7f764c0cc460 2024-01-15T11:35:12.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.858+0000 7f7651579640 1 -- 172.21.15.27:0/2286158236 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76440ad440 con 0x7f764c0cc460 2024-01-15T11:35:12.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.858+0000 7f76547df640 1 -- 172.21.15.27:0/2286158236 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f764c0cc460 msgr2=0x7f764c0abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:12.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.858+0000 7f76547df640 1 --2- 172.21.15.27:0/2286158236 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f764c0cc460 0x7f764c0abf90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7644009d90 tx=0x7f764401c920 comp rx=0 tx=0).stop 2024-01-15T11:35:12.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.858+0000 7f76547df640 1 -- 172.21.15.27:0/2286158236 shutdown_connections 2024-01-15T11:35:12.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.858+0000 7f76547df640 1 --2- 172.21.15.27:0/2286158236 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f764c0cc460 0x7f764c0abf90 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:12.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.858+0000 7f76547df640 1 -- 172.21.15.27:0/2286158236 >> 172.21.15.27:0/2286158236 conn(0x7f764c0b0cb0 msgr2=0x7f764c0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:12.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.862+0000 7f76547df640 1 -- 172.21.15.27:0/2286158236 shutdown_connections 2024-01-15T11:35:12.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.862+0000 7f76547df640 1 -- 172.21.15.27:0/2286158236 wait complete. 2024-01-15T11:35:12.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.862+0000 7f76547df640 1 Processor -- start 2024-01-15T11:35:12.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.862+0000 7f76547df640 1 -- start start 2024-01-15T11:35:12.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.862+0000 7f76547df640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f764c0cc460 0x7f764c09c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:12.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.862+0000 7f76547df640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f764c0cdfb0 0x7f764c15cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:12.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.862+0000 7f76547df640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f764c15a710 0x7f764c15ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:12.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.862+0000 7f76547df640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c099a30 con 0x7f764c0cdfb0 2024-01-15T11:35:12.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.862+0000 7f76547df640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c09c410 con 0x7f764c15a710 2024-01-15T11:35:12.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.862+0000 7f76547df640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764c15d9f0 con 0x7f764c0cc460 2024-01-15T11:35:12.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.862+0000 7f7651d7a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f764c0cdfb0 0x7f764c15cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:12.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.862+0000 7f7651d7a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f764c0cdfb0 0x7f764c15cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47692/0 (socket says 172.21.15.27:47692) 2024-01-15T11:35:12.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.862+0000 7f7651d7a640 1 -- 172.21.15.27:0/2507249401 learned_addr learned my addr 172.21.15.27:0/2507249401 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:12.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.862+0000 7f765257b640 1 --2- 172.21.15.27:0/2507249401 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f764c0cc460 0x7f764c09c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:12.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.862+0000 7f7652d7c640 1 --2- 172.21.15.27:0/2507249401 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f764c15a710 0x7f764c15ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:12.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.862+0000 7f7651d7a640 1 -- 172.21.15.27:0/2507249401 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f764c0cc460 msgr2=0x7f764c09c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:12.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.862+0000 7f7651d7a640 1 --2- 172.21.15.27:0/2507249401 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f764c0cc460 0x7f764c09c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:12.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.862+0000 7f7651d7a640 1 -- 172.21.15.27:0/2507249401 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f764c15a710 msgr2=0x7f764c15ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:12.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.862+0000 7f7651d7a640 1 --2- 172.21.15.27:0/2507249401 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f764c15a710 0x7f764c15ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:12.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.862+0000 7f7651d7a640 1 -- 172.21.15.27:0/2507249401 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7644009a70 con 0x7f764c0cdfb0 2024-01-15T11:35:12.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.862+0000 7f7651d7a640 1 --2- 172.21.15.27:0/2507249401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f764c0cdfb0 0x7f764c15cfd0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f763c00c400 tx=0x7f763c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:12.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.866+0000 7f7642ffd640 1 -- 172.21.15.27:0/2507249401 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c005cf0 con 0x7f764c0cdfb0 2024-01-15T11:35:12.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.866+0000 7f7642ffd640 1 -- 172.21.15.27:0/2507249401 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c005e50 con 0x7f764c0cdfb0 2024-01-15T11:35:12.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.866+0000 7f76547df640 1 -- 172.21.15.27:0/2507249401 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764c09cde0 con 0x7f764c0cdfb0 2024-01-15T11:35:12.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.866+0000 7f7642ffd640 1 -- 172.21.15.27:0/2507249401 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c0072d0 con 0x7f764c0cdfb0 2024-01-15T11:35:12.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.866+0000 7f76547df640 1 -- 172.21.15.27:0/2507249401 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764c099f60 con 0x7f764c0cdfb0 2024-01-15T11:35:12.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.866+0000 7f76547df640 1 -- 172.21.15.27:0/2507249401 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f764c0671f0 con 0x7f764c0cdfb0 2024-01-15T11:35:12.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.866+0000 7f7642ffd640 1 -- 172.21.15.27:0/2507249401 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7f763c007430 con 0x7f764c0cdfb0 2024-01-15T11:35:12.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.866+0000 7f7642ffd640 1 --2- 172.21.15.27:0/2507249401 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7630066aa0 0x7f7630068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:12.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.866+0000 7f7642ffd640 1 -- 172.21.15.27:0/2507249401 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f763c083d70 con 0x7f764c0cdfb0 2024-01-15T11:35:12.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.866+0000 7f765257b640 1 --2- 172.21.15.27:0/2507249401 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7630066aa0 0x7f7630068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:12.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.866+0000 7f765257b640 1 --2- 172.21.15.27:0/2507249401 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7630066aa0 0x7f7630068f60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f764c156ae0 tx=0x7f7648009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:12.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:12.870+0000 7f7642ffd640 1 -- 172.21.15.27:0/2507249401 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f763c050e30 con 0x7f764c0cdfb0 2024-01-15T11:35:13.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.062+0000 7f76547df640 1 -- 172.21.15.27:0/2507249401 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) v1 -- 0x7f764c06b460 con 0x7f7630066aa0 2024-01-15T11:35:13.086 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:35:13.091 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:35:13.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.554+0000 7f7642ffd640 1 -- 172.21.15.27:0/2507249401 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+46 (secure 0 0 0) 0x7f764c06b460 con 0x7f7630066aa0 2024-01-15T11:35:13.557 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-01-15T11:35:13.558 INFO:teuthology.orchestra.run.smithi027.stdout: "status": { 2024-01-15T11:35:13.558 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "complete" 2024-01-15T11:35:13.558 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:13.558 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-01-15T11:35:13.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.554+0000 7f76547df640 1 -- 172.21.15.27:0/2507249401 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7630066aa0 msgr2=0x7f7630068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:13.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.554+0000 7f76547df640 1 --2- 172.21.15.27:0/2507249401 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7630066aa0 0x7f7630068f60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f764c156ae0 tx=0x7f7648009040 comp rx=0 tx=0).stop 2024-01-15T11:35:13.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.554+0000 7f76547df640 1 -- 172.21.15.27:0/2507249401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f764c0cdfb0 msgr2=0x7f764c15cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:13.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.554+0000 7f76547df640 1 --2- 172.21.15.27:0/2507249401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f764c0cdfb0 0x7f764c15cfd0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f763c00c400 tx=0x7f763c00c8c0 comp rx=0 tx=0).stop 2024-01-15T11:35:13.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.554+0000 7f76547df640 1 -- 172.21.15.27:0/2507249401 shutdown_connections 2024-01-15T11:35:13.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.554+0000 7f76547df640 1 --2- 172.21.15.27:0/2507249401 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f7630066aa0 0x7f7630068f60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:13.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.554+0000 7f76547df640 1 --2- 172.21.15.27:0/2507249401 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f764c15a710 0x7f764c15ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:13.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.554+0000 7f76547df640 1 --2- 172.21.15.27:0/2507249401 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f764c0cdfb0 0x7f764c15cfd0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:13.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.554+0000 7f76547df640 1 --2- 172.21.15.27:0/2507249401 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f764c0cc460 0x7f764c09c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:13.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.554+0000 7f76547df640 1 -- 172.21.15.27:0/2507249401 >> 172.21.15.27:0/2507249401 conn(0x7f764c0b0cb0 msgr2=0x7f764c0af500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:13.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.554+0000 7f76547df640 1 -- 172.21.15.27:0/2507249401 shutdown_connections 2024-01-15T11:35:13.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.554+0000 7f76547df640 1 -- 172.21.15.27:0/2507249401 wait complete. 2024-01-15T11:35:13.582 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-01-15T11:35:13.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.726+0000 7f9d5e3df640 1 Processor -- start 2024-01-15T11:35:13.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.726+0000 7f9d5e3df640 1 -- start start 2024-01-15T11:35:13.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.726+0000 7f9d5e3df640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9d580cdfb0 0x7f9d580abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:13.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.726+0000 7f9d5e3df640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9d5815a710 0x7f9d580ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:13.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.726+0000 7f9d5e3df640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d580ce8d0 con 0x7f9d580cbd50 2024-01-15T11:35:13.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.726+0000 7f9d5e3df640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d580cca80 con 0x7f9d580cdfb0 2024-01-15T11:35:13.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.726+0000 7f9d5e3df640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d580b2710 con 0x7f9d5815a710 2024-01-15T11:35:13.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.726+0000 7f9d57fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9d580cdfb0 0x7f9d580abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:13.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.726+0000 7f9d57fff640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f9d580cdfb0 0x7f9d580abf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47708/0 (socket says 172.21.15.27:47708) 2024-01-15T11:35:13.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.726+0000 7f9d57fff640 1 -- 172.21.15.27:0/598435470 learned_addr learned my addr 172.21.15.27:0/598435470 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:13.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.726+0000 7f9d577fe640 1 --2- 172.21.15.27:0/598435470 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9d5815a710 0x7f9d580ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:13.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.726+0000 7f9d57fff640 1 -- 172.21.15.27:0/598435470 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9d5815a710 msgr2=0x7f9d580ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:13.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.726+0000 7f9d57fff640 1 --2- 172.21.15.27:0/598435470 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9d5815a710 0x7f9d580ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:13.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.726+0000 7f9d57fff640 1 -- 172.21.15.27:0/598435470 >> v1:172.21.15.93:6789/0 conn(0x7f9d580cbd50 legacy=0x7f9d580cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:13.732 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.726+0000 7f9d57fff640 1 -- 172.21.15.27:0/598435470 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d580b29f0 con 0x7f9d580cdfb0 2024-01-15T11:35:13.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.730+0000 7f9d57fff640 1 --2- 172.21.15.27:0/598435470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d580cdfb0 0x7f9d580abf90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009870 tx=0x7f9d4801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c5d3f26ea82df0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:13.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.730+0000 7f9d56ffd640 1 -- 172.21.15.27:0/598435470 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d480aa5f0 con 0x7f9d580cdfb0 2024-01-15T11:35:13.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.730+0000 7f9d56ffd640 1 -- 172.21.15.27:0/598435470 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d480aa750 con 0x7f9d580cdfb0 2024-01-15T11:35:13.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.730+0000 7f9d56ffd640 1 -- 172.21.15.27:0/598435470 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d480aaae0 con 0x7f9d580cdfb0 2024-01-15T11:35:13.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.730+0000 7f9d5e3df640 1 -- 172.21.15.27:0/598435470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d580cdfb0 msgr2=0x7f9d580abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:13.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.730+0000 7f9d5e3df640 1 --2- 172.21.15.27:0/598435470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d580cdfb0 0x7f9d580abf90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009870 tx=0x7f9d4801c4d0 comp rx=0 tx=0).stop 2024-01-15T11:35:13.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.730+0000 7f9d5e3df640 1 -- 172.21.15.27:0/598435470 shutdown_connections 2024-01-15T11:35:13.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.730+0000 7f9d5e3df640 1 --2- 172.21.15.27:0/598435470 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9d5815a710 0x7f9d580ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:13.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.730+0000 7f9d5e3df640 1 --2- 172.21.15.27:0/598435470 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d580cdfb0 0x7f9d580abf90 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:13.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.730+0000 7f9d5e3df640 1 -- 172.21.15.27:0/598435470 >> 172.21.15.27:0/598435470 conn(0x7f9d580b0cb0 msgr2=0x7f9d580b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:13.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.730+0000 7f9d5e3df640 1 -- 172.21.15.27:0/598435470 shutdown_connections 2024-01-15T11:35:13.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.730+0000 7f9d5e3df640 1 -- 172.21.15.27:0/598435470 wait complete. 2024-01-15T11:35:13.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.730+0000 7f9d5e3df640 1 Processor -- start 2024-01-15T11:35:13.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.734+0000 7f9d5e3df640 1 -- start start 2024-01-15T11:35:13.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.734+0000 7f9d5e3df640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9d580cbd50 0x7f9d5815ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:13.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.734+0000 7f9d5e3df640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d580cdfb0 0x7f9d5815b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:13.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.734+0000 7f9d5e3df640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9d5815a710 0x7f9d5815cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:13.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.734+0000 7f9d5e3df640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d58143a40 con 0x7f9d580cdfb0 2024-01-15T11:35:13.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.734+0000 7f9d5e3df640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d58143d20 con 0x7f9d5815a710 2024-01-15T11:35:13.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.734+0000 7f9d5e3df640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d58144000 con 0x7f9d580cbd50 2024-01-15T11:35:13.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.734+0000 7f9d577fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d580cdfb0 0x7f9d5815b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:13.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.734+0000 7f9d577fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d580cdfb0 0x7f9d5815b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47720/0 (socket says 172.21.15.27:47720) 2024-01-15T11:35:13.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.734+0000 7f9d577fe640 1 -- 172.21.15.27:0/3851899972 learned_addr learned my addr 172.21.15.27:0/3851899972 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:13.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.734+0000 7f9d57fff640 1 --2- 172.21.15.27:0/3851899972 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9d580cbd50 0x7f9d5815ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:13.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.734+0000 7f9d5c97c640 1 --2- 172.21.15.27:0/3851899972 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9d5815a710 0x7f9d5815cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:13.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.734+0000 7f9d577fe640 1 -- 172.21.15.27:0/3851899972 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9d580cbd50 msgr2=0x7f9d5815ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:13.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.734+0000 7f9d577fe640 1 --2- 172.21.15.27:0/3851899972 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9d580cbd50 0x7f9d5815ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:13.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.734+0000 7f9d577fe640 1 -- 172.21.15.27:0/3851899972 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9d5815a710 msgr2=0x7f9d5815cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:13.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.734+0000 7f9d577fe640 1 --2- 172.21.15.27:0/3851899972 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9d5815a710 0x7f9d5815cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:13.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.734+0000 7f9d577fe640 1 -- 172.21.15.27:0/3851899972 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d480094d0 con 0x7f9d580cdfb0 2024-01-15T11:35:13.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.734+0000 7f9d577fe640 1 --2- 172.21.15.27:0/3851899972 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d580cdfb0 0x7f9d5815b080 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00d7d0 tx=0x7f9d4c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:13.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.734+0000 7f9d54ff9640 1 -- 172.21.15.27:0/3851899972 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c00b6c0 con 0x7f9d580cdfb0 2024-01-15T11:35:13.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.734+0000 7f9d54ff9640 1 -- 172.21.15.27:0/3851899972 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4c00b820 con 0x7f9d580cdfb0 2024-01-15T11:35:13.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.734+0000 7f9d5e3df640 1 -- 172.21.15.27:0/3851899972 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d581442e0 con 0x7f9d580cdfb0 2024-01-15T11:35:13.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.734+0000 7f9d54ff9640 1 -- 172.21.15.27:0/3851899972 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c00bbb0 con 0x7f9d580cdfb0 2024-01-15T11:35:13.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.734+0000 7f9d5e3df640 1 -- 172.21.15.27:0/3851899972 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d581436f0 con 0x7f9d580cdfb0 2024-01-15T11:35:13.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.734+0000 7f9d5e3df640 1 -- 172.21.15.27:0/3851899972 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d580671f0 con 0x7f9d580cdfb0 2024-01-15T11:35:13.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.738+0000 7f9d54ff9640 1 -- 172.21.15.27:0/3851899972 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7f9d4c00bd10 con 0x7f9d580cdfb0 2024-01-15T11:35:13.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.738+0000 7f9d54ff9640 1 --2- 172.21.15.27:0/3851899972 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9d44066aa0 0x7f9d44068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:13.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.738+0000 7f9d54ff9640 1 -- 172.21.15.27:0/3851899972 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9d4c084bf0 con 0x7f9d580cdfb0 2024-01-15T11:35:13.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.738+0000 7f9d57fff640 1 --2- 172.21.15.27:0/3851899972 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9d44066aa0 0x7f9d44068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:13.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.738+0000 7f9d57fff640 1 --2- 172.21.15.27:0/3851899972 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9d44066aa0 0x7f9d44068f60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9d480ae000 tx=0x7f9d480b5040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:13.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.742+0000 7f9d54ff9640 1 -- 172.21.15.27:0/3851899972 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9d4c051b40 con 0x7f9d580cdfb0 2024-01-15T11:35:13.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.922+0000 7f9d5e3df640 1 -- 172.21.15.27:0/3851899972 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d5806b460 con 0x7f9d44066aa0 2024-01-15T11:35:13.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.922+0000 7f9d54ff9640 1 -- 172.21.15.27:0/3851899972 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f9d5806b460 con 0x7f9d44066aa0 2024-01-15T11:35:13.926 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2024-01-15T11:35:13.926 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:35:13.926 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cephfs" 2024-01-15T11:35:13.926 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:13.926 INFO:teuthology.orchestra.run.smithi027.stdout:] 2024-01-15T11:35:13.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.922+0000 7f9d5e3df640 1 -- 172.21.15.27:0/3851899972 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9d44066aa0 msgr2=0x7f9d44068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:13.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.922+0000 7f9d5e3df640 1 --2- 172.21.15.27:0/3851899972 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9d44066aa0 0x7f9d44068f60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9d480ae000 tx=0x7f9d480b5040 comp rx=0 tx=0).stop 2024-01-15T11:35:13.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.922+0000 7f9d5e3df640 1 -- 172.21.15.27:0/3851899972 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d580cdfb0 msgr2=0x7f9d5815b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:13.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.922+0000 7f9d5e3df640 1 --2- 172.21.15.27:0/3851899972 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d580cdfb0 0x7f9d5815b080 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00d7d0 tx=0x7f9d4c00dc90 comp rx=0 tx=0).stop 2024-01-15T11:35:13.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.922+0000 7f9d5e3df640 1 -- 172.21.15.27:0/3851899972 shutdown_connections 2024-01-15T11:35:13.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.922+0000 7f9d5e3df640 1 --2- 172.21.15.27:0/3851899972 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9d44066aa0 0x7f9d44068f60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:13.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.922+0000 7f9d5e3df640 1 --2- 172.21.15.27:0/3851899972 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9d5815a710 0x7f9d5815cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:13.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.922+0000 7f9d5e3df640 1 --2- 172.21.15.27:0/3851899972 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9d580cdfb0 0x7f9d5815b080 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:13.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.922+0000 7f9d5e3df640 1 --2- 172.21.15.27:0/3851899972 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9d580cbd50 0x7f9d5815ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:13.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.922+0000 7f9d5e3df640 1 -- 172.21.15.27:0/3851899972 >> 172.21.15.27:0/3851899972 conn(0x7f9d580b0cb0 msgr2=0x7f9d58156f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:13.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.922+0000 7f9d5e3df640 1 -- 172.21.15.27:0/3851899972 shutdown_connections 2024-01-15T11:35:13.929 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:13.922+0000 7f9d5e3df640 1 -- 172.21.15.27:0/3851899972 wait complete. 2024-01-15T11:35:13.948 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-01-15T11:35:14.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.090+0000 7f3f454e3640 1 Processor -- start 2024-01-15T11:35:14.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.090+0000 7f3f454e3640 1 -- start start 2024-01-15T11:35:14.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.090+0000 7f3f454e3640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3f400cb9b0 0x7f3f4006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:14.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.090+0000 7f3f454e3640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f40159630 con 0x7f3f400cbd90 2024-01-15T11:35:14.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.094+0000 7f3f454e3640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f400cd1d0 con 0x7f3f400ce5d0 2024-01-15T11:35:14.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.094+0000 7f3f454e3640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4015bba0 con 0x7f3f400cb9b0 2024-01-15T11:35:14.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.094+0000 7f3f37fff640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f3f400cbd90 0x7f3f4015f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34136/0 (socket says 172.21.15.27:34136) 2024-01-15T11:35:14.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.094+0000 7f3f37fff640 1 -- 172.21.15.27:0/453431276 learned_addr learned my addr 172.21.15.27:0/453431276 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:35:14.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.094+0000 7f3f3effd640 1 --2- 172.21.15.27:0/453431276 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3f400cb9b0 0x7f3f4006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:14.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.094+0000 7f3f3e7fc640 1 -- 172.21.15.27:0/453431276 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676209006 0 0) 0x7f3f40159630 con 0x7f3f400cbd90 2024-01-15T11:35:14.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.094+0000 7f3f3e7fc640 1 -- 172.21.15.27:0/453431276 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f2c003530 con 0x7f3f400cbd90 2024-01-15T11:35:14.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.094+0000 7f3f3e7fc640 1 -- 172.21.15.27:0/453431276 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686701127 0 0) 0x7f3f400cd1d0 con 0x7f3f400ce5d0 2024-01-15T11:35:14.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.094+0000 7f3f3e7fc640 1 -- 172.21.15.27:0/453431276 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f40159630 con 0x7f3f400ce5d0 2024-01-15T11:35:14.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.094+0000 7f3f3effd640 1 -- 172.21.15.27:0/453431276 >> v1:172.21.15.93:6789/0 conn(0x7f3f400ce5d0 legacy=0x7f3f4015bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:14.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.094+0000 7f3f3effd640 1 -- 172.21.15.27:0/453431276 >> v1:172.21.15.27:6789/0 conn(0x7f3f400cbd90 legacy=0x7f3f4015f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:14.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.094+0000 7f3f3effd640 1 -- 172.21.15.27:0/453431276 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f400cd4b0 con 0x7f3f400cb9b0 2024-01-15T11:35:14.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.094+0000 7f3f3effd640 1 --2- 172.21.15.27:0/453431276 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3f400cb9b0 0x7f3f4006e3f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3f300097f0 tx=0x7f3f3001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4af781db52ffedcc server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:14.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.098+0000 7f3f3e7fc640 1 -- 172.21.15.27:0/453431276 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f300ac410 con 0x7f3f400cb9b0 2024-01-15T11:35:14.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.098+0000 7f3f3e7fc640 1 -- 172.21.15.27:0/453431276 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f300ac570 con 0x7f3f400cb9b0 2024-01-15T11:35:14.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.098+0000 7f3f3e7fc640 1 -- 172.21.15.27:0/453431276 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f300ac900 con 0x7f3f400cb9b0 2024-01-15T11:35:14.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.098+0000 7f3f454e3640 1 -- 172.21.15.27:0/453431276 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3f400cb9b0 msgr2=0x7f3f4006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:14.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.098+0000 7f3f454e3640 1 --2- 172.21.15.27:0/453431276 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3f400cb9b0 0x7f3f4006e3f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3f300097f0 tx=0x7f3f3001c4c0 comp rx=0 tx=0).stop 2024-01-15T11:35:14.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.098+0000 7f3f454e3640 1 -- 172.21.15.27:0/453431276 shutdown_connections 2024-01-15T11:35:14.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.098+0000 7f3f454e3640 1 --2- 172.21.15.27:0/453431276 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3f400cb9b0 0x7f3f4006e3f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:14.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.098+0000 7f3f454e3640 1 -- 172.21.15.27:0/453431276 >> 172.21.15.27:0/453431276 conn(0x7f3f400b0cb0 msgr2=0x7f3f400b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:14.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.098+0000 7f3f454e3640 1 -- 172.21.15.27:0/453431276 shutdown_connections 2024-01-15T11:35:14.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.098+0000 7f3f454e3640 1 -- 172.21.15.27:0/453431276 wait complete. 2024-01-15T11:35:14.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.098+0000 7f3f454e3640 1 Processor -- start 2024-01-15T11:35:14.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.098+0000 7f3f454e3640 1 -- start start 2024-01-15T11:35:14.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.098+0000 7f3f454e3640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f400cb9b0 0x7f3f401418a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:14.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.098+0000 7f3f454e3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f400cbd90 0x7f3f40153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:14.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.098+0000 7f3f454e3640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3f400ce5d0 0x7f3f4014fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:14.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.098+0000 7f3f454e3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f40153940 con 0x7f3f400cbd90 2024-01-15T11:35:14.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.098+0000 7f3f454e3640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f40152d30 con 0x7f3f400cb9b0 2024-01-15T11:35:14.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.098+0000 7f3f454e3640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f40153010 con 0x7f3f400ce5d0 2024-01-15T11:35:14.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.098+0000 7f3f37fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f400cbd90 0x7f3f40153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:14.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.102+0000 7f3f37fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f400cbd90 0x7f3f40153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47722/0 (socket says 172.21.15.27:47722) 2024-01-15T11:35:14.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.102+0000 7f3f3effd640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f400cb9b0 0x7f3f401418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:14.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.102+0000 7f3f3f7fe640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3f400ce5d0 0x7f3f4014fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:14.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.102+0000 7f3f37fff640 1 -- 172.21.15.27:0/1898535315 learned_addr learned my addr 172.21.15.27:0/1898535315 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:14.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.102+0000 7f3f37fff640 1 -- 172.21.15.27:0/1898535315 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3f400ce5d0 msgr2=0x7f3f4014fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:14.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.102+0000 7f3f37fff640 1 --2- 172.21.15.27:0/1898535315 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3f400ce5d0 0x7f3f4014fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:14.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.102+0000 7f3f37fff640 1 -- 172.21.15.27:0/1898535315 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f400cb9b0 msgr2=0x7f3f401418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:14.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.102+0000 7f3f37fff640 1 --2- 172.21.15.27:0/1898535315 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f400cb9b0 0x7f3f401418a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:14.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.102+0000 7f3f37fff640 1 -- 172.21.15.27:0/1898535315 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f30009420 con 0x7f3f400cbd90 2024-01-15T11:35:14.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.102+0000 7f3f3effd640 1 --2- 172.21.15.27:0/1898535315 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f400cb9b0 0x7f3f401418a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-15T11:35:14.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.102+0000 7f3f37fff640 1 --2- 172.21.15.27:0/1898535315 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f400cbd90 0x7f3f40153dd0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800c4d0 tx=0x7f3f2800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:14.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.102+0000 7f3f377fe640 1 -- 172.21.15.27:0/1898535315 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f28005cf0 con 0x7f3f400cbd90 2024-01-15T11:35:14.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.102+0000 7f3f377fe640 1 -- 172.21.15.27:0/1898535315 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f28005e50 con 0x7f3f400cbd90 2024-01-15T11:35:14.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.102+0000 7f3f377fe640 1 -- 172.21.15.27:0/1898535315 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f28007270 con 0x7f3f400cbd90 2024-01-15T11:35:14.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.102+0000 7f3f454e3640 1 -- 172.21.15.27:0/1898535315 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f401532f0 con 0x7f3f400cbd90 2024-01-15T11:35:14.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.102+0000 7f3f454e3640 1 -- 172.21.15.27:0/1898535315 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f40141de0 con 0x7f3f400cbd90 2024-01-15T11:35:14.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.102+0000 7f3f454e3640 1 -- 172.21.15.27:0/1898535315 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f400671f0 con 0x7f3f400cbd90 2024-01-15T11:35:14.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.102+0000 7f3f377fe640 1 -- 172.21.15.27:0/1898535315 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7f3f280073d0 con 0x7f3f400cbd90 2024-01-15T11:35:14.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.106+0000 7f3f377fe640 1 --2- 172.21.15.27:0/1898535315 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3f20066aa0 0x7f3f20068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:14.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.106+0000 7f3f377fe640 1 -- 172.21.15.27:0/1898535315 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3f28083c30 con 0x7f3f400cbd90 2024-01-15T11:35:14.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.106+0000 7f3f3effd640 1 --2- 172.21.15.27:0/1898535315 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3f20066aa0 0x7f3f20068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:14.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.106+0000 7f3f3effd640 1 --2- 172.21.15.27:0/1898535315 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3f20066aa0 0x7f3f20068f60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3f300ae000 tx=0x7f3f30008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:14.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.110+0000 7f3f377fe640 1 -- 172.21.15.27:0/1898535315 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3f2808a080 con 0x7f3f400cbd90 2024-01-15T11:35:14.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.294+0000 7f3f454e3640 1 -- 172.21.15.27:0/1898535315 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3f400ccea0 con 0x7f3f20066aa0 2024-01-15T11:35:14.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.302+0000 7f3f377fe640 1 -- 172.21.15.27:0/1898535315 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+79 (secure 0 0 0) 0x7f3f300bd0b0 con 0x7f3f20066aa0 2024-01-15T11:35:14.305 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:35:14.305 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2024-01-15T11:35:14.305 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:35:14.305 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sv1" 2024-01-15T11:35:14.305 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-01-15T11:35:14.305 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:35:14.305 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ss1clone1" 2024-01-15T11:35:14.305 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:14.305 INFO:teuthology.orchestra.run.smithi027.stdout:] 2024-01-15T11:35:14.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.302+0000 7f3f454e3640 1 -- 172.21.15.27:0/1898535315 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3f20066aa0 msgr2=0x7f3f20068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:14.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.302+0000 7f3f454e3640 1 --2- 172.21.15.27:0/1898535315 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3f20066aa0 0x7f3f20068f60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3f300ae000 tx=0x7f3f30008040 comp rx=0 tx=0).stop 2024-01-15T11:35:14.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.302+0000 7f3f454e3640 1 -- 172.21.15.27:0/1898535315 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f400cbd90 msgr2=0x7f3f40153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:14.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.302+0000 7f3f454e3640 1 --2- 172.21.15.27:0/1898535315 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f400cbd90 0x7f3f40153dd0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800c4d0 tx=0x7f3f2800c990 comp rx=0 tx=0).stop 2024-01-15T11:35:14.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.302+0000 7f3f454e3640 1 -- 172.21.15.27:0/1898535315 shutdown_connections 2024-01-15T11:35:14.307 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.302+0000 7f3f454e3640 1 --2- 172.21.15.27:0/1898535315 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3f400ce5d0 0x7f3f4014fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:14.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.302+0000 7f3f454e3640 1 --2- 172.21.15.27:0/1898535315 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3f400cbd90 0x7f3f40153dd0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:14.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.302+0000 7f3f454e3640 1 --2- 172.21.15.27:0/1898535315 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3f20066aa0 0x7f3f20068f60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:14.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.302+0000 7f3f454e3640 1 --2- 172.21.15.27:0/1898535315 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f400cb9b0 0x7f3f401418a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:14.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.302+0000 7f3f454e3640 1 -- 172.21.15.27:0/1898535315 >> 172.21.15.27:0/1898535315 conn(0x7f3f400b0cb0 msgr2=0x7f3f4015df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:14.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.302+0000 7f3f454e3640 1 -- 172.21.15.27:0/1898535315 shutdown_connections 2024-01-15T11:35:14.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.302+0000 7f3f454e3640 1 -- 172.21.15.27:0/1898535315 wait complete. 2024-01-15T11:35:14.327 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-01-15T11:35:14.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.470+0000 7f39533d8640 1 Processor -- start 2024-01-15T11:35:14.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.470+0000 7f39533d8640 1 -- start start 2024-01-15T11:35:14.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.470+0000 7f39533d8640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f394c0cb9b0 0x7f394c06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:14.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.470+0000 7f39533d8640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f394c0cbd90 0x7f394c15f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:14.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.470+0000 7f39533d8640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f394c159630 con 0x7f394c0ce5d0 2024-01-15T11:35:14.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.470+0000 7f39533d8640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f394c15bba0 con 0x7f394c0cb9b0 2024-01-15T11:35:14.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.470+0000 7f39533d8640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0cdd50 con 0x7f394c0cbd90 2024-01-15T11:35:14.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.470+0000 7f3951174640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f394c0cb9b0 0x7f394c06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:14.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.470+0000 7f3951975640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f394c0ce5d0 0x7f394c15bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:34148/0 (socket says 172.21.15.27:34148) 2024-01-15T11:35:14.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.470+0000 7f3951975640 1 -- 172.21.15.27:0/1311006445 learned_addr learned my addr 172.21.15.27:0/1311006445 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:35:14.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.474+0000 7f3950973640 1 --2- 172.21.15.27:0/1311006445 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f394c0cbd90 0x7f394c15f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:14.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.474+0000 7f3951174640 1 -- 172.21.15.27:0/1311006445 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f394c0cbd90 msgr2=0x7f394c15f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:14.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.474+0000 7f3951174640 1 --2- 172.21.15.27:0/1311006445 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f394c0cbd90 0x7f394c15f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:14.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.474+0000 7f3951174640 1 -- 172.21.15.27:0/1311006445 >> v1:172.21.15.27:6789/0 conn(0x7f394c0ce5d0 legacy=0x7f394c15bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:14.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.474+0000 7f3951174640 1 -- 172.21.15.27:0/1311006445 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c15f6d0 con 0x7f394c0cb9b0 2024-01-15T11:35:14.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.474+0000 7f3951174640 1 --2- 172.21.15.27:0/1311006445 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f394c0cb9b0 0x7f394c06e3f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f39480097c0 tx=0x7f394801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6473aa09b973b287 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:14.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.474+0000 7f3943fff640 1 -- 172.21.15.27:0/1311006445 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39480ab650 con 0x7f394c0cb9b0 2024-01-15T11:35:14.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.474+0000 7f3943fff640 1 -- 172.21.15.27:0/1311006445 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39480ab7b0 con 0x7f394c0cb9b0 2024-01-15T11:35:14.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.474+0000 7f3943fff640 1 -- 172.21.15.27:0/1311006445 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39480abb40 con 0x7f394c0cb9b0 2024-01-15T11:35:14.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.474+0000 7f39533d8640 1 -- 172.21.15.27:0/1311006445 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f394c0cb9b0 msgr2=0x7f394c06e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:14.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.474+0000 7f39533d8640 1 --2- 172.21.15.27:0/1311006445 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f394c0cb9b0 0x7f394c06e3f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f39480097c0 tx=0x7f394801c450 comp rx=0 tx=0).stop 2024-01-15T11:35:14.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.474+0000 7f39533d8640 1 -- 172.21.15.27:0/1311006445 shutdown_connections 2024-01-15T11:35:14.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.474+0000 7f39533d8640 1 --2- 172.21.15.27:0/1311006445 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f394c0cbd90 0x7f394c15f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:14.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.474+0000 7f39533d8640 1 --2- 172.21.15.27:0/1311006445 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f394c0cb9b0 0x7f394c06e3f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:14.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.474+0000 7f39533d8640 1 -- 172.21.15.27:0/1311006445 >> 172.21.15.27:0/1311006445 conn(0x7f394c0b0cb0 msgr2=0x7f394c0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:14.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.478+0000 7f39533d8640 1 -- 172.21.15.27:0/1311006445 shutdown_connections 2024-01-15T11:35:14.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.478+0000 7f39533d8640 1 -- 172.21.15.27:0/1311006445 wait complete. 2024-01-15T11:35:14.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.478+0000 7f39533d8640 1 Processor -- start 2024-01-15T11:35:14.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.478+0000 7f39533d8640 1 -- start start 2024-01-15T11:35:14.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.478+0000 7f39533d8640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f394c0cb9b0 0x7f394c0ad050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:14.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.478+0000 7f39533d8640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f394c0cbd90 0x7f394c152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:14.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.478+0000 7f39533d8640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f394c0ce5d0 0x7f394c1526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:14.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.478+0000 7f39533d8640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c157f30 con 0x7f394c0ce5d0 2024-01-15T11:35:14.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.478+0000 7f39533d8640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c158210 con 0x7f394c0cbd90 2024-01-15T11:35:14.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.478+0000 7f39533d8640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c1584f0 con 0x7f394c0cb9b0 2024-01-15T11:35:14.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.478+0000 7f3951975640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f394c0ce5d0 0x7f394c1526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:14.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.478+0000 7f3951975640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f394c0ce5d0 0x7f394c1526b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47742/0 (socket says 172.21.15.27:47742) 2024-01-15T11:35:14.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.478+0000 7f3951975640 1 -- 172.21.15.27:0/2723788345 learned_addr learned my addr 172.21.15.27:0/2723788345 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:14.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.478+0000 7f3951174640 1 --2- 172.21.15.27:0/2723788345 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f394c0cb9b0 0x7f394c0ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:14.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.478+0000 7f3950973640 1 --2- 172.21.15.27:0/2723788345 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f394c0cbd90 0x7f394c152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:14.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.478+0000 7f3951975640 1 -- 172.21.15.27:0/2723788345 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f394c0cb9b0 msgr2=0x7f394c0ad050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:14.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.478+0000 7f3951975640 1 --2- 172.21.15.27:0/2723788345 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f394c0cb9b0 0x7f394c0ad050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:14.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.478+0000 7f3951975640 1 -- 172.21.15.27:0/2723788345 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f394c0cbd90 msgr2=0x7f394c152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:14.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.478+0000 7f3951975640 1 --2- 172.21.15.27:0/2723788345 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f394c0cbd90 0x7f394c152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:14.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.478+0000 7f3951975640 1 -- 172.21.15.27:0/2723788345 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3948009420 con 0x7f394c0ce5d0 2024-01-15T11:35:14.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.478+0000 7f3951174640 1 --2- 172.21.15.27:0/2723788345 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f394c0cb9b0 0x7f394c0ad050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:35:14.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.478+0000 7f3951975640 1 --2- 172.21.15.27:0/2723788345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f394c0ce5d0 0x7f394c1526b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f394400ca80 tx=0x7f394400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:14.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.482+0000 7f3941ffb640 1 -- 172.21.15.27:0/2723788345 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394400ac30 con 0x7f394c0ce5d0 2024-01-15T11:35:14.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.482+0000 7f3941ffb640 1 -- 172.21.15.27:0/2723788345 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394400ad90 con 0x7f394c0ce5d0 2024-01-15T11:35:14.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.482+0000 7f39533d8640 1 -- 172.21.15.27:0/2723788345 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f394c1587d0 con 0x7f394c0ce5d0 2024-01-15T11:35:14.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.482+0000 7f3941ffb640 1 -- 172.21.15.27:0/2723788345 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3944012600 con 0x7f394c0ce5d0 2024-01-15T11:35:14.486 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.482+0000 7f39533d8640 1 -- 172.21.15.27:0/2723788345 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394c0ad590 con 0x7f394c0ce5d0 2024-01-15T11:35:14.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.482+0000 7f39533d8640 1 -- 172.21.15.27:0/2723788345 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f394c0671f0 con 0x7f394c0ce5d0 2024-01-15T11:35:14.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.482+0000 7f3941ffb640 1 -- 172.21.15.27:0/2723788345 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7f3944007070 con 0x7f394c0ce5d0 2024-01-15T11:35:14.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.482+0000 7f3941ffb640 1 --2- 172.21.15.27:0/2723788345 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3930066aa0 0x7f3930068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:14.487 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.482+0000 7f3941ffb640 1 -- 172.21.15.27:0/2723788345 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3944084620 con 0x7f394c0ce5d0 2024-01-15T11:35:14.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.482+0000 7f3951174640 1 --2- 172.21.15.27:0/2723788345 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3930066aa0 0x7f3930068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:14.488 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.486+0000 7f3951174640 1 --2- 172.21.15.27:0/2723788345 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3930066aa0 0x7f3930068f60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f39480af000 tx=0x7f39480a7000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:14.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.486+0000 7f3941ffb640 1 -- 172.21.15.27:0/2723788345 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3944051570 con 0x7f394c0ce5d0 2024-01-15T11:35:14.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.670+0000 7f39533d8640 1 -- 172.21.15.27:0/2723788345 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f394c15c570 con 0x7f3930066aa0 2024-01-15T11:35:14.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.686+0000 7f3941ffb640 1 -- 172.21.15.27:0/2723788345 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f394c15c570 con 0x7f3930066aa0 2024-01-15T11:35:14.691 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:35:14.691 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2024-01-15T11:35:14.691 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-01-15T11:35:14.691 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ss1" 2024-01-15T11:35:14.692 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-01-15T11:35:14.692 INFO:teuthology.orchestra.run.smithi027.stdout:] 2024-01-15T11:35:14.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.690+0000 7f39533d8640 1 -- 172.21.15.27:0/2723788345 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3930066aa0 msgr2=0x7f3930068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:14.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.690+0000 7f39533d8640 1 --2- 172.21.15.27:0/2723788345 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3930066aa0 0x7f3930068f60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f39480af000 tx=0x7f39480a7000 comp rx=0 tx=0).stop 2024-01-15T11:35:14.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.690+0000 7f39533d8640 1 -- 172.21.15.27:0/2723788345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f394c0ce5d0 msgr2=0x7f394c1526b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:14.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.690+0000 7f39533d8640 1 --2- 172.21.15.27:0/2723788345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f394c0ce5d0 0x7f394c1526b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f394400ca80 tx=0x7f394400cf40 comp rx=0 tx=0).stop 2024-01-15T11:35:14.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.690+0000 7f39533d8640 1 -- 172.21.15.27:0/2723788345 shutdown_connections 2024-01-15T11:35:14.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.690+0000 7f39533d8640 1 --2- 172.21.15.27:0/2723788345 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f394c0ce5d0 0x7f394c1526b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:14.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.690+0000 7f39533d8640 1 --2- 172.21.15.27:0/2723788345 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3930066aa0 0x7f3930068f60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:14.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.690+0000 7f39533d8640 1 --2- 172.21.15.27:0/2723788345 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f394c0cbd90 0x7f394c152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:14.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.690+0000 7f39533d8640 1 --2- 172.21.15.27:0/2723788345 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f394c0cb9b0 0x7f394c0ad050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:14.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.690+0000 7f39533d8640 1 -- 172.21.15.27:0/2723788345 >> 172.21.15.27:0/2723788345 conn(0x7f394c0b0cb0 msgr2=0x7f394c06e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:14.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.690+0000 7f39533d8640 1 -- 172.21.15.27:0/2723788345 shutdown_connections 2024-01-15T11:35:14.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.690+0000 7f39533d8640 1 -- 172.21.15.27:0/2723788345 wait complete. 2024-01-15T11:35:14.713 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-01-15T11:35:14.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.858+0000 7fae61032640 1 Processor -- start 2024-01-15T11:35:14.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.858+0000 7fae61032640 1 -- start start 2024-01-15T11:35:14.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.858+0000 7fae61032640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fae5c15a710 0x7fae5c0abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:14.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.862+0000 7fae61032640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fae5c0cbd50 0x7fae5c0cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:14.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.862+0000 7fae61032640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae5c0b2710 con 0x7fae5c0cdfb0 2024-01-15T11:35:14.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.862+0000 7fae61032640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae5c0cca80 con 0x7fae5c15a710 2024-01-15T11:35:14.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.862+0000 7fae61032640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae5c0b29f0 con 0x7fae5c0cbd50 2024-01-15T11:35:14.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.862+0000 7fae5a59c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fae5c15a710 0x7fae5c0abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:14.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.862+0000 7fae5a59c640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fae5c15a710 0x7fae5c0abf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47746/0 (socket says 172.21.15.27:47746) 2024-01-15T11:35:14.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.862+0000 7fae5a59c640 1 -- 172.21.15.27:0/164774828 learned_addr learned my addr 172.21.15.27:0/164774828 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:14.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.862+0000 7fae5b59e640 1 --2- 172.21.15.27:0/164774828 >> v2:172.21.15.93:3300/0 conn(0x7fae5c0cbd50 0x7fae5c0cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:14.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.862+0000 7fae5a59c640 1 -- 172.21.15.27:0/164774828 >> v2:172.21.15.93:3300/0 conn(0x7fae5c0cbd50 msgr2=0x7fae5c0cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:14.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.862+0000 7fae5a59c640 1 --2- 172.21.15.27:0/164774828 >> v2:172.21.15.93:3300/0 conn(0x7fae5c0cbd50 0x7fae5c0cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:14.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.862+0000 7fae5a59c640 1 -- 172.21.15.27:0/164774828 >> v1:172.21.15.93:6789/0 conn(0x7fae5c0cdfb0 legacy=0x7fae5c0ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:14.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.862+0000 7fae5a59c640 1 -- 172.21.15.27:0/164774828 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5c0b2cd0 con 0x7fae5c15a710 2024-01-15T11:35:14.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.862+0000 7fae5a59c640 1 --2- 172.21.15.27:0/164774828 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae5c15a710 0x7fae5c0abf90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0aead0 tx=0x7fae5001eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2fc962b1ddec1ed server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:14.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.862+0000 7fae59d9b640 1 -- 172.21.15.27:0/164774828 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae500a7c90 con 0x7fae5c15a710 2024-01-15T11:35:14.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.866+0000 7fae59d9b640 1 -- 172.21.15.27:0/164774828 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae500a7df0 con 0x7fae5c15a710 2024-01-15T11:35:14.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.866+0000 7fae59d9b640 1 -- 172.21.15.27:0/164774828 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae500af660 con 0x7fae5c15a710 2024-01-15T11:35:14.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.866+0000 7fae61032640 1 -- 172.21.15.27:0/164774828 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae5c15a710 msgr2=0x7fae5c0abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:14.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.866+0000 7fae61032640 1 --2- 172.21.15.27:0/164774828 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae5c15a710 0x7fae5c0abf90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0aead0 tx=0x7fae5001eba0 comp rx=0 tx=0).stop 2024-01-15T11:35:14.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.866+0000 7fae61032640 1 -- 172.21.15.27:0/164774828 shutdown_connections 2024-01-15T11:35:14.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.866+0000 7fae61032640 1 --2- 172.21.15.27:0/164774828 >> v2:172.21.15.93:3300/0 conn(0x7fae5c0cbd50 0x7fae5c0cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:14.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.866+0000 7fae61032640 1 --2- 172.21.15.27:0/164774828 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae5c15a710 0x7fae5c0abf90 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:14.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.866+0000 7fae61032640 1 -- 172.21.15.27:0/164774828 >> 172.21.15.27:0/164774828 conn(0x7fae5c0b0cb0 msgr2=0x7fae5c0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:14.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.866+0000 7fae61032640 1 -- 172.21.15.27:0/164774828 shutdown_connections 2024-01-15T11:35:14.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.866+0000 7fae61032640 1 -- 172.21.15.27:0/164774828 wait complete. 2024-01-15T11:35:14.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.866+0000 7fae61032640 1 Processor -- start 2024-01-15T11:35:14.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.866+0000 7fae61032640 1 -- start start 2024-01-15T11:35:14.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.866+0000 7fae61032640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fae5c0cbd50 0x7fae5c15b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:14.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.866+0000 7fae61032640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae5c0cdfb0 0x7fae5c155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:14.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.866+0000 7fae61032640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae5c15a710 0x7fae5c156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:14.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.866+0000 7fae61032640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c156150 con 0x7fae5c0cdfb0 2024-01-15T11:35:14.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.866+0000 7fae61032640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c157b40 con 0x7fae5c15a710 2024-01-15T11:35:14.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.866+0000 7fae61032640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c156cd0 con 0x7fae5c0cbd50 2024-01-15T11:35:14.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.866+0000 7fae5a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae5c0cdfb0 0x7fae5c155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:14.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.866+0000 7fae5a59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae5c0cdfb0 0x7fae5c155c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47758/0 (socket says 172.21.15.27:47758) 2024-01-15T11:35:14.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.866+0000 7fae5a59c640 1 -- 172.21.15.27:0/1247587021 learned_addr learned my addr 172.21.15.27:0/1247587021 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:14.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.866+0000 7fae5ad9d640 1 --2- 172.21.15.27:0/1247587021 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fae5c0cbd50 0x7fae5c15b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:14.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.866+0000 7fae5b59e640 1 --2- 172.21.15.27:0/1247587021 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae5c15a710 0x7fae5c156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:14.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.870+0000 7fae5a59c640 1 -- 172.21.15.27:0/1247587021 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fae5c0cbd50 msgr2=0x7fae5c15b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:14.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.870+0000 7fae5a59c640 1 --2- 172.21.15.27:0/1247587021 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fae5c0cbd50 0x7fae5c15b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:14.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.870+0000 7fae5a59c640 1 -- 172.21.15.27:0/1247587021 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae5c15a710 msgr2=0x7fae5c156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:14.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.870+0000 7fae5a59c640 1 --2- 172.21.15.27:0/1247587021 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae5c15a710 0x7fae5c156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:14.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.870+0000 7fae5a59c640 1 -- 172.21.15.27:0/1247587021 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5000b770 con 0x7fae5c0cdfb0 2024-01-15T11:35:14.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.870+0000 7fae5a59c640 1 --2- 172.21.15.27:0/1247587021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae5c0cdfb0 0x7fae5c155c10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fae5000b2c0 tx=0x7fae5001d3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:14.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.870+0000 7fae437fe640 1 -- 172.21.15.27:0/1247587021 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae500afd40 con 0x7fae5c0cdfb0 2024-01-15T11:35:14.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.870+0000 7fae437fe640 1 -- 172.21.15.27:0/1247587021 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae500ba480 con 0x7fae5c0cdfb0 2024-01-15T11:35:14.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.870+0000 7fae61032640 1 -- 172.21.15.27:0/1247587021 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae5c156f30 con 0x7fae5c0cdfb0 2024-01-15T11:35:14.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.870+0000 7fae437fe640 1 -- 172.21.15.27:0/1247587021 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae500afea0 con 0x7fae5c0cdfb0 2024-01-15T11:35:14.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.870+0000 7fae61032640 1 -- 172.21.15.27:0/1247587021 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5c1574f0 con 0x7fae5c0cdfb0 2024-01-15T11:35:14.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.870+0000 7fae61032640 1 -- 172.21.15.27:0/1247587021 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae5c0671f0 con 0x7fae5c0cdfb0 2024-01-15T11:35:14.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.870+0000 7fae437fe640 1 -- 172.21.15.27:0/1247587021 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7fae500ba830 con 0x7fae5c0cdfb0 2024-01-15T11:35:14.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.870+0000 7fae437fe640 1 --2- 172.21.15.27:0/1247587021 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fae48066aa0 0x7fae48068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:14.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.870+0000 7fae437fe640 1 -- 172.21.15.27:0/1247587021 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fae5011fba0 con 0x7fae5c0cdfb0 2024-01-15T11:35:14.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.874+0000 7fae5ad9d640 1 --2- 172.21.15.27:0/1247587021 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fae48066aa0 0x7fae48068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:14.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.874+0000 7fae5ad9d640 1 --2- 172.21.15.27:0/1247587021 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fae48066aa0 0x7fae48068f60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fae4c007fd0 tx=0x7fae4c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:14.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:14.878+0000 7fae437fe640 1 -- 172.21.15.27:0/1247587021 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fae500ecb90 con 0x7fae5c0cdfb0 2024-01-15T11:35:15.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.066+0000 7fae61032640 1 -- 172.21.15.27:0/1247587021 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae5c06b460 con 0x7fae48066aa0 2024-01-15T11:35:15.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.098+0000 7fae437fe640 1 -- 172.21.15.27:0/1247587021 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fae5c06b460 con 0x7fae48066aa0 2024-01-15T11:35:15.103 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:35:15.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.102+0000 7fae61032640 1 -- 172.21.15.27:0/1247587021 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fae48066aa0 msgr2=0x7fae48068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:15.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.102+0000 7fae61032640 1 --2- 172.21.15.27:0/1247587021 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fae48066aa0 0x7fae48068f60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fae4c007fd0 tx=0x7fae4c009040 comp rx=0 tx=0).stop 2024-01-15T11:35:15.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.102+0000 7fae61032640 1 -- 172.21.15.27:0/1247587021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae5c0cdfb0 msgr2=0x7fae5c155c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:15.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.102+0000 7fae61032640 1 --2- 172.21.15.27:0/1247587021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae5c0cdfb0 0x7fae5c155c10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fae5000b2c0 tx=0x7fae5001d3e0 comp rx=0 tx=0).stop 2024-01-15T11:35:15.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.102+0000 7fae61032640 1 -- 172.21.15.27:0/1247587021 shutdown_connections 2024-01-15T11:35:15.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.102+0000 7fae61032640 1 --2- 172.21.15.27:0/1247587021 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fae48066aa0 0x7fae48068f60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:15.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.102+0000 7fae61032640 1 --2- 172.21.15.27:0/1247587021 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae5c15a710 0x7fae5c156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:15.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.102+0000 7fae61032640 1 --2- 172.21.15.27:0/1247587021 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fae5c0cdfb0 0x7fae5c155c10 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:15.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.102+0000 7fae61032640 1 --2- 172.21.15.27:0/1247587021 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fae5c0cbd50 0x7fae5c15b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:15.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.102+0000 7fae61032640 1 -- 172.21.15.27:0/1247587021 >> 172.21.15.27:0/1247587021 conn(0x7fae5c0b0cb0 msgr2=0x7fae5c0ad230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:15.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.102+0000 7fae61032640 1 -- 172.21.15.27:0/1247587021 shutdown_connections 2024-01-15T11:35:15.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.102+0000 7fae61032640 1 -- 172.21.15.27:0/1247587021 wait complete. 2024-01-15T11:35:15.125 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-01-15T11:35:15.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.270+0000 7fd959501640 1 Processor -- start 2024-01-15T11:35:15.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.270+0000 7fd959501640 1 -- start start 2024-01-15T11:35:15.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.270+0000 7fd959501640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd9540ced30 0x7fd9540cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:15.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.270+0000 7fd959501640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9540cdfb0 con 0x7fd95415d8f0 2024-01-15T11:35:15.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.270+0000 7fd959501640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9540d4140 con 0x7fd9540cf1e0 2024-01-15T11:35:15.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.270+0000 7fd959501640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9540d4420 con 0x7fd9540ced30 2024-01-15T11:35:15.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.270+0000 7fd9527fc640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd9540ced30 0x7fd9540cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:15.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.270+0000 7fd952ffd640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fd95415d8f0 0x7fd95415e780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42440/0 (socket says 172.21.15.27:42440) 2024-01-15T11:35:15.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.270+0000 7fd9527fc640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7fd9540ced30 0x7fd9540cfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53228/0 (socket says 172.21.15.27:53228) 2024-01-15T11:35:15.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.270+0000 7fd952ffd640 1 -- 172.21.15.27:0/1054639661 learned_addr learned my addr 172.21.15.27:0/1054639661 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:35:15.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.270+0000 7fd9527fc640 1 -- 172.21.15.27:0/1054639661 >> v1:172.21.15.93:6789/0 conn(0x7fd9540cf1e0 legacy=0x7fd9540d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:15.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.270+0000 7fd9527fc640 1 -- 172.21.15.27:0/1054639661 >> v1:172.21.15.27:6789/0 conn(0x7fd95415d8f0 legacy=0x7fd95415e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:15.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.270+0000 7fd951ffb640 1 -- 172.21.15.27:0/1054639661 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169092921 0 0) 0x7fd9540cdfb0 con 0x7fd95415d8f0 2024-01-15T11:35:15.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.270+0000 7fd9527fc640 1 -- 172.21.15.27:0/1054639661 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9540ce250 con 0x7fd9540ced30 2024-01-15T11:35:15.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.274+0000 7fd9527fc640 1 --2- 172.21.15.27:0/1054639661 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9540ced30 0x7fd9540cfe00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd9480097c0 tx=0x7fd94801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d397c39fd6b854 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:15.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.274+0000 7fd951ffb640 1 -- 172.21.15.27:0/1054639661 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9480ab650 con 0x7fd9540ced30 2024-01-15T11:35:15.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.274+0000 7fd951ffb640 1 -- 172.21.15.27:0/1054639661 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9480ab7b0 con 0x7fd9540ced30 2024-01-15T11:35:15.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.274+0000 7fd951ffb640 1 -- 172.21.15.27:0/1054639661 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9480abb40 con 0x7fd9540ced30 2024-01-15T11:35:15.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.274+0000 7fd959501640 1 -- 172.21.15.27:0/1054639661 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9540ced30 msgr2=0x7fd9540cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:15.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.274+0000 7fd959501640 1 --2- 172.21.15.27:0/1054639661 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9540ced30 0x7fd9540cfe00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd9480097c0 tx=0x7fd94801c450 comp rx=0 tx=0).stop 2024-01-15T11:35:15.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.274+0000 7fd959501640 1 -- 172.21.15.27:0/1054639661 shutdown_connections 2024-01-15T11:35:15.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.274+0000 7fd959501640 1 --2- 172.21.15.27:0/1054639661 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9540ced30 0x7fd9540cfe00 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:15.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.274+0000 7fd959501640 1 -- 172.21.15.27:0/1054639661 >> 172.21.15.27:0/1054639661 conn(0x7fd95409c750 msgr2=0x7fd9540d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:15.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.274+0000 7fd959501640 1 -- 172.21.15.27:0/1054639661 shutdown_connections 2024-01-15T11:35:15.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.274+0000 7fd959501640 1 -- 172.21.15.27:0/1054639661 wait complete. 2024-01-15T11:35:15.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.278+0000 7fd959501640 1 Processor -- start 2024-01-15T11:35:15.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.278+0000 7fd959501640 1 -- start start 2024-01-15T11:35:15.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.278+0000 7fd959501640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9540ced30 0x7fd954168ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:15.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.278+0000 7fd959501640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd9540cf1e0 0x7fd9540b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:15.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.278+0000 7fd959501640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd95415d8f0 0x7fd9540cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:15.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.278+0000 7fd959501640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9540b5fe0 con 0x7fd95415d8f0 2024-01-15T11:35:15.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.278+0000 7fd959501640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd954169400 con 0x7fd9540ced30 2024-01-15T11:35:15.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.278+0000 7fd959501640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9540cb2f0 con 0x7fd9540cf1e0 2024-01-15T11:35:15.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.278+0000 7fd9537fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd95415d8f0 0x7fd9540cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:15.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.278+0000 7fd9537fe640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd95415d8f0 0x7fd9540cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53242/0 (socket says 172.21.15.27:53242) 2024-01-15T11:35:15.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.278+0000 7fd9537fe640 1 -- 172.21.15.27:0/2874095435 learned_addr learned my addr 172.21.15.27:0/2874095435 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:15.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.278+0000 7fd952ffd640 1 --2- 172.21.15.27:0/2874095435 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9540ced30 0x7fd954168ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:15.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.278+0000 7fd9527fc640 1 --2- 172.21.15.27:0/2874095435 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd9540cf1e0 0x7fd9540b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:15.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.278+0000 7fd9537fe640 1 -- 172.21.15.27:0/2874095435 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd9540cf1e0 msgr2=0x7fd9540b8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:15.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.278+0000 7fd9537fe640 1 --2- 172.21.15.27:0/2874095435 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd9540cf1e0 0x7fd9540b8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:15.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.278+0000 7fd9537fe640 1 -- 172.21.15.27:0/2874095435 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9540ced30 msgr2=0x7fd954168ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:15.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.278+0000 7fd9537fe640 1 --2- 172.21.15.27:0/2874095435 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9540ced30 0x7fd954168ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:15.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.278+0000 7fd9537fe640 1 -- 172.21.15.27:0/2874095435 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd948009420 con 0x7fd95415d8f0 2024-01-15T11:35:15.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.278+0000 7fd9537fe640 1 --2- 172.21.15.27:0/2874095435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd95415d8f0 0x7fd9540cc5b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd94c00c760 tx=0x7fd94c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:15.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.278+0000 7fd93b7fe640 1 -- 172.21.15.27:0/2874095435 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c003b80 con 0x7fd95415d8f0 2024-01-15T11:35:15.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.278+0000 7fd93b7fe640 1 -- 172.21.15.27:0/2874095435 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94c003ce0 con 0x7fd95415d8f0 2024-01-15T11:35:15.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.278+0000 7fd93b7fe640 1 -- 172.21.15.27:0/2874095435 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c00aa90 con 0x7fd95415d8f0 2024-01-15T11:35:15.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.278+0000 7fd959501640 1 -- 172.21.15.27:0/2874095435 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9540cb5d0 con 0x7fd95415d8f0 2024-01-15T11:35:15.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.278+0000 7fd959501640 1 -- 172.21.15.27:0/2874095435 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9540b6230 con 0x7fd95415d8f0 2024-01-15T11:35:15.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.278+0000 7fd959501640 1 -- 172.21.15.27:0/2874095435 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd95404e850 con 0x7fd95415d8f0 2024-01-15T11:35:15.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.282+0000 7fd93b7fe640 1 -- 172.21.15.27:0/2874095435 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7fd94c00abf0 con 0x7fd95415d8f0 2024-01-15T11:35:15.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.282+0000 7fd93b7fe640 1 --2- 172.21.15.27:0/2874095435 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd940066aa0 0x7fd940068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:15.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.282+0000 7fd93b7fe640 1 -- 172.21.15.27:0/2874095435 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd94c0843b0 con 0x7fd95415d8f0 2024-01-15T11:35:15.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.282+0000 7fd952ffd640 1 --2- 172.21.15.27:0/2874095435 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd940066aa0 0x7fd940068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:15.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.282+0000 7fd952ffd640 1 --2- 172.21.15.27:0/2874095435 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd940066aa0 0x7fd940068f60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd944007a90 tx=0x7fd9440079e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:15.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.286+0000 7fd93b7fe640 1 -- 172.21.15.27:0/2874095435 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd94c051430 con 0x7fd95415d8f0 2024-01-15T11:35:15.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.490+0000 7fd959501640 1 -- 172.21.15.27:0/2874095435 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9540734f0 con 0x7fd940066aa0 2024-01-15T11:35:15.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.510+0000 7fd93b7fe640 1 -- 172.21.15.27:0/2874095435 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd9540734f0 con 0x7fd940066aa0 2024-01-15T11:35:15.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.510+0000 7fd959501640 1 -- 172.21.15.27:0/2874095435 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd940066aa0 msgr2=0x7fd940068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:15.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.510+0000 7fd959501640 1 --2- 172.21.15.27:0/2874095435 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd940066aa0 0x7fd940068f60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd944007a90 tx=0x7fd9440079e0 comp rx=0 tx=0).stop 2024-01-15T11:35:15.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.510+0000 7fd959501640 1 -- 172.21.15.27:0/2874095435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd95415d8f0 msgr2=0x7fd9540cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:15.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.510+0000 7fd959501640 1 --2- 172.21.15.27:0/2874095435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd95415d8f0 0x7fd9540cc5b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd94c00c760 tx=0x7fd94c00cc20 comp rx=0 tx=0).stop 2024-01-15T11:35:15.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.510+0000 7fd959501640 1 -- 172.21.15.27:0/2874095435 shutdown_connections 2024-01-15T11:35:15.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.510+0000 7fd959501640 1 --2- 172.21.15.27:0/2874095435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd95415d8f0 0x7fd9540cc5b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:15.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.510+0000 7fd959501640 1 --2- 172.21.15.27:0/2874095435 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd9540cf1e0 0x7fd9540b8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:15.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.510+0000 7fd959501640 1 --2- 172.21.15.27:0/2874095435 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fd940066aa0 0x7fd940068f60 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:15.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.510+0000 7fd959501640 1 --2- 172.21.15.27:0/2874095435 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd9540ced30 0x7fd954168ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:15.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.510+0000 7fd959501640 1 -- 172.21.15.27:0/2874095435 >> 172.21.15.27:0/2874095435 conn(0x7fd95409c750 msgr2=0x7fd9540b3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:15.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.510+0000 7fd959501640 1 -- 172.21.15.27:0/2874095435 shutdown_connections 2024-01-15T11:35:15.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.510+0000 7fd959501640 1 -- 172.21.15.27:0/2874095435 wait complete. 2024-01-15T11:35:15.519 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:35:15.516+0000 7fbe916cc640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:35:15.519 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:35:15.516+0000 7fbe916cc640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:35:15.519 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:35:15.516+0000 7fbe916cc640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:35:15.519 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:35:15.516+0000 7fbe916cc640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:35:15.519 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:35:15.516+0000 7fbe916cc640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:35:15.537 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs ss1clone1 2024-01-15T11:35:15.538 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:35:15.532+0000 7fbe8fec9640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:35:15.538 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:35:15.536+0000 7fbe8fec9640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:35:15.538 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:35:15.536+0000 7fbe8fec9640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:35:15.538 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:35:15.536+0000 7fbe8fec9640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:35:15.539 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:35:15.536+0000 7fbe8fec9640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:35:15.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.686+0000 7f9088165640 1 Processor -- start 2024-01-15T11:35:15.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.686+0000 7f9088165640 1 -- start start 2024-01-15T11:35:15.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.690+0000 7f9088165640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f90800ced30 0x7f90800cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:15.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.690+0000 7f9088165640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90800cdfb0 con 0x7f908015d8f0 2024-01-15T11:35:15.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.690+0000 7f9088165640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90800d4140 con 0x7f90800cf1e0 2024-01-15T11:35:15.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.690+0000 7f9088165640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90800d4420 con 0x7f90800ced30 2024-01-15T11:35:15.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.690+0000 7f9085f01640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f908015d8f0 0x7f908015e780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42450/0 (socket says 172.21.15.27:42450) 2024-01-15T11:35:15.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.690+0000 7f9085f01640 1 -- 172.21.15.27:0/1398763956 learned_addr learned my addr 172.21.15.27:0/1398763956 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:35:15.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.690+0000 7f9085700640 1 --2- 172.21.15.27:0/1398763956 >> v2:172.21.15.93:3300/0 conn(0x7f90800ced30 0x7f90800cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:15.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.690+0000 7f9084eff640 1 -- 172.21.15.27:0/1398763956 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155192343 0 0) 0x7f90800cdfb0 con 0x7f908015d8f0 2024-01-15T11:35:15.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.690+0000 7f9084eff640 1 -- 172.21.15.27:0/1398763956 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f906c003530 con 0x7f908015d8f0 2024-01-15T11:35:15.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.690+0000 7f9085700640 1 -- 172.21.15.27:0/1398763956 >> v1:172.21.15.93:6789/0 conn(0x7f90800cf1e0 legacy=0x7f90800d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:15.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.690+0000 7f9085700640 1 -- 172.21.15.27:0/1398763956 >> v1:172.21.15.27:6789/0 conn(0x7f908015d8f0 legacy=0x7f908015e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:15.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.690+0000 7f9085700640 1 -- 172.21.15.27:0/1398763956 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90800ce250 con 0x7f90800ced30 2024-01-15T11:35:15.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.694+0000 7f9085700640 1 --2- 172.21.15.27:0/1398763956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90800ced30 0x7f90800cfe00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f90700097c0 tx=0x7f907001c290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=321c2d10e735709d server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:15.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.694+0000 7f9084eff640 1 -- 172.21.15.27:0/1398763956 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c001680 con 0x7f90800ced30 2024-01-15T11:35:15.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.694+0000 7f9084eff640 1 -- 172.21.15.27:0/1398763956 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90700a7050 con 0x7f90800ced30 2024-01-15T11:35:15.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.694+0000 7f9084eff640 1 -- 172.21.15.27:0/1398763956 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90700ab620 con 0x7f90800ced30 2024-01-15T11:35:15.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.694+0000 7f9088165640 1 -- 172.21.15.27:0/1398763956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90800ced30 msgr2=0x7f90800cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:15.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.694+0000 7f9088165640 1 --2- 172.21.15.27:0/1398763956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90800ced30 0x7f90800cfe00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f90700097c0 tx=0x7f907001c290 comp rx=0 tx=0).stop 2024-01-15T11:35:15.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.694+0000 7f9088165640 1 -- 172.21.15.27:0/1398763956 shutdown_connections 2024-01-15T11:35:15.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.694+0000 7f9088165640 1 --2- 172.21.15.27:0/1398763956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90800ced30 0x7f90800cfe00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:15.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.694+0000 7f9088165640 1 -- 172.21.15.27:0/1398763956 >> 172.21.15.27:0/1398763956 conn(0x7f908009c750 msgr2=0x7f90800d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:15.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.694+0000 7f9088165640 1 -- 172.21.15.27:0/1398763956 shutdown_connections 2024-01-15T11:35:15.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.694+0000 7f9088165640 1 -- 172.21.15.27:0/1398763956 wait complete. 2024-01-15T11:35:15.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.698+0000 7f9088165640 1 Processor -- start 2024-01-15T11:35:15.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.698+0000 7f9088165640 1 -- start start 2024-01-15T11:35:15.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.698+0000 7f9088165640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f90800ced30 0x7f90800b8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:15.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.698+0000 7f9088165640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90800cf1e0 0x7f90800b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:15.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.698+0000 7f9088165640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f908015d8f0 0x7f908014ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:15.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.698+0000 7f9088165640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90800b3c10 con 0x7f90800cf1e0 2024-01-15T11:35:15.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.698+0000 7f9088165640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90801504a0 con 0x7f908015d8f0 2024-01-15T11:35:15.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.698+0000 7f9088165640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90800b5fe0 con 0x7f90800ced30 2024-01-15T11:35:15.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.698+0000 7f9085700640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90800cf1e0 0x7f90800b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:15.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.698+0000 7f9085700640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90800cf1e0 0x7f90800b36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53256/0 (socket says 172.21.15.27:53256) 2024-01-15T11:35:15.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.698+0000 7f9085700640 1 -- 172.21.15.27:0/2345322867 learned_addr learned my addr 172.21.15.27:0/2345322867 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:15.705 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.698+0000 7f9085f01640 1 --2- 172.21.15.27:0/2345322867 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f90800ced30 0x7f90800b8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:15.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.698+0000 7f9086702640 1 --2- 172.21.15.27:0/2345322867 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f908015d8f0 0x7f908014ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:15.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.698+0000 7f9085700640 1 -- 172.21.15.27:0/2345322867 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f90800ced30 msgr2=0x7f90800b8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:15.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.698+0000 7f9085700640 1 --2- 172.21.15.27:0/2345322867 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f90800ced30 0x7f90800b8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:15.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.698+0000 7f9085700640 1 -- 172.21.15.27:0/2345322867 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f908015d8f0 msgr2=0x7f908014ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:15.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.698+0000 7f9085700640 1 --2- 172.21.15.27:0/2345322867 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f908015d8f0 0x7f908014ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:15.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.698+0000 7f9085700640 1 -- 172.21.15.27:0/2345322867 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9070009420 con 0x7f90800cf1e0 2024-01-15T11:35:15.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.698+0000 7f9086702640 1 --2- 172.21.15.27:0/2345322867 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f908015d8f0 0x7f908014ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:35:15.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.698+0000 7f9085f01640 1 --2- 172.21.15.27:0/2345322867 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f90800ced30 0x7f90800b8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-15T11:35:15.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.698+0000 7f9085700640 1 --2- 172.21.15.27:0/2345322867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90800cf1e0 0x7f90800b36d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9070018ea0 tx=0x7f907001aad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:15.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.702+0000 7f90767fc640 1 -- 172.21.15.27:0/2345322867 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90700b7450 con 0x7f90800cf1e0 2024-01-15T11:35:15.706 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.702+0000 7f90767fc640 1 -- 172.21.15.27:0/2345322867 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90700b75b0 con 0x7f90800cf1e0 2024-01-15T11:35:15.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.702+0000 7f90767fc640 1 -- 172.21.15.27:0/2345322867 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90700b7960 con 0x7f90800cf1e0 2024-01-15T11:35:15.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.702+0000 7f9088165640 1 -- 172.21.15.27:0/2345322867 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90800b6230 con 0x7f90800cf1e0 2024-01-15T11:35:15.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.702+0000 7f9088165640 1 -- 172.21.15.27:0/2345322867 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9080151150 con 0x7f90800cf1e0 2024-01-15T11:35:15.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.702+0000 7f9088165640 1 -- 172.21.15.27:0/2345322867 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f908004e850 con 0x7f90800cf1e0 2024-01-15T11:35:15.707 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.702+0000 7f90767fc640 1 -- 172.21.15.27:0/2345322867 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 7) v1 ==== 86313+0+0 (secure 0 0 0) 0x7f90700b7ac0 con 0x7f90800cf1e0 2024-01-15T11:35:15.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.706+0000 7f90767fc640 1 --2- 172.21.15.27:0/2345322867 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9064066aa0 0x7f9064068f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:15.708 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.706+0000 7f90767fc640 1 -- 172.21.15.27:0/2345322867 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f907011efe0 con 0x7f90800cf1e0 2024-01-15T11:35:15.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.706+0000 7f9085f01640 1 --2- 172.21.15.27:0/2345322867 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9064066aa0 0x7f9064068f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:15.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.706+0000 7f9085f01640 1 --2- 172.21.15.27:0/2345322867 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9064066aa0 0x7f9064068f60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f907c0017b0 tx=0x7f907c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:15.713 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.710+0000 7f90767fc640 1 -- 172.21.15.27:0/2345322867 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f90700ebe00 con 0x7f90800cf1e0 2024-01-15T11:35:15.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.894+0000 7f9088165640 1 -- 172.21.15.27:0/2345322867 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) v1 -- 0x7f90800d0750 con 0x7f9064066aa0 2024-01-15T11:35:15.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.906+0000 7f90767fc640 1 -- 172.21.15.27:0/2345322867 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f907c00d950 con 0x7f9064066aa0 2024-01-15T11:35:15.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.910+0000 7f9088165640 1 -- 172.21.15.27:0/2345322867 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9064066aa0 msgr2=0x7f9064068f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:15.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.910+0000 7f9088165640 1 --2- 172.21.15.27:0/2345322867 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9064066aa0 0x7f9064068f60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f907c0017b0 tx=0x7f907c009040 comp rx=0 tx=0).stop 2024-01-15T11:35:15.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.910+0000 7f9088165640 1 -- 172.21.15.27:0/2345322867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90800cf1e0 msgr2=0x7f90800b36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:15.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.910+0000 7f9088165640 1 --2- 172.21.15.27:0/2345322867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90800cf1e0 0x7f90800b36d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9070018ea0 tx=0x7f907001aad0 comp rx=0 tx=0).stop 2024-01-15T11:35:15.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.910+0000 7f9088165640 1 -- 172.21.15.27:0/2345322867 shutdown_connections 2024-01-15T11:35:15.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.910+0000 7f9088165640 1 --2- 172.21.15.27:0/2345322867 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f9064066aa0 0x7f9064068f60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:15.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.910+0000 7f9088165640 1 --2- 172.21.15.27:0/2345322867 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f908015d8f0 0x7f908014ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:15.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.910+0000 7f9088165640 1 --2- 172.21.15.27:0/2345322867 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f90800cf1e0 0x7f90800b36d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:15.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.910+0000 7f9088165640 1 --2- 172.21.15.27:0/2345322867 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f90800ced30 0x7f90800b8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:15.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.910+0000 7f9088165640 1 -- 172.21.15.27:0/2345322867 >> 172.21.15.27:0/2345322867 conn(0x7f908009c750 msgr2=0x7f9080158a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:15.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.910+0000 7f9088165640 1 -- 172.21.15.27:0/2345322867 shutdown_connections 2024-01-15T11:35:15.915 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:15.910+0000 7f9088165640 1 -- 172.21.15.27:0/2345322867 wait complete. 2024-01-15T11:35:15.924 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:35:15.920+0000 7fbe90ecb640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:35:15.924 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:35:15.920+0000 7fbe90ecb640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:35:15.924 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:35:15.920+0000 7fbe90ecb640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:35:15.925 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:35:15.920+0000 7fbe90ecb640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:35:15.925 INFO:tasks.ceph.mgr.x.smithi093.stderr:2024-01-15T11:35:15.920+0000 7fbe90ecb640 -1 client.0 error registering admin socket command: (17) File exists 2024-01-15T11:35:15.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:35:15.935 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-01-15T11:35:16.128 INFO:teuthology.orchestra.run.smithi027.stdout:3 2024-01-15T11:35:21.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:35:21.130 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-01-15T11:35:21.143 INFO:teuthology.orchestra.run.smithi027.stdout:2 2024-01-15T11:35:21.144 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs --yes-i-really-mean-it 2024-01-15T11:35:21.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.337+0000 7fa53872a640 1 Processor -- start 2024-01-15T11:35:21.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.337+0000 7fa53872a640 1 -- start start 2024-01-15T11:35:21.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa53872a640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa5300cb9b0 0x7fa53006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:21.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa53872a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa5300cbd90 0x7fa53015f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:21.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa53872a640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa530159630 con 0x7fa5300ce5d0 2024-01-15T11:35:21.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa53872a640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa53015bba0 con 0x7fa5300cb9b0 2024-01-15T11:35:21.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa53872a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5300cdd50 con 0x7fa5300cbd90 2024-01-15T11:35:21.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa536cc7640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fa5300ce5d0 0x7fa53015bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:42458/0 (socket says 172.21.15.27:42458) 2024-01-15T11:35:21.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa536cc7640 1 -- 172.21.15.27:0/2243568083 learned_addr learned my addr 172.21.15.27:0/2243568083 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:35:21.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa535cc5640 1 --2- 172.21.15.27:0/2243568083 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa5300cbd90 0x7fa53015f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:21.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa5364c6640 1 --2- 172.21.15.27:0/2243568083 >> v2:172.21.15.93:3300/0 conn(0x7fa5300cb9b0 0x7fa53006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:21.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa5354c4640 1 -- 172.21.15.27:0/2243568083 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041842353 0 0) 0x7fa530159630 con 0x7fa5300ce5d0 2024-01-15T11:35:21.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa5354c4640 1 -- 172.21.15.27:0/2243568083 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa51c003530 con 0x7fa5300ce5d0 2024-01-15T11:35:21.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa5354c4640 1 -- 172.21.15.27:0/2243568083 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 880313370 0 0) 0x7fa51c003530 con 0x7fa5300ce5d0 2024-01-15T11:35:21.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa5354c4640 1 -- 172.21.15.27:0/2243568083 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa5300cbd90 msgr2=0x7fa53015f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:21.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa5354c4640 1 --2- 172.21.15.27:0/2243568083 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa5300cbd90 0x7fa53015f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:21.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa5354c4640 1 -- 172.21.15.27:0/2243568083 >> v2:172.21.15.93:3300/0 conn(0x7fa5300cb9b0 msgr2=0x7fa53006e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:21.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa5354c4640 1 --2- 172.21.15.27:0/2243568083 >> v2:172.21.15.93:3300/0 conn(0x7fa5300cb9b0 0x7fa53006e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:21.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa5354c4640 1 -- 172.21.15.27:0/2243568083 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53015f6d0 con 0x7fa5300ce5d0 2024-01-15T11:35:21.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa5354c4640 1 -- 172.21.15.27:0/2243568083 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1394381265 0 0) 0x7fa528001a00 con 0x7fa5300ce5d0 2024-01-15T11:35:21.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa5354c4640 1 -- 172.21.15.27:0/2243568083 >> v1:172.21.15.27:6789/0 conn(0x7fa5300ce5d0 legacy=0x7fa53015bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:21.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa5354c4640 1 --2- 172.21.15.27:0/2243568083 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa5300cbd90 0x7fa51c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:21.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa5354c4640 1 --2- 172.21.15.27:0/2243568083 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa51c003f00 0x7fa51c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:21.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa5354c4640 1 --2- 172.21.15.27:0/2243568083 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa51c004d10 0x7fa51c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:21.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa5354c4640 1 -- 172.21.15.27:0/2243568083 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5300cdd50 con 0x7fa51c003f00 2024-01-15T11:35:21.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa5354c4640 1 -- 172.21.15.27:0/2243568083 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c00b990 con 0x7fa51c004d10 2024-01-15T11:35:21.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa5354c4640 1 -- 172.21.15.27:0/2243568083 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c00bad0 con 0x7fa5300cbd90 2024-01-15T11:35:21.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa535cc5640 1 --2- 172.21.15.27:0/2243568083 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa51c003f00 0x7fa51c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:21.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa5364c6640 1 --2- 172.21.15.27:0/2243568083 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa5300cbd90 0x7fa51c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:21.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa536cc7640 1 --2- 172.21.15.27:0/2243568083 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa51c004d10 0x7fa51c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:21.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa535cc5640 1 -- 172.21.15.27:0/2243568083 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa5300cbd90 msgr2=0x7fa51c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:21.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa535cc5640 1 --2- 172.21.15.27:0/2243568083 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa5300cbd90 0x7fa51c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:21.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa535cc5640 1 -- 172.21.15.27:0/2243568083 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa51c004d10 msgr2=0x7fa51c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:21.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa535cc5640 1 --2- 172.21.15.27:0/2243568083 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa51c004d10 0x7fa51c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:21.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa535cc5640 1 -- 172.21.15.27:0/2243568083 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c003530 con 0x7fa51c003f00 2024-01-15T11:35:21.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.341+0000 7fa536cc7640 1 --2- 172.21.15.27:0/2243568083 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa51c004d10 0x7fa51c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:35:21.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.345+0000 7fa535cc5640 1 --2- 172.21.15.27:0/2243568083 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa51c003f00 0x7fa51c0047d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa520009ae0 tx=0x7fa52001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b699e56589500c server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:21.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.345+0000 7fa5354c4640 1 -- 172.21.15.27:0/2243568083 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5200a5640 con 0x7fa51c003f00 2024-01-15T11:35:21.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.345+0000 7fa5354c4640 1 -- 172.21.15.27:0/2243568083 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5200a57a0 con 0x7fa51c003f00 2024-01-15T11:35:21.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.345+0000 7fa5354c4640 1 -- 172.21.15.27:0/2243568083 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5200a5b50 con 0x7fa51c003f00 2024-01-15T11:35:21.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.345+0000 7fa53872a640 1 -- 172.21.15.27:0/2243568083 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa51c003f00 msgr2=0x7fa51c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:21.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.345+0000 7fa53872a640 1 --2- 172.21.15.27:0/2243568083 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa51c003f00 0x7fa51c0047d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa520009ae0 tx=0x7fa52001c9f0 comp rx=0 tx=0).stop 2024-01-15T11:35:21.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.345+0000 7fa536cc7640 1 -- 172.21.15.27:0/2243568083 reap_dead start 2024-01-15T11:35:21.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.345+0000 7fa53872a640 1 -- 172.21.15.27:0/2243568083 shutdown_connections 2024-01-15T11:35:21.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.345+0000 7fa53872a640 1 -- 172.21.15.27:0/2243568083 >> 172.21.15.27:0/2243568083 conn(0x7fa5300b0cb0 msgr2=0x7fa5300b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:21.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.345+0000 7fa53872a640 1 -- 172.21.15.27:0/2243568083 shutdown_connections 2024-01-15T11:35:21.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.345+0000 7fa53872a640 1 -- 172.21.15.27:0/2243568083 wait complete. 2024-01-15T11:35:21.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.349+0000 7fa53872a640 1 Processor -- start 2024-01-15T11:35:21.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.349+0000 7fa53872a640 1 -- start start 2024-01-15T11:35:21.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.349+0000 7fa53872a640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa51c003f00 0x7fa5300c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:21.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.349+0000 7fa53872a640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa53014d570 0x7fa5300ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:21.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.349+0000 7fa53872a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5300afb10 0x7fa53014c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:21.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.349+0000 7fa53872a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5300b3040 con 0x7fa5300afb10 2024-01-15T11:35:21.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.349+0000 7fa53872a640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53014d9d0 con 0x7fa53014d570 2024-01-15T11:35:21.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.349+0000 7fa53872a640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5300c84d0 con 0x7fa51c003f00 2024-01-15T11:35:21.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.349+0000 7fa536cc7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5300afb10 0x7fa53014c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:21.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.349+0000 7fa536cc7640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5300afb10 0x7fa53014c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53278/0 (socket says 172.21.15.27:53278) 2024-01-15T11:35:21.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.349+0000 7fa536cc7640 1 -- 172.21.15.27:0/3673265214 learned_addr learned my addr 172.21.15.27:0/3673265214 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:21.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.349+0000 7fa5364c6640 1 --2- 172.21.15.27:0/3673265214 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa51c003f00 0x7fa5300c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:21.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.349+0000 7fa535cc5640 1 --2- 172.21.15.27:0/3673265214 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa53014d570 0x7fa5300ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:21.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.349+0000 7fa536cc7640 1 -- 172.21.15.27:0/3673265214 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa51c003f00 msgr2=0x7fa5300c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:21.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.349+0000 7fa536cc7640 1 --2- 172.21.15.27:0/3673265214 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa51c003f00 0x7fa5300c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:21.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.349+0000 7fa536cc7640 1 -- 172.21.15.27:0/3673265214 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa53014d570 msgr2=0x7fa5300ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:21.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.349+0000 7fa536cc7640 1 --2- 172.21.15.27:0/3673265214 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa53014d570 0x7fa5300ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:21.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.349+0000 7fa536cc7640 1 -- 172.21.15.27:0/3673265214 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5300c8770 con 0x7fa5300afb10 2024-01-15T11:35:21.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.349+0000 7fa536cc7640 1 --2- 172.21.15.27:0/3673265214 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5300afb10 0x7fa53014c6f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa5300ce9b0 tx=0x7fa528011930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:21.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.349+0000 7fa526ffd640 1 -- 172.21.15.27:0/3673265214 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5280137a0 con 0x7fa5300afb10 2024-01-15T11:35:21.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.349+0000 7fa526ffd640 1 -- 172.21.15.27:0/3673265214 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa528013900 con 0x7fa5300afb10 2024-01-15T11:35:21.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.349+0000 7fa53872a640 1 -- 172.21.15.27:0/3673265214 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5300b2c60 con 0x7fa5300afb10 2024-01-15T11:35:21.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.349+0000 7fa526ffd640 1 -- 172.21.15.27:0/3673265214 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528013c90 con 0x7fa5300afb10 2024-01-15T11:35:21.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.349+0000 7fa53872a640 1 -- 172.21.15.27:0/3673265214 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5300aff90 con 0x7fa5300afb10 2024-01-15T11:35:21.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.353+0000 7fa53872a640 1 -- 172.21.15.27:0/3673265214 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5300671f0 con 0x7fa5300afb10 2024-01-15T11:35:21.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.353+0000 7fa526ffd640 1 -- 172.21.15.27:0/3673265214 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 86466+0+0 (secure 0 0 0) 0x7fa5280203b0 con 0x7fa5300afb10 2024-01-15T11:35:21.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.353+0000 7fa526ffd640 1 --2- 172.21.15.27:0/3673265214 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa514066c80 0x7fa514069140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:21.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.353+0000 7fa526ffd640 1 -- 172.21.15.27:0/3673265214 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fa528087370 con 0x7fa5300afb10 2024-01-15T11:35:21.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.353+0000 7fa5364c6640 1 --2- 172.21.15.27:0/3673265214 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa514066c80 0x7fa514069140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:21.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.353+0000 7fa5364c6640 1 --2- 172.21.15.27:0/3673265214 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa514066c80 0x7fa514069140 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009c60 tx=0x7fa52c009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:21.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.357+0000 7fa526ffd640 1 -- 172.21.15.27:0/3673265214 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa5280541f0 con 0x7fa5300afb10 2024-01-15T11:35:21.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:21.537+0000 7fa53872a640 1 -- 172.21.15.27:0/3673265214 --> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "cephfs", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5300cae20 con 0x7fa514066c80 2024-01-15T11:35:21.584 INFO:tasks.ceph.mon.a.smithi027.stderr:2024-01-15T11:35:21.581+0000 7fb49cf85640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-15T11:35:21.672 INFO:tasks.ceph.mds.c.smithi027.stdout:starting mds.c at 2024-01-15T11:35:22.815 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:22.809+0000 7fa526ffd640 1 -- 172.21.15.27:0/3673265214 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 9) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa5280545c0 con 0x7fa5300afb10 2024-01-15T11:35:24.618 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:24.613+0000 7fa526ffd640 1 -- 172.21.15.27:0/3673265214 <== mgr.4111 v2:172.21.15.93:6832/5213615 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7fa5300cae20 con 0x7fa514066c80 2024-01-15T11:35:24.619 INFO:teuthology.orchestra.run.smithi027.stdout:metadata pool: cephfs_metadata data pool: ['cephfs_data'] removed 2024-01-15T11:35:24.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:24.617+0000 7fa53872a640 1 -- 172.21.15.27:0/3673265214 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa514066c80 msgr2=0x7fa514069140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:24.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:24.617+0000 7fa53872a640 1 --2- 172.21.15.27:0/3673265214 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa514066c80 0x7fa514069140 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009c60 tx=0x7fa52c009190 comp rx=0 tx=0).stop 2024-01-15T11:35:24.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:24.617+0000 7fa53872a640 1 -- 172.21.15.27:0/3673265214 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5300afb10 msgr2=0x7fa53014c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:24.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:24.617+0000 7fa53872a640 1 --2- 172.21.15.27:0/3673265214 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5300afb10 0x7fa53014c6f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa5300ce9b0 tx=0x7fa528011930 comp rx=0 tx=0).stop 2024-01-15T11:35:24.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:24.617+0000 7fa53872a640 1 -- 172.21.15.27:0/3673265214 shutdown_connections 2024-01-15T11:35:24.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:24.617+0000 7fa53872a640 1 --2- 172.21.15.27:0/3673265214 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5300afb10 0x7fa53014c6f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:24.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:24.617+0000 7fa53872a640 1 --2- 172.21.15.27:0/3673265214 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa514066c80 0x7fa514069140 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:24.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:24.617+0000 7fa53872a640 1 --2- 172.21.15.27:0/3673265214 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa53014d570 0x7fa5300ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:24.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:24.617+0000 7fa53872a640 1 --2- 172.21.15.27:0/3673265214 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa51c003f00 0x7fa5300c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:24.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:24.617+0000 7fa53872a640 1 -- 172.21.15.27:0/3673265214 >> 172.21.15.27:0/3673265214 conn(0x7fa5300b0cb0 msgr2=0x7fa5300ae250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:24.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:24.617+0000 7fa53872a640 1 -- 172.21.15.27:0/3673265214 shutdown_connections 2024-01-15T11:35:24.625 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:24.617+0000 7fa53872a640 1 -- 172.21.15.27:0/3673265214 wait complete. 2024-01-15T11:35:24.654 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-15T11:35:24.655 DEBUG:teuthology.orchestra.run.smithi027:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-15T11:35:24.739 DEBUG:teuthology.orchestra.run.smithi093:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-15T11:35:24.836 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-15T11:35:24.837 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:35:24.837 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T11:35:24.848 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T11:35:24.848 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T11:35:24.901 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-15T11:35:25.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.081+0000 7fa46cbdf640 1 Processor -- start 2024-01-15T11:35:25.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.081+0000 7fa46cbdf640 1 -- start start 2024-01-15T11:35:25.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa46cbdf640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa468161ab0 0x7fa4680d3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:25.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa46cbdf640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4680ce1f0 con 0x7fa468160d00 2024-01-15T11:35:25.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa46cbdf640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4680cea70 con 0x7fa4680d1da0 2024-01-15T11:35:25.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa46cbdf640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4680cf610 con 0x7fa468161ab0 2024-01-15T11:35:25.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa46659c640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7fa468160d00 0x7fa4680cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45308/0 (socket says 172.21.15.27:45308) 2024-01-15T11:35:25.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa46659c640 1 -- 172.21.15.27:0/1133774783 learned_addr learned my addr 172.21.15.27:0/1133774783 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:35:25.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa46559a640 1 -- 172.21.15.27:0/1133774783 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851927770 0 0) 0x7fa4680ce1f0 con 0x7fa468160d00 2024-01-15T11:35:25.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa46559a640 1 -- 172.21.15.27:0/1133774783 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa450003530 con 0x7fa468160d00 2024-01-15T11:35:25.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa466d9d640 1 --2- 172.21.15.27:0/1133774783 >> v2:172.21.15.93:3300/0 conn(0x7fa468161ab0 0x7fa4680d3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:25.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa46559a640 1 -- 172.21.15.27:0/1133774783 <== mon.0 v1:172.21.15.27:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4130383772 0 0) 0x7fa450003530 con 0x7fa468160d00 2024-01-15T11:35:25.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa46559a640 1 -- 172.21.15.27:0/1133774783 >> v2:172.21.15.93:3300/0 conn(0x7fa468161ab0 msgr2=0x7fa4680d3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:25.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa46559a640 1 --2- 172.21.15.27:0/1133774783 >> v2:172.21.15.93:3300/0 conn(0x7fa468161ab0 0x7fa4680d3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:25.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa46559a640 1 -- 172.21.15.27:0/1133774783 >> v1:172.21.15.93:6789/0 conn(0x7fa4680d1da0 legacy=0x7fa4681613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:25.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa46559a640 1 -- 172.21.15.27:0/1133774783 --> v1:172.21.15.27:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4680d4380 con 0x7fa468160d00 2024-01-15T11:35:25.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa46559a640 1 -- 172.21.15.27:0/1133774783 <== mon.0 v1:172.21.15.27:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1394381265 0 0) 0x7fa458001680 con 0x7fa468160d00 2024-01-15T11:35:25.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa46559a640 1 -- 172.21.15.27:0/1133774783 >> v1:172.21.15.27:6789/0 conn(0x7fa468160d00 legacy=0x7fa4680cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:25.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa46559a640 1 --2- 172.21.15.27:0/1133774783 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa4500039d0 0x7fa450003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:25.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa46559a640 1 --2- 172.21.15.27:0/1133774783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4500047d0 0x7fa450004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:25.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa46559a640 1 --2- 172.21.15.27:0/1133774783 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa450005190 0x7fa45000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:25.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa46559a640 1 -- 172.21.15.27:0/1133774783 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4680cf610 con 0x7fa4500047d0 2024-01-15T11:35:25.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa46559a640 1 -- 172.21.15.27:0/1133774783 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45000c070 con 0x7fa450005190 2024-01-15T11:35:25.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa46559a640 1 -- 172.21.15.27:0/1133774783 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45000c230 con 0x7fa4500039d0 2024-01-15T11:35:25.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa465d9b640 1 --2- 172.21.15.27:0/1133774783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4500047d0 0x7fa450004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:25.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa46659c640 1 --2- 172.21.15.27:0/1133774783 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa4500039d0 0x7fa450003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:25.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa466d9d640 1 --2- 172.21.15.27:0/1133774783 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa450005190 0x7fa45000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:25.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa465d9b640 1 -- 172.21.15.27:0/1133774783 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa4500039d0 msgr2=0x7fa450003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:25.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa465d9b640 1 --2- 172.21.15.27:0/1133774783 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa4500039d0 0x7fa450003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:25.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa465d9b640 1 -- 172.21.15.27:0/1133774783 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa450005190 msgr2=0x7fa45000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:25.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa465d9b640 1 --2- 172.21.15.27:0/1133774783 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa450005190 0x7fa45000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:25.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa465d9b640 1 -- 172.21.15.27:0/1133774783 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa450003530 con 0x7fa4500047d0 2024-01-15T11:35:25.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.085+0000 7fa466d9d640 1 -- 172.21.15.27:0/1133774783 reap_dead start 2024-01-15T11:35:25.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.089+0000 7fa465d9b640 1 --2- 172.21.15.27:0/1133774783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4500047d0 0x7fa450004c50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa45c001780 tx=0x7fa45c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611de106dccb0b3d server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:25.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.089+0000 7fa46559a640 1 -- 172.21.15.27:0/1133774783 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c0052d0 con 0x7fa4500047d0 2024-01-15T11:35:25.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.089+0000 7fa46559a640 1 -- 172.21.15.27:0/1133774783 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45c0a7050 con 0x7fa4500047d0 2024-01-15T11:35:25.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.089+0000 7fa46559a640 1 -- 172.21.15.27:0/1133774783 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c003600 con 0x7fa4500047d0 2024-01-15T11:35:25.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.089+0000 7fa46cbdf640 1 -- 172.21.15.27:0/1133774783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4500047d0 msgr2=0x7fa450004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:25.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.089+0000 7fa46cbdf640 1 --2- 172.21.15.27:0/1133774783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4500047d0 0x7fa450004c50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa45c001780 tx=0x7fa45c01c3e0 comp rx=0 tx=0).stop 2024-01-15T11:35:25.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.089+0000 7fa46cbdf640 1 -- 172.21.15.27:0/1133774783 shutdown_connections 2024-01-15T11:35:25.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.089+0000 7fa46cbdf640 1 --2- 172.21.15.27:0/1133774783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4500047d0 0x7fa450004c50 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:25.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.089+0000 7fa46cbdf640 1 -- 172.21.15.27:0/1133774783 >> 172.21.15.27:0/1133774783 conn(0x7fa46808afc0 msgr2=0x7fa4680d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:25.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.089+0000 7fa46cbdf640 1 -- 172.21.15.27:0/1133774783 shutdown_connections 2024-01-15T11:35:25.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.089+0000 7fa46cbdf640 1 -- 172.21.15.27:0/1133774783 wait complete. 2024-01-15T11:35:25.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa46cbdf640 1 Processor -- start 2024-01-15T11:35:25.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa46cbdf640 1 -- start start 2024-01-15T11:35:25.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa46cbdf640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4500047d0 0x7fa46814fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:25.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa46cbdf640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa46814f800 0x7fa4680ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:25.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa46cbdf640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa4680cd2a0 0x7fa4680b6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:25.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa46cbdf640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4680cd750 con 0x7fa4500047d0 2024-01-15T11:35:25.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa46cbdf640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4680b73f0 con 0x7fa46814f800 2024-01-15T11:35:25.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa46cbdf640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4680b76d0 con 0x7fa4680cd2a0 2024-01-15T11:35:25.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa46659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4500047d0 0x7fa46814fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:25.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa46659c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4500047d0 0x7fa46814fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45326/0 (socket says 172.21.15.27:45326) 2024-01-15T11:35:25.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa46659c640 1 -- 172.21.15.27:0/3589920386 learned_addr learned my addr 172.21.15.27:0/3589920386 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:25.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa465d9b640 1 --2- 172.21.15.27:0/3589920386 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa46814f800 0x7fa4680ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:25.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa466d9d640 1 --2- 172.21.15.27:0/3589920386 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa4680cd2a0 0x7fa4680b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:25.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa46659c640 1 -- 172.21.15.27:0/3589920386 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa4680cd2a0 msgr2=0x7fa4680b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:25.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa46659c640 1 --2- 172.21.15.27:0/3589920386 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa4680cd2a0 0x7fa4680b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:25.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa46659c640 1 -- 172.21.15.27:0/3589920386 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa46814f800 msgr2=0x7fa4680ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:25.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa46659c640 1 --2- 172.21.15.27:0/3589920386 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa46814f800 0x7fa4680ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:25.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa46659c640 1 -- 172.21.15.27:0/3589920386 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4680b79b0 con 0x7fa4500047d0 2024-01-15T11:35:25.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa466d9d640 1 --2- 172.21.15.27:0/3589920386 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa4680cd2a0 0x7fa4680b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:35:25.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa46659c640 1 --2- 172.21.15.27:0/3589920386 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4500047d0 0x7fa46814fff0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa458001d70 tx=0x7fa458007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:25.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa456ffd640 1 -- 172.21.15.27:0/3589920386 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa458001630 con 0x7fa4500047d0 2024-01-15T11:35:25.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa456ffd640 1 -- 172.21.15.27:0/3589920386 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45800f9c0 con 0x7fa4500047d0 2024-01-15T11:35:25.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa456ffd640 1 -- 172.21.15.27:0/3589920386 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45800fd90 con 0x7fa4500047d0 2024-01-15T11:35:25.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa46cbdf640 1 -- 172.21.15.27:0/3589920386 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4680b7c90 con 0x7fa4500047d0 2024-01-15T11:35:25.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa46cbdf640 1 -- 172.21.15.27:0/3589920386 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa468150530 con 0x7fa4500047d0 2024-01-15T11:35:25.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.093+0000 7fa46cbdf640 1 -- 172.21.15.27:0/3589920386 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa468150720 con 0x7fa4500047d0 2024-01-15T11:35:25.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.097+0000 7fa456ffd640 1 -- 172.21.15.27:0/3589920386 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 9) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa45801d460 con 0x7fa4500047d0 2024-01-15T11:35:25.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.097+0000 7fa456ffd640 1 --2- 172.21.15.27:0/3589920386 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa448066bf0 0x7fa4480690b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:25.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.097+0000 7fa456ffd640 1 -- 172.21.15.27:0/3589920386 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4971+0+0 (secure 0 0 0) 0x7fa458084650 con 0x7fa4500047d0 2024-01-15T11:35:25.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.097+0000 7fa465d9b640 1 --2- 172.21.15.27:0/3589920386 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa448066bf0 0x7fa4480690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:25.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.097+0000 7fa465d9b640 1 --2- 172.21.15.27:0/3589920386 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa448066bf0 0x7fa4480690b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa45c001750 tx=0x7fa45c0011a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:25.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.101+0000 7fa456ffd640 1 -- 172.21.15.27:0/3589920386 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa4580517e0 con 0x7fa4500047d0 2024-01-15T11:35:25.268 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.265+0000 7fa46cbdf640 1 -- 172.21.15.27:0/3589920386 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa46804e850 con 0x7fa4500047d0 2024-01-15T11:35:25.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.265+0000 7fa456ffd640 1 -- 172.21.15.27:0/3589920386 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+12945 (secure 0 0 0) 0x7fa458054e00 con 0x7fa4500047d0 2024-01-15T11:35:25.269 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-01-15T11:35:25.269 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":41,"fsid":"adeed595-43d7-47b7-9d6d-c1a89f44a694","created":"2024-01-15T11:32:54.977059+0000","modified":"2024-01-15T11:35:24.602233+0000","last_up_change":"2024-01-15T11:33:06.942333+0000","last_in_change":"2024-01-15T11:32:57.562518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-15T11:33:08.134662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dbacd381-9dea-4b4e-8773-41d5cba18117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6801","nonce":35041065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6803","nonce":35041065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6807","nonce":35041065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":35041065},{"type":"v1","addr":"172.21.15.27:6805","nonce":35041065}]},"public_addr":"172.21.15.27:6801/35041065","cluster_addr":"172.21.15.27:6803/35041065","heartbeat_back_addr":"172.21.15.27:6807/35041065","heartbeat_front_addr":"172.21.15.27:6805/35041065","state":["exists","up"]},{"osd":1,"uuid":"40901daa-dded-4309-9f19-e932950da9ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6809","nonce":4242255864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6811","nonce":4242255864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6815","nonce":4242255864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":4242255864},{"type":"v1","addr":"172.21.15.27:6813","nonce":4242255864}]},"public_addr":"172.21.15.27:6809/4242255864","cluster_addr":"172.21.15.27:6811/4242255864","heartbeat_back_addr":"172.21.15.27:6815/4242255864","heartbeat_front_addr":"172.21.15.27:6813/4242255864","state":["exists","up"]},{"osd":2,"uuid":"39d921fb-8f9c-477c-9d98-a9507c560242","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6817","nonce":746325995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6819","nonce":746325995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6823","nonce":746325995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":746325995},{"type":"v1","addr":"172.21.15.27:6821","nonce":746325995}]},"public_addr":"172.21.15.27:6817/746325995","cluster_addr":"172.21.15.27:6819/746325995","heartbeat_back_addr":"172.21.15.27:6823/746325995","heartbeat_front_addr":"172.21.15.27:6821/746325995","state":["exists","up"]},{"osd":3,"uuid":"8ab2b92a-f7bd-4f05-9534-e9ed06ab43d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6825","nonce":1557364309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6827","nonce":1557364309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6831","nonce":1557364309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":1557364309},{"type":"v1","addr":"172.21.15.27:6829","nonce":1557364309}]},"public_addr":"172.21.15.27:6825/1557364309","cluster_addr":"172.21.15.27:6827/1557364309","heartbeat_back_addr":"172.21.15.27:6831/1557364309","heartbeat_front_addr":"172.21.15.27:6829/1557364309","state":["exists","up"]},{"osd":4,"uuid":"e1e455a4-4dd0-4b5b-8822-b3b8010b8c2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6809","nonce":472500806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6811","nonce":472500806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6815","nonce":472500806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":472500806},{"type":"v1","addr":"172.21.15.93:6813","nonce":472500806}]},"public_addr":"172.21.15.93:6809/472500806","cluster_addr":"172.21.15.93:6811/472500806","heartbeat_back_addr":"172.21.15.93:6815/472500806","heartbeat_front_addr":"172.21.15.93:6813/472500806","state":["exists","up"]},{"osd":5,"uuid":"96910818-78ef-48a1-9c95-ba3c0efc7d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6801","nonce":1055846984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6803","nonce":1055846984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6807","nonce":1055846984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1055846984},{"type":"v1","addr":"172.21.15.93:6805","nonce":1055846984}]},"public_addr":"172.21.15.93:6801/1055846984","cluster_addr":"172.21.15.93:6803/1055846984","heartbeat_back_addr":"172.21.15.93:6807/1055846984","heartbeat_front_addr":"172.21.15.93:6805/1055846984","state":["exists","up"]},{"osd":6,"uuid":"23b0f723-79e4-414c-a01e-e7befa7ca49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6817","nonce":2052561323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6819","nonce":2052561323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6823","nonce":2052561323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":2052561323},{"type":"v1","addr":"172.21.15.93:6821","nonce":2052561323}]},"public_addr":"172.21.15.93:6817/2052561323","cluster_addr":"172.21.15.93:6819/2052561323","heartbeat_back_addr":"172.21.15.93:6823/2052561323","heartbeat_front_addr":"172.21.15.93:6821/2052561323","state":["exists","up"]},{"osd":7,"uuid":"a2b44835-210e-4e2a-aa00-2847ac6ac735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6825","nonce":2215132622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6827","nonce":2215132622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6831","nonce":2215132622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2215132622},{"type":"v1","addr":"172.21.15.93:6829","nonce":2215132622}]},"public_addr":"172.21.15.93:6825/2215132622","cluster_addr":"172.21.15.93:6827/2215132622","heartbeat_back_addr":"172.21.15.93:6831/2215132622","heartbeat_front_addr":"172.21.15.93:6829/2215132622","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.101117+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.201053+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.332087+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.313697+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.167686+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:04.208101+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.248564+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-15T11:33:03.302460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:6835/1732204565":"2024-01-16T11:35:21.582991+0000","172.21.15.27:6833/1732204565":"2024-01-16T11:35:21.582991+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-15T11:35:25.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.265+0000 7fa46cbdf640 1 -- 172.21.15.27:0/3589920386 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa448066bf0 msgr2=0x7fa4480690b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:25.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.265+0000 7fa46cbdf640 1 --2- 172.21.15.27:0/3589920386 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa448066bf0 0x7fa4480690b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa45c001750 tx=0x7fa45c0011a0 comp rx=0 tx=0).stop 2024-01-15T11:35:25.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.265+0000 7fa46cbdf640 1 -- 172.21.15.27:0/3589920386 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4500047d0 msgr2=0x7fa46814fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:25.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.265+0000 7fa46cbdf640 1 --2- 172.21.15.27:0/3589920386 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4500047d0 0x7fa46814fff0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa458001d70 tx=0x7fa458007720 comp rx=0 tx=0).stop 2024-01-15T11:35:25.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.265+0000 7fa46cbdf640 1 -- 172.21.15.27:0/3589920386 shutdown_connections 2024-01-15T11:35:25.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.265+0000 7fa46cbdf640 1 --2- 172.21.15.27:0/3589920386 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa4680cd2a0 0x7fa4680b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:25.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.265+0000 7fa46cbdf640 1 --2- 172.21.15.27:0/3589920386 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7fa448066bf0 0x7fa4480690b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:25.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.265+0000 7fa46cbdf640 1 --2- 172.21.15.27:0/3589920386 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa46814f800 0x7fa4680ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:25.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.265+0000 7fa46cbdf640 1 --2- 172.21.15.27:0/3589920386 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4500047d0 0x7fa46814fff0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:25.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.265+0000 7fa46cbdf640 1 -- 172.21.15.27:0/3589920386 >> 172.21.15.27:0/3589920386 conn(0x7fa46808afc0 msgr2=0x7fa46815fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:25.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.265+0000 7fa46cbdf640 1 -- 172.21.15.27:0/3589920386 shutdown_connections 2024-01-15T11:35:25.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.265+0000 7fa46cbdf640 1 -- 172.21.15.27:0/3589920386 wait complete. 2024-01-15T11:35:25.291 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-15T11:33:08.134662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-15T11:35:25.291 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-15T11:35:25.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.433+0000 7f69907df640 1 Processor -- start 2024-01-15T11:35:25.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.433+0000 7f69907df640 1 -- start start 2024-01-15T11:35:25.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.433+0000 7f69907df640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f69880cb9b0 0x7f698806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:25.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.433+0000 7f69907df640 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f69880cbd90 0x7f698815f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:25.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.433+0000 7f69907df640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6988159630 con 0x7f69880ce5d0 2024-01-15T11:35:25.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.433+0000 7f69907df640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f698815bba0 con 0x7f69880cb9b0 2024-01-15T11:35:25.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.433+0000 7f69907df640 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69880cdd50 con 0x7f69880cbd90 2024-01-15T11:35:25.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.433+0000 7f698ed7c640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f69880ce5d0 0x7f698815bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45316/0 (socket says 172.21.15.27:45316) 2024-01-15T11:35:25.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.433+0000 7f698e57b640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f69880cb9b0 0x7f698806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:25.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.433+0000 7f698ed7c640 1 -- 172.21.15.27:0/3284420336 learned_addr learned my addr 172.21.15.27:0/3284420336 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:35:25.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.433+0000 7f698dd7a640 1 --2- 172.21.15.27:0/3284420336 >> v2:172.21.15.93:3300/0 conn(0x7f69880cbd90 0x7f698815f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:25.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.433+0000 7f698e57b640 1 -- 172.21.15.27:0/3284420336 >> v2:172.21.15.93:3300/0 conn(0x7f69880cbd90 msgr2=0x7f698815f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-15T11:35:25.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.433+0000 7f698e57b640 1 --2- 172.21.15.27:0/3284420336 >> v2:172.21.15.93:3300/0 conn(0x7f69880cbd90 0x7f698815f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:25.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.433+0000 7f698e57b640 1 -- 172.21.15.27:0/3284420336 >> v1:172.21.15.27:6789/0 conn(0x7f69880ce5d0 legacy=0x7f698815bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:25.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.433+0000 7f698e57b640 1 -- 172.21.15.27:0/3284420336 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698815f6d0 con 0x7f69880cb9b0 2024-01-15T11:35:25.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.433+0000 7f698d579640 1 -- 172.21.15.27:0/3284420336 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491736156 0 0) 0x7f6988159630 con 0x7f69880ce5d0 2024-01-15T11:35:25.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.437+0000 7f698e57b640 1 --2- 172.21.15.27:0/3284420336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69880cb9b0 0x7f698806e3f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f69880b5200 tx=0x7f698401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178a9ddc3cd9d10a server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:25.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.437+0000 7f698d579640 1 -- 172.21.15.27:0/3284420336 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69840ab610 con 0x7f69880cb9b0 2024-01-15T11:35:25.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.437+0000 7f698d579640 1 -- 172.21.15.27:0/3284420336 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69840ab770 con 0x7f69880cb9b0 2024-01-15T11:35:25.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.437+0000 7f698d579640 1 -- 172.21.15.27:0/3284420336 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69840abb00 con 0x7f69880cb9b0 2024-01-15T11:35:25.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.437+0000 7f69907df640 1 -- 172.21.15.27:0/3284420336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69880cb9b0 msgr2=0x7f698806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:25.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.437+0000 7f69907df640 1 --2- 172.21.15.27:0/3284420336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69880cb9b0 0x7f698806e3f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f69880b5200 tx=0x7f698401c410 comp rx=0 tx=0).stop 2024-01-15T11:35:25.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.437+0000 7f69907df640 1 -- 172.21.15.27:0/3284420336 shutdown_connections 2024-01-15T11:35:25.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.437+0000 7f69907df640 1 --2- 172.21.15.27:0/3284420336 >> v2:172.21.15.93:3300/0 conn(0x7f69880cbd90 0x7f698815f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:25.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.437+0000 7f69907df640 1 --2- 172.21.15.27:0/3284420336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69880cb9b0 0x7f698806e3f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:25.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.437+0000 7f69907df640 1 -- 172.21.15.27:0/3284420336 >> 172.21.15.27:0/3284420336 conn(0x7f69880b0cb0 msgr2=0x7f69880b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:25.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.437+0000 7f69907df640 1 -- 172.21.15.27:0/3284420336 shutdown_connections 2024-01-15T11:35:25.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.437+0000 7f69907df640 1 -- 172.21.15.27:0/3284420336 wait complete. 2024-01-15T11:35:25.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.441+0000 7f69907df640 1 Processor -- start 2024-01-15T11:35:25.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.441+0000 7f69907df640 1 -- start start 2024-01-15T11:35:25.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.441+0000 7f69907df640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69880cb9b0 0x7f69880b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:25.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.441+0000 7f69907df640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f69880cbd90 0x7f698815a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:25.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.441+0000 7f69907df640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69880ce5d0 0x7f6988150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:25.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.441+0000 7f69907df640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698815ae30 con 0x7f69880cb9b0 2024-01-15T11:35:25.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.441+0000 7f69907df640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6988155290 con 0x7f69880ce5d0 2024-01-15T11:35:25.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.441+0000 7f69907df640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69880b32c0 con 0x7f69880cbd90 2024-01-15T11:35:25.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.441+0000 7f698e57b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69880cb9b0 0x7f69880b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:25.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.441+0000 7f698e57b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69880cb9b0 0x7f69880b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45350/0 (socket says 172.21.15.27:45350) 2024-01-15T11:35:25.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.441+0000 7f698e57b640 1 -- 172.21.15.27:0/1446474893 learned_addr learned my addr 172.21.15.27:0/1446474893 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:25.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.441+0000 7f698dd7a640 1 --2- 172.21.15.27:0/1446474893 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f69880cbd90 0x7f698815a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:25.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.441+0000 7f698ed7c640 1 --2- 172.21.15.27:0/1446474893 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69880ce5d0 0x7f6988150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:25.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.441+0000 7f698e57b640 1 -- 172.21.15.27:0/1446474893 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f69880cbd90 msgr2=0x7f698815a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:25.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.441+0000 7f698e57b640 1 --2- 172.21.15.27:0/1446474893 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f69880cbd90 0x7f698815a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:25.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.441+0000 7f698e57b640 1 -- 172.21.15.27:0/1446474893 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69880ce5d0 msgr2=0x7f6988150440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:25.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.441+0000 7f698e57b640 1 --2- 172.21.15.27:0/1446474893 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69880ce5d0 0x7f6988150440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:25.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.441+0000 7f698e57b640 1 -- 172.21.15.27:0/1446474893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6984009420 con 0x7f69880cb9b0 2024-01-15T11:35:25.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.441+0000 7f698ed7c640 1 --2- 172.21.15.27:0/1446474893 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69880ce5d0 0x7f6988150440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:35:25.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.441+0000 7f698e57b640 1 --2- 172.21.15.27:0/1446474893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69880cb9b0 0x7f69880b20b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f69840ad040 tx=0x7f698401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:25.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.441+0000 7f697effd640 1 -- 172.21.15.27:0/1446474893 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69840bf610 con 0x7f69880cb9b0 2024-01-15T11:35:25.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.441+0000 7f697effd640 1 -- 172.21.15.27:0/1446474893 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69840bf7b0 con 0x7f69880cb9b0 2024-01-15T11:35:25.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.441+0000 7f697effd640 1 -- 172.21.15.27:0/1446474893 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69840bfb60 con 0x7f69880cb9b0 2024-01-15T11:35:25.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.441+0000 7f69907df640 1 -- 172.21.15.27:0/1446474893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69880b2740 con 0x7f69880cb9b0 2024-01-15T11:35:25.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.441+0000 7f69907df640 1 -- 172.21.15.27:0/1446474893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69880b2d00 con 0x7f69880cb9b0 2024-01-15T11:35:25.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.445+0000 7f69907df640 1 -- 172.21.15.27:0/1446474893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69880671f0 con 0x7f69880cb9b0 2024-01-15T11:35:25.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.445+0000 7f697effd640 1 -- 172.21.15.27:0/1446474893 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 9) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f69840b5400 con 0x7f69880cb9b0 2024-01-15T11:35:25.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.445+0000 7f697effd640 1 --2- 172.21.15.27:0/1446474893 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f696c066bc0 0x7f696c069080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:25.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.445+0000 7f697effd640 1 -- 172.21.15.27:0/1446474893 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4971+0+0 (secure 0 0 0) 0x7f698411f2d0 con 0x7f69880cb9b0 2024-01-15T11:35:25.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.445+0000 7f698dd7a640 1 --2- 172.21.15.27:0/1446474893 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f696c066bc0 0x7f696c069080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:25.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.445+0000 7f698dd7a640 1 --2- 172.21.15.27:0/1446474893 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f696c066bc0 0x7f696c069080 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f69881fa3a0 tx=0x7f6978009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:25.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.449+0000 7f697effd640 1 -- 172.21.15.27:0/1446474893 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f69840ec3a0 con 0x7f69880cb9b0 2024-01-15T11:35:25.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.653+0000 7f69907df640 1 -- 172.21.15.27:0/1446474893 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6988164780 con 0x7f69880cb9b0 2024-01-15T11:35:25.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.653+0000 7f697effd640 1 -- 172.21.15.27:0/1446474893 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6988164780 con 0x7f69880cb9b0 2024-01-15T11:35:25.660 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-01-15T11:35:25.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.657+0000 7f69907df640 1 -- 172.21.15.27:0/1446474893 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f696c066bc0 msgr2=0x7f696c069080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:25.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.657+0000 7f69907df640 1 --2- 172.21.15.27:0/1446474893 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f696c066bc0 0x7f696c069080 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f69881fa3a0 tx=0x7f6978009190 comp rx=0 tx=0).stop 2024-01-15T11:35:25.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.657+0000 7f69907df640 1 -- 172.21.15.27:0/1446474893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69880cb9b0 msgr2=0x7f69880b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.657+0000 7f69907df640 1 --2- 172.21.15.27:0/1446474893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69880cb9b0 0x7f69880b20b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f69840ad040 tx=0x7f698401ac50 comp rx=0 tx=0).stop 2024-01-15T11:35:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.657+0000 7f69907df640 1 -- 172.21.15.27:0/1446474893 shutdown_connections 2024-01-15T11:35:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.657+0000 7f69907df640 1 --2- 172.21.15.27:0/1446474893 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f696c066bc0 0x7f696c069080 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.657+0000 7f69907df640 1 --2- 172.21.15.27:0/1446474893 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f69880ce5d0 0x7f6988150440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.657+0000 7f69907df640 1 --2- 172.21.15.27:0/1446474893 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f69880cbd90 0x7f698815a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.657+0000 7f69907df640 1 --2- 172.21.15.27:0/1446474893 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f69880cb9b0 0x7f69880b20b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.657+0000 7f69907df640 1 -- 172.21.15.27:0/1446474893 >> 172.21.15.27:0/1446474893 conn(0x7f69880b0cb0 msgr2=0x7f698815bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.657+0000 7f69907df640 1 -- 172.21.15.27:0/1446474893 shutdown_connections 2024-01-15T11:35:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.657+0000 7f69907df640 1 -- 172.21.15.27:0/1446474893 wait complete. 2024-01-15T11:35:25.682 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-15T11:35:25.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.821+0000 7f3559572640 1 Processor -- start 2024-01-15T11:35:25.826 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.821+0000 7f3559572640 1 -- start start 2024-01-15T11:35:25.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.821+0000 7f3559572640 1 --2- >> v2:172.21.15.27:3300/0 conn(0x7f35540ce5d0 0x7f355415bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:25.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.821+0000 7f3559572640 1 -- --> v1:172.21.15.27:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3554159630 con 0x7f35540cb9b0 2024-01-15T11:35:25.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.821+0000 7f3559572640 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35540cd1d0 con 0x7f355406e3f0 2024-01-15T11:35:25.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.821+0000 7f3559572640 1 -- --> v2:172.21.15.27:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f355406e860 con 0x7f35540ce5d0 2024-01-15T11:35:25.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.821+0000 7f3552ffd640 1 --1- >> v1:172.21.15.27:6789/0 conn(0x7f35540cb9b0 0x7f35540cbd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.27:6789/0 says I am v1:172.21.15.27:45320/0 (socket says 172.21.15.27:45320) 2024-01-15T11:35:25.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.821+0000 7f3552ffd640 1 -- 172.21.15.27:0/2045577026 learned_addr learned my addr 172.21.15.27:0/2045577026 (peer_addr_for_me v1:172.21.15.27:0/0) 2024-01-15T11:35:25.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.821+0000 7f35537fe640 1 --2- 172.21.15.27:0/2045577026 >> v2:172.21.15.27:3300/0 conn(0x7f35540ce5d0 0x7f355415bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:25.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.821+0000 7f35527fc640 1 -- 172.21.15.27:0/2045577026 <== mon.0 v1:172.21.15.27:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343571704 0 0) 0x7f3554159630 con 0x7f35540cb9b0 2024-01-15T11:35:25.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.821+0000 7f35527fc640 1 -- 172.21.15.27:0/2045577026 --> v1:172.21.15.27:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3540003530 con 0x7f35540cb9b0 2024-01-15T11:35:25.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.821+0000 7f35527fc640 1 -- 172.21.15.27:0/2045577026 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999008649 0 0) 0x7f35540cd1d0 con 0x7f355406e3f0 2024-01-15T11:35:25.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.821+0000 7f35527fc640 1 -- 172.21.15.27:0/2045577026 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3554159630 con 0x7f355406e3f0 2024-01-15T11:35:25.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.825+0000 7f35537fe640 1 -- 172.21.15.27:0/2045577026 >> v1:172.21.15.93:6789/0 conn(0x7f355406e3f0 legacy=0x7f355415f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:25.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.825+0000 7f35537fe640 1 -- 172.21.15.27:0/2045577026 >> v1:172.21.15.27:6789/0 conn(0x7f35540cb9b0 legacy=0x7f35540cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:25.829 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.825+0000 7f35537fe640 1 -- 172.21.15.27:0/2045577026 --> v2:172.21.15.27:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35540cd4b0 con 0x7f35540ce5d0 2024-01-15T11:35:25.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.825+0000 7f35537fe640 1 --2- 172.21.15.27:0/2045577026 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35540ce5d0 0x7f355415bfd0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f354c009d90 tx=0x7f354c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96213d90e81f6474 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:25.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.825+0000 7f35527fc640 1 -- 172.21.15.27:0/2045577026 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c0a57f0 con 0x7f35540ce5d0 2024-01-15T11:35:25.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.825+0000 7f35527fc640 1 -- 172.21.15.27:0/2045577026 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354c0a5950 con 0x7f35540ce5d0 2024-01-15T11:35:25.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.825+0000 7f35527fc640 1 -- 172.21.15.27:0/2045577026 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c0a5ce0 con 0x7f35540ce5d0 2024-01-15T11:35:25.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.825+0000 7f3559572640 1 -- 172.21.15.27:0/2045577026 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35540ce5d0 msgr2=0x7f355415bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:25.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.825+0000 7f3559572640 1 --2- 172.21.15.27:0/2045577026 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35540ce5d0 0x7f355415bfd0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f354c009d90 tx=0x7f354c01c950 comp rx=0 tx=0).stop 2024-01-15T11:35:25.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.825+0000 7f3559572640 1 -- 172.21.15.27:0/2045577026 shutdown_connections 2024-01-15T11:35:25.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.825+0000 7f3559572640 1 --2- 172.21.15.27:0/2045577026 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35540ce5d0 0x7f355415bfd0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:25.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.825+0000 7f3559572640 1 -- 172.21.15.27:0/2045577026 >> 172.21.15.27:0/2045577026 conn(0x7f35540b0cb0 msgr2=0x7f35540b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:25.832 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.825+0000 7f3559572640 1 -- 172.21.15.27:0/2045577026 shutdown_connections 2024-01-15T11:35:25.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.825+0000 7f3559572640 1 -- 172.21.15.27:0/2045577026 wait complete. 2024-01-15T11:35:25.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.829+0000 7f3559572640 1 Processor -- start 2024-01-15T11:35:25.833 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.829+0000 7f3559572640 1 -- start start 2024-01-15T11:35:25.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.829+0000 7f3559572640 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f355406e3f0 0x7f3554099a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:25.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.829+0000 7f3559572640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35540cb9b0 0x7f3554143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:25.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.829+0000 7f3559572640 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f35540ce5d0 0x7f35540acfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:25.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.829+0000 7f3559572640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3554165fd0 con 0x7f35540cb9b0 2024-01-15T11:35:25.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.829+0000 7f3559572640 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355409b400 con 0x7f35540ce5d0 2024-01-15T11:35:25.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.829+0000 7f3559572640 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35541667a0 con 0x7f355406e3f0 2024-01-15T11:35:25.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.829+0000 7f354bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35540cb9b0 0x7f3554143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:25.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.829+0000 7f354bfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35540cb9b0 0x7f3554143f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45370/0 (socket says 172.21.15.27:45370) 2024-01-15T11:35:25.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.829+0000 7f354bfff640 1 -- 172.21.15.27:0/3159824686 learned_addr learned my addr 172.21.15.27:0/3159824686 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-01-15T11:35:25.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.829+0000 7f35537fe640 1 --2- 172.21.15.27:0/3159824686 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f35540ce5d0 0x7f35540acfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:25.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.829+0000 7f3552ffd640 1 --2- 172.21.15.27:0/3159824686 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f355406e3f0 0x7f3554099a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:25.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.829+0000 7f354bfff640 1 -- 172.21.15.27:0/3159824686 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f355406e3f0 msgr2=0x7f3554099a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:25.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.829+0000 7f354bfff640 1 --2- 172.21.15.27:0/3159824686 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f355406e3f0 0x7f3554099a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:25.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.829+0000 7f354bfff640 1 -- 172.21.15.27:0/3159824686 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f35540ce5d0 msgr2=0x7f35540acfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:25.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.829+0000 7f354bfff640 1 --2- 172.21.15.27:0/3159824686 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f35540ce5d0 0x7f35540acfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:25.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.829+0000 7f354bfff640 1 -- 172.21.15.27:0/3159824686 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f354c009a70 con 0x7f35540cb9b0 2024-01-15T11:35:25.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.829+0000 7f3552ffd640 1 --2- 172.21.15.27:0/3159824686 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f355406e3f0 0x7f3554099a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-15T11:35:25.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.829+0000 7f354bfff640 1 --2- 172.21.15.27:0/3159824686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35540cb9b0 0x7f3554143f40 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f353c00c490 tx=0x7f353c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:25.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.829+0000 7f354b7fe640 1 -- 172.21.15.27:0/3159824686 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c0052d0 con 0x7f35540cb9b0 2024-01-15T11:35:25.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.829+0000 7f354b7fe640 1 -- 172.21.15.27:0/3159824686 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353c005430 con 0x7f35540cb9b0 2024-01-15T11:35:25.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.829+0000 7f354b7fe640 1 -- 172.21.15.27:0/3159824686 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c012870 con 0x7f35540cb9b0 2024-01-15T11:35:25.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.829+0000 7f3559572640 1 -- 172.21.15.27:0/3159824686 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3554099f70 con 0x7f35540cb9b0 2024-01-15T11:35:25.838 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.833+0000 7f3559572640 1 -- 172.21.15.27:0/3159824686 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35541661e0 con 0x7f35540cb9b0 2024-01-15T11:35:25.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.833+0000 7f3559572640 1 -- 172.21.15.27:0/3159824686 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35540671f0 con 0x7f35540cb9b0 2024-01-15T11:35:25.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.833+0000 7f354b7fe640 1 -- 172.21.15.27:0/3159824686 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 9) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f353c0129d0 con 0x7f35540cb9b0 2024-01-15T11:35:25.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.833+0000 7f354b7fe640 1 --2- 172.21.15.27:0/3159824686 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3534066bc0 0x7f3534069080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-15T11:35:25.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.833+0000 7f354b7fe640 1 -- 172.21.15.27:0/3159824686 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4971+0+0 (secure 0 0 0) 0x7f353c084120 con 0x7f35540cb9b0 2024-01-15T11:35:25.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.833+0000 7f3552ffd640 1 --2- 172.21.15.27:0/3159824686 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3534066bc0 0x7f3534069080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-15T11:35:25.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.837+0000 7f3552ffd640 1 --2- 172.21.15.27:0/3159824686 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3534066bc0 0x7f3534069080 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f35440011f0 tx=0x7f3544009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-15T11:35:25.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:25.837+0000 7f354b7fe640 1 -- 172.21.15.27:0/3159824686 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f353c0512b0 con 0x7f35540cb9b0 2024-01-15T11:35:26.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:26.005+0000 7f3559572640 1 -- 172.21.15.27:0/3159824686 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f355406b460 con 0x7f35540cb9b0 2024-01-15T11:35:26.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:26.005+0000 7f354b7fe640 1 -- 172.21.15.27:0/3159824686 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v41) v1 ==== 80+0+122 (secure 0 0 0) 0x7f353c0548d0 con 0x7f35540cb9b0 2024-01-15T11:35:26.012 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6835/1732204565 2024-01-16T11:35:21.582991+0000 2024-01-15T11:35:26.012 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6833/1732204565 2024-01-16T11:35:21.582991+0000 2024-01-15T11:35:26.012 INFO:teuthology.orchestra.run.smithi027.stderr:listed 2 entries 2024-01-15T11:35:26.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:26.009+0000 7f3559572640 1 -- 172.21.15.27:0/3159824686 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3534066bc0 msgr2=0x7f3534069080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:26.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:26.009+0000 7f3559572640 1 --2- 172.21.15.27:0/3159824686 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3534066bc0 0x7f3534069080 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f35440011f0 tx=0x7f3544009040 comp rx=0 tx=0).stop 2024-01-15T11:35:26.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:26.009+0000 7f3559572640 1 -- 172.21.15.27:0/3159824686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35540cb9b0 msgr2=0x7f3554143f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-15T11:35:26.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:26.009+0000 7f3559572640 1 --2- 172.21.15.27:0/3159824686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35540cb9b0 0x7f3554143f40 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f353c00c490 tx=0x7f353c00c950 comp rx=0 tx=0).stop 2024-01-15T11:35:26.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:26.009+0000 7f3559572640 1 -- 172.21.15.27:0/3159824686 shutdown_connections 2024-01-15T11:35:26.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:26.009+0000 7f3559572640 1 --2- 172.21.15.27:0/3159824686 >> [v2:172.21.15.93:6832/5213615,v1:172.21.15.93:6833/5213615] conn(0x7f3534066bc0 0x7f3534069080 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:26.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:26.009+0000 7f3559572640 1 --2- 172.21.15.27:0/3159824686 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f35540ce5d0 0x7f35540acfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:26.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:26.009+0000 7f3559572640 1 --2- 172.21.15.27:0/3159824686 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f35540cb9b0 0x7f3554143f40 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:26.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:26.009+0000 7f3559572640 1 --2- 172.21.15.27:0/3159824686 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f355406e3f0 0x7f3554099a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-15T11:35:26.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:26.009+0000 7f3559572640 1 -- 172.21.15.27:0/3159824686 >> 172.21.15.27:0/3159824686 conn(0x7f35540b0cb0 msgr2=0x7f355415f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-15T11:35:26.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:26.009+0000 7f3559572640 1 -- 172.21.15.27:0/3159824686 shutdown_connections 2024-01-15T11:35:26.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-01-15T11:35:26.009+0000 7f3559572640 1 -- 172.21.15.27:0/3159824686 wait complete. 2024-01-15T11:35:26.033 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-15T11:35:26.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T11:35:26.033 DEBUG:teuthology.orchestra.run.smithi027:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-15T11:35:43.309 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:35:43.314 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:36:13.374 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:36:13.378 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:36:43.439 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:36:43.444 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:37:13.504 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:37:13.509 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:37:43.560 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:37:43.565 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:38:13.616 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:38:13.621 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:38:43.696 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:38:43.701 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:39:13.746 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:39:13.750 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:39:43.802 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:39:43.807 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:40:13.990 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:40:13.995 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:40:26.039 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 745, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 154, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 109, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 275, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1374, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr raise socket.timeout() socket.timeout 2024-01-15T11:40:26.040 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 697, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 154, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 109, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 275, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1359, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv raise socket.timeout() socket.timeout 2024-01-15T11:40:44.054 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:40:44.059 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:41:14.127 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:41:14.131 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:41:44.199 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:41:44.207 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:42:14.275 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:42:14.281 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:42:44.332 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:42:44.338 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:43:14.402 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:43:14.407 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:43:44.457 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:43:44.462 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:44:14.521 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:44:14.526 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:44:44.677 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:44:44.681 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:45:14.742 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:45:14.747 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:45:44.804 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:45:44.809 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:46:14.863 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:46:14.868 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:46:44.935 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:46:44.940 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:47:15.005 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:47:15.009 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:47:45.064 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:47:45.069 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:48:15.438 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:48:15.445 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:48:45.503 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:48:45.507 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:49:15.582 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:49:15.586 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:49:45.640 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:49:45.645 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:50:15.854 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:50:15.859 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:50:45.911 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:50:45.916 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:51:16.254 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:51:16.258 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:51:46.329 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:51:46.334 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:52:16.399 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:52:16.403 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:52:46.729 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:52:46.734 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:53:16.788 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:53:16.793 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:53:46.846 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:53:46.851 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:54:17.033 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:54:17.038 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:54:47.090 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:54:47.094 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:55:17.146 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:55:17.150 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:55:47.201 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:55:47.206 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:56:17.449 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:56:17.454 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:56:47.521 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:56:47.526 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:57:17.585 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:57:17.591 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:57:47.650 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:57:47.655 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:58:17.797 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:58:17.801 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:58:47.855 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:58:47.860 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:59:17.911 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:59:17.916 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:59:48.209 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T11:59:48.217 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:00:18.269 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:00:18.274 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:00:48.332 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:00:48.338 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:01:18.522 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:01:18.527 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:01:48.604 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:01:48.609 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:02:18.677 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:02:18.682 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:02:48.742 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:02:48.747 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:03:18.800 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:03:18.805 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:03:48.865 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:03:48.871 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:04:18.925 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:04:18.930 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:04:49.014 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:04:49.019 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:05:19.077 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:05:19.082 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:05:49.137 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:05:49.144 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:06:19.490 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:06:19.495 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:06:49.573 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:06:49.578 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:07:19.647 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:07:19.655 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:07:49.766 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:07:49.771 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:08:19.829 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:08:19.836 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:08:49.894 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:08:49.899 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:09:19.957 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:09:19.962 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:09:50.022 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:09:50.028 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:10:20.086 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:10:20.090 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:10:50.147 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:10:50.152 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:11:20.257 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:11:20.261 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:11:50.321 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:11:50.325 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:12:20.392 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:12:20.397 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:12:50.624 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:12:50.629 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:13:20.680 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:13:20.685 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:13:50.747 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:13:50.752 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:14:20.928 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:14:20.933 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:14:50.992 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:14:50.997 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:15:21.051 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:15:21.055 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:15:51.213 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:15:51.217 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:16:21.308 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:16:21.313 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:16:51.384 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:16:51.389 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:17:21.464 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:17:21.470 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:17:51.681 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:17:51.686 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:18:21.744 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:18:21.750 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:18:51.808 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:18:51.813 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:19:21.892 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:19:21.897 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:19:51.954 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:19:51.959 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:20:22.019 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:20:22.024 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:20:52.087 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:20:52.092 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:21:22.339 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:21:22.343 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:21:52.412 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:21:52.417 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:22:22.492 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:22:22.497 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:22:52.557 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:22:52.562 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:23:22.621 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:23:22.626 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:23:52.994 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:23:52.999 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:24:23.057 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:24:23.063 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:24:53.113 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:24:53.118 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:25:23.178 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:25:23.183 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:25:53.284 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:25:53.288 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:26:23.341 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:26:23.346 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:26:53.423 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:26:53.428 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:27:23.488 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:27:23.493 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:27:53.553 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:27:53.558 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:28:23.930 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:28:23.935 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:28:54.002 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:28:54.006 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:29:24.067 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:29:24.071 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:29:54.124 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:29:54.128 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:30:24.373 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:30:24.377 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:30:54.436 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:30:54.441 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:31:24.502 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:31:24.506 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:31:54.575 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:31:54.580 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:32:24.646 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:32:24.650 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:32:54.712 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:32:54.717 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:33:24.776 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:33:24.782 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:33:54.864 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:33:54.869 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:34:24.972 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:34:24.976 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:34:55.052 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:34:55.058 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:35:25.109 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:35:25.114 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:35:55.175 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:35:55.180 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:36:25.237 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:36:25.242 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:36:55.309 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:36:55.313 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:37:25.410 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:37:25.415 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:37:55.471 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:37:55.476 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:38:25.528 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:38:25.534 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:38:55.633 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:38:55.637 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:39:25.693 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:39:25.698 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:39:55.753 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:39:55.758 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:40:25.817 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:40:25.822 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:40:55.873 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:40:55.877 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:41:25.953 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:41:25.958 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:41:56.052 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:41:56.057 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:42:26.123 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:42:26.128 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:42:56.489 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:42:56.494 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:43:26.553 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:43:26.558 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:43:56.609 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:43:56.614 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:44:26.897 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:44:26.902 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:44:56.962 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:44:56.966 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:45:27.018 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:45:27.023 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:45:57.082 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:45:57.087 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:46:27.148 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:46:27.156 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:46:57.237 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:46:57.241 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:47:27.316 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:47:27.321 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:47:57.563 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:47:57.567 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:48:27.629 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:48:27.635 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:48:57.697 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:48:57.702 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:49:27.761 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:49:27.767 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:49:57.836 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:49:57.841 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:50:27.902 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:50:27.907 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:50:57.964 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:50:57.969 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:51:28.021 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:51:28.026 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:51:58.105 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:51:58.110 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:52:28.186 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:52:28.190 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:52:58.241 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:52:58.246 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:53:28.455 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:53:28.460 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:53:58.515 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:53:58.520 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:54:28.832 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:54:28.838 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:54:59.058 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:54:59.062 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:55:29.122 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:55:29.127 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:55:59.186 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:55:59.190 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:56:29.242 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:56:29.246 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:56:59.324 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:56:59.330 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:57:29.408 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:57:29.413 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:57:59.469 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:57:59.475 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:58:29.534 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:58:29.545 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:58:59.600 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:58:59.609 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:59:29.678 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:59:29.683 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:59:59.776 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T12:59:59.781 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:00:29.831 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:00:29.836 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:00:59.888 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:00:59.893 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:01:30.268 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:01:30.273 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:02:00.350 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:02:00.355 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:02:30.440 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:02:30.445 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:03:00.697 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:03:00.702 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:03:30.759 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:03:30.764 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:04:00.823 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:04:00.828 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:04:30.889 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:04:30.893 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:05:00.948 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:05:00.953 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:05:31.009 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:05:31.014 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:06:01.071 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:06:01.076 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:06:31.158 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:06:31.163 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:07:01.232 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:07:01.238 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:07:31.302 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:07:31.307 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:08:01.362 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:08:01.369 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:08:31.427 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:08:31.432 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:09:01.533 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:09:01.537 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:09:31.600 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:09:31.604 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:10:01.656 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:10:01.663 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:10:31.722 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:10:31.727 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:11:01.783 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:11:01.789 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:11:31.845 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:11:31.850 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:12:01.922 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:12:01.927 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:12:32.029 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:12:32.034 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:13:02.094 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:13:02.099 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:13:32.160 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:13:32.165 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:14:02.217 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:14:02.221 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:14:32.276 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:14:32.280 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:15:02.333 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:15:02.338 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:15:32.398 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:15:32.402 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:16:02.479 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:16:02.484 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:16:32.543 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:16:32.547 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:17:02.649 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:17:02.654 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:17:32.723 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:17:32.727 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:18:02.785 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:18:02.791 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:18:32.849 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:18:32.855 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:19:02.934 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:19:02.939 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:19:33.038 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:19:33.045 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:20:03.348 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:20:03.353 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:20:33.416 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:20:33.424 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:21:03.482 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:21:03.487 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:21:33.545 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:21:33.550 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:22:03.618 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:22:03.623 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:22:33.687 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:22:33.692 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:23:03.747 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:23:03.753 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:23:34.106 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:23:34.112 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:24:04.171 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:24:04.176 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:24:34.235 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:24:34.241 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:25:04.305 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:25:04.310 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:25:34.369 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:25:34.374 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:26:04.573 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:26:04.579 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:26:34.638 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:26:34.642 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:27:04.797 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:27:04.801 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:27:34.878 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:27:34.882 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:28:05.102 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:28:05.107 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:28:35.332 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:28:35.338 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:29:05.391 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:29:05.395 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:29:35.461 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:29:35.466 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:30:05.536 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:30:05.542 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:30:35.625 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:30:35.630 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:31:05.689 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:31:05.694 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:31:35.754 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:31:35.759 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:32:05.836 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:32:05.841 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:32:35.901 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:32:35.907 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:33:05.965 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:33:05.973 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:33:36.038 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:33:36.045 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:34:06.382 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:34:06.393 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:34:36.452 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:34:36.458 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:35:06.519 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:35:06.525 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:35:36.581 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:35:36.586 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:36:06.646 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:36:06.651 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:36:36.710 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:36:36.717 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:37:06.813 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:37:06.821 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:37:36.882 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:37:36.887 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:38:06.953 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:38:06.958 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:38:37.018 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:38:37.023 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:39:07.392 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:39:07.397 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:39:37.464 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:39:37.474 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:40:07.536 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:40:07.540 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:40:37.600 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:40:37.604 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:41:07.664 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:41:07.669 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:41:37.729 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:41:37.733 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:42:07.810 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:42:07.816 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:42:37.894 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:42:37.899 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:43:07.956 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:43:07.962 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:43:38.021 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:43:38.027 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:44:08.086 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:44:08.092 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:44:38.143 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:44:38.150 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:45:08.256 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:45:08.261 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:45:38.346 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:45:38.351 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:46:08.461 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:46:08.466 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:46:38.616 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:46:38.620 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:47:08.698 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:47:08.702 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:47:38.775 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:47:38.781 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:48:08.839 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:48:08.843 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:48:38.975 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:48:38.981 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:49:09.107 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:49:09.111 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:49:39.245 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:49:39.249 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:50:09.367 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:50:09.372 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:50:39.507 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:50:39.512 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:51:09.571 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:51:09.577 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:51:39.710 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:51:39.714 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:52:09.791 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:52:09.797 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:52:39.861 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:52:39.866 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:53:09.986 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:53:09.991 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:53:40.109 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:53:40.113 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:54:10.257 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:54:10.263 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:54:40.323 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:54:40.329 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:55:10.453 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:55:10.459 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:55:40.600 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:55:40.605 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:56:10.756 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:56:10.761 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:56:40.888 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:56:40.896 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:57:11.236 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:57:11.244 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:57:41.309 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:57:41.315 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:58:11.430 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:58:11.436 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:58:41.554 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:58:41.558 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:59:11.886 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:59:11.891 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:59:41.942 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T13:59:41.946 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:00:12.039 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:00:12.044 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:00:42.188 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:00:42.192 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:01:12.261 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:01:12.267 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:01:42.392 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:01:42.397 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:02:12.716 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:02:12.721 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:02:42.784 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:02:42.790 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:03:13.029 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:03:13.034 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:03:43.098 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:03:43.104 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:04:13.226 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:04:13.232 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:04:43.349 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:04:43.355 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:05:13.409 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:05:13.415 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:05:43.546 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:05:43.550 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:06:13.669 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:06:13.675 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:06:43.742 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:06:43.747 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:07:14.108 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:07:14.113 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:07:44.240 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:07:44.247 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:08:14.379 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:08:14.384 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:08:44.527 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:08:44.532 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:09:14.651 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:09:14.656 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:09:44.782 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:09:44.787 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:10:14.840 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:10:14.845 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:10:44.905 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:10:44.911 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:11:15.053 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:11:15.057 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:11:45.184 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:11:45.189 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:12:15.416 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:12:15.421 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:12:45.563 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:12:45.568 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:13:15.628 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:13:15.637 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:13:45.694 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:13:45.699 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:14:15.808 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:14:15.813 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:14:45.973 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:14:45.978 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:15:16.104 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:15:16.109 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:15:46.244 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:15:46.249 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:16:16.359 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:16:16.364 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:16:46.423 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:16:46.428 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:17:16.506 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:17:16.511 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:17:46.638 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:17:46.643 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:18:16.753 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:18:16.757 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:18:46.877 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:18:46.881 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:19:16.940 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:19:16.946 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:19:47.040 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:19:47.045 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:20:17.097 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:20:17.113 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:20:47.277 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:20:47.283 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:21:09.755 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T14:21:09.756 DEBUG:tasks.cephfs.kernel_mount:Killing processes on client.0... 2024-01-15T14:21:09.756 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:21:09.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:21:09.931 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-01-15T14:21:10.676 DEBUG:teuthology.orchestra.run.smithi027:> true 2024-01-15T14:21:11.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:21:11.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-15T14:21:11.176 DEBUG:teuthology.orchestra.run.smithi027:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2024-01-15T14:21:14.932 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-01-15T14:21:14.932 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-01-15T14:21:14.933 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-01-15T14:21:14.933 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-01-15T14:21:14.933 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-01-15T14:21:14.933 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-01-15T14:21:14.933 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-01-15T14:21:14.933 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-01-15T14:21:14.933 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-01-15T14:21:14.933 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-01-15T14:21:14.933 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-01-15T14:21:14.933 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-01-15T14:21:14.933 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-01-15T14:21:14.933 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-01-15T14:21:14.934 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-01-15T14:21:14.934 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~7s 2024-01-15T14:21:14.934 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-01-15T14:21:17.409 DEBUG:teuthology.orchestra.run.smithi027:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-15T14:21:19.935 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~5s 2024-01-15T14:21:19.936 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~5s 2024-01-15T14:21:19.936 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~5s 2024-01-15T14:21:19.936 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~5s 2024-01-15T14:21:19.936 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~5s 2024-01-15T14:21:19.936 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~5s 2024-01-15T14:21:19.936 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~5s 2024-01-15T14:21:19.936 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~5s 2024-01-15T14:21:19.936 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~5s 2024-01-15T14:21:19.937 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~5s 2024-01-15T14:21:19.937 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~5s 2024-01-15T14:21:19.937 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~5s 2024-01-15T14:21:19.937 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~5s 2024-01-15T14:21:19.937 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~5s 2024-01-15T14:21:19.937 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~5s 2024-01-15T14:21:19.937 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~12s 2024-01-15T14:21:19.937 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~5s 2024-01-15T14:21:24.939 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~10s 2024-01-15T14:21:24.939 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~10s 2024-01-15T14:21:24.939 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~10s 2024-01-15T14:21:24.939 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~10s 2024-01-15T14:21:24.940 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~10s 2024-01-15T14:21:24.940 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~10s 2024-01-15T14:21:24.940 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~10s 2024-01-15T14:21:24.940 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~10s 2024-01-15T14:21:24.940 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~10s 2024-01-15T14:21:24.940 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~10s 2024-01-15T14:21:24.940 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~10s 2024-01-15T14:21:24.940 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~10s 2024-01-15T14:21:24.940 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~10s 2024-01-15T14:21:24.940 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~10s 2024-01-15T14:21:24.940 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~10s 2024-01-15T14:21:24.940 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~17s 2024-01-15T14:21:24.940 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~10s 2024-01-15T14:21:29.942 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~15s 2024-01-15T14:21:29.942 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~15s 2024-01-15T14:21:29.942 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~15s 2024-01-15T14:21:29.942 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~15s 2024-01-15T14:21:29.942 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~15s 2024-01-15T14:21:29.942 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~15s 2024-01-15T14:21:29.942 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~15s 2024-01-15T14:21:29.942 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~15s 2024-01-15T14:21:29.942 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~15s 2024-01-15T14:21:29.942 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~15s 2024-01-15T14:21:29.942 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~15s 2024-01-15T14:21:29.942 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~15s 2024-01-15T14:21:29.942 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~15s 2024-01-15T14:21:29.943 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~15s 2024-01-15T14:21:29.943 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~15s 2024-01-15T14:21:29.943 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~22s 2024-01-15T14:21:29.943 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~15s 2024-01-15T14:21:34.944 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~20s 2024-01-15T14:21:34.945 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~20s 2024-01-15T14:21:34.945 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~20s 2024-01-15T14:21:34.945 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~20s 2024-01-15T14:21:34.945 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~20s 2024-01-15T14:21:34.945 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~20s 2024-01-15T14:21:34.945 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~20s 2024-01-15T14:21:34.945 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~20s 2024-01-15T14:21:34.945 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~20s 2024-01-15T14:21:34.945 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~20s 2024-01-15T14:21:34.945 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~20s 2024-01-15T14:21:34.945 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~20s 2024-01-15T14:21:34.946 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~20s 2024-01-15T14:21:34.946 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~20s 2024-01-15T14:21:34.946 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~20s 2024-01-15T14:21:34.946 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~27s 2024-01-15T14:21:34.946 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~20s 2024-01-15T14:21:39.947 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~25s 2024-01-15T14:21:39.947 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~25s 2024-01-15T14:21:39.947 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~25s 2024-01-15T14:21:39.947 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~25s 2024-01-15T14:21:39.947 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~25s 2024-01-15T14:21:39.947 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~25s 2024-01-15T14:21:39.947 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~25s 2024-01-15T14:21:39.947 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~25s 2024-01-15T14:21:39.948 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~25s 2024-01-15T14:21:39.948 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~25s 2024-01-15T14:21:39.948 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~25s 2024-01-15T14:21:39.948 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~25s 2024-01-15T14:21:39.948 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~25s 2024-01-15T14:21:39.948 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~25s 2024-01-15T14:21:39.948 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~25s 2024-01-15T14:21:39.948 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~32s 2024-01-15T14:21:39.948 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~25s 2024-01-15T14:21:44.949 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~30s 2024-01-15T14:21:44.950 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~30s 2024-01-15T14:21:44.950 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~30s 2024-01-15T14:21:44.950 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~30s 2024-01-15T14:21:44.950 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~30s 2024-01-15T14:21:44.950 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~30s 2024-01-15T14:21:44.950 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~30s 2024-01-15T14:21:44.950 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~30s 2024-01-15T14:21:44.950 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~30s 2024-01-15T14:21:44.950 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~30s 2024-01-15T14:21:44.950 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~30s 2024-01-15T14:21:44.951 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~30s 2024-01-15T14:21:44.951 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~30s 2024-01-15T14:21:44.951 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~30s 2024-01-15T14:21:44.951 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~30s 2024-01-15T14:21:44.951 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~37s 2024-01-15T14:21:44.951 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~30s 2024-01-15T14:21:49.952 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~35s 2024-01-15T14:21:49.952 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~35s 2024-01-15T14:21:49.952 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~35s 2024-01-15T14:21:49.953 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~35s 2024-01-15T14:21:49.953 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~35s 2024-01-15T14:21:49.953 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~35s 2024-01-15T14:21:49.953 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~35s 2024-01-15T14:21:49.953 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~35s 2024-01-15T14:21:49.953 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~35s 2024-01-15T14:21:49.953 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~35s 2024-01-15T14:21:49.953 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~35s 2024-01-15T14:21:49.953 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~35s 2024-01-15T14:21:49.953 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~35s 2024-01-15T14:21:49.953 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~35s 2024-01-15T14:21:49.954 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~35s 2024-01-15T14:21:49.954 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~42s 2024-01-15T14:21:49.954 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~35s 2024-01-15T14:21:54.955 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~40s 2024-01-15T14:21:54.956 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~40s 2024-01-15T14:21:54.956 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~40s 2024-01-15T14:21:54.956 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~40s 2024-01-15T14:21:54.956 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~40s 2024-01-15T14:21:54.956 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~40s 2024-01-15T14:21:54.956 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~40s 2024-01-15T14:21:54.956 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~40s 2024-01-15T14:21:54.956 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~40s 2024-01-15T14:21:54.957 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~40s 2024-01-15T14:21:54.957 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~40s 2024-01-15T14:21:54.957 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~40s 2024-01-15T14:21:54.957 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~40s 2024-01-15T14:21:54.957 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~40s 2024-01-15T14:21:54.957 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~40s 2024-01-15T14:21:54.957 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~47s 2024-01-15T14:21:54.957 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~40s 2024-01-15T14:21:59.959 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~45s 2024-01-15T14:21:59.959 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~45s 2024-01-15T14:21:59.959 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~45s 2024-01-15T14:21:59.959 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~45s 2024-01-15T14:21:59.959 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~45s 2024-01-15T14:21:59.959 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~45s 2024-01-15T14:21:59.959 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~45s 2024-01-15T14:21:59.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~45s 2024-01-15T14:21:59.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~45s 2024-01-15T14:21:59.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~45s 2024-01-15T14:21:59.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~45s 2024-01-15T14:21:59.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~45s 2024-01-15T14:21:59.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~45s 2024-01-15T14:21:59.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~45s 2024-01-15T14:21:59.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~45s 2024-01-15T14:21:59.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~52s 2024-01-15T14:21:59.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~45s 2024-01-15T14:22:04.962 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~50s 2024-01-15T14:22:04.962 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~50s 2024-01-15T14:22:04.962 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~50s 2024-01-15T14:22:04.962 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~50s 2024-01-15T14:22:04.962 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~50s 2024-01-15T14:22:04.963 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~50s 2024-01-15T14:22:04.963 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~50s 2024-01-15T14:22:04.963 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~50s 2024-01-15T14:22:04.963 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~50s 2024-01-15T14:22:04.963 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~50s 2024-01-15T14:22:04.963 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~50s 2024-01-15T14:22:04.963 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~50s 2024-01-15T14:22:04.963 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~50s 2024-01-15T14:22:04.963 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~50s 2024-01-15T14:22:04.963 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~50s 2024-01-15T14:22:04.963 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~57s 2024-01-15T14:22:04.963 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~50s 2024-01-15T14:22:09.965 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~55s 2024-01-15T14:22:09.965 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~55s 2024-01-15T14:22:09.965 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~55s 2024-01-15T14:22:09.965 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~55s 2024-01-15T14:22:09.965 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~55s 2024-01-15T14:22:09.965 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~55s 2024-01-15T14:22:09.965 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~55s 2024-01-15T14:22:09.965 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~55s 2024-01-15T14:22:09.965 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~55s 2024-01-15T14:22:09.966 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~55s 2024-01-15T14:22:09.966 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~55s 2024-01-15T14:22:09.966 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~55s 2024-01-15T14:22:09.966 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~55s 2024-01-15T14:22:09.966 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~55s 2024-01-15T14:22:09.966 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~55s 2024-01-15T14:22:09.966 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~62s 2024-01-15T14:22:09.966 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~55s 2024-01-15T14:22:14.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~60s 2024-01-15T14:22:14.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~60s 2024-01-15T14:22:14.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~60s 2024-01-15T14:22:14.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~60s 2024-01-15T14:22:14.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~60s 2024-01-15T14:22:14.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~60s 2024-01-15T14:22:14.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~60s 2024-01-15T14:22:14.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~60s 2024-01-15T14:22:14.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~60s 2024-01-15T14:22:14.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~60s 2024-01-15T14:22:14.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~60s 2024-01-15T14:22:14.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~60s 2024-01-15T14:22:14.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~60s 2024-01-15T14:22:14.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~60s 2024-01-15T14:22:14.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~60s 2024-01-15T14:22:14.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~67s 2024-01-15T14:22:14.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~60s 2024-01-15T14:22:19.971 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~65s 2024-01-15T14:22:19.971 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~65s 2024-01-15T14:22:19.971 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~65s 2024-01-15T14:22:19.971 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~65s 2024-01-15T14:22:19.971 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~65s 2024-01-15T14:22:19.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~65s 2024-01-15T14:22:19.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~65s 2024-01-15T14:22:19.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~65s 2024-01-15T14:22:19.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~65s 2024-01-15T14:22:19.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~65s 2024-01-15T14:22:19.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~65s 2024-01-15T14:22:19.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~65s 2024-01-15T14:22:19.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~65s 2024-01-15T14:22:19.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~65s 2024-01-15T14:22:19.973 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~65s 2024-01-15T14:22:19.973 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~72s 2024-01-15T14:22:19.973 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~65s 2024-01-15T14:22:24.975 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~70s 2024-01-15T14:22:24.975 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~70s 2024-01-15T14:22:24.975 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~70s 2024-01-15T14:22:24.975 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~70s 2024-01-15T14:22:24.975 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~70s 2024-01-15T14:22:24.975 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~70s 2024-01-15T14:22:24.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~70s 2024-01-15T14:22:24.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~70s 2024-01-15T14:22:24.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~70s 2024-01-15T14:22:24.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~70s 2024-01-15T14:22:24.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~70s 2024-01-15T14:22:24.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~70s 2024-01-15T14:22:24.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~70s 2024-01-15T14:22:24.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~70s 2024-01-15T14:22:24.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~70s 2024-01-15T14:22:24.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~77s 2024-01-15T14:22:24.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~70s 2024-01-15T14:22:29.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~75s 2024-01-15T14:22:29.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~75s 2024-01-15T14:22:29.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~75s 2024-01-15T14:22:29.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~75s 2024-01-15T14:22:29.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~75s 2024-01-15T14:22:29.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~75s 2024-01-15T14:22:29.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~75s 2024-01-15T14:22:29.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~75s 2024-01-15T14:22:29.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~75s 2024-01-15T14:22:29.979 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~75s 2024-01-15T14:22:29.979 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~75s 2024-01-15T14:22:29.979 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~75s 2024-01-15T14:22:29.979 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~75s 2024-01-15T14:22:29.979 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~75s 2024-01-15T14:22:29.979 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~75s 2024-01-15T14:22:29.979 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~82s 2024-01-15T14:22:29.979 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~75s 2024-01-15T14:22:34.980 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~80s 2024-01-15T14:22:34.981 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~80s 2024-01-15T14:22:34.981 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~80s 2024-01-15T14:22:34.981 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~80s 2024-01-15T14:22:34.981 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~80s 2024-01-15T14:22:34.981 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~80s 2024-01-15T14:22:34.981 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~80s 2024-01-15T14:22:34.981 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~80s 2024-01-15T14:22:34.981 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~80s 2024-01-15T14:22:34.981 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~80s 2024-01-15T14:22:34.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~80s 2024-01-15T14:22:34.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~80s 2024-01-15T14:22:34.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~80s 2024-01-15T14:22:34.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~80s 2024-01-15T14:22:34.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~80s 2024-01-15T14:22:34.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~87s 2024-01-15T14:22:34.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~80s 2024-01-15T14:22:39.984 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~85s 2024-01-15T14:22:39.984 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~85s 2024-01-15T14:22:39.984 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~85s 2024-01-15T14:22:39.984 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~85s 2024-01-15T14:22:39.984 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~85s 2024-01-15T14:22:39.984 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~85s 2024-01-15T14:22:39.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~85s 2024-01-15T14:22:39.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~85s 2024-01-15T14:22:39.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~85s 2024-01-15T14:22:39.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~85s 2024-01-15T14:22:39.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~85s 2024-01-15T14:22:39.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~85s 2024-01-15T14:22:39.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~85s 2024-01-15T14:22:39.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~85s 2024-01-15T14:22:39.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~85s 2024-01-15T14:22:39.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~92s 2024-01-15T14:22:39.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~85s 2024-01-15T14:22:44.987 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~90s 2024-01-15T14:22:44.987 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~90s 2024-01-15T14:22:44.987 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~90s 2024-01-15T14:22:44.987 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~90s 2024-01-15T14:22:44.987 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~90s 2024-01-15T14:22:44.987 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~90s 2024-01-15T14:22:44.987 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~90s 2024-01-15T14:22:44.988 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~90s 2024-01-15T14:22:44.988 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~90s 2024-01-15T14:22:44.988 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~90s 2024-01-15T14:22:44.988 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~90s 2024-01-15T14:22:44.988 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~90s 2024-01-15T14:22:44.988 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~90s 2024-01-15T14:22:44.988 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~90s 2024-01-15T14:22:44.988 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~90s 2024-01-15T14:22:44.988 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~97s 2024-01-15T14:22:44.988 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~90s 2024-01-15T14:22:49.990 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~95s 2024-01-15T14:22:49.990 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~95s 2024-01-15T14:22:49.990 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~95s 2024-01-15T14:22:49.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~95s 2024-01-15T14:22:49.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~95s 2024-01-15T14:22:49.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~95s 2024-01-15T14:22:49.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~95s 2024-01-15T14:22:49.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~95s 2024-01-15T14:22:49.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~95s 2024-01-15T14:22:49.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~95s 2024-01-15T14:22:49.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~95s 2024-01-15T14:22:49.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~95s 2024-01-15T14:22:49.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~95s 2024-01-15T14:22:49.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~95s 2024-01-15T14:22:49.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~95s 2024-01-15T14:22:49.992 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~102s 2024-01-15T14:22:49.992 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~95s 2024-01-15T14:22:54.994 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~100s 2024-01-15T14:22:54.994 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~100s 2024-01-15T14:22:54.994 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~100s 2024-01-15T14:22:54.994 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~100s 2024-01-15T14:22:54.994 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~100s 2024-01-15T14:22:54.994 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~100s 2024-01-15T14:22:54.994 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~100s 2024-01-15T14:22:54.994 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~100s 2024-01-15T14:22:54.995 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~100s 2024-01-15T14:22:54.995 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~100s 2024-01-15T14:22:54.995 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~100s 2024-01-15T14:22:54.995 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~100s 2024-01-15T14:22:54.995 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~100s 2024-01-15T14:22:54.995 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~100s 2024-01-15T14:22:54.995 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~100s 2024-01-15T14:22:54.995 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~107s 2024-01-15T14:22:54.995 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~100s 2024-01-15T14:22:59.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~105s 2024-01-15T14:22:59.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~105s 2024-01-15T14:22:59.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~105s 2024-01-15T14:22:59.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~105s 2024-01-15T14:22:59.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~105s 2024-01-15T14:22:59.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~105s 2024-01-15T14:22:59.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~105s 2024-01-15T14:22:59.998 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~105s 2024-01-15T14:22:59.998 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~105s 2024-01-15T14:22:59.998 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~105s 2024-01-15T14:22:59.998 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~105s 2024-01-15T14:22:59.998 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~105s 2024-01-15T14:22:59.998 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~105s 2024-01-15T14:22:59.998 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~105s 2024-01-15T14:22:59.998 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~105s 2024-01-15T14:22:59.998 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~112s 2024-01-15T14:22:59.998 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~105s 2024-01-15T14:23:05.000 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~110s 2024-01-15T14:23:05.000 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~110s 2024-01-15T14:23:05.001 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~110s 2024-01-15T14:23:05.001 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~110s 2024-01-15T14:23:05.001 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~110s 2024-01-15T14:23:05.001 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~110s 2024-01-15T14:23:05.001 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~110s 2024-01-15T14:23:05.001 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~110s 2024-01-15T14:23:05.001 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~110s 2024-01-15T14:23:05.001 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~110s 2024-01-15T14:23:05.001 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~110s 2024-01-15T14:23:05.001 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~110s 2024-01-15T14:23:05.001 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~110s 2024-01-15T14:23:05.001 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~110s 2024-01-15T14:23:05.002 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~110s 2024-01-15T14:23:05.002 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~117s 2024-01-15T14:23:05.002 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~110s 2024-01-15T14:23:10.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~115s 2024-01-15T14:23:10.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~115s 2024-01-15T14:23:10.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~115s 2024-01-15T14:23:10.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~115s 2024-01-15T14:23:10.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~115s 2024-01-15T14:23:10.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~115s 2024-01-15T14:23:10.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~115s 2024-01-15T14:23:10.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~115s 2024-01-15T14:23:10.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~115s 2024-01-15T14:23:10.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~115s 2024-01-15T14:23:10.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~115s 2024-01-15T14:23:10.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~115s 2024-01-15T14:23:10.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~115s 2024-01-15T14:23:10.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~115s 2024-01-15T14:23:10.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~115s 2024-01-15T14:23:10.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~122s 2024-01-15T14:23:10.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~115s 2024-01-15T14:23:15.005 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~120s 2024-01-15T14:23:15.006 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~120s 2024-01-15T14:23:15.006 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~120s 2024-01-15T14:23:15.006 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~120s 2024-01-15T14:23:15.006 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~120s 2024-01-15T14:23:15.006 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~120s 2024-01-15T14:23:15.006 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~120s 2024-01-15T14:23:15.006 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~120s 2024-01-15T14:23:15.006 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~120s 2024-01-15T14:23:15.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~120s 2024-01-15T14:23:15.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~120s 2024-01-15T14:23:15.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~120s 2024-01-15T14:23:15.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~120s 2024-01-15T14:23:15.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~120s 2024-01-15T14:23:15.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~120s 2024-01-15T14:23:15.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~127s 2024-01-15T14:23:15.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~120s 2024-01-15T14:23:20.009 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~125s 2024-01-15T14:23:20.009 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~125s 2024-01-15T14:23:20.009 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~125s 2024-01-15T14:23:20.009 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~125s 2024-01-15T14:23:20.009 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~125s 2024-01-15T14:23:20.009 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~125s 2024-01-15T14:23:20.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~125s 2024-01-15T14:23:20.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~125s 2024-01-15T14:23:20.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~125s 2024-01-15T14:23:20.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~125s 2024-01-15T14:23:20.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~125s 2024-01-15T14:23:20.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~125s 2024-01-15T14:23:20.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~125s 2024-01-15T14:23:20.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~125s 2024-01-15T14:23:20.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~125s 2024-01-15T14:23:20.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~132s 2024-01-15T14:23:20.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~125s 2024-01-15T14:23:25.011 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~130s 2024-01-15T14:23:25.011 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~130s 2024-01-15T14:23:25.011 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~130s 2024-01-15T14:23:25.011 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~130s 2024-01-15T14:23:25.011 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~130s 2024-01-15T14:23:25.011 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~130s 2024-01-15T14:23:25.011 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~130s 2024-01-15T14:23:25.012 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~130s 2024-01-15T14:23:25.012 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~130s 2024-01-15T14:23:25.012 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~130s 2024-01-15T14:23:25.012 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~130s 2024-01-15T14:23:25.012 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~130s 2024-01-15T14:23:25.012 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~130s 2024-01-15T14:23:25.012 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~130s 2024-01-15T14:23:25.012 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~130s 2024-01-15T14:23:25.012 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~137s 2024-01-15T14:23:25.012 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~130s 2024-01-15T14:23:30.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~135s 2024-01-15T14:23:30.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~135s 2024-01-15T14:23:30.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~135s 2024-01-15T14:23:30.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~135s 2024-01-15T14:23:30.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~135s 2024-01-15T14:23:30.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~135s 2024-01-15T14:23:30.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~135s 2024-01-15T14:23:30.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~135s 2024-01-15T14:23:30.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~135s 2024-01-15T14:23:30.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~135s 2024-01-15T14:23:30.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~135s 2024-01-15T14:23:30.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~135s 2024-01-15T14:23:30.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~135s 2024-01-15T14:23:30.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~135s 2024-01-15T14:23:30.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~135s 2024-01-15T14:23:30.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~142s 2024-01-15T14:23:30.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~135s 2024-01-15T14:23:35.016 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~140s 2024-01-15T14:23:35.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~140s 2024-01-15T14:23:35.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~140s 2024-01-15T14:23:35.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~140s 2024-01-15T14:23:35.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~140s 2024-01-15T14:23:35.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~140s 2024-01-15T14:23:35.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~140s 2024-01-15T14:23:35.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~140s 2024-01-15T14:23:35.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~140s 2024-01-15T14:23:35.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~140s 2024-01-15T14:23:35.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~140s 2024-01-15T14:23:35.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~140s 2024-01-15T14:23:35.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~140s 2024-01-15T14:23:35.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~140s 2024-01-15T14:23:35.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~140s 2024-01-15T14:23:35.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~147s 2024-01-15T14:23:35.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~140s 2024-01-15T14:23:40.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~145s 2024-01-15T14:23:40.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~145s 2024-01-15T14:23:40.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~145s 2024-01-15T14:23:40.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~145s 2024-01-15T14:23:40.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~145s 2024-01-15T14:23:40.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~145s 2024-01-15T14:23:40.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~145s 2024-01-15T14:23:40.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~145s 2024-01-15T14:23:40.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~145s 2024-01-15T14:23:40.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~145s 2024-01-15T14:23:40.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~145s 2024-01-15T14:23:40.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~145s 2024-01-15T14:23:40.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~145s 2024-01-15T14:23:40.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~145s 2024-01-15T14:23:40.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~145s 2024-01-15T14:23:40.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~152s 2024-01-15T14:23:40.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~145s 2024-01-15T14:23:45.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~150s 2024-01-15T14:23:45.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~150s 2024-01-15T14:23:45.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~150s 2024-01-15T14:23:45.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~150s 2024-01-15T14:23:45.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~150s 2024-01-15T14:23:45.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~150s 2024-01-15T14:23:45.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~150s 2024-01-15T14:23:45.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~150s 2024-01-15T14:23:45.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~150s 2024-01-15T14:23:45.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~150s 2024-01-15T14:23:45.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~150s 2024-01-15T14:23:45.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~150s 2024-01-15T14:23:45.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~150s 2024-01-15T14:23:45.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~150s 2024-01-15T14:23:45.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~150s 2024-01-15T14:23:45.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~157s 2024-01-15T14:23:45.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~150s 2024-01-15T14:23:50.024 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~155s 2024-01-15T14:23:50.024 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~155s 2024-01-15T14:23:50.024 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~155s 2024-01-15T14:23:50.024 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~155s 2024-01-15T14:23:50.024 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~155s 2024-01-15T14:23:50.024 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~155s 2024-01-15T14:23:50.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~155s 2024-01-15T14:23:50.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~155s 2024-01-15T14:23:50.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~155s 2024-01-15T14:23:50.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~155s 2024-01-15T14:23:50.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~155s 2024-01-15T14:23:50.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~155s 2024-01-15T14:23:50.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~155s 2024-01-15T14:23:50.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~155s 2024-01-15T14:23:50.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~155s 2024-01-15T14:23:50.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~162s 2024-01-15T14:23:50.026 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~155s 2024-01-15T14:23:55.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~160s 2024-01-15T14:23:55.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~160s 2024-01-15T14:23:55.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~160s 2024-01-15T14:23:55.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~160s 2024-01-15T14:23:55.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~160s 2024-01-15T14:23:55.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~160s 2024-01-15T14:23:55.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~160s 2024-01-15T14:23:55.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~160s 2024-01-15T14:23:55.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~160s 2024-01-15T14:23:55.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~160s 2024-01-15T14:23:55.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~160s 2024-01-15T14:23:55.028 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~160s 2024-01-15T14:23:55.028 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~160s 2024-01-15T14:23:55.028 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~160s 2024-01-15T14:23:55.028 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~160s 2024-01-15T14:23:55.028 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~167s 2024-01-15T14:23:55.028 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~160s 2024-01-15T14:24:00.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~165s 2024-01-15T14:24:00.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~165s 2024-01-15T14:24:00.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~165s 2024-01-15T14:24:00.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~165s 2024-01-15T14:24:00.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~165s 2024-01-15T14:24:00.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~165s 2024-01-15T14:24:00.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~165s 2024-01-15T14:24:00.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~165s 2024-01-15T14:24:00.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~165s 2024-01-15T14:24:00.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~165s 2024-01-15T14:24:00.031 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~165s 2024-01-15T14:24:00.031 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~165s 2024-01-15T14:24:00.031 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~165s 2024-01-15T14:24:00.031 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~165s 2024-01-15T14:24:00.031 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~165s 2024-01-15T14:24:00.031 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~172s 2024-01-15T14:24:00.031 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~165s 2024-01-15T14:24:05.032 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~170s 2024-01-15T14:24:05.032 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~170s 2024-01-15T14:24:05.032 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~170s 2024-01-15T14:24:05.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~170s 2024-01-15T14:24:05.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~170s 2024-01-15T14:24:05.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~170s 2024-01-15T14:24:05.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~170s 2024-01-15T14:24:05.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~170s 2024-01-15T14:24:05.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~170s 2024-01-15T14:24:05.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~170s 2024-01-15T14:24:05.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~170s 2024-01-15T14:24:05.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~170s 2024-01-15T14:24:05.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~170s 2024-01-15T14:24:05.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~170s 2024-01-15T14:24:05.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~170s 2024-01-15T14:24:05.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~177s 2024-01-15T14:24:05.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~170s 2024-01-15T14:24:10.035 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~175s 2024-01-15T14:24:10.035 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~175s 2024-01-15T14:24:10.035 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~175s 2024-01-15T14:24:10.035 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~175s 2024-01-15T14:24:10.035 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~175s 2024-01-15T14:24:10.035 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~175s 2024-01-15T14:24:10.035 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~175s 2024-01-15T14:24:10.035 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~175s 2024-01-15T14:24:10.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~175s 2024-01-15T14:24:10.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~175s 2024-01-15T14:24:10.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~175s 2024-01-15T14:24:10.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~175s 2024-01-15T14:24:10.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~175s 2024-01-15T14:24:10.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~175s 2024-01-15T14:24:10.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~175s 2024-01-15T14:24:10.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~182s 2024-01-15T14:24:10.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~175s 2024-01-15T14:24:15.038 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~180s 2024-01-15T14:24:15.039 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~180s 2024-01-15T14:24:15.039 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~180s 2024-01-15T14:24:15.039 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~180s 2024-01-15T14:24:15.039 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~180s 2024-01-15T14:24:15.039 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~180s 2024-01-15T14:24:15.039 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~180s 2024-01-15T14:24:15.039 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~180s 2024-01-15T14:24:15.039 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~180s 2024-01-15T14:24:15.039 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~180s 2024-01-15T14:24:15.039 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~180s 2024-01-15T14:24:15.039 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~180s 2024-01-15T14:24:15.040 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~180s 2024-01-15T14:24:15.040 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~180s 2024-01-15T14:24:15.040 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~180s 2024-01-15T14:24:15.040 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~187s 2024-01-15T14:24:15.040 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~180s 2024-01-15T14:24:20.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~185s 2024-01-15T14:24:20.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~185s 2024-01-15T14:24:20.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~185s 2024-01-15T14:24:20.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~185s 2024-01-15T14:24:20.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~185s 2024-01-15T14:24:20.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~185s 2024-01-15T14:24:20.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~185s 2024-01-15T14:24:20.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~185s 2024-01-15T14:24:20.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~185s 2024-01-15T14:24:20.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~185s 2024-01-15T14:24:20.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~185s 2024-01-15T14:24:20.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~185s 2024-01-15T14:24:20.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~185s 2024-01-15T14:24:20.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~185s 2024-01-15T14:24:20.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~185s 2024-01-15T14:24:20.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~192s 2024-01-15T14:24:20.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~185s 2024-01-15T14:24:25.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~190s 2024-01-15T14:24:25.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~190s 2024-01-15T14:24:25.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~190s 2024-01-15T14:24:25.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~190s 2024-01-15T14:24:25.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~190s 2024-01-15T14:24:25.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~190s 2024-01-15T14:24:25.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~190s 2024-01-15T14:24:25.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~190s 2024-01-15T14:24:25.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~190s 2024-01-15T14:24:25.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~190s 2024-01-15T14:24:25.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~190s 2024-01-15T14:24:25.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~190s 2024-01-15T14:24:25.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~190s 2024-01-15T14:24:25.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~190s 2024-01-15T14:24:25.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~190s 2024-01-15T14:24:25.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~197s 2024-01-15T14:24:25.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~190s 2024-01-15T14:24:30.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~195s 2024-01-15T14:24:30.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~195s 2024-01-15T14:24:30.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~195s 2024-01-15T14:24:30.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~195s 2024-01-15T14:24:30.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~195s 2024-01-15T14:24:30.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~195s 2024-01-15T14:24:30.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~195s 2024-01-15T14:24:30.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~195s 2024-01-15T14:24:30.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~195s 2024-01-15T14:24:30.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~195s 2024-01-15T14:24:30.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~195s 2024-01-15T14:24:30.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~195s 2024-01-15T14:24:30.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~195s 2024-01-15T14:24:30.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~195s 2024-01-15T14:24:30.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~195s 2024-01-15T14:24:30.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~202s 2024-01-15T14:24:30.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~195s 2024-01-15T14:24:35.049 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~200s 2024-01-15T14:24:35.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~200s 2024-01-15T14:24:35.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~200s 2024-01-15T14:24:35.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~200s 2024-01-15T14:24:35.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~200s 2024-01-15T14:24:35.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~200s 2024-01-15T14:24:35.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~200s 2024-01-15T14:24:35.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~200s 2024-01-15T14:24:35.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~200s 2024-01-15T14:24:35.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~200s 2024-01-15T14:24:35.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~200s 2024-01-15T14:24:35.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~200s 2024-01-15T14:24:35.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~200s 2024-01-15T14:24:35.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~200s 2024-01-15T14:24:35.051 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~200s 2024-01-15T14:24:35.051 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~207s 2024-01-15T14:24:35.051 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~200s 2024-01-15T14:24:40.052 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~205s 2024-01-15T14:24:40.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~205s 2024-01-15T14:24:40.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~205s 2024-01-15T14:24:40.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~205s 2024-01-15T14:24:40.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~205s 2024-01-15T14:24:40.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~205s 2024-01-15T14:24:40.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~205s 2024-01-15T14:24:40.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~205s 2024-01-15T14:24:40.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~205s 2024-01-15T14:24:40.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~205s 2024-01-15T14:24:40.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~205s 2024-01-15T14:24:40.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~205s 2024-01-15T14:24:40.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~205s 2024-01-15T14:24:40.054 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~205s 2024-01-15T14:24:40.054 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~205s 2024-01-15T14:24:40.054 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~212s 2024-01-15T14:24:40.054 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~205s 2024-01-15T14:24:45.055 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~210s 2024-01-15T14:24:45.055 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~210s 2024-01-15T14:24:45.055 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~210s 2024-01-15T14:24:45.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~210s 2024-01-15T14:24:45.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~210s 2024-01-15T14:24:45.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~210s 2024-01-15T14:24:45.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~210s 2024-01-15T14:24:45.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~210s 2024-01-15T14:24:45.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~210s 2024-01-15T14:24:45.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~210s 2024-01-15T14:24:45.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~210s 2024-01-15T14:24:45.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~210s 2024-01-15T14:24:45.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~210s 2024-01-15T14:24:45.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~210s 2024-01-15T14:24:45.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~210s 2024-01-15T14:24:45.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~217s 2024-01-15T14:24:45.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~210s 2024-01-15T14:24:50.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~215s 2024-01-15T14:24:50.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~215s 2024-01-15T14:24:50.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~215s 2024-01-15T14:24:50.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~215s 2024-01-15T14:24:50.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~215s 2024-01-15T14:24:50.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~215s 2024-01-15T14:24:50.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~215s 2024-01-15T14:24:50.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~215s 2024-01-15T14:24:50.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~215s 2024-01-15T14:24:50.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~215s 2024-01-15T14:24:50.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~215s 2024-01-15T14:24:50.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~215s 2024-01-15T14:24:50.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~215s 2024-01-15T14:24:50.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~215s 2024-01-15T14:24:50.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~215s 2024-01-15T14:24:50.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~222s 2024-01-15T14:24:50.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~215s 2024-01-15T14:24:55.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~220s 2024-01-15T14:24:55.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~220s 2024-01-15T14:24:55.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~220s 2024-01-15T14:24:55.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~220s 2024-01-15T14:24:55.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~220s 2024-01-15T14:24:55.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~220s 2024-01-15T14:24:55.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~220s 2024-01-15T14:24:55.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~220s 2024-01-15T14:24:55.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~220s 2024-01-15T14:24:55.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~220s 2024-01-15T14:24:55.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~220s 2024-01-15T14:24:55.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~220s 2024-01-15T14:24:55.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~220s 2024-01-15T14:24:55.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~220s 2024-01-15T14:24:55.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~220s 2024-01-15T14:24:55.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~227s 2024-01-15T14:24:55.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~220s 2024-01-15T14:25:00.064 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~225s 2024-01-15T14:25:00.064 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~225s 2024-01-15T14:25:00.064 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~225s 2024-01-15T14:25:00.064 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~225s 2024-01-15T14:25:00.064 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~225s 2024-01-15T14:25:00.064 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~225s 2024-01-15T14:25:00.064 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~225s 2024-01-15T14:25:00.064 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~225s 2024-01-15T14:25:00.064 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~225s 2024-01-15T14:25:00.064 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~225s 2024-01-15T14:25:00.064 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~225s 2024-01-15T14:25:00.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~225s 2024-01-15T14:25:00.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~225s 2024-01-15T14:25:00.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~225s 2024-01-15T14:25:00.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~225s 2024-01-15T14:25:00.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~232s 2024-01-15T14:25:00.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~225s 2024-01-15T14:25:05.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~230s 2024-01-15T14:25:05.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~230s 2024-01-15T14:25:05.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~230s 2024-01-15T14:25:05.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~230s 2024-01-15T14:25:05.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~230s 2024-01-15T14:25:05.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~230s 2024-01-15T14:25:05.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~230s 2024-01-15T14:25:05.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~230s 2024-01-15T14:25:05.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~230s 2024-01-15T14:25:05.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~230s 2024-01-15T14:25:05.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~230s 2024-01-15T14:25:05.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~230s 2024-01-15T14:25:05.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~230s 2024-01-15T14:25:05.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~230s 2024-01-15T14:25:05.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~230s 2024-01-15T14:25:05.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~237s 2024-01-15T14:25:05.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~230s 2024-01-15T14:25:10.068 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~235s 2024-01-15T14:25:10.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~235s 2024-01-15T14:25:10.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~235s 2024-01-15T14:25:10.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~235s 2024-01-15T14:25:10.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~235s 2024-01-15T14:25:10.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~235s 2024-01-15T14:25:10.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~235s 2024-01-15T14:25:10.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~235s 2024-01-15T14:25:10.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~235s 2024-01-15T14:25:10.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~235s 2024-01-15T14:25:10.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~235s 2024-01-15T14:25:10.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~235s 2024-01-15T14:25:10.070 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~235s 2024-01-15T14:25:10.070 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~235s 2024-01-15T14:25:10.070 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~235s 2024-01-15T14:25:10.070 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~242s 2024-01-15T14:25:10.070 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~235s 2024-01-15T14:25:15.072 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~240s 2024-01-15T14:25:15.072 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~240s 2024-01-15T14:25:15.072 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~240s 2024-01-15T14:25:15.072 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~240s 2024-01-15T14:25:15.072 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~240s 2024-01-15T14:25:15.072 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~240s 2024-01-15T14:25:15.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~240s 2024-01-15T14:25:15.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~240s 2024-01-15T14:25:15.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~240s 2024-01-15T14:25:15.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~240s 2024-01-15T14:25:15.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~240s 2024-01-15T14:25:15.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~240s 2024-01-15T14:25:15.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~240s 2024-01-15T14:25:15.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~240s 2024-01-15T14:25:15.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~240s 2024-01-15T14:25:15.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~247s 2024-01-15T14:25:15.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~240s 2024-01-15T14:25:20.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~245s 2024-01-15T14:25:20.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~245s 2024-01-15T14:25:20.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~245s 2024-01-15T14:25:20.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~245s 2024-01-15T14:25:20.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~245s 2024-01-15T14:25:20.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~245s 2024-01-15T14:25:20.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~245s 2024-01-15T14:25:20.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~245s 2024-01-15T14:25:20.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~245s 2024-01-15T14:25:20.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~245s 2024-01-15T14:25:20.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~245s 2024-01-15T14:25:20.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~245s 2024-01-15T14:25:20.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~245s 2024-01-15T14:25:20.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~245s 2024-01-15T14:25:20.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~245s 2024-01-15T14:25:20.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~252s 2024-01-15T14:25:20.078 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~245s 2024-01-15T14:25:25.079 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~250s 2024-01-15T14:25:25.079 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~250s 2024-01-15T14:25:25.079 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~250s 2024-01-15T14:25:25.079 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~250s 2024-01-15T14:25:25.079 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~250s 2024-01-15T14:25:25.079 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~250s 2024-01-15T14:25:25.079 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~250s 2024-01-15T14:25:25.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~250s 2024-01-15T14:25:25.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~250s 2024-01-15T14:25:25.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~250s 2024-01-15T14:25:25.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~250s 2024-01-15T14:25:25.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~250s 2024-01-15T14:25:25.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~250s 2024-01-15T14:25:25.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~250s 2024-01-15T14:25:25.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~250s 2024-01-15T14:25:25.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~257s 2024-01-15T14:25:25.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~250s 2024-01-15T14:25:30.081 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~255s 2024-01-15T14:25:30.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~255s 2024-01-15T14:25:30.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~255s 2024-01-15T14:25:30.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~255s 2024-01-15T14:25:30.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~255s 2024-01-15T14:25:30.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~255s 2024-01-15T14:25:30.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~255s 2024-01-15T14:25:30.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~255s 2024-01-15T14:25:30.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~255s 2024-01-15T14:25:30.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~255s 2024-01-15T14:25:30.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~255s 2024-01-15T14:25:30.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~255s 2024-01-15T14:25:30.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~255s 2024-01-15T14:25:30.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~255s 2024-01-15T14:25:30.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~255s 2024-01-15T14:25:30.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~262s 2024-01-15T14:25:30.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~255s 2024-01-15T14:25:35.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~260s 2024-01-15T14:25:35.088 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~260s 2024-01-15T14:25:35.088 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~260s 2024-01-15T14:25:35.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~260s 2024-01-15T14:25:35.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~260s 2024-01-15T14:25:35.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~260s 2024-01-15T14:25:35.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~260s 2024-01-15T14:25:35.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~260s 2024-01-15T14:25:35.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~260s 2024-01-15T14:25:35.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~260s 2024-01-15T14:25:35.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~260s 2024-01-15T14:25:35.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~260s 2024-01-15T14:25:35.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~260s 2024-01-15T14:25:35.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~260s 2024-01-15T14:25:35.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~260s 2024-01-15T14:25:35.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~267s 2024-01-15T14:25:35.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~260s 2024-01-15T14:25:40.091 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~265s 2024-01-15T14:25:40.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~265s 2024-01-15T14:25:40.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~265s 2024-01-15T14:25:40.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~265s 2024-01-15T14:25:40.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~265s 2024-01-15T14:25:40.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~265s 2024-01-15T14:25:40.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~265s 2024-01-15T14:25:40.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~265s 2024-01-15T14:25:40.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~265s 2024-01-15T14:25:40.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~265s 2024-01-15T14:25:40.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~265s 2024-01-15T14:25:40.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~265s 2024-01-15T14:25:40.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~265s 2024-01-15T14:25:40.093 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~265s 2024-01-15T14:25:40.093 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~265s 2024-01-15T14:25:40.093 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~272s 2024-01-15T14:25:40.093 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~265s 2024-01-15T14:25:45.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~270s 2024-01-15T14:25:45.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~270s 2024-01-15T14:25:45.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~270s 2024-01-15T14:25:45.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~270s 2024-01-15T14:25:45.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~270s 2024-01-15T14:25:45.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~270s 2024-01-15T14:25:45.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~270s 2024-01-15T14:25:45.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~270s 2024-01-15T14:25:45.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~270s 2024-01-15T14:25:45.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~270s 2024-01-15T14:25:45.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~270s 2024-01-15T14:25:45.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~270s 2024-01-15T14:25:45.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~270s 2024-01-15T14:25:45.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~270s 2024-01-15T14:25:45.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~270s 2024-01-15T14:25:45.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~277s 2024-01-15T14:25:45.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~270s 2024-01-15T14:25:50.098 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~275s 2024-01-15T14:25:50.099 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~275s 2024-01-15T14:25:50.099 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~275s 2024-01-15T14:25:50.099 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~275s 2024-01-15T14:25:50.099 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~275s 2024-01-15T14:25:50.099 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~275s 2024-01-15T14:25:50.099 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~275s 2024-01-15T14:25:50.099 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~275s 2024-01-15T14:25:50.099 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~275s 2024-01-15T14:25:50.099 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~275s 2024-01-15T14:25:50.099 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~275s 2024-01-15T14:25:50.099 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~275s 2024-01-15T14:25:50.099 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~275s 2024-01-15T14:25:50.099 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~275s 2024-01-15T14:25:50.099 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~275s 2024-01-15T14:25:50.100 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~282s 2024-01-15T14:25:50.100 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~275s 2024-01-15T14:25:55.101 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~280s 2024-01-15T14:25:55.101 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~280s 2024-01-15T14:25:55.101 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~280s 2024-01-15T14:25:55.101 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~280s 2024-01-15T14:25:55.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~280s 2024-01-15T14:25:55.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~280s 2024-01-15T14:25:55.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~280s 2024-01-15T14:25:55.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~280s 2024-01-15T14:25:55.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~280s 2024-01-15T14:25:55.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~280s 2024-01-15T14:25:55.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~280s 2024-01-15T14:25:55.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~280s 2024-01-15T14:25:55.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~280s 2024-01-15T14:25:55.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~280s 2024-01-15T14:25:55.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~280s 2024-01-15T14:25:55.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~287s 2024-01-15T14:25:55.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~280s 2024-01-15T14:26:00.104 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~285s 2024-01-15T14:26:00.104 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~285s 2024-01-15T14:26:00.104 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~285s 2024-01-15T14:26:00.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~285s 2024-01-15T14:26:00.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~285s 2024-01-15T14:26:00.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~285s 2024-01-15T14:26:00.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~285s 2024-01-15T14:26:00.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~285s 2024-01-15T14:26:00.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~285s 2024-01-15T14:26:00.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~285s 2024-01-15T14:26:00.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~285s 2024-01-15T14:26:00.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~285s 2024-01-15T14:26:00.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~285s 2024-01-15T14:26:00.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~285s 2024-01-15T14:26:00.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~285s 2024-01-15T14:26:00.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~292s 2024-01-15T14:26:00.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~285s 2024-01-15T14:26:05.107 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~290s 2024-01-15T14:26:05.107 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~290s 2024-01-15T14:26:05.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~290s 2024-01-15T14:26:05.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~290s 2024-01-15T14:26:05.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~290s 2024-01-15T14:26:05.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~290s 2024-01-15T14:26:05.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~290s 2024-01-15T14:26:05.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~290s 2024-01-15T14:26:05.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~290s 2024-01-15T14:26:05.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~290s 2024-01-15T14:26:05.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~290s 2024-01-15T14:26:05.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~290s 2024-01-15T14:26:05.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~290s 2024-01-15T14:26:05.109 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~290s 2024-01-15T14:26:05.109 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~290s 2024-01-15T14:26:05.109 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~297s 2024-01-15T14:26:05.109 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~290s 2024-01-15T14:26:10.110 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~295s 2024-01-15T14:26:10.110 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~295s 2024-01-15T14:26:10.110 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~295s 2024-01-15T14:26:10.110 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~295s 2024-01-15T14:26:10.110 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~295s 2024-01-15T14:26:10.110 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~295s 2024-01-15T14:26:10.110 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~295s 2024-01-15T14:26:10.110 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~295s 2024-01-15T14:26:10.110 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~295s 2024-01-15T14:26:10.110 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~295s 2024-01-15T14:26:10.110 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~295s 2024-01-15T14:26:10.110 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~295s 2024-01-15T14:26:10.111 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~295s 2024-01-15T14:26:10.111 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~295s 2024-01-15T14:26:10.111 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~295s 2024-01-15T14:26:10.111 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~302s 2024-01-15T14:26:10.111 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~295s 2024-01-15T14:26:10.111 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2024-01-15T14:26:10.111 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-01-15T14:26:10.111 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-15T14:26:11.227 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 745, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 154, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 109, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 275, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1374, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr raise socket.timeout() socket.timeout 2024-01-15T14:26:11.231 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 697, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 154, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 109, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 275, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1359, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv raise socket.timeout() socket.timeout 2024-01-15T14:37:03.932 ERROR:paramiko.transport:Socket exception: No route to host (113) 2024-01-15T14:37:03.933 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T14:37:03.938 INFO:tasks.cephfs_test_runner:Test that when one clone is in progress, one progress bar is printed ... ERROR 2024-01-15T14:37:03.938 INFO:tasks.cephfs_test_runner: 2024-01-15T14:37:03.938 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-15T14:37:03.938 INFO:tasks.cephfs_test_runner:ERROR: test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgress) 2024-01-15T14:37:03.938 INFO:tasks.cephfs_test_runner:Test that when one clone is in progress, one progress bar is printed 2024-01-15T14:37:03.938 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-15T14:37:03.939 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-15T14:37:03.939 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 745, in recv_stderr 2024-01-15T14:37:03.939 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2024-01-15T14:37:03.939 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 154, in read 2024-01-15T14:37:03.939 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2024-01-15T14:37:03.939 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2024-01-15T14:37:03.939 INFO:tasks.cephfs_test_runner: 2024-01-15T14:37:03.939 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2024-01-15T14:37:03.939 INFO:tasks.cephfs_test_runner: 2024-01-15T14:37:03.939 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-15T14:37:03.939 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/kernel_mount.py", line 160, in umount 2024-01-15T14:37:03.939 INFO:tasks.cephfs_test_runner: self.client_remote.run(args=cmd, timeout=UMOUNT_TIMEOUT, omit_sudo=False) 2024-01-15T14:37:03.939 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run 2024-01-15T14:37:03.939 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-01-15T14:37:03.939 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run 2024-01-15T14:37:03.939 INFO:tasks.cephfs_test_runner: r.wait() 2024-01-15T14:37:03.939 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 148, in wait 2024-01-15T14:37:03.939 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2024-01-15T14:37:03.939 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get 2024-01-15T14:37:03.940 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2024-01-15T14:37:03.940 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise 2024-01-15T14:37:03.940 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2024-01-15T14:37:03.940 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run 2024-01-15T14:37:03.940 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 323, in copy_file_to 2024-01-15T14:37:03.940 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2024-01-15T14:37:03.940 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 276, in copy_to_log 2024-01-15T14:37:03.940 INFO:tasks.cephfs_test_runner: for line in f: 2024-01-15T14:37:03.940 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 109, in __next__ 2024-01-15T14:37:03.940 INFO:tasks.cephfs_test_runner: line = self.readline() 2024-01-15T14:37:03.940 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 275, in readline 2024-01-15T14:37:03.940 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2024-01-15T14:37:03.940 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1374, in _read 2024-01-15T14:37:03.940 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2024-01-15T14:37:03.940 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr 2024-01-15T14:37:03.940 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2024-01-15T14:37:03.941 INFO:tasks.cephfs_test_runner:socket.timeout 2024-01-15T14:37:03.941 INFO:tasks.cephfs_test_runner: 2024-01-15T14:37:03.941 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2024-01-15T14:37:03.941 INFO:tasks.cephfs_test_runner: 2024-01-15T14:37:03.941 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-15T14:37:03.941 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/test_volumes.py", line 7609, in tearDown 2024-01-15T14:37:03.941 INFO:tasks.cephfs_test_runner: super(self.__class__, self).tearDown() 2024-01-15T14:37:03.941 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/test_volumes.py", line 459, in tearDown 2024-01-15T14:37:03.941 INFO:tasks.cephfs_test_runner: super(TestVolumesHelper, self).tearDown() 2024-01-15T14:37:03.941 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/cephfs_test_case.py", line 205, in tearDown 2024-01-15T14:37:03.941 INFO:tasks.cephfs_test_runner: m.teardown() 2024-01-15T14:37:03.941 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/kernel_mount.py", line 207, in teardown 2024-01-15T14:37:03.941 INFO:tasks.cephfs_test_runner: self.umount() 2024-01-15T14:37:03.941 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/kernel_mount.py", line 163, in umount 2024-01-15T14:37:03.941 INFO:tasks.cephfs_test_runner: self.client_remote.run( 2024-01-15T14:37:03.941 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run 2024-01-15T14:37:03.941 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-01-15T14:37:03.941 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run 2024-01-15T14:37:03.941 INFO:tasks.cephfs_test_runner: r.wait() 2024-01-15T14:37:03.942 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 148, in wait 2024-01-15T14:37:03.942 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2024-01-15T14:37:03.942 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get 2024-01-15T14:37:03.942 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2024-01-15T14:37:03.942 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise 2024-01-15T14:37:03.942 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2024-01-15T14:37:03.942 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run 2024-01-15T14:37:03.942 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 323, in copy_file_to 2024-01-15T14:37:03.942 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2024-01-15T14:37:03.942 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 276, in copy_to_log 2024-01-15T14:37:03.942 INFO:tasks.cephfs_test_runner: for line in f: 2024-01-15T14:37:03.942 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 109, in __next__ 2024-01-15T14:37:03.942 INFO:tasks.cephfs_test_runner: line = self.readline() 2024-01-15T14:37:03.942 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 275, in readline 2024-01-15T14:37:03.942 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2024-01-15T14:37:03.942 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1374, in _read 2024-01-15T14:37:03.942 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2024-01-15T14:37:03.942 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr 2024-01-15T14:37:03.942 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2024-01-15T14:37:03.943 INFO:tasks.cephfs_test_runner:socket.timeout 2024-01-15T14:37:03.943 INFO:tasks.cephfs_test_runner: 2024-01-15T14:37:03.943 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-15T14:37:03.943 INFO:tasks.cephfs_test_runner:Ran 1 test in 10996.020s 2024-01-15T14:37:03.943 INFO:tasks.cephfs_test_runner: 2024-01-15T14:37:03.943 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-01-15T14:37:03.943 INFO:tasks.cephfs_test_runner: 2024-01-15T14:37:03.943 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-15T14:37:03.943 INFO:tasks.cephfs_test_runner:ERROR: test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgress) 2024-01-15T14:37:03.943 INFO:tasks.cephfs_test_runner:Test that when one clone is in progress, one progress bar is printed 2024-01-15T14:37:03.943 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-15T14:37:03.943 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-15T14:37:03.943 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 745, in recv_stderr 2024-01-15T14:37:03.943 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2024-01-15T14:37:03.943 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 154, in read 2024-01-15T14:37:03.943 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2024-01-15T14:37:03.944 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2024-01-15T14:37:03.944 INFO:tasks.cephfs_test_runner: 2024-01-15T14:37:03.944 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2024-01-15T14:37:03.944 INFO:tasks.cephfs_test_runner: 2024-01-15T14:37:03.944 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-15T14:37:03.944 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/kernel_mount.py", line 160, in umount 2024-01-15T14:37:03.944 INFO:tasks.cephfs_test_runner: self.client_remote.run(args=cmd, timeout=UMOUNT_TIMEOUT, omit_sudo=False) 2024-01-15T14:37:03.944 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run 2024-01-15T14:37:03.944 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-01-15T14:37:03.944 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run 2024-01-15T14:37:03.944 INFO:tasks.cephfs_test_runner: r.wait() 2024-01-15T14:37:03.944 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 148, in wait 2024-01-15T14:37:03.944 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2024-01-15T14:37:03.944 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get 2024-01-15T14:37:03.944 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2024-01-15T14:37:03.944 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise 2024-01-15T14:37:03.944 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2024-01-15T14:37:03.945 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run 2024-01-15T14:37:03.945 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 323, in copy_file_to 2024-01-15T14:37:03.945 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2024-01-15T14:37:03.945 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 276, in copy_to_log 2024-01-15T14:37:03.945 INFO:tasks.cephfs_test_runner: for line in f: 2024-01-15T14:37:03.945 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 109, in __next__ 2024-01-15T14:37:03.945 INFO:tasks.cephfs_test_runner: line = self.readline() 2024-01-15T14:37:03.945 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 275, in readline 2024-01-15T14:37:03.945 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2024-01-15T14:37:03.945 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1374, in _read 2024-01-15T14:37:03.945 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2024-01-15T14:37:03.945 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr 2024-01-15T14:37:03.945 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2024-01-15T14:37:03.945 INFO:tasks.cephfs_test_runner:socket.timeout 2024-01-15T14:37:03.945 INFO:tasks.cephfs_test_runner: 2024-01-15T14:37:03.945 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2024-01-15T14:37:03.945 INFO:tasks.cephfs_test_runner: 2024-01-15T14:37:03.945 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-15T14:37:03.945 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/test_volumes.py", line 7609, in tearDown 2024-01-15T14:37:03.945 INFO:tasks.cephfs_test_runner: super(self.__class__, self).tearDown() 2024-01-15T14:37:03.946 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/test_volumes.py", line 459, in tearDown 2024-01-15T14:37:03.946 INFO:tasks.cephfs_test_runner: super(TestVolumesHelper, self).tearDown() 2024-01-15T14:37:03.946 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/cephfs_test_case.py", line 205, in tearDown 2024-01-15T14:37:03.946 INFO:tasks.cephfs_test_runner: m.teardown() 2024-01-15T14:37:03.946 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/kernel_mount.py", line 207, in teardown 2024-01-15T14:37:03.946 INFO:tasks.cephfs_test_runner: self.umount() 2024-01-15T14:37:03.946 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/kernel_mount.py", line 163, in umount 2024-01-15T14:37:03.946 INFO:tasks.cephfs_test_runner: self.client_remote.run( 2024-01-15T14:37:03.946 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run 2024-01-15T14:37:03.946 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-01-15T14:37:03.946 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run 2024-01-15T14:37:03.946 INFO:tasks.cephfs_test_runner: r.wait() 2024-01-15T14:37:03.946 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 148, in wait 2024-01-15T14:37:03.946 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2024-01-15T14:37:03.946 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get 2024-01-15T14:37:03.946 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2024-01-15T14:37:03.946 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise 2024-01-15T14:37:03.946 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2024-01-15T14:37:03.946 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run 2024-01-15T14:37:03.947 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 323, in copy_file_to 2024-01-15T14:37:03.947 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2024-01-15T14:37:03.947 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 276, in copy_to_log 2024-01-15T14:37:03.947 INFO:tasks.cephfs_test_runner: for line in f: 2024-01-15T14:37:03.947 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 109, in __next__ 2024-01-15T14:37:03.947 INFO:tasks.cephfs_test_runner: line = self.readline() 2024-01-15T14:37:03.947 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 275, in readline 2024-01-15T14:37:03.947 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2024-01-15T14:37:03.947 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1374, in _read 2024-01-15T14:37:03.947 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2024-01-15T14:37:03.947 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr 2024-01-15T14:37:03.947 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2024-01-15T14:37:03.947 INFO:tasks.cephfs_test_runner:socket.timeout 2024-01-15T14:37:03.947 INFO:tasks.cephfs_test_runner: 2024-01-15T14:37:03.948 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgress) 2024-01-15T14:37:04.170 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=ac218d7686eb4ae88c094c7f22a484db Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgress) 2024-01-15T14:37:04.171 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-01-15T14:37:04.179 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-01-15T14:37:04.196 INFO:tasks.kclient:Unmounting kernel clients... 2024-01-15T14:37:04.196 ERROR:teuthology.run_tasks:Manager failed: kclient Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' 2024-01-15T14:37:04.206 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-01-15T14:37:04.214 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-15T14:37:04.214 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-01-15T14:37:04.228 INFO:teuthology.misc:Shutting down mds daemons... 2024-01-15T14:37:04.228 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-15T14:37:04.228 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T14:37:04.238 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T14:37:04.239 ERROR:teuthology.misc:Saw exception from ceph.mds.a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2024-01-15T14:37:04.257 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-15T14:37:04.257 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T14:37:04.257 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T14:37:04.257 ERROR:teuthology.misc:Saw exception from ceph.mds.c Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2024-01-15T14:37:04.273 DEBUG:tasks.ceph:Missed logrotate, host unreachable 2024-01-15T14:37:04.273 ERROR:tasks.daemonwatchdog.daemon_watchdog:ignoring exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/daemonwatchdog.py", line 61, in bark mount.umount_wait(force=True) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/kernel_mount.py", line 183, in umount_wait if not self.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 100, in execute self.client.exec_command(self.command) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 560, in exec_command chan = self._transport.open_session(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 959, in open_session return self.open_channel( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1090, in open_channel raise e paramiko.ssh_exception.SSHException: Unable to open channel. 2024-01-15T14:37:04.274 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-15T14:37:04.274 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T14:37:04.279 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T14:37:04.279 ERROR:teuthology.misc:Saw exception from ceph.mds.b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2024-01-15T14:37:04.280 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:37:04.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:37:04.298 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-15T14:37:04.298 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T14:37:04.298 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T14:37:04.298 ERROR:teuthology.misc:Saw exception from ceph.mds.d Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2024-01-15T14:37:04.313 INFO:teuthology.misc:Shutting down osd daemons... 2024-01-15T14:37:04.314 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-01-15T14:37:04.314 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T14:37:04.314 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T14:37:04.314 ERROR:teuthology.misc:Saw exception from ceph.osd.0 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0' 2024-01-15T14:37:04.333 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-01-15T14:37:04.333 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T14:37:04.333 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T14:37:04.333 ERROR:teuthology.misc:Saw exception from ceph.osd.1 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1' 2024-01-15T14:37:04.354 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-01-15T14:37:04.354 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T14:37:04.354 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T14:37:04.354 ERROR:teuthology.misc:Saw exception from ceph.osd.2 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2' 2024-01-15T14:37:04.377 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-01-15T14:37:04.377 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T14:37:04.377 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T14:37:04.378 ERROR:teuthology.misc:Saw exception from ceph.osd.3 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3' 2024-01-15T14:37:04.398 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-01-15T14:37:04.398 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T14:37:04.405 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T14:37:04.405 ERROR:teuthology.misc:Saw exception from ceph.osd.4 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4' 2024-01-15T14:37:04.427 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-01-15T14:37:04.427 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T14:37:04.428 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T14:37:04.428 ERROR:teuthology.misc:Saw exception from ceph.osd.5 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5' 2024-01-15T14:37:04.449 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-01-15T14:37:04.449 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T14:37:04.449 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T14:37:04.449 ERROR:teuthology.misc:Saw exception from ceph.osd.6 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6' 2024-01-15T14:37:04.470 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-01-15T14:37:04.471 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T14:37:04.471 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T14:37:04.471 ERROR:teuthology.misc:Saw exception from ceph.osd.7 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' 2024-01-15T14:37:04.491 INFO:teuthology.misc:Shutting down mgr daemons... 2024-01-15T14:37:04.491 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-01-15T14:37:04.491 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T14:37:04.491 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T14:37:04.491 ERROR:teuthology.misc:Saw exception from ceph.mgr.y Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y' 2024-01-15T14:37:04.516 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-01-15T14:37:04.516 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T14:37:04.516 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T14:37:04.516 ERROR:teuthology.misc:Saw exception from ceph.mgr.x Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2024-01-15T14:37:04.542 INFO:teuthology.misc:Shutting down mon daemons... 2024-01-15T14:37:04.542 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-01-15T14:37:04.542 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T14:37:04.542 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T14:37:04.542 ERROR:teuthology.misc:Saw exception from ceph.mon.a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a' 2024-01-15T14:37:04.573 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-01-15T14:37:04.574 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T14:37:04.574 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T14:37:04.574 ERROR:teuthology.misc:Saw exception from ceph.mon.b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b' 2024-01-15T14:37:04.602 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-01-15T14:37:04.602 INFO:teuthology.orchestra.run:waiting for 300 2024-01-15T14:37:04.602 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-15T14:37:04.602 ERROR:teuthology.misc:Saw exception from ceph.mon.c Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi093 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c' 2024-01-15T14:37:04.631 INFO:tasks.ceph:Checking cluster log for badness... 2024-01-15T14:37:04.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:37:04.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:37:07.356 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:37:07.357 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:37:16.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:37:16.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:37:16.369 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:37:16.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:37:19.420 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:37:19.420 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:37:31.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:37:31.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:37:31.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:37:31.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:37:34.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:37:34.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:37:34.492 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:37:34.492 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:37:34.492 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:37:37.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:37:37.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:37:37.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:37:37.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:37:37.564 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:37:37.564 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T14:37:37.564 ERROR:tasks.daemonwatchdog.daemon_watchdog:ignoring exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/daemonwatchdog.py", line 61, in bark mount.umount_wait(force=True) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/kernel_mount.py", line 183, in umount_wait if not self.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 522, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi027 2024-01-15T14:37:37.570 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:37:37.570 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T14:37:37.570 INFO:tasks.ceph:Archiving crash dumps... 2024-01-15T14:37:37.572 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-01-15_11:07:32-fs:volumes-rishabh-clone-stats-testing-default-smithi/7517066/remote/smithi027/crash 2024-01-15T14:37:37.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:37:37.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:37:37.576 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2024-01-15T14:37:37.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:37:40.636 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:37:43.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:37:43.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:37:43.708 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:37:49.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:37:49.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:37:52.700 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:37:55.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:37:55.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:37:55.772 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:37:55.900 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.93 2024-01-15T14:37:58.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:37:58.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:38:01.852 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:38:01.852 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T14:38:01.853 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 184, in invoke_logrotate procs = ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 522, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi027 2024-01-15T14:38:04.704 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:38:04.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:38:04.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2024-01-15T14:38:04.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:38:04.924 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:38:07.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:38:07.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:38:07.964 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.93 2024-01-15T14:38:11.004 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:38:11.004 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T14:38:11.005 INFO:tasks.ceph:Shutting down logrotate 2024-01-15T14:38:11.006 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 257, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 222, in end self.thread.get() File "src/gevent/greenlet.py", line 805, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/ceph.py", line 184, in invoke_logrotate procs = ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 522, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi027 2024-01-15T14:38:11.034 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-15T14:38:11.044 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' 2024-01-15T14:38:11.058 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-15T14:38:11.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:38:11.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:38:14.076 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:38:19.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2024-01-15T14:38:19.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:38:23.036 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.93 2024-01-15T14:38:23.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:38:23.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:38:26.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2024-01-15T14:38:26.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:38:26.108 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.93 2024-01-15T14:38:26.108 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T14:38:26.108 ERROR:tasks.daemonwatchdog.daemon_watchdog:ignoring exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/daemonwatchdog.py", line 61, in bark mount.umount_wait(force=True) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/kernel_mount.py", line 183, in umount_wait if not self.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 522, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi093 2024-01-15T14:38:26.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2024-01-15T14:38:26.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:38:26.140 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:38:29.180 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.93 2024-01-15T14:38:38.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:38:38.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:38:38.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2024-01-15T14:38:38.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:38:41.212 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:38:41.244 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.93 2024-01-15T14:38:44.216 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:38:44.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:38:44.284 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:38:44.284 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T14:38:44.335 ERROR:teuthology.run_tasks:Manager failed: install Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/install/util.py", line 148, in ship_utilities yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/install/__init__.py", line 626, in task yield File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/install/__init__.py", line 220, in install yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/install/util.py", line 150, in ship_utilities _remove_utilities(ctx, filenames) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/install/util.py", line 121, in _remove_utilities ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 522, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi027 2024-01-15T14:38:44.353 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-15T14:38:44.364 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-15T14:38:44.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:38:44.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:38:47.420 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:38:53.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2024-01-15T14:38:53.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:38:56.316 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.93 2024-01-15T14:38:56.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:38:56.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:38:59.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2024-01-15T14:38:59.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:38:59.388 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.93 2024-01-15T14:38:59.388 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T14:38:59.389 ERROR:tasks.daemonwatchdog.daemon_watchdog:ignoring exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/daemonwatchdog.py", line 61, in bark mount.umount_wait(force=True) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/kernel_mount.py", line 183, in umount_wait if not self.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 522, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi093 2024-01-15T14:38:59.484 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:39:11.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:39:11.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:39:14.556 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:39:17.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:39:17.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:39:17.628 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:39:17.628 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T14:39:17.629 ERROR:teuthology.run_tasks:Manager failed: clock Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/clock.py", line 66, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/clock.py", line 72, in task cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 522, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi027 2024-01-15T14:39:17.645 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-15T14:39:17.657 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-15T14:39:17.657 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-15T14:39:17.673 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-15T14:39:17.683 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-15T14:39:17.693 INFO:teuthology.task.internal:Duration was 11852.562444 seconds 2024-01-15T14:39:17.693 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-15T14:39:17.702 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-15T14:39:17.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:39:17.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:39:20.765 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:39:29.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:39:29.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:39:32.828 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:39:44.843 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:39:44.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:39:47.901 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:39:50.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:39:50.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:39:50.972 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:39:50.972 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T14:39:50.973 ERROR:teuthology.run_tasks:Manager failed: internal.syslog Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/internal/syslog.py", line 76, in syslog yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/internal/syslog.py", line 85, in syslog cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 522, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi027 2024-01-15T14:39:50.993 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-15T14:39:51.006 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-15T14:39:51.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:39:51.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:39:54.076 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:40:03.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:40:03.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:40:06.140 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:40:18.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:40:18.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:40:21.212 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:40:24.216 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:40:24.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:40:24.284 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:40:24.284 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T14:40:24.284 ERROR:teuthology.run_tasks:Manager failed: internal.sudo Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/internal/__init__.py", line 452, in sudo yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/internal/__init__.py", line 455, in sudo ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 522, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi027 2024-01-15T14:40:24.297 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-15T14:40:24.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:40:24.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:40:27.388 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:40:36.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:40:36.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:40:39.452 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:40:51.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:40:51.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:40:54.524 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:40:57.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:40:57.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:40:57.596 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:40:57.596 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T14:40:57.597 ERROR:teuthology.run_tasks:Manager failed: internal.coredump Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/internal/__init__.py", line 488, in coredump yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/internal/__init__.py", line 492, in coredump cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 522, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi027 2024-01-15T14:40:57.611 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-15T14:40:57.623 INFO:teuthology.task.internal:Transferring archived files... 2024-01-15T14:40:57.624 DEBUG:teuthology.misc:Transferring archived files from smithi027:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-01-15_11:07:32-fs:volumes-rishabh-clone-stats-testing-default-smithi/7517066/remote/smithi027 2024-01-15T14:40:57.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:40:57.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:41:00.700 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:41:09.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:41:09.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:41:12.764 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:41:24.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:41:24.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:41:27.836 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:41:30.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:41:30.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:41:30.908 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:41:30.908 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T14:41:30.908 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/internal/__init__.py", line 392, in archive yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/internal/__init__.py", line 418, in archive misc.pull_directory(rem, archive_dir, path, maybe_compress) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/misc.py", line 748, in pull_directory r = remote.get_tar_stream(remotedir, sudo=True, compress=False) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 678, in get_tar_stream return self.run(args=args, wait=False, stdout=run.PIPE) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 522, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi027 2024-01-15T14:41:30.922 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-15T14:41:30.934 INFO:teuthology.task.internal:Not uploading archives. 2024-01-15T14:41:30.934 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-15T14:41:30.963 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-15T14:41:30.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:41:30.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:41:34.044 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:41:43.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:41:43.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:41:46.108 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:41:58.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:41:58.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:42:01.180 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:42:04.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-01-15T14:42:04.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-15T14:42:04.252 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-01-15T14:42:04.252 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2024-01-15T14:42:04.252 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 436, in run (host, port) = transport.getpeername()[0:2] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1881, in getpeername return gp() File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 544, in getpeername return self._sock.getpeername() OSError: [Errno 107] Transport endpoint is not connected During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 139, in task forced = umount_all() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/kclient.py", line 119, in umount_all if mount.is_mounted(): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73a4532fc4d97adee0b985d4d42874ea351a1c86/qa/tasks/cephfs/mount.py", line 220, in is_mounted file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 254, in read_file proc = self.run(args=args, stdout=stdout, stderr=StringIO(), File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 440, in run raise ConnectionLostError(command=quote(args), node=name) teuthology.exceptions.ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/task/internal/__init__.py", line 54, in base ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 522, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi027 2024-01-15T14:42:04.264 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-15T14:42:04.275 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-15T14:42:04.293 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: ConnectionLostError: SSH connection to smithi027 was lost: 'set -ex\ndd if=/proc/self/mounts of=/dev/stdout' 2024-01-15T14:42:04.294 INFO:teuthology.nuke:Checking targets against current locks 2024-01-15T14:42:04.321 INFO:teuthology.nuke:Not nuking smithi027.front.sepia.ceph.com because description doesn't match: rishabh-2024-01-15_11:07:32-fs:volumes-rishabh-clone-stats-testing-default-smithi != None 2024-01-15T14:42:04.344 INFO:teuthology.nuke:Not nuking smithi093.front.sepia.ceph.com because description doesn't match: rishabh-2024-01-15_11:07:32-fs:volumes-rishabh-clone-stats-testing-default-smithi != None 2024-01-15T14:42:04.345 ERROR:teuthology.nuke:Could not nuke the following targets: targets: smithi027.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPBnOYlMQZHvWwfRYzDYI90m0b2Ib+moa15Lpnog/0M4WWyxTtEegBqhQQxuZnqNOBdau4US96SblQ9RadXUjdM= smithi093.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMzxXsvE+yYOk/I5Pd5RHOAYL4opbzOhvVRVsnTWbJZUQYmMi3dUgNFEJYyITebwHf0tYQgIOC62SsEqOtZLbJI= 2024-01-15T14:42:04.353 INFO:teuthology.run:Summary data: client.0-kernel-sha1: c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b client.1-kernel-sha1: c719ee96ba7847b7d8dd469c35de92fb2f0dfd6b description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone-progress}} duration: 11852.562443733215 failure_reason: 'Test failure: test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgress)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=ac218d7686eb4ae88c094c7f22a484db status: fail success: false 2024-01-15T14:42:04.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-15T14:42:04.433 INFO:teuthology.run:FAIL